• GreenBeanMachine@lemmy.world
    link
    fedilink
    English
    arrow-up
    5
    arrow-down
    1
    ·
    edit-2
    1 day ago

    There are more aspects to the randomness such as race conditions and intentionally nondeterministic tiebreaking when tokens have the same probability, apparently.

    Yeah, in addition to what the commenter above said about floating points and GPU calculations, LLMs are never fully deterministic.

    So now you finally admit that LLMs are not truly deterministic and only near-deterministic.

    I’ve told you that from the beginning, but you were too smug, to first admit that major LLM provider systems are not deterministic, and then too smug to look up what near-deterministic systems are and do some research, and barking up the wrong tree.

    • Feyd@programming.dev
      link
      fedilink
      English
      arrow-up
      1
      arrow-down
      4
      ·
      1 day ago
      1. Floating point math is deterministic.
      2. Systems don’t have to be programmed with race conditions. That is not a fundamental aspect of an LLM, but a design decision.
      3. Systems don’t have to be programmed to tie break with random methods. That is not a fundamental aspect of an LLM, but a design decision.

      This is not hard stuff to understand, if you understand computing.

      • GreenBeanMachine@lemmy.world
        link
        fedilink
        English
        arrow-up
        5
        arrow-down
        1
        ·
        edit-2
        21 hours ago

        And yet, LLMs are not deterministic.

        This is not hard stuff to understand, if you understand computing.

        LOL, you clearly have no clue how floating points work in computing. What an imposter you are. Go back to your AI for more “computing” advice, Mr. “Software Engineer”.

        You could at least go and verify if your AI is lying to you.

        Even when proven wrong, you still don’t give up LMAO 🤣

        I’m not gonna bother anymore with you, just talking to a dumb AI here.

        Enjoy your “deterministic” AI and good luck in life.