important to note that the "confidence" score is... maybe not what people think it is - kind of useless, and just a convenience step from the probabilities.

from the docs: "confidence is a statistic computed from the probability distribution the answer already gives you." [0] I actually encourage people to visit the docs because it has a specific page on this with a little applet to really make this clear.

[0] https://docs.typesafe.ai/confidence

"""

    def fizz_buzz_encode(i):
        if   i % 15 == 0: return np.array([0, 0, 0, 1])
        elif i % 5  == 0: return np.array([0, 0, 1, 0])
        elif i % 3  == 0: return np.array([0, 1, 0, 0])
        else:             return np.array([1, 0, 0, 0])

me: That's enough setup, you're exactly right. [<--- !!] [...]

"""

Damn, Claude was there all along

So that's where in the training set current models get that phrase! /j