MicroGPT explained interactively

An interactive walkthrough of Karpathy's MicroGPT. Characters become integer tokens, a sliding window generates input-target pairs, softmax turns raw logits into probability distributions, and the model learns to predict the next character. Same mechanism as ChatGPT, but small enough to visualize every step. Trains on 32,000 human names.

Visit Original Article →