Transformers 11 min How GPT Actually Works: A Visual Guide to Transformers How does a GPT actually work? A visual walkthrough of transformers: tokens, word embeddings, dot products, softmax and temperature, with real GPT-3 numbers. Jun 4, 2026
