How Attention Works in Transformers: Queries, Keys, Values
How does attention work in transformers? Queries, keys, values, the attention pattern, masking, and multi-head attention, with real GPT-3 parameter counts.
How GPT Actually Works: A Visual Guide to Transformers
How does a GPT actually work? A visual walkthrough of transformers: tokens, word embeddings, dot products, softmax and temperature, with real GPT-3 numbers.
Linear Algebra for Machine Learning: The Visual Intuition
Linear algebra for machine learning explained visually: vectors, matrices, dot products, determinants, eigenvectors, and the basis changes that make it click.