Token Embeddings Explained: How LLMs Turn Token IDs Into Meaning Vectors
What is a token embedding? How LLMs map token IDs to learned vectors — the embedding matrix, gather lookup vs one-hot matmul, parameter counts, and a from-scratch NumPy implementation.