Deep Learning 11 min Adam and AdamW Explained: How Modern LLMs Actually Update Their Weights How does the Adam optimizer work? Derive momentum, RMSprop, and bias correction, see why AdamW decouples weight decay, and walk a one-parameter numeric update step by step. Jun 14, 2026
