All topics

Autograd

Every post tagged “Autograd”, newest first.

2 posts
Deep Learning 14 min

Numerical Gradient Checking: Debug Your Autograd Engine

What is numerical gradient checking? The central difference formula, why you never train with finite differences, and a grad checker that catches real bugs.
Deep Learning 31 min

Backpropagation from Scratch: Build an Autograd Engine

How does backpropagation work? Build a working autograd engine from scratch in ~80 lines of Python: computation graphs, chain rule, reverse-mode autodiff.