Gruhesh Sri Sai Karthik

Gruhesh Sri Sai Karthik

Notes on AI, machine learning, and engineering. Deep-dives into the systems and ideas that matter.

Portfolio ↗

Latest post

GPT-2 25 min read

Building GPT-2 from Scratch

A complete walkthrough of GPT-2's architecture — tokenization, causal self-attention, transformer blocks, weight tying — implemented in pure PyTorch and trained locally on your machine.

AI & Machine Learning

View all →
GPT-2 25 min

Building GPT-2 from Scratch

A complete walkthrough of GPT-2's architecture — tokenization, causal self-attention, transformer blocks, weight tying — implemented in pure PyTorch and trained locally on your machine.
Deep Learning 20 min

Building Autograd from Scratch

How modern deep learning frameworks compute gradients automatically. We build a working autograd engine in ~80 lines of Python — the same core idea behind PyTorch.