All topics

NLP

Every post tagged “NLP”, newest first.

3 posts
NLP 16 min

Natural Language Inference Explained: Entailment in NLP

What is natural language inference (NLI)? How models label a premise and hypothesis as entailment, contradiction, or neutral on SNLI, MNLI, and BERT.

Embeddings 15 min

Token Embeddings Explained: How LLMs Turn IDs Into Vectors

What is a token embedding? How LLMs map token IDs to learned vectors: the embedding matrix, gather vs one-hot matmul, and a from-scratch NumPy build.

Tokenization 21 min

Byte Pair Encoding (BPE) Explained: How GPT Tokenizers Work

What is byte pair encoding (BPE)? How GPT tokenizers turn text into IDs: pretokenization, merge rules, byte-level vocab, and a from-scratch build.