Implementing Transformer Attention from Scratch
A practical guide to reproducing attention kernels and validating correctness.
2026-01-20
Writing Archive
Research Notes and Technical Essays
Read article
Failure Modes in RAG Systems
Why retrieval quality and ranking calibration dominate downstream generation quality.
2025-10-06