Mathematics

Build a GPT-2 from scratch

by build a gpt2 to show all the detail of how to train a llm

Building intuition for deep learning through formal mathematics — from scalars to transformers