Lets build GPT: from scratch, in code, spelled out.

Let's reproduce GPT-2 (124M)

Let's build the GPT Tokenizer

[1hr Talk] Intro to Large Language Models

Let's build GPT: from scratch, in code, spelled out.

Building makemore Part 5: Building a WaveNet

Building makemore Part 4: Becoming a Backprop Ninja

Building makemore Part 3: Activations & Gradients, BatchNorm

Building makemore Part 2: MLP

The spelled-out intro to language modeling: building makemore

Stable diffusion dreams of psychedelic faces

Stable diffusion dreams of steampunk brains

Stable diffusion dreams of tattoos

The spelled-out intro to neural networks and backpropagation: building micrograd

Stable diffusion dreams of "blueberry spaghetti" for one night

Stable diffusion dreams of steam punk neural networks