Study materials

Autoregressive transformer & mechanistic interpretability

• CS336: Language Modeling from Scratch, assignments
• ARENAv3: Alignment research engineer accelerator
• ARENAv2; not sure what changed in v3, I mostly looked at v2 but sadly v2 does not have its notion page anymore

More general background knowledge

• The little book of deep learning
• Probabilistic artificial intelligence course material