Transformers
Process Supervision
October 1, 2026
Interactive slides on two exact transformer programs for counting a letter: one that writes the running count, one that answers directly. Covers the matrix shapes, the block encoding of the residual stream, and what each head and MLP unit does, all computed live in the page.
Credit Assignment
Process Supervision
Transformers
Learning Theory
September 12, 2026 · updated October 4, 2026 · Password protected
A walkthrough of why a correct final answer gives a fresh network almost nothing to learn from on a long computation, why showing each step fixes that, and what is proved versus measured. The proofs are there if you want the mathematics.
Credit Assignment
Process Supervision
Transformers
Learning Theory
September 28, 2026 · Password protected
Lecture slides for the note above: the hand-built counting programs, the proofs, and the experiments.
Multi-Agent Systems
LLM Applications
Education Technology
September 12, 2026
An evidence-anchored, multi-agent grading pipeline for handwritten and typed answer sheets — deterministic score auditing, an evidence-checked regrade flow, and memory that carries weak-area feedback and grading corrections across submissions.
Generative Models
Diffusion Models
Representation Learning
September 12, 2026
Notes from reproducing Diffusion Autoencoders (Preechakul et al., CVPR 2022): a semantic encoder that splits a diffusion model's latent into a compact, decodable code and a deterministic stochastic subcode, tested by aligning, autoencoding, interpolating, and manipulating our own photo.
Mechanistic Interpretability
Transformers
Tooling
September 12, 2026
An introduction to NNsight's tracing-context API — lazy intervention graphs, proxies, activation patching, and logit-lens probes — and why remote execution changes what's practical to try.
Differential Privacy
Optimization
August 17, 2026
A mathematical exploration of why privacy loss in noisy contractive optimization can saturate instead of growing linearly with every training iteration.