Research Blog

Slides: Hand-Coded Process and Outcome Programs

Transformers Process Supervision

October 1, 2026

Interactive slides on two exact transformer programs for counting a letter: one that writes the running count, one that answers directly. Covers the matrix shapes, the block encoding of the residual stream, and what each head and MLP unit does, all computed live in the page.

Why the Final Answer Is a Weak Teacher

Credit Assignment Process Supervision Transformers Learning Theory

September 12, 2026 · updated October 4, 2026 · Password protected

A walkthrough of why a correct final answer gives a fresh network almost nothing to learn from on a long computation, why showing each step fixes that, and what is proved versus measured. The proofs are there if you want the mathematics.

Slides: Why Process Supervision Survives Wrong Traces

Credit Assignment Process Supervision Transformers Learning Theory

September 28, 2026 · Password protected

Lecture slides for the note above: the hand-built counting programs, the proofs, and the experiments.

Grading With Evidence: A Multi-Agent Auto-Assessment System

Multi-Agent Systems LLM Applications Education Technology

September 12, 2026

An evidence-anchored, multi-agent grading pipeline for handwritten and typed answer sheets — deterministic score auditing, an evidence-checked regrade flow, and memory that carries weak-area feedback and grading corrections across submissions.

Diffusion Autoencoders: Reproducing a Meaningful, Decodable Latent Space

Generative Models Diffusion Models Representation Learning

September 12, 2026

Notes from reproducing Diffusion Autoencoders (Preechakul et al., CVPR 2022): a semantic encoder that splits a diffusion model's latent into a compact, decodable code and a deterministic stochastic subcode, tested by aligning, autoencoding, interpolating, and manipulating our own photo.

Poking Inside a Language Model with NNsight

Mechanistic Interpretability Transformers Tooling

September 12, 2026

An introduction to NNsight's tracing-context API — lazy intervention graphs, proxies, activation patching, and logit-lens probes — and why remote execution changes what's practical to try.