I adjust numbers until other numbers get smaller.

Recent

• Trajectory
  Jan 19, 2026 2 min read [md]

  You won each decision and lost the trajectory.

• AVnorm
  Jan 10, 2026 2 min read [md]

  Per-head normalization on attention outputs fixes length generalization.

• The Box
  Jan 1, 2026 1 min read [md]

  The hardest box to escape is the one you cannot see.

• Attention Normalizes the Wrong Norm
  Dec 23, 2025 1 min read [md]

  Softmax constrains the L1 norm to 1, but should constrain the L2 norm.

• People are the new oil
  Dec 13, 2025 2 min read [md]

  Compute used to be the bottleneck. Now it's people.