Posts

• Trajectory Jan 19, 2026 [md]

  You won each decision and lost the trajectory.

• AVnorm Jan 10, 2026 [md]

  Per-head normalization on attention outputs fixes length generalization.

• The Box Jan 1, 2026 [md]

  The hardest box to escape is the one you cannot see.

• Attention Normalizes the Wrong Norm Dec 23, 2025 [md]

  Softmax constrains the L1 norm to 1, but should constrain the L2 norm.

• People are the new oil Dec 13, 2025 [md]

  Compute used to be the bottleneck. Now it's people.