Treating ML Inference as a System, Not a Function Call
2025 TOWARDS AI

Treating ML Inference as a System, Not a Function Call

A systems perspective on ML inference: treating it as a distributed, observable system rather than a black-box function call.

September 2026 NOTES

Notes on Transformer Attention Patterns

Exploring how attention heads specialize and what that tells us about model behavior.