Treating ML Inference as a System, Not a Function Call
A systems perspective on ML inference: treating it as a distributed, observable system rather than a black-box function call.
A systems perspective on ML inference: treating it as a distributed, observable system rather than a black-box function call.
Exploring how attention heads specialize and what that tells us about model behavior.