Fine-tuned small models that make agent systems convenient, fast and cheap to run.
wyt.si · Hugging Face · PugPort, the production use case · yutong.wiki, the author
A classifier and inference API that answers ten routing questions about a request to an AI agent system in one forward pass: what kind of task it is, how hard it is, and which tools it needs. It routes requests in production in PugPort, a multi-agent desktop app.
72.0% → 91.0% on sealed real requests (v4 → v5) · 322M parameters · 37 ms median latency
Model weights on Hugging Face · Case study · API reference · Model card