Skip to content
@Waytrine

Waytrine

Fine-tuned small models that make agent systems convenient, fast and cheap.

Waytrine mark Waytrine

Fine-tuned small models that make agent systems convenient, fast and cheap to run.

wyt.si · Hugging Face · PugPort, the production use case · yutong.wiki, the author

Projects

A classifier and inference API that answers ten routing questions about a request to an AI agent system in one forward pass: what kind of task it is, how hard it is, and which tools it needs. It routes requests in production in PugPort, a multi-agent desktop app.

72.0% → 91.0% on sealed real requests (v4 → v5) · 322M parameters · 37 ms median latency

Model weights on Hugging Face · Case study · API reference · Model card

Pinned Loading

  1. task-router task-router Public

    Fine-tuned 322M classifier and inference API that answers ten routing questions about a request to an AI agent system in one forward pass

    Python

Repositories

Showing 2 of 2 repositories

Top languages

Loading…

Most used topics

Loading…