feat(plugin): add Relay random and LLM-classifier routing - #220

Closed

bbednarski9 wants to merge 51 commits into

NVIDIA-NeMo:mainfrom

bbednarski9:feat/nemo-relay-dynamic-plugin

Commits on Aug 3, 2026

feat(translation): preserve raw stream events
bbednarski9
committed
9295eb4
docs(translation): describe stream preservation as parsed-JSON-value replay
bbednarski9
committed
b4df242
fix(translation): suppress synthesized finish after a replayed terminal event
bbednarski9
committed
c2f089d
perf(translation): move preserved stream events
bbednarski9
committed
42e23ce
refactor(translation): centralize preserved stream dispatch
bbednarski9
committed
1c160a2
refactor(translation): trim preserving stream API
bbednarski9
committed
d53b4ff
docs(protocol): define provider event boundary
bbednarski9
committed
e3f9bc0
refactor(protocol): compose preserved stream events
bbednarski9
committed
56012ed
fix(translation): retain served model on replay
bbednarski9
committed
3ccca40
docs(translation): clarify stream preservation contracts
bbednarski9
committed
a485afc
fix(translation): retain replay encoder state
bbednarski9
committed
784837c
feat(plugin): add NeMo Relay dynamic integration
bbednarski9
committed
ae354a0
test(plugin): add Relay process and bundle validation
bbednarski9
committed
62afc8c
refactor(plugin): use targeted LLM continuation contract
bbednarski9
committed
47b9d72
chore(plugin): update Relay SDK pin
bbednarski9
committed
19b3bfd
chore(plugin): refresh Relay SDK pin
bbednarski9
committed
9193405
refactor(plugin): use Relay safe native v2 SDK
bbednarski9
committed
6f9dbfc
test(plugin): cover safe stream outcomes
bbednarski9
committed
128bead
chore(plugin): update Relay safe v2 SDK pin
bbednarski9
committed
5ac0f3a
chore(plugin): update Relay safe v2 SDK pin
bbednarski9
committed
325ed5f
refactor(plugin): own routing retry policy
bbednarski9
committed
e6b6f49
chore(plugin): adopt cooperative Relay SDK
bbednarski9
committed
b56c907
refactor(plugin): rely on host cooperative runtime
bbednarski9
committed
cb2b785
fix(plugin): keep libsy futures executor neutral
bbednarski9
committed
434e27f
docs(libsy): describe poll-driven run streams
bbednarski9
committed
61a4c3f
refactor(plugin): simplify Relay run stream driver
bbednarski9
committed
8edc9b5
refactor(plugin): simplify run stream routing
bbednarski9
committed
7226c03
test(plugin): expand dynamic routing end-to-end coverage
bbednarski9
committed
8a15966
refactor(plugin): trim dynamic plugin surface
bbednarski9
committed
cd8b448
refactor(plugin): tighten dynamic plugin contract
bbednarski9
committed
642599f
docs(plugin): clarify dynamic routing contract
bbednarski9
committed
55456f9
docs(plugin): define managed call boundary
bbednarski9
committed
6d2a155
chore(plugin): pin final Relay v2 revision
bbednarski9
committed
716cee4
chore(plugin): pin bounded Relay v2 transport
bbednarski9
committed
6ae2ae1
refactor(plugin): reuse libsy classifier config
bbednarski9
committed
3568275
refactor(plugin): remove draft retry leftovers
bbednarski9
committed
a386765
docs(plugin): describe shared bounded output
bbednarski9
committed
90ce083
chore(plugin): pin reviewed Relay native API v2
bbednarski9
committed
10d204b
fix(plugin): stop routing after terminal controls
bbednarski9
committed
f92e6e2
fix(libsy): avoid unused classifier session state
bbednarski9
committed
4e87155
docs(plugin): define initial router scope
bbednarski9
committed
fc40dae
chore(plugin): pin rebased Relay native API v2
bbednarski9
committed
f44666d
chore(plugin): refresh Relay native API v2 pin
bbednarski9
committed
77be543
fix(plugin): address review safety findings
bbednarski9
committed
34d48df
fix(plugin): reject lossy Anthropic classifier targets
bbednarski9
committed
63da586
chore(plugin): refresh Relay SDK pin
bbednarski9
committed
c9d3808
chore(plugin): refresh Relay SDK pin
bbednarski9
committed
dd1bd84
chore(plugin): refresh Relay SDK pin
bbednarski9
committed
57254df
chore(plugin): refresh Relay SDK pin
bbednarski9
committed
881e0d3
chore(plugin): refresh Relay SDK pin
bbednarski9
committed
0b3b243
chore(plugin): track classifier token limit
bbednarski9
committed
cda935c