perf(rollout): stream the rollout data path and fetch in parser actors - #199

Merged

Rockdu merged 7 commits into

radixark:mainfrom

Rockdu:h3-router-streaming

Aug 28, 2026

Commits on Aug 28, 2026

perf(rollout): submit the parser task off the event loop
Rockdu
committed
427daa1
fix(router): drop the worker's date and server headers so the relay does not duplicate them
Rockdu
committed
4815610
perf(router): stream responses through instead of buffering them
Rockdu
committed
98aadc5
feat(rollout): parser actors fetch rollout responses straight from the engines
Rockdu
committed
bfb34ee
perf(rollout): log rollout media off the train barrier
Rockdu
committed
458541a
ci(scripts): run the e2e recipes with --rollout-fetch-in-parser
Rockdu
committed
9cbdd2f
refactor(rollout): report only the max for the dispatch queue depth metrics
Rockdu
committed
3ae3e5f