Skip to content

Dingo router continuous usage sglang 0.5.21 - #77

Merged
guojn1 merged 3 commits into
DingoRouter-basefrom
DingoRouter-continuous-usage-sglang-0.5.21
Oct 12, 2026
Merged

guojn1 merged 3 commits into
DingoRouter-basefrom
DingoRouter-continuous-usage-sglang-0.5.21

Conversation

@githubgxll

Copy link
Copy Markdown
Owner

No description provided.

…gine update

- OutputOptions: add continuous_usage_stats flag surviving Rust serialization
- decode handler: report cumulative prompt/completion/cache usage per engine
  meta_info update in aggregated and PD decode paths; retain known sparse
  cache values; stop consuming after cancellation
- custom frontend: forward include_usage+continuous_usage_stats, emit
  usage-only chunks while parsers buffer text/tool syntax, attach usage to
  terminal tool payload frames
- tests: frontend metrics + decode handler behavior regressions
- docs: describe option semantics, version-consistency and billing rules
@githubgxll
githubgxll had a problem deploying to external_collaborator October 11, 2026 14:28 — with GitHub Actions Failure
@github-actions github-actions Bot added documentation Improvements or additions to documentation frontend container labels Oct 11, 2026
@guojn1
guojn1 merged commit badd16f into DingoRouter-base Oct 12, 2026
5 of 7 checks passed

This branch had an error being deployed

1 failed deployment
external_collaborator — 717e5b7f Deployed Oct 11, 2026 by githubgxll via ok-to-test #164
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

container documentation Improvements or additions to documentation frontend

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants