Skip to content

build(llm-router): allow always-disagg deciders in llm-d-router observer - #762

Merged
thxCode merged 1 commit into
mainfrom
build/llm-router-epd-deciders
Oct 15, 2026
Merged

thxCode merged 1 commit into
mainfrom
build/llm-router-epd-deciders

Conversation

@thxCode

@thxCode thxCode commented Oct 15, 2026

Copy link
Copy Markdown
Collaborator

What type of PR is this?

/kind enhancement
/area worker

What this PR does / why we need it:

  • Adds always-disagg-pd-decider and always-disagg-multimodal-decider to the observer plugin allowlist (SupportedPlugins) and unit test coverage (TestObserverPluginCoverage) in pack/llm-router/patches/llm-d/0001-observer-endpoints-and-dispatch.patch.
  • Without these two built-in llm-d-router deciders in the observer's known plugin set, /observer/endpoints refuses requests with 403 Forbidden when llm-d-router runs an Encoder-Prefill-Decode (always-disagg-multimodal-decider) or SGLang disaggregated (always-disagg-pd-decider) profile.

Which issue(s) this PR links to:

NONE

Special notes for your reviewer:

Does this PR introduce a user-facing change?

NONE

Add always-disagg-pd-decider and always-disagg-multimodal-decider to the observer endpoint allowlist and coverage test in pack/llm-router/patches/llm-d/0001-observer-endpoints-and-dispatch.patch so the read-only /observer/endpoints route stays open on SGLang and EPD disaggregation profiles.

Signed-off-by: thxCode <thxcode0824@gmail.com>
@gpustack-code-review

Copy link
Copy Markdown

✅ OpenCodeReview: Review skipped: no items were selected.

@thxCode
thxCode merged commit 8c1c29a into main Oct 15, 2026
7 checks passed
@thxCode
thxCode deleted the build/llm-router-epd-deciders branch October 15, 2026 05:20
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant