Repository navigation
π Make the legacy LiteLLM endpoint findable in Settings and keep it in step with the litellm gateway - #12057
Conversation
β¦th the litellm gateway Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com> Signed-off-by: scanner <scanner@hive.kubestellar.io> Co-authored-by: MikeSpreitzer <14296719+MikeSpreitzer@users.noreply.github.com>
|
[APPROVALNOTIFIER] This PR is NOT APPROVED This pull-request has been approved by: The full list of commands accepted by this bot can be found here. DetailsNeeds approval from an approver in each of these files:Approvers can indicate their approval by writing |
|
hive/awaiting-ci: CI pending β sweep will merge when green. π Hive Agent: β hive: agent=scanner backend=copilot model=claude-fable-5.1 copilot=1.0.88 |
Open PR overlap checkBase branch: Conflicts are checked with every PR merged onto the current tip of
|
|
Thank you for your contribution! Your PR has been merged. We'd love to hear how your experience was: share feedback |
Gap (#9945 reopen): #11794 made route diagnostics tell operators to reconcile the "legacy endpoint" (
governor.litellm.endpoint, "LiteLLM tab"). But the standalone LiteLLM settings tab was retired:renderGovLiteLLMstill exists, but nothing calls it, andrenderGovernorTabhas no LiteLLM case. That left the legacy endpoint, key and default model editable only in hive.yaml. The reporter asked "What is a legacy endpoint and where do I go to set it?" and the honest answer was "nowhere in the UI".Saving gateway
litellmwith a new endpoint also left the legacy block pointing at the OLD proxy, and the legacy key store synced only when the endpoints already matched. On builds that resolve the legacy endpoint first (and on legacy-only paths), agents sent the new key to the old proxy and got 401, while the Gateways Test passed.Fix:
renderGovLiteLLMeditor (Endpoint, API Key, Default Model, Test Connection) and saves through the existinglitellmconfig section. No new inline styles; it uses thecard-inset/mt-4/fs-smutilities.litellm(kind litellm) with a different endpoint repointsgovernor.litellm.endpointto it. It also carries over the default model and syncs the legacy key store from the submitted key, or from the gateway's stored key if none was submitted. The two can no longer diverge. Gateways with other names are left alone.Settings β Model Gateways β Legacy LiteLLM endpoint) instead of the non-existent "LiteLLM tab". The setup dialog and welcome-tour hints no longer point at "Settings β LiteLLM".docs/inference-backends.md) and changelog fragment.Tests:
Refs #9945 (needs-human: reporter must retest on the FMA hive after the fix ships in a tagged release)
β hive: agent=scanner backend=copilot model=claude-fable-5.1 copilot=1.0.88 requested_by=@MikeSpreitzer