docs: add Nebius Serverless endpoint RAG example - #12814
SalikovAlex wants to merge 3 commits into
Conversation
|
@SalikovAlex is attempting to deploy a commit to the deepset Team on Vercel. A member of the Team first needs to authorize it. |
|
Hi @SalikovAlex, thanks a lot for your contribution! 🙏 We noticed that the Contributor License Agreement (CLA) check ( To get your PR reviewed, please sign the CLA via the link in the |
|
Hi @SalikovAlex, just a friendly reminder: this PR is still in draft because the Contributor License Agreement (CLA) hasn't been signed yet. We'd love to review your contribution! Please sign the CLA via the link in the |
|
Hi @SalikovAlex, thanks for the PR. We keep provider-specific setup guidance off the core component pages, so I'm closing this one. |
|
Thanks for clarifying, @bogdankostic Would a standalone Haystack cookbook example be a suitable home for the Nebius RAG walkthrough? I’d also be happy to narrow this PR to generic OpenAI-compatible endpoint guidance covering |
Related Issues
No related issue. Public Nebius searches in the deepset organization found no existing issue or PR for this example on September 18, 2026.
Proposed Changes
Clarify how
OpenAIChatGeneratoruses an OpenAI-compatible endpoint's URL, served model identifier and credential. Add a small RAG example using a local BM25 retriever and an existing Nebius Serverless Endpoint, with readiness, streaming, serialization and troubleshooting guidance.Update both the next-version and current stable (3.1) component pages. This uses the existing generator; there are no provider classes, dependencies or deployment changes. The example uses Serverless Endpoints, not the Token Factory managed model API.
How did you test it?
main(b717d00654af0dc405e5cec35546d734c832042f,3.2.0rc0, OpenAI3.14.1) and stable3.1.1(OpenAI3.15.0). Eight validation groups passed in each environment: request/auth/context, serialization, streaming, HTTP errors, timeout, interrupted stream, streaming limits/callback serialization, and missing credentials.git diff --checkpassed for the changed pages.Notes for the reviewer
Keep this as a draft pending live endpoint validation. A deployment dry run passed on September 19, but two provisioning attempts returned Nebius internal errors before an endpoint was created. The endpoint must be configured for token authentication and expose the OpenAI Chat Completions API over managed HTTPS.
No release note:
AGENTS.mdexcludes docs-only changes and.github/workflows/release_notes.ymlskips the requirement for adocs:commit.This change was developed with AI assistance. I wrote part of the code and reviewed all contributed content. The automated checks above were run. Verification of the submitting account's CLA status remains pending; any required CLA must be completed by an authorized signatory.
Checklist
docs:title and commit prepared.Related-issue updates, library unit tests/docstrings and a release note are not applicable to this documentation-only change.