Skip to content

feat(llm): add Novita AI as a built-in provider - #755

Open
jax-novita wants to merge 3 commits into
alibaba:mainfrom
jax-novita:feat/novita-provider
Open

feat(llm): add Novita AI as a built-in provider#755
jax-novita wants to merge 3 commits into
alibaba:mainfrom
jax-novita:feat/novita-provider

Conversation

@jax-novita

Copy link
Copy Markdown

Adds novita to the built-in provider registry in internal/llm/providers.go. Novita's endpoint is OpenAI-compatible, so it registers the same way as the other openai-protocol providers (deepseek, kimi, z-ai, ...) — no new client code needed.

  • Base URL: https://api.novita.ai/openai (current documented endpoint)
  • Auth: NOVITA_API_KEY env var (Bearer, OpenAI-compatible default)
  • Models: moonshotai/kimi-k3, zai-org/glm-5.2, deepseek/deepseek-v4-flash-0731 — current flagships per Novita's live /openai/v1/models

Also updates the provider table in the en/ja/zh configuration docs and the provider-order test in providers_test.go.

Verified against the real Novita endpoint via ocr llm test (the repo's own connectivity-check command), which returned a live response from moonshotai/kimi-k3 through the configured provider.

jax-novita and others added 3 commits July 31, 2026 04:33
Novita's endpoint (https://api.novita.ai/v3/openai) is OpenAI-compatible,
so it registers like the other OpenAI-protocol providers (deepseek, kimi,
z-ai, ...). Adds the registry entry, the matching name in the
provider-order test, and the provider table in the en/zh/ja
configuration docs. Model ids are taken from the live
/v3/openai/models endpoint.
The registry entry, tests-adjacent docs tables (en/ja/zh configuration.md)
used https://api.novita.ai/v3/openai. That path still resolves today, but
Novita's current documentation (novita.ai/docs/guides/llm-api) no longer
shows it; the current documented OpenAI-compatible endpoint is
https://api.novita.ai/openai. Verified live 2026-08-01: both paths return
identical /models and /chat/completions results, so this is a stale-citation
fix, not a functional break.
The models listed for Novita were older ids that no longer reflect what
the platform leads with. Point the recommendations at the three current
flagships instead, each verified against api.novita.ai:

  moonshotai/kimi-k3              1M context, native vision
  zai-org/glm-5.2                 1M context, long-horizon agentic work
  deepseek/deepseek-v4-flash-0731 1M context, cheapest of the three

Context windows, output limits, input modalities and pricing were taken
from the live /openai/v1/models response rather than carried over.
@CLAassistant

Copy link
Copy Markdown

CLA assistant check
Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.


jax-novita seems not to be a GitHub user. You need a GitHub account to be able to sign the CLA. If you have already a GitHub account, please add the email address used for this commit to your account.
You have signed the CLA already but the status is still pending? Let us recheck it.

@github-actions

github-actions Bot commented Aug 6, 2026

Copy link
Copy Markdown
Contributor

OpenCodeReview: Review complete: 0 finding(s) across 1 selected item(s).

@wu21-web

wu21-web commented Aug 6, 2026

Copy link
Copy Markdown
Contributor

@jax-novita Maybe you forgot to link this pull request to issue #673

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants