Skip to content

feat(openless-all): add OpenAI Fast mode on the polish channel - #1251

Open
mvanhorn wants to merge 2 commits into
Open-Less:betafrom
mvanhorn:fix/1165-openai-fast-mode
Open

mvanhorn wants to merge 2 commits into
Open-Less:betafrom
mvanhorn:fix/1165-openai-fast-mode

Conversation

@mvanhorn

@mvanhorn mvanhorn commented Oct 22, 2026 •

Copy link
Copy Markdown

摘要

Fixes #1165

After speech recognition, polish on an OpenAI channel still runs at the normal service tier, so the rewritten text waits a few seconds before it is inserted. The low-latency choice already offered for Ark is unavailable on OpenAI, so there is no way to pay a higher rate for a shorter wait.

修复 / 新增 / 改进

OpenAI channels gain a per-channel Fast mode switch.

  • With it on, Chat Completions and Responses bodies include a top-level service_tier of fast beside the existing model and reasoning fields.
  • An off switch, the Messages format, and custom, opencode, and openai-compatible providers leave the field out. Ark still sends fast on every format.
  • Desktop and Linux settings use OpenAI-specific copy that states the higher price and links to the official pricing page.
  • Blocking and streaming diagnostics record the tier sent and the service_tier on the response, or absent when none is returned.
  • Leaving the OpenAI provider clears the saved value, and an unsupported tier still surfaces as the provider's invalid response.

兼容

  • 不包含:service_tier for the Messages format and for custom, opencode, and openai-compatible providers.
  • 对现有用户 / 本地环境 / 构建流程的影响:service_tier is sent only when Fast mode is switched on for an OpenAI channel. Ark behavior is unchanged.

测试计划

Tests for the openless LlmProtocolConfig change live in openless-all/app/src/pages/settings/LlmProtocolFields.test.ts.

  • 命令:
  • 结果:
  • 证据路径:

OpenAI channels gain a per-channel Fast mode switch. With it on, Chat
Completions and Responses bodies include a top-level service_tier of
fast beside the existing model and reasoning fields; an off switch, the
Messages format, and custom, opencode, and openai-compatible providers
leave the field out, while Ark still sends fast on every format. Desktop
and Linux settings use OpenAI-specific copy that states the higher price
and links to the official pricing page. Blocking and streaming
diagnostics record the tier sent and the service_tier on the response,
or absent when none is returned; leaving the OpenAI provider clears the
saved value, and an unsupported tier still surfaces as the provider's
invalid response.

Fixes Open-Less#1165
@H-Chris233 H-Chris233 added area:provider Provider area area:ui UI area enhancement New feature or request needs-review Needs review needs-tests Needs tests P3 Low priority labels Oct 23, 2026
@appergb appergb added the branch-retained Keep source branch while the pull request remains open label Oct 30, 2026
…t-mode

# Conflicts:
#	openless-all/app/linux-egui/src/i18n.rs
@mvanhorn

Copy link
Copy Markdown
Author

Merged beta into the branch as 4bab17a. The only conflict was in linux-egui/src/i18n.rs, where the two Fast mode catalog entries sat next to the reindented messagesThinkingLabel entry; I kept both and matched the new indentation. cargo test -p openless-core --lib passes (1421 tests). The linux-egui crate depends on Wayland and cpal, so I could not build it on macOS, and CI covers that part.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

area:provider Provider area area:ui UI area branch-retained Keep source branch while the pull request remains open enhancement New feature or request needs-review Needs review needs-tests Needs tests P3 Low priority

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[polish] 为 OpenAI 渠道增加低延迟(Fast mode)选项

3 participants