Repository navigation

llama-server : make chat logprobs response OpenAI-compatible - #113

Merged

jimw567 merged 11 commits into

gfx11from

jamesong.aiesw-41278-logprobs-tools-stream

Oct 31, 2026

Merged

llama-server : make chat logprobs response OpenAI-compatible#113
jimw567 merged 11 commits into
gfx11from
jamesong.aiesw-41278-logprobs-tools-stream

Commits on Sep 22, 2026
- server : remove a throw for stream + tool + logprobs and add a unit test; remove the OAI incompatible comment
  Json288
  committed
  5692fb5
Commits on Oct 14, 2026
- requested fixes: queue+flush logprobs across chunks so none are silently dropped when a chat-msg diff is empty
  Json288
  committed
  53d3cd3
Commits on Oct 15, 2026
- trim comments
  Json288
  committed
  0cd46de
Commits on Oct 19, 2026
- server : add stream/non-stream x 5/100 top_logprobs test matrix for tool calls
  Json288
  committed
  2deb95b
Commits on Oct 20, 2026
- server : fix discarded logprobs for UTF-8 multi-token characters
  Json288
  committed
  59366e6
Commits on Oct 21, 2026
- server : apply stricter bytes check in tool-call logprobs tests
  Json288
  committed
  1675ff1
Commits on Oct 26, 2026
- server : fix dropping stored contents logprobs in stop string partial match branch and add unit test
  Json288
  committed
  e1812a3
Commits on Oct 27, 2026
- server : fix logprobs containing matched stop string's text and add unit test
  Json288
  committed
  e47a754
Commits on Oct 29, 2026
- server : remove logprob entries for stop-string tokens; fix streaming dropping held text when generation ends; edit unit tests accordingly
  Json288
  committed
  b883680
Commits on Oct 30, 2026
- Merge remote-tracking branch 'origin/gfx11' into jamesong.aiesw-41278-logprobs-tools-stream
  Json288
  committed
  df5cc4c
- server : fix slot.generated_text to slot.generated.text
  Json288
  committed
  5d4f15b

Commits

Commits on Sep 22, 2026

Commits on Oct 14, 2026

Commits on Oct 15, 2026

Commits on Oct 19, 2026

Commits on Oct 20, 2026

Commits on Oct 21, 2026

Commits on Oct 26, 2026

Commits on Oct 27, 2026

Commits on Oct 29, 2026

Commits on Oct 30, 2026