Skip to content

[PR] fix: defaultCountTokens counts every Han ideograph and subtracts the UTF-16 unit footprint (#4315) - #4321

Open
ranxianglei wants to merge 4 commits into
masterfrom
2026-10-22_default-count-tokens-han-coverage
Open

ranxianglei wants to merge 4 commits into
masterfrom
2026-10-22_default-count-tokens-han-coverage

Commits

  1. Commits on Oct 22, 2026