Skip to content

Update tokenizers requirement from ^0.21 to ^0.23#17

Merged
awadell1 merged 2 commits into
mainfrom
dependabot/cargo/tokenizers-tw-0.23
May 11, 2026
Merged

Update tokenizers requirement from ^0.21 to ^0.23#17
awadell1 merged 2 commits into
mainfrom
dependabot/cargo/tokenizers-tw-0.23

fix: token addition for tokenizer v0.23

e92c1b8
Select commit
Loading
Failed to load commit list.

Select a check to view from the sidebar