Skip to content

Decode byte-fallback pieces in metaspace BPE tokenizers - #810

Open
ayushmk7 wants to merge 1 commit into
cactus-compute:mainfrom
ayushmk7:fix/bpe-byte-fallback-decode
Open

ayushmk7 wants to merge 1 commit into
cactus-compute:mainfrom
ayushmk7:fix/bpe-byte-fallback-decode

Decode byte-fallback pieces in metaspace BPE tokenizers

2f40478
Select commit
Loading
Failed to load commit list.
DCO / DCO succeeded Sep 14, 2026 in 1s

DCO

All commits are signed off!