fix tokenize_document() with slow tokenizer#34

ArneBinder wants to merge 2 commits into

mainArneBinder/pie-modules:mainfrom

tokenize_document_with_slow_tokenizerArneBinder/pie-modules:tokenize_document_with_slow_tokenizerCopy head branch name to clipboard