Skip to content

Parallelize multi-chunk inference for ~3-4x speedup on multi-sentence text#147

Open
namanomar wants to merge 1 commit into
KittenML:mainfrom
namanomar:perf/onnx-inference-speedup
Open

Parallelize multi-chunk inference for ~3-4x speedup on multi-sentence text#147
namanomar wants to merge 1 commit into
KittenML:mainfrom
namanomar:perf/onnx-inference-speedup

Commits

Commits on Jun 28, 2026