perf(sampler): batched AR decoding + shape bucketing (~4x on the AR path) - #3
Open
trvachov wants to merge 1 commit into
Open
perf(sampler): batched AR decoding + shape bucketing (~4x on the AR path)#3trvachov wants to merge 1 commit into
trvachov wants to merge 1 commit into