generate.py: --dit-dtype {bfloat16,float16,float32} flag for ~30%% faster sampling#12
Open
NoahBPeterson wants to merge 1 commit into
Open
generate.py: --dit-dtype {bfloat16,float16,float32} flag for ~30%% faster sampling#12NoahBPeterson wants to merge 1 commit into
NoahBPeterson wants to merge 1 commit into
