Add argument for setting inference logits dtype#4584
Draft
santhnm2 wants to merge 3 commits intoNVIDIA:mainfrom
Draft
Add argument for setting inference logits dtype#4584santhnm2 wants to merge 3 commits intoNVIDIA:mainfrom
santhnm2 wants to merge 3 commits intoNVIDIA:mainfrom