feat(fsdp): add --fsdp-reshard-after-forward for ZeRO-2 style training - #196
Open
Rockdu wants to merge 1 commit into
Open
feat(fsdp): add --fsdp-reshard-after-forward for ZeRO-2 style training#196Rockdu wants to merge 1 commit into
Rockdu wants to merge 1 commit into