This repository was archived by the owner on Aug 7, 2024. It is now read-only.
[DISCUSSION] fix float8 all-gather in FSDP2 + TP: DTensor(WeightWithDynamicFloat8CastTensor)#326
Draft
weifengpy wants to merge 10 commits into
Draft
[DISCUSSION] fix float8 all-gather in FSDP2 + TP: DTensor(WeightWithDynamicFloat8CastTensor)#326weifengpy wants to merge 10 commits into
weifengpy wants to merge 10 commits into