This repository was archived by the owner on Aug 7, 2024. It is now read-only.
[DISCUSSION] fix float8 all-gather in FSDP2 + TP: DTensor(WeightWithDynamicFloat8CastTensor)#326
Draft
weifengpy wants to merge 10 commits into
Draft
[DISCUSSION] fix float8 all-gather in FSDP2 + TP: DTensor(WeightWithDynamicFloat8CastTensor)#326weifengpy wants to merge 10 commits into
weifengpy wants to merge 10 commits into
Commits
Commits on Jul 17, 2024
Commits on Jul 18, 2024
Commits on Jul 21, 2024
Commits on Jul 24, 2024
- committed
Commits on Aug 1, 2024
- committed