Skip to content

Add send/receive payload tracking for non-shuffle collectives - #1118

Merged
rapids-bot[bot] merged 10 commits into
rapidsai:mainfrom
wence-:wence/fea/more-coll-stats
Jul 3, 2026
Merged

Add send/receive payload tracking for non-shuffle collectives#1118
rapids-bot[bot] merged 10 commits into
rapidsai:mainfrom
wence-:wence/fea/more-coll-stats

Conversation

@wence-

@wence- wence- commented Jul 2, 2026

Copy link
Copy Markdown
Contributor

Now that the communicator carries a Statistics object, we can plumb through basic communication volume statistics for the remaining collectives.

Additionally, consistently take the statistics object from the communicator's progress thread when recording statistics for an object with a communicator.

wence- added 2 commits July 2, 2026 10:10
Now that the communicator carries a Statistics object, we can plumb through
basic communication volume statistics for the remaining collectives.
@wence-
wence- requested a review from a team as a code owner July 2, 2026 09:39
@wence- wence- added improvement Improves an existing functionality non-breaking Introduces a non-breaking change labels Jul 2, 2026
@wence-
wence- requested a review from a team as a code owner July 2, 2026 11:46
Comment thread python/rapidsmpf/rapidsmpf/statistics.pxd
Comment thread cpp/src/coll/allgather.cpp
Comment thread cpp/src/shuffler/shuffler.cpp
Comment thread cpp/src/shuffler/shuffler.cpp
Comment thread cpp/src/coll/allgather.cpp
Comment thread cpp/src/coll/allgather.cpp

@nirandaperera nirandaperera left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM. Thanks @wence-

Comment thread cpp/src/coll/allgather.cpp
Comment thread cpp/src/coll/allgather.cpp
Comment thread cpp/tests/environment.hpp
Comment thread cpp/tests/test_shuffler.cpp

@madsbk madsbk left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good beside a missing argument

Comment thread python/rapidsmpf/rapidsmpf/statistics.pyx Outdated
@wence-
wence- force-pushed the wence/fea/more-coll-stats branch from 9a8a713 to bda5ee8 Compare July 3, 2026 09:22
@wence-
wence- force-pushed the wence/fea/more-coll-stats branch from b5043a9 to 1297032 Compare July 3, 2026 10:11
@wence-
wence- force-pushed the wence/fea/more-coll-stats branch from d0c295c to 3530e42 Compare July 3, 2026 13:39
@wence-
wence- force-pushed the wence/fea/more-coll-stats branch from 3530e42 to a008f21 Compare July 3, 2026 13:41
@wence-

wence- commented Jul 3, 2026

Copy link
Copy Markdown
Contributor Author

/merge

@rapids-bot
rapids-bot Bot merged commit d8aee08 into rapidsai:main Jul 3, 2026
66 checks passed
@wence-
wence- deleted the wence/fea/more-coll-stats branch July 3, 2026 14:17
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

improvement Improves an existing functionality non-breaking Introduces a non-breaking change

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants