Skip to content

MPI partition: minimize ghost cells (METIS volume objective) - #403

Draft
hnil wants to merge 1 commit into
sintefmath:mainfrom
hnil:perf/mpi-partition-volume
Draft

hnil wants to merge 1 commit into
sintefmath:mainfrom
hnil:perf/mpi-partition-volume

Conversation

@hnil

@hnil hnil commented Oct 22, 2026

Copy link
Copy Markdown
Contributor

Every rank evaluates properties, equations and the smoother on its ghost cells too, so the slowest rank is set by owned + ghost cells, not by the edge cut. MetisPartitioner gets objective = :cut (default, as before) or :vol (METIS total communication volume), and partition_distributed uses :vol. The well-cell node weight (10) becomes the group_weight keyword.

Largest local subdomain (owned + ghost), edge cut -> volume: Norne np 8: 7483 -> 6897 (-8%), np 16: 4209 -> 3889 (-8%); refined Norne np 16 -3%, Egg np 16 -3%, OLYMPUS np 16 -2%.

Every rank evaluates properties, equations and the smoother on its ghost
cells too, so the slowest rank is set by owned + ghost cells, not by the
edge cut. MetisPartitioner gets objective = :cut (default, as before) or
:vol (METIS total communication volume), and partition_distributed uses
:vol. The well-cell node weight (10) becomes the group_weight keyword.

Largest local subdomain (owned + ghost), edge cut -> volume:
Norne np 8: 7483 -> 6897 (-8%), np 16: 4209 -> 3889 (-8%);
refined Norne np 16 -3%, Egg np 16 -3%, OLYMPUS np 16 -2%.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant