Skip to content

Try tests on GitHub Actions with three MPI ranks #3163

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 16 commits into from
Apr 24, 2024

Conversation

jhale
Copy link
Member

@jhale jhale commented Apr 23, 2024

Can keep the others on two for coverage? To discuss.

@jhale
Copy link
Member Author

jhale commented Apr 23, 2024

--------------------------------------------------------------------------
There are not enough slots available in the system to satisfy the 3
slots that were requested by the application:

  ctest

Either request fewer procs for your application, or make more slots
available for use.

A "slot" is the PRRTE term for an allocatable unit where we can
launch a process.  The number of slots available are defined by the
environment in which PRRTE processes are run:

  1. Hostfile, via "slots=N" clauses (N defaults to number of
     processor cores if not provided)
  2. The --host command line parameter, via a ":N" suffix on the
     hostname (N defaults to 1 if not provided)
  3. Resource manager (e.g., SLURM, PBS/Torque, LSF, etc.)
  4. If none of a hostfile, the --host command line parameter, or an
     RM is present, PRRTE defaults to the number of processor cores

In all the above cases, if you want PRRTE to default to the number
of hardware threads instead of the number of processor cores, use the
--use-hwthread-cpus option.

Alternatively, you can use the --map-by :OVERSUBSCRIBE option to ignore the
number of available slots when deciding the number of processes to
launch.
--------------------------------------------------------------------------

https://docs.github.com/en/actions/using-github-hosted-runners/about-github-hosted-runners/about-github-hosted-runners#standard-github-hosted-runners-for-public-repositories

Strange as the public runners all have at least 3 processors.

@jorgensd
Copy link
Member

--------------------------------------------------------------------------
There are not enough slots available in the system to satisfy the 3
slots that were requested by the application:

  ctest

Either request fewer procs for your application, or make more slots
available for use.

A "slot" is the PRRTE term for an allocatable unit where we can
launch a process.  The number of slots available are defined by the
environment in which PRRTE processes are run:

  1. Hostfile, via "slots=N" clauses (N defaults to number of
     processor cores if not provided)
  2. The --host command line parameter, via a ":N" suffix on the
     hostname (N defaults to 1 if not provided)
  3. Resource manager (e.g., SLURM, PBS/Torque, LSF, etc.)
  4. If none of a hostfile, the --host command line parameter, or an
     RM is present, PRRTE defaults to the number of processor cores

In all the above cases, if you want PRRTE to default to the number
of hardware threads instead of the number of processor cores, use the
--use-hwthread-cpus option.

Alternatively, you can use the --map-by :OVERSUBSCRIBE option to ignore the
number of available slots when deciding the number of processes to
launch.
--------------------------------------------------------------------------

https://docs.github.com/en/actions/using-github-hosted-runners/about-github-hosted-runners/about-github-hosted-runners#standard-github-hosted-runners-for-public-repositories

Strange as the public runners all have at least 3 processors.

Ubuntu runders only have two processors. Mac tynnere have more

@jhale
Copy link
Member Author

jhale commented Apr 23, 2024

Not according to githubs own documentation?

@francesco-ballarin
Copy link
Member

That's odd, in multiphenicsx I use 3 slots
https://github.com/multiphenics/multiphenicsx/blob/main/.github/workflows/ci.yml#L74
and I don't seem to have any need to use oversubscribe or similar options

@jorgensd
Copy link
Member

Not according to githubs own documentation?

are we reading the same documentation?
IMG_8445

@jhale
Copy link
Member Author

jhale commented Apr 23, 2024

No, there are two sections, one for public repositories and one for private. You are reading the latter.

@jorgensd
Copy link
Member

No, there are two sections, one for public repositories and one for private. You are reading the latter.

Interesting! That is a new development?

I had the same oversubscription issue when using openmpi with adios4dolfinx a while back. I haven't seen it with mpich before.

@jhale jhale added this pull request to the merge queue Apr 24, 2024
Merged via the queue into main with commit a546611 Apr 24, 2024
@jhale jhale deleted the jhale/three-mpi-ranks-tests branch April 24, 2024 14:36
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants