Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Workaround for current CI issues with clang14 on MacOS #1565

Merged
merged 2 commits into from
Dec 7, 2023

Conversation

franzpoeschel
Copy link
Contributor

All CI runs for appleclang14_py_mpi_h5_ad2 are currently failing and this looks like a bug in mpiexec to me.
This tries a workaround.

The error:

...

2023-11-28T10:53:38.1264050Z 27: --------------------------------------------------------------------------
2023-11-28T10:53:38.1265160Z 27: An unrecognized option was included on the mpiexec command line:
2023-11-28T10:53:38.1265740Z 27: 
2023-11-28T10:53:38.1266110Z 27:   Option: --infile
2023-11-28T10:53:38.1266410Z 27: 
2023-11-28T10:53:38.1266940Z 27: Please use the "mpiexec --help" command to obtain a list of all
2023-11-28T10:53:38.1267520Z 27: supported options.
2023-11-28T10:53:38.1268080Z 27: --------------------------------------------------------------------------
2023-11-28T10:53:38.1271700Z 27/40 Test #27: CLI.pipe.py .................................***Failed    0.03 sec

...

2023-11-28T10:53:39.7926460Z 33: --------------------------------------------------------------------------
2023-11-28T10:53:39.7927270Z 33: An unrecognized option was included on the mpiexec command line:
2023-11-28T10:53:39.7927830Z 33: 
2023-11-28T10:53:39.7928140Z 33:   Option: -m
2023-11-28T10:53:39.7928420Z 33: 
2023-11-28T10:53:39.7928970Z 33: Please use the "mpiexec --help" command to obtain a list of all
2023-11-28T10:53:39.7929540Z 33: supported options.
2023-11-28T10:53:39.7930100Z 33: --------------------------------------------------------------------------
2023-11-28T10:53:39.7930850Z 33/40 Test #33: Example.py.4_read_parallel ..................***Failed    0.02 sec

...

2023-11-28T10:53:39.8126700Z 34: --------------------------------------------------------------------------
2023-11-28T10:53:39.8127470Z 34: An unrecognized option was included on the mpiexec command line:
2023-11-28T10:53:39.8128040Z 34: 
2023-11-28T10:53:39.8128360Z 34:   Option: -m
2023-11-28T10:53:39.8128640Z 34: 
2023-11-28T10:53:39.8129180Z 34: Please use the "mpiexec --help" command to obtain a list of all
2023-11-28T10:53:39.8129760Z 34: supported options.
2023-11-28T10:53:39.8130740Z 34: --------------------------------------------------------------------------
2023-11-28T10:53:39.8131570Z 34/40 Test #34: Example.py.5_write_parallel .................***Failed    0.02 sec

...

2023-11-28T10:53:45.0888290Z The following tests FAILED:
2023-11-28T10:53:45.0890320Z 	 27 - CLI.pipe.py (Failed)
2023-11-28T10:53:45.0891220Z 	 33 - Example.py.4_read_parallel (Failed)
2023-11-28T10:53:45.0892090Z 	 34 - Example.py.5_write_parallel (Failed)

Happens always when the subcommand that is launched via mpiexec contains an argument starting with a dash, so this is probably a parser error in mipexec.

@franzpoeschel
Copy link
Contributor Author

franzpoeschel commented Dec 6, 2023

The last commit ensures that the CI fails again as soon as the parser bug is fixed. The wrapper used as a workaround will fail as soon as mpiexec starts behaving correctly again.

@franzpoeschel franzpoeschel changed the title Try working around current CI issues with clang14 on MacOS Workaround for current CI issues with clang14 on MacOS Dec 6, 2023
The bug sounds similar to this one
open-mpi/ompi#6372, though that is supposedly
fixed in Open MPI 5..

This creates a tmp script to call the launched application instead of
calling it directly on the command line. This way, mpirun does not see
the command line arguments and cannot try to wrongly parse them.
@franzpoeschel franzpoeschel enabled auto-merge (squash) December 7, 2023 11:54
@franzpoeschel franzpoeschel merged commit 6b963ba into openPMD:dev Dec 7, 2023
28 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant