Skip to content

HDF5: Allow Non-Collective, Parallel I/O#576

Merged
ax3l merged 1 commit intoopenPMD:devfrom
ax3l:topic-hdf5Independent
Oct 18, 2019
Merged

HDF5: Allow Non-Collective, Parallel I/O#576
ax3l merged 1 commit intoopenPMD:devfrom
ax3l:topic-hdf5Independent

Conversation

@ax3l
Copy link
Member

@ax3l ax3l commented Oct 18, 2019

Add a new environment variable, OPENPMD_HDF5_INDEPENDENT[=OFF], to control the MPI-parallel file I/O transfers.

By default, this is collective which achieves the highest performance. But in case one wants to call storeChunk et al. in an independent manner, this can be handy to be changed.

Should later on also be exposed via a Series constructor option, see #569

Related to #554

@ax3l ax3l added backend: HDF5 api: new additions to the API labels Oct 18, 2019
Add a new environment variable, OPENPMD_HDF5_INDEPENDENT[=OFF],
to control the MPI-parallel file I/O transfer.

By default, this is collective which achieves the highest
performance. But in case one wants to call `storeChunk` et al.
in an independent manner, this can be handy to be changed.
@ax3l ax3l force-pushed the topic-hdf5Independent branch from 0f9a1e2 to d42cbb2 Compare October 18, 2019 01:26
@ax3l ax3l changed the title OPENPMD_HDF5_INDEPENDENT: Transfer HDF5: Allow Non-Collective, Parallel I/O Oct 18, 2019
@ax3l ax3l merged commit 7261fd9 into openPMD:dev Oct 18, 2019
@ax3l ax3l deleted the topic-hdf5Independent branch October 18, 2019 04:16
@ax3l ax3l mentioned this pull request Oct 18, 2019
3 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

api: new additions to the API backend: HDF5

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant