Skip to content

Series Test: FileBased Independent#668

Merged
ax3l merged 1 commit intoopenPMD:devfrom
ax3l:fix-flushCreatesFiles
Jan 25, 2020
Merged

Series Test: FileBased Independent#668
ax3l merged 1 commit intoopenPMD:devfrom
ax3l:fix-flushCreatesFiles

Conversation

@ax3l
Copy link
Member

@ax3l ax3l commented Jan 25, 2020

Make sure that fileBase encoded series also support the independent writes as in #554.

This is currently problematic with ADIOS1 (in CI) and HDF5 (not in CI since I need #569 for that).

This causes interesting hang situations in WarpX particle flushes if one rank only writes attributes and other ranks actually write particles on first open.

To Do

  • add test case
  • is this an MPICH 3.3a2 specific problem? even though CI looks good here, my local WarpX tests also hang when build with OpenMPI 3.1.5 local MPI mix-up in deps

Future

@ax3l ax3l requested review from anokfireball and guj January 25, 2020 00:34
@ax3l ax3l force-pushed the fix-flushCreatesFiles branch 2 times, most recently from 7978de6 to be13dbc Compare January 25, 2020 00:51
@ax3l ax3l changed the title [WIP] Series: GroupBased Flush Shall Create [WIP] Series: FileBased Flush Shall Create Jan 25, 2020
@ax3l ax3l force-pushed the fix-flushCreatesFiles branch 4 times, most recently from 053805c to b354ea9 Compare January 25, 2020 01:29
@ax3l ax3l changed the title [WIP] Series: FileBased Flush Shall Create [WIP] Series: FileBased Independent Jan 25, 2020
@ax3l ax3l requested a review from franzpoeschel January 25, 2020 02:23
@ax3l ax3l force-pushed the fix-flushCreatesFiles branch from b354ea9 to 1f4169a Compare January 25, 2020 02:24
@ax3l ax3l added the MPI label Jan 25, 2020
@ax3l ax3l force-pushed the fix-flushCreatesFiles branch from 1f4169a to f4f8158 Compare January 25, 2020 07:20
Extend the test for independent writes of data chunks to fileBased
iteration encoding.
@ax3l ax3l force-pushed the fix-flushCreatesFiles branch from f4f8158 to 1c4aec2 Compare January 25, 2020 07:35
@ax3l
Copy link
Member Author

ax3l commented Jan 25, 2020

The problem seams to be a local MPI mixup. Dang, lost half a day with it.

@ax3l ax3l changed the title [WIP] Series: FileBased Independent Series Test: FileBased Independent Jan 25, 2020
@ax3l ax3l merged commit 90d7bd0 into openPMD:dev Jan 25, 2020
@ax3l ax3l deleted the fix-flushCreatesFiles branch January 25, 2020 19:49
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant