Allow formatting data as binary protocol messages #40
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Although the majority of common analysis use cases requires only the parsing of Harp flat binary files and messages into data frames, it is also desirable to support the converse operation: generating Harp binary files from existing data frames.
This PR enables post-processing and storage of processed datasets using the Harp binary format, for compatibility with existing systems. Both a
writeandformatfunctions are defined to allow writing data to a Harp binary file, or to a memory array buffer, respectively. Regression tests were added to validate successful round-trip. Example signature for thewritefunction:Further testing may be required to ensure timestamp roundtrip is not lossy if done over
float64. Given the specs of the 8-bit protocol this should be the case, but conversion may require revision in case of the 32-bit protocol.