We need an interface for ingesting sharded data from individual processes and then getting it back out again when users are done with it.