Skip to content

Add an InlineFirehose that contains the data to be ingested in its spec (for examples and demos) #7910

@vogievetsky

Description

@vogievetsky

Description

It would be awesome to have a very simple firehose that produces data inlined from its own spec. I am not sure what the API should be but it would be like:

{
  "type": "inline",
  "mime": "application/json",
  "encoding": "base64",
  "data": "iVBORw0KGgoAAAANSUhEUgAAAKsAAADVCAMAAAAfHvCaAAAAGFBMVEV..."
}

Encoding could maybe be base64, base64gzip, or whatever is needed to decode the contents of data.

I am imagining that there will be like a 200kb limit on the data so as it fits into a znode with room to spare.

Motivation

This would allow us to paste some data directly into the data loader to test out the parsing and schema.

Metadata

Metadata

Assignees

No one assigned

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions