Skip to content

[Proposal] Allow ingesting timestamp from Kafka's Metadata envelope. #6625

@Igosuki

Description

@Igosuki

Kafka wraps messages in an envelope that contains the offset and the timestamp. Currently, it's not possible to use these timestamps in druid's parseSpec.

This update requires finding a way to append or wrap values sent to parsers with the timestamp, since it's basically not included in the message byte array.

Metadata

Metadata

Assignees

No one assigned

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions