Skip to content

Add Apache Iceberg IO connector #20327

@damccorm

Description

@damccorm

Apache Iceberg is an open table format layer on top of different filesystems.

Beam could support it in the form of an IO connector ideally integrating with Beam's own system for SQL support.

Inspiration can be taken from the ongoing effort to support Iceberg on Flink:
apache/iceberg#788
https://docs.google.com/document/d/1idTjQCubhOCea8LkKJ_5aMTV4V_Wf1n0aYhabGsLQZc/edit

Imported from Jira BEAM-10160. Original Jira may contain additional context.
Reported by: iemejia.

Metadata

Metadata

Assignees

Type

No type

Projects

No projects

Relationships

None yet

Development

No branches or pull requests

Issue actions