-
Notifications
You must be signed in to change notification settings - Fork 4.5k
Closed
Description
Apache Iceberg is an open table format layer on top of different filesystems.
Beam could support it in the form of an IO connector ideally integrating with Beam's own system for SQL support.
Inspiration can be taken from the ongoing effort to support Iceberg on Flink:
apache/iceberg#788
https://docs.google.com/document/d/1idTjQCubhOCea8LkKJ_5aMTV4V_Wf1n0aYhabGsLQZc/edit
Imported from Jira BEAM-10160. Original Jira may contain additional context.
Reported by: iemejia.
Blackmamba23, crtomirmajer, usbrandon, zjffdu, Panos-Bletsos and 4 more