Skip to content

[Feature Request]: Add support for Iceberg table identifiers with special characters #33292

@regadas

Description

@regadas

What would you like to happen?

Currently, the IcebergIO internally uses TableIdentifier#parse and TableIdentifier#toString to encode/decode TableIdentifier. However, parse is using dot as a splitter not allowing cases where table names have dots i.e. default.table.id.

There are several approaches we can take here:

  1. support escaping using ", or ' or even i.edefault."table.id"`
  2. use Iceberg json representation https://github.com/apache/iceberg/blob/36140b819c60743b39176e28a63ab588df445329/core/src/main/java/org/apache/iceberg/catalog/TableIdentifierParser.java#L37-L40

I have a draft proposal using 2. #33293

Issue Priority

Priority: 2 (default / most feature requests should be filed as P2)

Issue Components

  • Component: Python SDK
  • Component: Java SDK
  • Component: Go SDK
  • Component: Typescript SDK
  • Component: IO connector
  • Component: Beam YAML
  • Component: Beam examples
  • Component: Beam playground
  • Component: Beam katas
  • Component: Website
  • Component: Infrastructure
  • Component: Spark Runner
  • Component: Flink Runner
  • Component: Samza Runner
  • Component: Twister2 Runner
  • Component: Hazelcast Jet Runner
  • Component: Google Cloud Dataflow Runner

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions