[Feature Request]: Upgrade to Iceberg >1.7.0 and support timestamp nano types

[ahmedabu98]

What would you like to happen?

Iceberg spec V3 introduces new timestamp types timestamp_ns and timestamptz_ns for nanosecond precision (apache/iceberg#9008).

We should upgrade to a later version that includes these types and add support for conversion in our IcebergUtils.

Issue Priority

Priority: 2 (default / most feature requests should be filed as P2)

Issue Components

• Component: Python SDK
• Component: Java SDK
• Component: Go SDK
• Component: Typescript SDK
• Component: IO connector
• Component: Beam YAML
• Component: Beam examples
• Component: Beam playground
• Component: Beam katas
• Component: Website
• Component: Infrastructure
• Component: Spark Runner
• Component: Flink Runner
• Component: Samza Runner
• Component: Twister2 Runner
• Component: Hazelcast Jet Runner
• Component: Google Cloud Dataflow Runner

[github-actions]

This issue has been marked as stale due to 150 days of inactivity. It will be closed in 30 days if no further activity occurs. If you think that’s incorrect or this issue still needs to be addressed, please simply write any comment. If closed, you can reopen the issue at any time. Thank you for your contributions.

[masfworld]

I think it's very important to upgrade Iceberg. There are a bunch of bugs and new features missed.
For me, this is critical apache/iceberg#11282

[ahmedabu98]

We were waiting to update directly to Iceberg version 1.10.0

But considering the bugs you mention and how it's still taking them some time to get a release going, I think we should upgrade to 1.9.2 for now