TimestampType support in GenericParquetReaders/GenericParquetWriter is different

[vanliu-tx]

GenericParquetReaders support TimestampType with zone and without zone.

GenericParquetWriter only support Timestamp with zone.

[chenjunjiedada]

@vanliu-tx , There is a PR: #891 for this. Also, we are using SparkParquetReader and SparkParquetWriter for spark engine.

[vanliu-tx]

@chenjunjiedada in my case we don't use any engine to read/write iceberg table, we want to minimize the resource used.

[chenjunjiedada]

@vanliu-tx , Does PR: #891 works for you? I think that fixes the issue.

[waterlx]

in my case we don't use any engine to read/write iceberg table, we want to minimize the resource used.

@vanliu-tx If you need an engine-independent fix, would you please take a look at #965 ? It is dedicated to address your issue so it is shorter than #891.
But I might need to know your Parquet version. Both of #965 and #891 depend on Parquet 1.11, with "logical type annotation". Based on that, we could build a flag which helps to distingish between timestamp with and without zone. In Parquet 1.10, I could not find a flag like that yet.
Please let me know if it works for you.

[waterlx]

This issue is a dup of #965 or #475. All of them could be addressed by #891 thoroughly

[vanliu-tx]

ok, close it as duplicate with #965