[CORE] Bump iceberg version of spark 3.3 to 1.5.0#8418
[CORE] Bump iceberg version of spark 3.3 to 1.5.0#8418zhztheplayer merged 7 commits intoapache:mainfrom
Conversation
|
Thanks for opening a pull request! Could you open an issue for this pull request on Github Issues? https://github.com/apache/incubator-gluten/issues Then could you also rename commit message and pull request title in the following format? See also: |
|
Run Gluten Clickhouse CI on x86 |
|
Run Gluten Clickhouse CI on x86 |
|
Run Gluten Clickhouse CI on x86 |
|
Run Gluten Clickhouse CI on x86 |
|
The PR enables spark-3.3 to upgrade iceberg's version. It seems this change is unrelated to ClickHouse, but why ClickHouse CI fail ? @philo-he |
|
Run Gluten Clickhouse CI on x86 |
Not sure. Just retriggered the CI. |
|
Run Gluten Clickhouse CI on x86 |
|
@j7nhai, could you check the error log? See public account for login: https://github.com/apache/incubator-gluten/blob/main/docs/get-started/ClickHouse.md#new-ci-system. |
…into j7nhai-iceberg-dev
|
Run Gluten Clickhouse CI on x86 |
Thanks, I have fixed it. |
| <spark.version>3.3.1</spark.version> | ||
| <!-- keep using iceberg v1.3.1 for parquet compatibilty. --> | ||
| <iceberg.version>1.3.1</iceberg.version> | ||
| <iceberg.version>1.5.0</iceberg.version> |
There was a problem hiding this comment.
not sure if this parquet compatibility is still valid for spark33
CC @ulysses-you
There was a problem hiding this comment.
I don't know what the compatibility issue is here. @yma11
There was a problem hiding this comment.
As I remember, there should be an API mismatch because of different parquet version used by icerberg 1.5.0+ and Spark3.3.1. But I am not sure why it's okay now as no UT failure detected. Suggest you guys double check this part.
|
===== Performance report for TPCDS SF2000 with Velox backend, for reference only ====
|
|
===== Performance report for TPCH SF2000 with Velox backend, for reference only ====
|
What changes were proposed in this pull request?
Bump iceberg version of spark 3.3 to 1.5.0
How was this patch tested?
UT