Skip to content

fix: [iceberg] additional parquet independent api for iceberg integration#2442

Merged
andygrove merged 1 commit intoapache:mainfrom
parthchandra:iceberg-shading-col-desc
Sep 23, 2025
Merged

fix: [iceberg] additional parquet independent api for iceberg integration#2442
andygrove merged 1 commit intoapache:mainfrom
parthchandra:iceberg-shading-col-desc

Conversation

@parthchandra
Copy link
Copy Markdown
Contributor

Which issue does this PR close?

Part of #2079

Rationale for this change

Needed for iceberg integration. Without this API the current PRs to fix shading issues in Iceberg-Comet still hit a method not found error.

What changes are included in this PR?

Adds a new API to Comet's RowGroupReader that does not use ColumnDescriptor (which is a Parquet class)

How are these changes tested?

With a local build of Comet, and corresponding changes in Iceberg. After this all tests pass.

@parthchandra
Copy link
Copy Markdown
Contributor Author

@andygrove please consider this PR also for 0.10.1
@hsiang-c fyi

@andygrove andygrove mentioned this pull request Sep 22, 2025
@codecov-commenter
Copy link
Copy Markdown

codecov-commenter commented Sep 22, 2025

Codecov Report

❌ Patch coverage is 75.00000% with 1 line in your changes missing coverage. Please review.
✅ Project coverage is 58.05%. Comparing base (f09f8af) to head (ae31e5a).
⚠️ Report is 1166 commits behind head on main.

Files with missing lines Patch % Lines
.../java/org/apache/comet/parquet/RowGroupReader.java 75.00% 0 Missing and 1 partial ⚠️
Additional details and impacted files
@@             Coverage Diff              @@
##               main    #2442      +/-   ##
============================================
+ Coverage     56.12%   58.05%   +1.93%     
- Complexity      976     1403     +427     
============================================
  Files           119      146      +27     
  Lines         11743    13466    +1723     
  Branches       2251     2342      +91     
============================================
+ Hits           6591     7818    +1227     
- Misses         4012     4413     +401     
- Partials       1140     1235      +95     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

Copy link
Copy Markdown
Contributor

@hsiang-c hsiang-c left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@andygrove andygrove merged commit ab2edcb into apache:main Sep 23, 2025
113 checks passed
andygrove pushed a commit to andygrove/datafusion-comet that referenced this pull request Sep 30, 2025
mbutrovich pushed a commit that referenced this pull request Sep 30, 2025
…tion (#2442) (#2499)

Co-authored-by: Parth Chandra <parthc@apache.org>
coderfender pushed a commit to coderfender/datafusion-comet that referenced this pull request Dec 13, 2025
@parthchandra parthchandra deleted the iceberg-shading-col-desc branch January 14, 2026 22:02
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants