Skip to content

docs: Documentation updates for 0.9.0 release#1981

Merged
andygrove merged 14 commits intoapache:mainfrom
andygrove:docs-update-0.9.0
Jul 8, 2025
Merged

docs: Documentation updates for 0.9.0 release#1981
andygrove merged 14 commits intoapache:mainfrom
andygrove:docs-update-0.9.0

Conversation

@andygrove
Copy link
Copy Markdown
Member

@andygrove andygrove commented Jul 3, 2025

Which issue does this PR close?

Part of #1856

Rationale for this change

Various documentation updates to reflect changes in 0.9.0

What changes are included in this PR?

  • Update info on native scans and complex type support
  • Update Iceberg integration docs

How are these changes tested?

Comment thread docs/source/user-guide/installation.md
Comment on lines -24 to -34
## Parquet Scans

Comet currently has three distinct implementations of the Parquet scan operator. The configuration property
`spark.comet.scan.impl` is used to select an implementation. These scans are described in the
[Compatibility Guide].

[Compatibility Guide]: compatibility.md

When using `native_datafusion` or `native_iceberg_compat`, there are known performance issues when pushing filters
down to Parquet scans. Until this issue is resolved, performance can be improved by setting
`spark.sql.parquet.filterPushdown=false`.
Copy link
Copy Markdown
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We no longer need this section because of the new config COMET_RESPECT_PARQUET_FILTER_PUSHDOWN and users should not need to know the details of this.

@andygrove andygrove marked this pull request as ready for review July 3, 2025 17:44
@andygrove andygrove marked this pull request as draft July 3, 2025 17:44
@andygrove andygrove marked this pull request as ready for review July 7, 2025 19:59
Copy link
Copy Markdown
Contributor

@comphead comphead left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lgtm thanks @andygrove

@andygrove andygrove merged commit 5ddd921 into apache:main Jul 8, 2025
1 check passed
@andygrove
Copy link
Copy Markdown
Member Author

Thanks for the review @comphead

@andygrove andygrove deleted the docs-update-0.9.0 branch July 8, 2025 14:41
coderfender pushed a commit to coderfender/datafusion-comet that referenced this pull request Dec 13, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants