Skip to content

[GLUTEN-9287][VL] Enable array_compact function for Spark 3.4+#9349

Merged
philo-he merged 3 commits intoapache:mainfrom
dcoliversun:gluten-9287
Apr 17, 2025
Merged

[GLUTEN-9287][VL] Enable array_compact function for Spark 3.4+#9349
philo-he merged 3 commits intoapache:mainfrom
dcoliversun:gluten-9287

Conversation

@dcoliversun
Copy link
Copy Markdown
Contributor

What changes were proposed in this pull request?

This PR aims to use the ArrayRemoveNullFunction in Velox to implement the Spark array_compact function.

(Fixes: #9287)

How was this patch tested?

unit tests

@github-actions github-actions bot added CORE works for Gluten Core VELOX labels Apr 17, 2025
@github-actions
Copy link
Copy Markdown

#9287

@github-actions
Copy link
Copy Markdown

Run Gluten Clickhouse CI on x86

@github-actions
Copy link
Copy Markdown

Run Gluten Clickhouse CI on x86

@dcoliversun
Copy link
Copy Markdown
Contributor Author

cc @philo-he Could you please review this? Thanks!

@github-actions
Copy link
Copy Markdown

Run Gluten Clickhouse CI on x86

@dcoliversun dcoliversun requested a review from philo-he April 17, 2025 12:13
@philo-he philo-he changed the title [GLUTEN-9287][VL] Enable array_compact function for spark3.4+ [GLUTEN-9287][VL] Enable array_compact function for Spark 3.4+ Apr 17, 2025
Copy link
Copy Markdown
Member

@philo-he philo-he left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks!

@philo-he philo-he merged commit d659c80 into apache:main Apr 17, 2025
48 checks passed
@dcoliversun dcoliversun deleted the gluten-9287 branch April 18, 2025 03:17
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

CORE works for Gluten Core VELOX

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[VL] Enable array_compact function

2 participants