Skip to content

Add support for Spark-compatible explode_outer function #19053

@andygrove

Description

@andygrove

Is your feature request related to a problem or challenge?

Spark supports explode and explode_outer, which are very similar to DataFusion's existing unnest function.

explode_outer treats nulls and empty arrays identically and produces an output row containing null. This differs from unnest with the preserve_nulls option set, which only does this for null inputs and does not generate output for empty arrays.

Describe the solution you'd like

I propose adding a new flag to unnest to treat empty arrays consistently with null arrays.

Describe alternatives you've considered

No response

Additional context

No response

Metadata

Metadata

Assignees

No one assigned

    Labels

    No fields configured for Feature.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions