Skip to content

Support SubqueryBroadcastExec in Comet #242

@viirya

Description

@viirya

What is the problem the feature request solves?

Currently we support BroadcastExchange if it is under BroadcastHashJoin in Comet.

Besides broadcast join, BroadcastExchange can also occur under SubqueryBroadcastExec for dynamic pruning expression. Because Spark BroadcastExchange assumes it is row-based so we cannot simply transform BroadcastExchange under SubqueryBroadcastExec into Comet's broadcast operator.

We need to come out with a Comet SubqueryBroadcastExec which supports Comet's BroadcastExchange.

Describe the potential solution

No response

Additional context

No response

Metadata

Metadata

Assignees

No one assigned

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions