Skip to content

Optimize planner to avoid excessive schema transform functions #9144

@comphead

Description

@comphead

Is your feature request related to a problem or challenge?

it was found that the planner calling schema transform functions excessively.

Experiment, lets take a simple query

        let sql = "select a, a + 1 b from (select 1 a union all select 2 a) x";

And increase rows in the x subquery by adding more and more rows, and we can see that schema function grows with every record

rows new_with_metadata merge
2 58 35
3 131 83
4 165 109

IMHO That is not expected, once the plan has built the schema calls should not increase with every new record in the dataset

Describe the solution you'd like

Ideally resolve excessive, more real is to reduce such calls

Describe alternatives you've considered

No response

Additional context

Follow up on #9104 investigations

Metadata

Metadata

Assignees

Labels

enhancementNew feature or request

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions