Skip to content

Conversation

@924060929
Copy link
Contributor

cherry pick from #34854

sollhui and others added 30 commits April 26, 2024 07:42
…iew rewriting (apache#34127)

Optimize the performance of nested materialized view rewriting gracefully, future performance optimzie base on this.
* Update doris_main.cpp

Log(FATAL) introduces a core dump, which is confusing for users. We should print error msg and exit without a core dump.

* Update doris_main.cpp
…apache#34114)

this is a stupid mistake. we import a same name class from another package
…e#34079)

we save bi-map in cte consumer to get the maping between producer and consumer.
the consumer's output is decided by the map in it.
so, cte consumer should be output prunable, and should remove useless entry from map when do column pruning
… to resolve special characters issue with git on windows. (apache#34026)
Make skip_page() in ColumnChunkReader more efficient. No more reading page headers if there are pagelocations in chunk.
fix compile problem in branch-2.1
Expand bucket shuffle downgrade condition, which originally requiring a single partition after pruning, basic table and bucket number < para number. Currently, we expect this option can be used for disabling bucket shuffle more efficiently, without above restrictions.

Co-authored-by: zhongjian.xzj <zhongjian.xzj@zhongjianxzjdeMacBook-Pro.local>
…apache#34163)

Record increase refersh version more accurately.
The refreshVersion in the memo will increase when mv rewrite successfully.
In query rewrite, if refresh version is different from the current struct info map in group,
will refresh the group struct info or not.
…34151)

In SQL syntax, `col != ''` equals `col.length() > 0`.
It means that this column must exist in ES doc fields and its content is not empty.
In this PR, we make a special translation for this binary predicate to keep the behavior of both consistent.

---------

Co-authored-by: Luennng <luennng@gmail.com>
wuwenchi and others added 26 commits May 14, 2024 23:40
1.  Forbid rollback to the old optimizer in `Export` task. Since originStmt is empty, reverting to the old optimizer when the new optimizer is enabled is meaningless.

2. Display `parallelism` in 'show export'.

3. Create an initial Map for resultAttachedInfo to avoid NullPointerException.

4. Remove the originStmt added in this PR apache#31020, because the `Export` statement is underlying the Outfile statement, it cannot be treated as `OriginStmt`.
fix check column privilege failed by hidden column: DORIS_DELETE_SIGN
…rm position delete when reading the orc file without a predicate. (apache#34814) (apache#34882)

bp apache#34814
…y mv (apache#34274)

check groupby in agg-bottom-plan when rewrite and rollup agg query by mv
Because apache#34397 changed error code of ARITHMETIC_OVERFLOW_ERRROR, so the error msg is not expected in the test.
@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@924060929 924060929 closed this May 23, 2024
@924060929 924060929 deleted the branch-2.1-distinct-agg branch May 23, 2024 11:02
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.