Skip to content

Conversation

@englefly
Copy link
Contributor

Proposed changes

pick #41790

disable join reorder if any condition is matched:

  1. any table row count is -1
  2. any column, whose ndv is 0, but MinExpr or MaxExpr is not null
  3. ndv > 10* rowCount

Issue Number: close #xxx

(cherry picked from commit e238a87)

Proposed changes

Issue Number: close #xxx

…e#41790)

## Proposed changes
disable join reorder if any condition is matched:
1. any table row count is -1
2. any column, whose ndv is 0, but MinExpr or MaxExpr is not null
3. ndv > 10* rowCount

Issue Number: close #xxx

<!--Describe your changes.-->

(cherry picked from commit e238a87)
@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@englefly
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 40586 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 505d7dca0a06f58d022d354d489beaabe415d7cf, data reload: false

------ Round 1 ----------------------------------
q1	17594	7392	7324	7324
q2	2066	155	153	153
q3	10696	1064	1146	1064
q4	10551	766	723	723
q5	7742	2789	2790	2789
q6	233	146	144	144
q7	977	606	596	596
q8	9335	1947	1960	1947
q9	6563	6382	6483	6382
q10	6945	2274	2297	2274
q11	440	247	248	247
q12	407	227	208	208
q13	17776	2980	3005	2980
q14	241	208	215	208
q15	574	517	512	512
q16	667	602	599	599
q17	966	530	504	504
q18	7226	6632	6704	6632
q19	1394	1053	992	992
q20	486	202	207	202
q21	3866	3303	3131	3131
q22	1090	989	975	975
Total cold run time: 107835 ms
Total hot run time: 40586 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7293	7209	7646	7209
q2	335	239	232	232
q3	2866	2887	2911	2887
q4	2017	1783	1802	1783
q5	5689	5688	5716	5688
q6	222	137	146	137
q7	2172	1795	1780	1780
q8	3293	3558	3479	3479
q9	8797	8870	8860	8860
q10	3551	3507	3506	3506
q11	588	477	473	473
q12	809	589	592	589
q13	16465	3084	3144	3084
q14	308	270	287	270
q15	559	529	525	525
q16	687	668	655	655
q17	1869	1625	1631	1625
q18	8264	7734	7675	7675
q19	6456	1560	1603	1560
q20	2106	1874	1878	1874
q21	5405	5161	5362	5161
q22	1120	1035	1015	1015
Total cold run time: 80871 ms
Total hot run time: 60067 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 193467 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 505d7dca0a06f58d022d354d489beaabe415d7cf, data reload: false

query1	1249	970	888	888
query2	6237	2099	1988	1988
query3	10800	3819	3726	3726
query4	67960	28945	23389	23389
query5	5605	445	426	426
query6	470	165	165	165
query7	6154	302	302	302
query8	338	238	240	238
query9	9279	2671	2662	2662
query10	508	275	247	247
query11	18073	15204	15611	15204
query12	173	103	106	103
query13	1608	443	422	422
query14	11166	6999	7197	6999
query15	233	188	179	179
query16	7163	506	499	499
query17	1060	552	558	552
query18	1856	306	304	304
query19	195	154	148	148
query20	113	113	107	107
query21	213	103	102	102
query22	4471	4176	4302	4176
query23	34334	33997	33782	33782
query24	5700	2780	2843	2780
query25	521	426	407	407
query26	676	169	164	164
query27	1694	301	298	298
query28	4198	2566	2515	2515
query29	664	430	431	430
query30	234	158	152	152
query31	1008	799	833	799
query32	67	53	54	53
query33	468	277	274	274
query34	969	493	507	493
query35	831	719	705	705
query36	1053	926	926	926
query37	120	76	71	71
query38	3914	3752	3920	3752
query39	1500	1427	1422	1422
query40	205	103	98	98
query41	51	50	49	49
query42	117	98	97	97
query43	526	483	497	483
query44	1128	789	788	788
query45	183	167	164	164
query46	1115	697	723	697
query47	1873	1808	1794	1794
query48	447	371	367	367
query49	744	400	384	384
query50	821	403	401	401
query51	6959	6849	6966	6849
query52	104	103	94	94
query53	258	182	180	180
query54	551	450	440	440
query55	75	76	78	76
query56	261	256	243	243
query57	1169	1103	1100	1100
query58	203	198	201	198
query59	3098	2826	2797	2797
query60	282	248	243	243
query61	105	130	102	102
query62	747	661	660	660
query63	214	183	185	183
query64	1672	626	606	606
query65	3257	3162	3185	3162
query66	644	319	302	302
query67	15820	15120	15103	15103
query68	4553	553	543	543
query69	418	255	251	251
query70	1179	1140	1143	1140
query71	388	263	252	252
query72	6454	3969	3878	3878
query73	746	341	337	337
query74	10048	8843	8934	8843
query75	3349	2634	2639	2634
query76	2503	1037	1024	1024
query77	499	259	265	259
query78	10536	9583	9593	9583
query79	8200	572	585	572
query80	1906	408	415	408
query81	538	244	242	242
query82	1285	118	113	113
query83	269	144	136	136
query84	287	76	76	76
query85	1777	293	285	285
query86	482	298	275	275
query87	4487	4148	4186	4148
query88	5734	2377	2361	2361
query89	544	289	290	289
query90	2126	182	178	178
query91	182	158	140	140
query92	68	47	46	46
query93	6405	552	543	543
query94	1002	286	273	273
query95	343	243	242	242
query96	621	291	282	282
query97	3376	3121	3168	3121
query98	220	198	192	192
query99	1700	1292	1327	1292
Total cold run time: 337729 ms
Total hot run time: 193467 ms

@englefly englefly merged commit 7490df8 into apache:branch-3.0 Oct 30, 2024
@englefly englefly deleted the pick41790-3.0 branch October 30, 2024 15:49
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants