Skip to content

Conversation

@xzj7019
Copy link
Contributor

@xzj7019 xzj7019 commented Aug 12, 2024

intro by #38393

Fix the cases whose window function both contains row_number and other types but only the other types contains pushing down filter.

@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@github-actions github-actions bot added the doing label Aug 12, 2024
@xzj7019
Copy link
Contributor Author

xzj7019 commented Aug 12, 2024

run buildall

@github-actions
Copy link
Contributor

PR approved by at least one committer and no changes requested.

@github-actions github-actions bot added approved Indicates a PR has been approved by one committer. reviewed labels Aug 12, 2024
@github-actions
Copy link
Contributor

PR approved by anyone and no changes requested.

@doris-robot
Copy link

TPC-H: Total hot run time: 39590 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 651cd5f0491827da65b660bd41e9641186cec920, data reload: false

------ Round 1 ----------------------------------
q1	18248	4471	4330	4330
q2	2029	211	200	200
q3	11136	996	1166	996
q4	10509	824	749	749
q5	7511	2579	2538	2538
q6	223	137	139	137
q7	982	595	600	595
q8	9226	1935	1957	1935
q9	8798	6611	6564	6564
q10	7034	2163	2205	2163
q11	451	254	254	254
q12	398	227	226	226
q13	18789	3009	3050	3009
q14	286	235	239	235
q15	525	483	511	483
q16	491	413	385	385
q17	1003	665	800	665
q18	8165	7440	7383	7383
q19	6610	1002	965	965
q20	669	330	326	326
q21	5484	4485	4588	4485
q22	1144	1011	967	967
Total cold run time: 119711 ms
Total hot run time: 39590 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4447	4239	4217	4217
q2	364	286	277	277
q3	2923	2781	2782	2781
q4	1984	1728	1744	1728
q5	5555	5536	5452	5452
q6	229	132	140	132
q7	2167	1775	1786	1775
q8	3281	3494	3447	3447
q9	8846	8923	8720	8720
q10	3540	3201	3209	3201
q11	639	532	513	513
q12	813	621	642	621
q13	17410	3151	3209	3151
q14	330	289	298	289
q15	563	493	491	491
q16	523	438	432	432
q17	1863	1546	1544	1544
q18	8337	8186	7903	7903
q19	1822	1544	1676	1544
q20	2354	1866	1869	1866
q21	9220	5312	5263	5263
q22	1107	1040	1056	1040
Total cold run time: 78317 ms
Total hot run time: 56387 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 203183 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 651cd5f0491827da65b660bd41e9641186cec920, data reload: false

query1	1601	1481	1467	1467
query2	6334	1983	1927	1927
query3	13752	8574	286	286
query4	33319	23087	23098	23087
query5	3767	496	484	484
query6	266	180	169	169
query7	3933	294	293	293
query8	244	199	213	199
query9	8426	2477	2479	2477
query10	541	480	477	477
query11	16396	15014	15061	15014
query12	149	95	92	92
query13	1527	377	357	357
query14	10091	7621	7758	7621
query15	265	247	238	238
query16	7448	540	496	496
query17	1284	603	544	544
query18	1882	291	295	291
query19	202	146	142	142
query20	126	115	110	110
query21	214	101	112	101
query22	4529	4430	4321	4321
query23	34387	33712	33673	33673
query24	9927	2553	2477	2477
query25	559	369	378	369
query26	702	152	151	151
query27	2148	273	277	273
query28	5975	2055	2059	2055
query29	789	400	396	396
query30	256	154	143	143
query31	979	767	748	748
query32	94	57	52	52
query33	603	279	274	274
query34	869	452	455	452
query35	945	823	836	823
query36	1084	896	931	896
query37	134	79	77	77
query38	4278	4213	4098	4098
query39	1423	1397	1432	1397
query40	189	112	113	112
query41	41	39	44	39
query42	116	104	95	95
query43	511	475	471	471
query44	1063	733	721	721
query45	239	202	203	202
query46	1084	737	719	719
query47	1834	1752	1733	1733
query48	359	296	293	293
query49	864	434	440	434
query50	809	410	409	409
query51	6732	6770	6620	6620
query52	112	89	89	89
query53	257	189	181	181
query54	776	458	457	457
query55	76	76	79	76
query56	274	248	254	248
query57	1152	1091	1066	1066
query58	230	277	227	227
query59	2885	2745	2702	2702
query60	297	251	255	251
query61	111	96	92	92
query62	793	627	626	626
query63	206	175	177	175
query64	9214	2242	1790	1790
query65	3199	3213	3180	3180
query66	778	341	331	331
query67	15279	15042	14762	14762
query68	4553	539	538	538
query69	395	396	359	359
query70	1191	1076	1051	1051
query71	378	269	267	267
query72	18463	16743	16810	16743
query73	759	326	325	325
query74	9266	8703	8673	8673
query75	3380	2665	2666	2665
query76	2161	1038	946	946
query77	450	314	313	313
query78	10081	8991	9391	8991
query79	1813	525	525	525
query80	1149	545	497	497
query81	609	225	216	216
query82	1079	138	134	134
query83	230	144	146	144
query84	225	76	80	76
query85	1059	306	281	281
query86	359	317	295	295
query87	4737	4538	4576	4538
query88	3267	2486	2499	2486
query89	417	290	278	278
query90	1660	194	193	193
query91	123	98	96	96
query92	58	51	50	50
query93	2309	533	529	529
query94	683	288	299	288
query95	414	262	259	259
query96	611	279	280	279
query97	3246	3053	3061	3053
query98	226	203	200	200
query99	1492	1287	1247	1247
Total cold run time: 307771 ms
Total hot run time: 203183 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.75 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 651cd5f0491827da65b660bd41e9641186cec920, data reload: false

query1	0.04	0.04	0.04
query2	0.08	0.04	0.04
query3	0.23	0.06	0.05
query4	1.66	0.08	0.08
query5	0.50	0.50	0.48
query6	1.13	0.74	0.73
query7	0.02	0.02	0.01
query8	0.05	0.04	0.04
query9	0.55	0.48	0.48
query10	0.55	0.54	0.53
query11	0.16	0.12	0.11
query12	0.15	0.13	0.13
query13	0.59	0.59	0.58
query14	0.77	0.79	0.77
query15	0.87	0.84	0.81
query16	0.35	0.37	0.36
query17	1.04	1.03	1.04
query18	0.22	0.21	0.22
query19	1.90	1.69	1.74
query20	0.01	0.01	0.01
query21	15.40	0.73	0.65
query22	3.93	6.33	3.02
query23	18.32	1.46	1.23
query24	2.11	0.24	0.24
query25	0.15	0.09	0.08
query26	0.29	0.20	0.22
query27	0.46	0.23	0.23
query28	13.16	1.02	1.00
query29	12.93	3.29	3.30
query30	0.24	0.06	0.04
query31	2.88	0.38	0.39
query32	3.28	0.48	0.47
query33	2.90	2.93	2.91
query34	17.18	4.35	4.39
query35	4.34	4.45	4.42
query36	0.64	0.47	0.47
query37	0.18	0.17	0.16
query38	0.15	0.15	0.15
query39	0.05	0.03	0.03
query40	0.15	0.12	0.13
query41	0.09	0.05	0.05
query42	0.05	0.04	0.04
query43	0.05	0.05	0.04
Total cold run time: 109.8 s
Total hot run time: 31.75 s

@morrySnow morrySnow merged commit 139faad into apache:master Aug 13, 2024
wyxxxcat pushed a commit to wyxxxcat/doris that referenced this pull request Aug 14, 2024
…e#39233)

intro by apache#38393

Fix the cases whose window function both contains row_number and other
types but only the other types contains pushing down filter.
dataroaring pushed a commit that referenced this pull request Aug 17, 2024
intro by #38393

Fix the cases whose window function both contains row_number and other
types but only the other types contains pushing down filter.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

approved Indicates a PR has been approved by one committer. dev/3.0.2-merged p0_b reviewed

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants