Skip to content

Conversation

@wuwenchi
Copy link
Contributor

Proposed changes

bp: #34856

Further comments

If this is a relatively large or complex change, kick off the discussion at dev@doris.apache.org by explaining why you chose the solution you did and what alternatives you considered, etc...

@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@github-actions github-actions bot added the area/planner Issues or PRs related to the query planner label May 21, 2024
@morningman
Copy link
Contributor

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 49419 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 4644ee5ae4f7817ba8e54e02eb39be7c1e9fdca6, data reload: false

------ Round 1 ----------------------------------
q1	18035	4407	4353	4353
q2	2039	153	146	146
q3	10457	1887	1945	1887
q4	10300	1226	1346	1226
q5	8433	3883	3887	3883
q6	237	125	124	124
q7	2007	1570	1608	1570
q8	9300	2737	2702	2702
q9	10392	10241	10069	10069
q10	8625	3499	3506	3499
q11	423	235	234	234
q12	463	298	295	295
q13	18340	3960	4002	3960
q14	347	329	323	323
q15	515	466	463	463
q16	690	580	578	578
q17	1140	965	952	952
q18	7242	6827	6939	6827
q19	1730	1536	1546	1536
q20	542	326	298	298
q21	4496	4111	4092	4092
q22	479	402	402	402
Total cold run time: 116232 ms
Total hot run time: 49419 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4370	4291	4332	4291
q2	325	226	219	219
q3	4118	4140	4159	4140
q4	2757	2737	2757	2737
q5	7136	7126	7149	7126
q6	232	121	118	118
q7	3182	2840	2849	2840
q8	4378	4437	4467	4437
q9	16923	16779	16675	16675
q10	4265	4227	4247	4227
q11	791	684	666	666
q12	1020	842	865	842
q13	7022	3738	3746	3738
q14	442	422	428	422
q15	504	462	465	462
q16	734	709	685	685
q17	3855	3860	3900	3860
q18	8767	8779	8727	8727
q19	1694	1699	1638	1638
q20	2402	2148	2147	2147
q21	8482	8468	8393	8393
q22	1026	917	946	917
Total cold run time: 84425 ms
Total hot run time: 79307 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 204568 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 4644ee5ae4f7817ba8e54e02eb39be7c1e9fdca6, data reload: false

query1	924	392	379	379
query2	6518	2900	2716	2716
query3	6917	211	206	206
query4	20631	17886	17894	17886
query5	19719	6511	6540	6511
query6	285	214	223	214
query7	4164	309	316	309
query8	279	241	255	241
query9	3225	2751	2646	2646
query10	419	306	296	296
query11	11402	10702	10672	10672
query12	120	77	76	76
query13	5608	692	678	678
query14	17681	13678	13666	13666
query15	362	223	236	223
query16	6476	275	254	254
query17	1732	1453	881	881
query18	2305	408	412	408
query19	212	150	158	150
query20	83	81	81	81
query21	190	96	93	93
query22	5281	5101	4981	4981
query23	32487	31891	32087	31891
query24	6992	6445	6508	6445
query25	507	420	429	420
query26	525	162	163	162
query27	1908	302	297	297
query28	6142	2337	2315	2315
query29	2989	2785	2793	2785
query30	240	164	168	164
query31	901	725	720	720
query32	70	62	59	59
query33	408	251	262	251
query34	857	490	494	490
query35	1126	908	892	892
query36	1332	1153	1207	1153
query37	91	61	62	61
query38	3050	2983	2960	2960
query39	1382	1329	1330	1329
query40	208	99	99	99
query41	39	39	36	36
query42	89	89	81	81
query43	793	730	784	730
query44	1166	722	722	722
query45	247	233	232	232
query46	1227	979	1010	979
query47	1790	1734	1705	1705
query48	1034	733	723	723
query49	620	377	378	377
query50	870	646	587	587
query51	4723	4637	4653	4637
query52	88	85	87	85
query53	444	323	329	323
query54	2688	2469	2456	2456
query55	91	85	88	85
query56	244	209	220	209
query57	1230	1264	1158	1158
query58	199	207	205	205
query59	4422	4129	4246	4129
query60	211	197	216	197
query61	93	90	97	90
query62	825	494	533	494
query63	478	359	339	339
query64	2392	1445	1529	1445
query65	3642	3570	3577	3570
query66	793	402	381	381
query67	15520	15549	16620	15549
query68	8510	656	668	656
query69	578	349	349	349
query70	1618	1561	1592	1561
query71	411	302	311	302
query72	6515	3479	3461	3461
query73	731	325	330	325
query74	6372	5889	5851	5851
query75	5235	3686	3703	3686
query76	5201	1151	1178	1151
query77	875	260	267	260
query78	12492	11547	11858	11547
query79	8928	667	656	656
query80	1368	391	391	391
query81	490	243	235	235
query82	1736	99	96	96
query83	170	136	129	129
query84	270	71	67	67
query85	897	299	305	299
query86	344	301	298	298
query87	3266	3045	3007	3007
query88	5201	2381	2367	2367
query89	399	284	302	284
query90	1931	217	213	213
query91	166	132	135	132
query92	58	52	54	52
query93	5577	576	609	576
query94	731	200	201	200
query95	1127	1063	1076	1063
query96	668	351	346	346
query97	6524	6560	6426	6426
query98	199	176	172	172
query99	2949	861	826	826
Total cold run time: 313243 ms
Total hot run time: 204568 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.37 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 4644ee5ae4f7817ba8e54e02eb39be7c1e9fdca6, data reload: false

query1	0.02	0.02	0.02
query2	0.06	0.03	0.02
query3	0.24	0.05	0.04
query4	1.83	0.07	0.06
query5	0.54	0.52	0.51
query6	1.24	0.61	0.60
query7	0.01	0.01	0.01
query8	0.04	0.02	0.02
query9	0.52	0.46	0.48
query10	0.54	0.53	0.52
query11	0.12	0.09	0.08
query12	0.11	0.08	0.09
query13	0.61	0.62	0.60
query14	0.79	0.79	0.78
query15	0.79	0.76	0.77
query16	0.37	0.37	0.38
query17	1.03	1.03	1.03
query18	0.23	0.23	0.24
query19	1.94	1.85	1.90
query20	0.02	0.01	0.01
query21	15.47	0.55	0.55
query22	2.19	2.80	2.39
query23	17.73	0.84	0.94
query24	6.69	0.88	0.88
query25	0.38	0.11	0.06
query26	0.62	0.16	0.15
query27	0.04	0.04	0.04
query28	6.69	0.74	0.73
query29	12.64	2.38	2.36
query30	0.60	0.53	0.52
query31	2.80	0.39	0.38
query32	3.36	0.50	0.49
query33	3.11	3.09	3.10
query34	15.26	4.82	4.80
query35	4.85	4.84	4.81
query36	1.04	1.01	1.00
query37	0.05	0.04	0.05
query38	0.04	0.02	0.02
query39	0.02	0.02	0.01
query40	0.16	0.13	0.14
query41	0.06	0.01	0.02
query42	0.02	0.01	0.02
query43	0.02	0.01	0.02
Total cold run time: 104.89 s
Total hot run time: 31.37 s

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit 4644ee5ae4f7817ba8e54e02eb39be7c1e9fdca6 with default session variables
Stream load json:         19 seconds loaded 2358488459 Bytes, about 118 MB/s
Stream load orc:          58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select:       21.6 seconds inserted 10000000 Rows, about 462K ops/s

@morningman morningman merged commit 2ef077e into apache:branch-2.0 May 22, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

area/planner Issues or PRs related to the query planner

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants