Skip to content

Conversation

@starocean999
Copy link
Contributor

@starocean999 starocean999 commented May 14, 2024

Proposed changes

pick from master #34833

Further comments

If this is a relatively large or complex change, kick off the discussion at dev@doris.apache.org by explaining why you chose the solution you did and what alternatives you considered, etc...

@starocean999
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@github-actions github-actions bot added area/planner Issues or PRs related to the query planner kind/test labels May 14, 2024
@doris-robot
Copy link

TPC-H: Total hot run time: 50002 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit e0b1ba4687665b78788e7c994d451850930c47bd, data reload: false

------ Round 1 ----------------------------------
q1	17989	4351	4294	4294
q2	2039	152	148	148
q3	10316	1935	1935	1935
q4	10108	1267	1329	1267
q5	8405	3971	3951	3951
q6	233	123	125	123
q7	2020	1646	1623	1623
q8	9329	2732	2729	2729
q9	10684	10342	10353	10342
q10	8647	3521	3481	3481
q11	404	245	252	245
q12	468	298	296	296
q13	18355	3947	4053	3947
q14	351	314	327	314
q15	500	462	449	449
q16	675	581	574	574
q17	1170	990	990	990
q18	7368	6974	6956	6956
q19	1754	1595	1547	1547
q20	548	309	333	309
q21	4414	4179	4103	4103
q22	496	379	406	379
Total cold run time: 116273 ms
Total hot run time: 50002 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4290	4267	4287	4267
q2	323	228	221	221
q3	4157	4168	4173	4168
q4	2753	2728	2733	2728
q5	7150	7099	7100	7099
q6	235	119	119	119
q7	3208	2814	2822	2814
q8	4349	4433	4488	4433
q9	16840	16795	16745	16745
q10	4244	4245	4258	4245
q11	757	677	646	646
q12	1031	849	848	848
q13	7162	3764	3732	3732
q14	454	425	424	424
q15	497	451	457	451
q16	741	672	681	672
q17	3849	3868	3936	3868
q18	8765	8710	8751	8710
q19	1723	1711	1663	1663
q20	2414	2126	2124	2124
q21	8460	8502	8574	8502
q22	1043	956	897	897
Total cold run time: 84445 ms
Total hot run time: 79376 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 202835 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit e0b1ba4687665b78788e7c994d451850930c47bd, data reload: false

query1	927	385	375	375
query2	6529	2889	2662	2662
query3	6917	211	205	205
query4	20210	18039	17928	17928
query5	19711	6450	6532	6450
query6	273	215	234	215
query7	4152	299	305	299
query8	256	250	269	250
query9	3149	2710	2629	2629
query10	409	300	294	294
query11	11396	10709	10851	10709
query12	124	70	73	70
query13	5589	705	667	667
query14	17445	13445	13705	13445
query15	376	225	229	225
query16	6462	267	252	252
query17	1731	1474	874	874
query18	2323	402	405	402
query19	198	142	144	142
query20	77	79	79	79
query21	186	97	92	92
query22	5107	4978	5076	4978
query23	32478	31895	31844	31844
query24	7004	6465	6514	6465
query25	520	440	410	410
query26	525	161	154	154
query27	1893	293	298	293
query28	6223	2351	2325	2325
query29	2850	2770	2785	2770
query30	246	161	161	161
query31	900	724	725	724
query32	69	62	57	57
query33	397	276	245	245
query34	870	462	499	462
query35	1088	912	906	906
query36	1282	1153	1216	1153
query37	89	57	62	57
query38	3055	2957	2921	2921
query39	1359	1317	1297	1297
query40	212	93	94	93
query41	38	35	35	35
query42	89	76	79	76
query43	748	628	693	628
query44	1142	717	712	712
query45	242	227	223	223
query46	1218	958	972	958
query47	1733	1762	1606	1606
query48	1040	727	717	717
query49	627	378	371	371
query50	861	570	584	570
query51	4787	4576	4691	4576
query52	89	85	80	80
query53	451	326	318	318
query54	2640	2455	2470	2455
query55	92	78	79	78
query56	210	217	205	205
query57	1238	1024	1086	1024
query58	215	214	188	188
query59	4209	3964	4354	3964
query60	206	183	198	183
query61	85	88	83	83
query62	831	455	486	455
query63	480	339	336	336
query64	2538	1514	1437	1437
query65	3647	3558	3576	3558
query66	757	367	373	367
query67	15871	15419	15415	15415
query68	9785	646	628	628
query69	566	348	319	319
query70	2010	1501	1444	1444
query71	429	304	310	304
query72	6451	3398	3423	3398
query73	734	324	323	323
query74	6336	5822	5862	5822
query75	5462	3653	3649	3649
query76	6238	1155	1172	1155
query77	1021	261	261	261
query78	12643	11669	11765	11669
query79	7155	636	660	636
query80	1123	395	395	395
query81	486	236	228	228
query82	1653	93	99	93
query83	173	133	127	127
query84	262	69	71	69
query85	870	286	287	286
query86	323	287	288	287
query87	3181	2969	3052	2969
query88	4783	2337	2336	2336
query89	382	317	282	282
query90	1960	209	191	191
query91	170	136	135	135
query92	60	52	49	49
query93	5477	549	552	549
query94	700	209	209	209
query95	1095	1043	1073	1043
query96	631	344	327	327
query97	6463	6427	6363	6363
query98	189	182	181	181
query99	2914	948	911	911
Total cold run time: 312416 ms
Total hot run time: 202835 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.76 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit e0b1ba4687665b78788e7c994d451850930c47bd, data reload: false

query1	0.02	0.02	0.02
query2	0.07	0.02	0.02
query3	0.25	0.04	0.05
query4	1.79	0.06	0.06
query5	0.53	0.52	0.52
query6	1.23	0.61	0.61
query7	0.01	0.02	0.02
query8	0.02	0.02	0.02
query9	0.53	0.46	0.48
query10	0.54	0.53	0.52
query11	0.12	0.09	0.09
query12	0.12	0.09	0.09
query13	0.62	0.61	0.61
query14	0.79	0.77	0.79
query15	0.78	0.77	0.77
query16	0.38	0.35	0.38
query17	1.02	0.99	1.02
query18	0.24	0.25	0.23
query19	1.94	1.84	1.87
query20	0.01	0.01	0.01
query21	15.50	0.55	0.54
query22	2.01	2.03	1.68
query23	16.65	1.01	0.97
query24	4.96	0.89	1.32
query25	0.38	0.10	0.05
query26	0.53	0.15	0.15
query27	0.04	0.03	0.05
query28	8.02	0.76	0.76
query29	12.78	2.34	2.35
query30	0.62	0.54	0.54
query31	2.81	0.39	0.37
query32	3.38	0.50	0.49
query33	3.08	3.08	3.07
query34	15.27	4.76	4.81
query35	4.86	4.84	4.83
query36	1.08	1.02	1.01
query37	0.05	0.05	0.04
query38	0.03	0.02	0.02
query39	0.02	0.01	0.02
query40	0.16	0.14	0.15
query41	0.06	0.02	0.01
query42	0.02	0.02	0.01
query43	0.02	0.02	0.01
Total cold run time: 103.34 s
Total hot run time: 30.76 s

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit e0b1ba4687665b78788e7c994d451850930c47bd with default session variables
Stream load json:         20 seconds loaded 2358488459 Bytes, about 112 MB/s
Stream load orc:          58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select:       21.4 seconds inserted 10000000 Rows, about 467K ops/s

@starocean999 starocean999 marked this pull request as ready for review May 15, 2024 02:01
@starocean999 starocean999 merged commit 5d719b8 into apache:branch-2.0 May 15, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

area/planner Issues or PRs related to the query planner kind/test

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants