Skip to content

Conversation

@starocean999
Copy link
Contributor

pick from master #34047

Issue Number: close #xxx

Further comments

If this is a relatively large or complex change, kick off the discussion at dev@doris.apache.org by explaining why you chose the solution you did and what alternatives you considered, etc...

@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@starocean999
Copy link
Contributor Author

run buildall

@github-actions github-actions bot added area/planner Issues or PRs related to the query planner kind/test labels Apr 24, 2024
@doris-robot
Copy link

TPC-H: Total hot run time: 50634 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 47acb6c3d3697e0b6b1134838b0638bc9116c9f3, data reload: false

------ Round 1 ----------------------------------
q1	18345	4370	4322	4322
q2	2038	151	142	142
q3	10465	1899	1970	1899
q4	10313	1275	1306	1275
q5	8476	3930	4015	3930
q6	228	125	123	123
q7	1997	1586	1607	1586
q8	9619	2713	2724	2713
q9	11050	10699	10662	10662
q10	8663	3555	3533	3533
q11	425	243	250	243
q12	464	298	314	298
q13	18877	3988	4027	3988
q14	349	343	329	329
q15	502	467	453	453
q16	722	600	582	582
q17	1121	969	946	946
q18	7604	7220	7244	7220
q19	1759	1581	1537	1537
q20	561	314	325	314
q21	4491	4210	4135	4135
q22	527	404	412	404
Total cold run time: 118596 ms
Total hot run time: 50634 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4415	4416	4467	4416
q2	327	233	240	233
q3	4169	4120	4140	4120
q4	2740	2723	2750	2723
q5	7224	7189	7109	7109
q6	236	119	118	118
q7	3240	2899	2831	2831
q8	4304	4456	4417	4417
q9	17485	17404	17214	17214
q10	4203	4276	4368	4276
q11	740	663	691	663
q12	1028	845	839	839
q13	7300	3696	3744	3696
q14	456	417	416	416
q15	500	455	454	454
q16	754	693	698	693
q17	3784	3809	3856	3809
q18	8815	8728	8776	8728
q19	1711	1705	1663	1663
q20	2369	2126	2097	2097
q21	8424	8504	8454	8454
q22	1050	946	975	946
Total cold run time: 85274 ms
Total hot run time: 79915 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 202494 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 47acb6c3d3697e0b6b1134838b0638bc9116c9f3, data reload: false

query1	903	393	379	379
query2	6526	2908	2645	2645
query3	6914	195	191	191
query4	20222	17898	17995	17898
query5	19733	6487	6438	6438
query6	290	221	236	221
query7	4161	303	305	303
query8	253	246	254	246
query9	3112	2685	2601	2601
query10	412	292	299	292
query11	11315	10556	10715	10556
query12	121	72	72	72
query13	5583	696	686	686
query14	17838	13358	13824	13358
query15	355	230	228	228
query16	6456	278	254	254
query17	1737	1463	853	853
query18	2329	403	398	398
query19	208	143	153	143
query20	75	75	71	71
query21	182	93	94	93
query22	5073	4997	5005	4997
query23	32384	31714	31752	31714
query24	7046	6535	6571	6535
query25	522	422	410	410
query26	525	159	157	157
query27	1909	299	301	299
query28	6266	2355	2331	2331
query29	2837	2717	2868	2717
query30	244	162	171	162
query31	915	737	758	737
query32	66	61	59	59
query33	400	253	253	253
query34	846	461	473	461
query35	1131	924	929	924
query36	1258	1090	1209	1090
query37	91	64	62	62
query38	3079	2918	2906	2906
query39	1386	1313	1309	1309
query40	207	98	96	96
query41	37	38	34	34
query42	79	86	80	80
query43	780	720	631	631
query44	1120	742	738	738
query45	244	225	232	225
query46	1251	970	986	970
query47	1748	1681	1707	1681
query48	1023	711	701	701
query49	607	366	355	355
query50	866	619	618	618
query51	4717	4651	4680	4651
query52	88	73	76	73
query53	435	312	311	311
query54	2643	2454	2476	2454
query55	85	82	78	78
query56	219	189	182	182
query57	1168	1049	1146	1049
query58	221	208	194	194
query59	4132	4002	3779	3779
query60	208	187	204	187
query61	93	84	83	83
query62	832	479	472	472
query63	468	322	333	322
query64	2515	1554	1415	1415
query65	3602	3524	3527	3524
query66	776	364	388	364
query67	16005	15963	15330	15330
query68	9468	689	684	684
query69	585	349	357	349
query70	1722	1418	1344	1344
query71	417	320	302	302
query72	6478	3437	3411	3411
query73	736	320	321	320
query74	6297	5777	5777	5777
query75	5415	3764	3776	3764
query76	5962	1145	1202	1145
query77	1007	257	253	253
query78	12771	11713	11692	11692
query79	8217	655	644	644
query80	1347	397	396	396
query81	490	234	230	230
query82	1634	107	98	98
query83	169	133	135	133
query84	257	69	72	69
query85	853	298	293	293
query86	328	299	288	288
query87	3227	3045	3007	3007
query88	4819	2329	2360	2329
query89	415	289	293	289
query90	1957	216	213	213
query91	186	132	146	132
query92	55	47	48	47
query93	6374	598	572	572
query94	700	210	197	197
query95	1130	1070	1045	1045
query96	648	331	326	326
query97	6564	6416	6451	6416
query98	188	176	171	171
query99	2944	912	956	912
Total cold run time: 314232 ms
Total hot run time: 202494 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.59 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 47acb6c3d3697e0b6b1134838b0638bc9116c9f3, data reload: false

query1	0.02	0.01	0.02
query2	0.07	0.02	0.02
query3	0.25	0.05	0.06
query4	1.78	0.06	0.06
query5	0.54	0.53	0.52
query6	1.26	0.62	0.63
query7	0.02	0.01	0.02
query8	0.03	0.02	0.03
query9	0.53	0.49	0.48
query10	0.55	0.53	0.54
query11	0.13	0.08	0.09
query12	0.12	0.08	0.09
query13	0.63	0.61	0.61
query14	0.78	0.81	0.78
query15	0.79	0.75	0.77
query16	0.37	0.37	0.37
query17	1.00	1.01	1.02
query18	0.21	0.27	0.25
query19	1.87	1.86	1.79
query20	0.02	0.01	0.01
query21	15.46	0.57	0.55
query22	2.41	2.86	1.34
query23	16.91	1.14	1.00
query24	4.25	5.38	0.92
query25	0.42	0.11	0.06
query26	0.79	0.15	0.15
query27	0.05	0.04	0.04
query28	4.71	0.78	0.74
query29	12.61	2.37	2.36
query30	0.58	0.54	0.52
query31	2.81	0.39	0.37
query32	3.40	0.49	0.49
query33	3.05	3.08	3.14
query34	15.27	4.82	4.83
query35	4.88	4.84	4.85
query36	1.08	1.02	1.01
query37	0.06	0.05	0.05
query38	0.04	0.02	0.02
query39	0.02	0.01	0.01
query40	0.16	0.14	0.14
query41	0.07	0.01	0.01
query42	0.02	0.02	0.01
query43	0.02	0.01	0.02
Total cold run time: 100.04 s
Total hot run time: 30.59 s

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit 47acb6c3d3697e0b6b1134838b0638bc9116c9f3 with default session variables
Stream load json:         20 seconds loaded 2358488459 Bytes, about 112 MB/s
Stream load orc:          58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet:      32 seconds loaded 861443392 Bytes, about 25 MB/s
Insert into select:       21.4 seconds inserted 10000000 Rows, about 467K ops/s

@starocean999 starocean999 merged commit a8120e9 into apache:branch-2.0 Apr 26, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

area/planner Issues or PRs related to the query planner kind/test

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants