Skip to content

Conversation

@sollhui
Copy link
Contributor

@sollhui sollhui commented Feb 20, 2024

Proposed changes

#31095

Further comments

If this is a relatively large or complex change, kick off the discussion at dev@doris.apache.org by explaining why you chose the solution you did and what alternatives you considered, etc...

@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

@sollhui
Copy link
Contributor Author

sollhui commented Feb 20, 2024

run buildall

@github-actions github-actions bot added the area/load Issues or PRs related to all kinds of load label Feb 20, 2024
@doris-robot
Copy link

TPC-H: Total hot run time: 49824 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit afb6faeef6a71619cdde9dfe559a698a43b43038, data reload: false

------ Round 1 ----------------------------------
q1	17667	4400	4363	4363
q2	2113	159	141	141
q3	10360	1925	1958	1925
q4	10107	1278	1308	1278
q5	8385	3914	3994	3914
q6	229	121	125	121
q7	2036	1613	1593	1593
q8	9301	2737	2715	2715
q9	10680	10449	10456	10449
q10	8662	3519	3566	3519
q11	419	239	237	237
q12	475	301	314	301
q13	18366	3910	4008	3910
q14	341	329	336	329
q15	506	454	465	454
q16	692	587	592	587
q17	1124	991	980	980
q18	7280	6961	6731	6731
q19	1680	1546	1519	1519
q20	511	303	299	299
q21	4454	4146	4068	4068
q22	505	391	400	391
Total cold run time: 115893 ms
Total hot run time: 49824 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4296	4292	4318	4292
q2	316	219	235	219
q3	4157	4146	4185	4146
q4	2772	2794	2763	2763
q5	7317	7154	7235	7154
q6	233	120	117	117
q7	3274	2873	2856	2856
q8	4379	4457	4551	4457
q9	17150	17132	16912	16912
q10	4224	4287	4254	4254
q11	781	692	666	666
q12	1032	855	830	830
q13	7265	3737	3753	3737
q14	459	436	423	423
q15	501	450	458	450
q16	748	692	694	692
q17	3854	3847	3880	3847
q18	8757	8678	8878	8678
q19	1730	1708	1673	1673
q20	2412	2159	2105	2105
q21	8425	8453	8498	8453
q22	998	957	904	904
Total cold run time: 85080 ms
Total hot run time: 79628 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 235011 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit afb6faeef6a71619cdde9dfe559a698a43b43038, data reload: false

query1	914	390	380	380
query2	6517	2256	2098	2098
query3	6941	204	198	198
query4	20524	17844	17932	17844
query5	19722	6493	6520	6493
query6	278	207	232	207
query7	4165	296	303	296
query8	258	251	234	234
query9	3139	2675	2623	2623
query10	417	285	303	285
query11	11337	10744	10665	10665
query12	116	76	66	66
query13	5571	655	629	629
query14	17267	13148	13147	13147
query15	361	240	234	234
query16	6427	262	259	259
query17	1732	1453	860	860
query18	2317	403	396	396
query19	211	144	146	144
query20	76	79	73	73
query21	186	97	98	97
query22	5347	5205	5131	5131
query23	32471	31782	31854	31782
query24	7051	6607	6512	6512
query25	507	411	414	411
query26	604	164	151	151
query27	2031	291	292	291
query28	6164	2242	2193	2193
query29	2943	2832	2840	2832
query30	239	158	162	158
query31	906	745	719	719
query32	66	59	59	59
query33	383	251	230	230
query34	857	456	484	456
query35	1092	916	930	916
query36	1559	1451	1652	1451
query37	88	59	56	56
query38	3118	2902	2914	2902
query39	1393	1309	1321	1309
query40	197	95	92	92
query41	34	37	32	32
query42	79	78	82	78
query43	724	611	581	581
query44	1118	720	707	707
query45	233	229	230	229
query46	1238	961	956	956
query47	1702	1982	1666	1666
query48	974	693	672	672
query49	618	372	356	356
query50	876	609	606	606
query51	5573	5389	5425	5389
query52	85	83	72	72
query53	448	316	320	316
query54	2670	2443	2455	2443
query55	86	76	87	76
query56	207	198	205	198
query57	1289	1180	1033	1033
query58	215	202	189	189
query59	3400	3308	3243	3243
query60	206	199	191	191
query61	82	85	81	81
query62	795	534	546	534
query63	475	331	325	325
query64	2552	1508	1286	1286
query65	3632	3573	3562	3562
query66	799	367	367	367
query67	17784	15500	15218	15218
query68	8807	635	648	635
query69	589	348	359	348
query70	1846	1690	1649	1649
query71	407	302	310	302
query72	6468	3433	3428	3428
query73	730	338	308	308
query74	6410	5806	5797	5797
query75	5329	3733	3666	3666
query76	5499	1119	1193	1119
query77	952	242	254	242
query78	32325	50087	44533	44533
query79	15692	643	645	643
query80	5162	378	378	378
query81	574	230	226	226
query82	800	102	97	97
query83	411	138	133	133
query84	259	67	69	67
query85	2646	285	283	283
query86	478	377	389	377
query87	3250	2993	2950	2950
query88	6712	2341	2339	2339
query89	419	285	294	285
query90	2501	208	210	208
query91	165	115	126	115
query92	65	55	50	50
query93	5359	617	568	568
query94	1847	205	202	202
query95	1125	1043	1056	1043
query96	649	324	336	324
query97	6458	6365	6407	6365
query98	197	180	168	168
query99	3948	878	938	878
Total cold run time: 351465 ms
Total hot run time: 235011 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.85 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit afb6faeef6a71619cdde9dfe559a698a43b43038, data reload: false

query1	0.02	0.03	0.02
query2	0.08	0.02	0.02
query3	0.24	0.04	0.05
query4	1.81	0.07	0.07
query5	0.51	0.52	0.52
query6	1.27	0.62	0.62
query7	0.02	0.01	0.01
query8	0.03	0.02	0.02
query9	0.53	0.49	0.47
query10	0.55	0.54	0.53
query11	0.12	0.08	0.08
query12	0.12	0.09	0.09
query13	0.62	0.61	0.60
query14	0.79	0.77	0.78
query15	0.79	0.76	0.77
query16	0.37	0.39	0.36
query17	1.00	1.02	1.00
query18	0.22	0.27	0.24
query19	1.96	1.87	1.85
query20	0.02	0.00	0.01
query21	15.51	0.56	0.54
query22	2.12	2.57	1.65
query23	17.26	1.13	0.85
query24	9.75	1.08	1.51
query25	1.55	0.12	0.11
query26	0.44	0.14	0.13
query27	0.11	0.11	0.10
query28	4.09	0.78	0.71
query29	12.71	2.29	2.33
query30	0.62	0.53	0.52
query31	2.82	0.37	0.39
query32	3.38	0.48	0.50
query33	3.07	3.10	3.06
query34	15.26	4.79	4.80
query35	4.85	4.87	4.86
query36	1.04	1.01	1.03
query37	0.06	0.05	0.04
query38	0.04	0.03	0.02
query39	0.02	0.02	0.01
query40	0.16	0.13	0.13
query41	0.07	0.01	0.01
query42	0.02	0.02	0.01
query43	0.02	0.02	0.01
Total cold run time: 106.04 s
Total hot run time: 30.85 s

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit afb6faeef6a71619cdde9dfe559a698a43b43038 with default session variables
Stream load json:         20 seconds loaded 2358488459 Bytes, about 112 MB/s
Stream load orc:          59 seconds loaded 1101869774 Bytes, about 17 MB/s
Stream load parquet:      32 seconds loaded 861443392 Bytes, about 25 MB/s
Insert into select:       21.4 seconds inserted 10000000 Rows, about 467K ops/s

@xiaokang xiaokang merged commit 5e443c7 into apache:branch-2.0 Feb 20, 2024
mongo360 pushed a commit to mongo360/doris that referenced this pull request Aug 16, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

area/load Issues or PRs related to all kinds of load

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants