Skip to content

Conversation

@feiniaofeiafei
Copy link
Contributor

cherry-pick #37340 to branch-2.0

@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@feiniaofeiafei
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 49465 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 0dcc2783d715b1a4a0452772bb739bc4d07fc3c9, data reload: false

------ Round 1 ----------------------------------
q1	17782	4372	4366	4366
q2	2062	158	145	145
q3	10271	1914	1902	1902
q4	10127	1280	1306	1280
q5	8389	3852	3933	3852
q6	228	150	127	127
q7	2025	1591	1625	1591
q8	9553	2748	2704	2704
q9	13678	10221	10097	10097
q10	8717	3515	3510	3510
q11	410	250	256	250
q12	476	300	309	300
q13	18372	3950	3990	3950
q14	356	338	331	331
q15	519	458	464	458
q16	681	573	584	573
q17	1126	927	887	887
q18	7192	6744	6819	6744
q19	1767	1654	1580	1580
q20	587	304	310	304
q21	4445	4146	4057	4057
q22	520	461	457	457
Total cold run time: 119283 ms
Total hot run time: 49465 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4313	4295	4310	4295
q2	318	228	223	223
q3	4175	4139	4113	4113
q4	2757	2740	2730	2730
q5	7153	7028	7082	7028
q6	240	119	120	119
q7	3227	2889	2846	2846
q8	4388	4476	4527	4476
q9	16895	16750	16599	16599
q10	4238	4260	4257	4257
q11	727	721	706	706
q12	1041	855	883	855
q13	7258	3699	3709	3699
q14	457	426	432	426
q15	509	460	458	458
q16	754	685	676	676
q17	3852	3908	3798	3798
q18	8770	8922	8887	8887
q19	1744	1707	1669	1669
q20	2308	2126	2092	2092
q21	8585	8362	8357	8357
q22	1089	975	1028	975
Total cold run time: 84798 ms
Total hot run time: 79284 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 204787 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 0dcc2783d715b1a4a0452772bb739bc4d07fc3c9, data reload: false

query1	927	392	412	392
query2	6549	2893	2540	2540
query3	6932	208	204	204
query4	20282	18117	18111	18111
query5	19724	6604	6551	6551
query6	290	218	241	218
query7	4160	316	317	316
query8	442	402	467	402
query9	3159	2700	2624	2624
query10	425	294	308	294
query11	11271	10679	10670	10670
query12	126	76	78	76
query13	5598	704	699	699
query14	17955	13411	14012	13411
query15	369	253	249	249
query16	6452	278	269	269
query17	1706	1449	880	880
query18	2319	406	415	406
query19	214	149	155	149
query20	79	81	81	81
query21	192	99	92	92
query22	5224	5020	4966	4966
query23	32621	32072	32059	32059
query24	6993	6575	6491	6491
query25	544	449	446	446
query26	530	167	159	159
query27	1902	296	290	290
query28	6136	2376	2350	2350
query29	2884	2682	2762	2682
query30	246	172	171	171
query31	906	739	752	739
query32	69	69	64	64
query33	410	254	258	254
query34	833	485	478	478
query35	1112	892	939	892
query36	1319	1138	1187	1138
query37	90	61	63	61
query38	3157	2970	2937	2937
query39	1377	1345	1324	1324
query40	206	96	98	96
query41	47	49	45	45
query42	87	88	89	88
query43	684	692	683	683
query44	1147	736	732	732
query45	254	244	238	238
query46	1212	956	986	956
query47	1896	1773	1975	1773
query48	1030	707	706	706
query49	620	378	366	366
query50	859	631	584	584
query51	4835	4667	4686	4667
query52	100	81	85	81
query53	445	329	330	329
query54	2657	2483	2452	2452
query55	84	85	92	85
query56	235	217	222	217
query57	1250	1215	1108	1108
query58	228	205	206	205
query59	4086	4189	4103	4103
query60	210	189	201	189
query61	98	93	94	93
query62	836	463	505	463
query63	489	337	341	337
query64	2559	1534	1455	1455
query65	3591	3566	3560	3560
query66	818	392	381	381
query67	15782	15636	15709	15636
query68	9770	647	662	647
query69	592	350	341	341
query70	1779	1495	1413	1413
query71	431	294	312	294
query72	6504	3489	3474	3474
query73	721	322	320	320
query74	6354	5868	5860	5860
query75	5404	3676	3635	3635
query76	6177	1142	1145	1142
query77	1002	259	257	257
query78	12504	11877	12116	11877
query79	7727	639	646	639
query80	1195	404	407	404
query81	500	239	235	235
query82	1562	99	100	99
query83	178	137	132	132
query84	259	72	73	72
query85	889	325	335	325
query86	342	294	337	294
query87	3227	3019	3028	3019
query88	4724	2371	2352	2352
query89	383	290	308	290
query90	1945	209	211	209
query91	181	141	139	139
query92	58	54	54	54
query93	4948	579	559	559
query94	703	210	211	210
query95	1112	1061	1053	1053
query96	703	333	334	333
query97	6460	6402	6343	6343
query98	193	174	172	172
query99	2825	831	857	831
Total cold run time: 313221 ms
Total hot run time: 204787 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.41 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 0dcc2783d715b1a4a0452772bb739bc4d07fc3c9, data reload: false

query1	0.03	0.02	0.02
query2	0.06	0.03	0.02
query3	0.25	0.06	0.05
query4	1.79	0.07	0.07
query5	0.53	0.52	0.51
query6	1.26	0.62	0.61
query7	0.01	0.01	0.01
query8	0.03	0.03	0.02
query9	0.53	0.48	0.48
query10	0.55	0.53	0.53
query11	0.12	0.09	0.09
query12	0.12	0.08	0.09
query13	0.62	0.61	0.62
query14	0.77	0.77	0.80
query15	0.78	0.76	0.76
query16	0.37	0.39	0.37
query17	1.04	1.01	1.00
query18	0.22	0.28	0.24
query19	1.92	1.86	1.85
query20	0.01	0.02	0.01
query21	15.47	0.57	0.56
query22	2.06	1.94	1.36
query23	16.55	1.12	0.87
query24	5.85	1.08	1.07
query25	0.38	0.11	0.06
query26	0.64	0.15	0.15
query27	0.04	0.04	0.03
query28	7.52	0.76	0.72
query29	12.62	2.12	2.20
query30	0.53	0.54	0.54
query31	2.82	0.39	0.37
query32	3.39	0.50	0.49
query33	3.08	3.10	3.09
query34	15.26	4.80	4.77
query35	4.87	4.85	4.85
query36	1.05	1.01	1.01
query37	0.06	0.04	0.05
query38	0.03	0.02	0.03
query39	0.02	0.02	0.01
query40	0.16	0.14	0.14
query41	0.07	0.02	0.01
query42	0.02	0.02	0.01
query43	0.03	0.02	0.02
Total cold run time: 103.53 s
Total hot run time: 30.41 s

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit 0dcc2783d715b1a4a0452772bb739bc4d07fc3c9 with default session variables
Stream load json:         20 seconds loaded 2358488459 Bytes, about 112 MB/s
Stream load orc:          59 seconds loaded 1101869774 Bytes, about 17 MB/s
Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select:       21.0 seconds inserted 10000000 Rows, about 476K ops/s

@feiniaofeiafei
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 49917 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 3c1e7f8a00cffdf5b203419681a0b020449accea, data reload: false

------ Round 1 ----------------------------------
q1	17791	4400	4353	4353
q2	2071	153	142	142
q3	10271	1916	1978	1916
q4	10121	1225	1337	1225
q5	8396	3934	3946	3934
q6	269	124	125	124
q7	2018	1617	1618	1617
q8	9569	2744	2708	2708
q9	13739	10330	10248	10248
q10	8664	3547	3536	3536
q11	418	250	255	250
q12	483	306	304	304
q13	18340	3950	3996	3950
q14	357	321	323	321
q15	505	456	450	450
q16	673	566	571	566
q17	1133	960	908	908
q18	7183	6886	6864	6864
q19	1823	1666	1656	1656
q20	509	301	299	299
q21	4433	4205	4091	4091
q22	551	459	455	455
Total cold run time: 119317 ms
Total hot run time: 49917 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4339	4295	4287	4287
q2	322	232	220	220
q3	4165	4166	4128	4128
q4	2746	2749	2747	2747
q5	7193	7067	7102	7067
q6	239	119	119	119
q7	3218	2851	2829	2829
q8	4369	4497	4470	4470
q9	16899	16748	16734	16734
q10	4212	4247	4311	4247
q11	786	715	687	687
q12	1047	857	858	857
q13	7174	3729	3725	3725
q14	453	426	433	426
q15	497	462	465	462
q16	736	680	672	672
q17	3840	3898	3880	3880
q18	8798	8782	8828	8782
q19	1739	1695	1702	1695
q20	2348	2163	2117	2117
q21	8504	8505	8565	8505
q22	1117	993	1010	993
Total cold run time: 84741 ms
Total hot run time: 79649 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 203558 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 3c1e7f8a00cffdf5b203419681a0b020449accea, data reload: false

query1	915	384	437	384
query2	6549	2770	2755	2755
query3	6923	206	201	201
query4	21530	17858	17964	17858
query5	19742	6538	6606	6538
query6	314	213	230	213
query7	4167	292	308	292
query8	441	446	381	381
query9	3178	2699	2641	2641
query10	441	310	308	308
query11	11420	10834	10815	10815
query12	121	79	72	72
query13	5601	694	706	694
query14	17759	13908	13713	13713
query15	359	268	235	235
query16	6434	279	261	261
query17	1716	1446	877	877
query18	2305	408	415	408
query19	207	153	149	149
query20	75	79	80	79
query21	194	97	98	97
query22	5316	5093	5131	5093
query23	32608	31956	31894	31894
query24	6984	6508	6498	6498
query25	510	436	424	424
query26	528	167	159	159
query27	1899	292	296	292
query28	6151	2356	2317	2317
query29	2837	2694	2771	2694
query30	242	166	168	166
query31	921	725	743	725
query32	67	64	61	61
query33	401	251	257	251
query34	845	474	459	459
query35	1118	950	936	936
query36	1337	1147	1183	1147
query37	87	61	60	60
query38	3064	2922	2967	2922
query39	1359	1341	1318	1318
query40	200	96	95	95
query41	47	44	45	44
query42	89	83	84	83
query43	687	660	676	660
query44	1137	734	731	731
query45	244	241	237	237
query46	1220	956	973	956
query47	1817	1675	1763	1675
query48	1008	725	686	686
query49	622	368	374	368
query50	854	597	591	591
query51	4707	4651	4674	4651
query52	105	85	89	85
query53	455	333	313	313
query54	2651	2432	2458	2432
query55	92	78	80	78
query56	230	224	185	185
query57	1193	1173	1156	1156
query58	221	216	201	201
query59	4306	3795	4019	3795
query60	218	202	211	202
query61	99	93	94	93
query62	834	455	446	446
query63	479	347	337	337
query64	2478	1576	1425	1425
query65	3610	3532	3583	3532
query66	781	378	370	370
query67	16413	16007	15443	15443
query68	8986	658	648	648
query69	574	337	384	337
query70	1642	1241	1388	1241
query71	413	306	317	306
query72	6508	3527	3470	3470
query73	737	331	325	325
query74	6366	5958	5886	5886
query75	5442	3641	3657	3641
query76	5544	1140	1205	1140
query77	933	266	256	256
query78	12708	11495	11569	11495
query79	9971	657	633	633
query80	1637	394	391	391
query81	494	229	233	229
query82	1579	95	108	95
query83	179	137	133	133
query84	265	71	73	71
query85	892	332	326	326
query86	323	293	297	293
query87	3240	2991	3059	2991
query88	5018	2326	2332	2326
query89	481	299	271	271
query90	1958	219	209	209
query91	176	151	137	137
query92	58	58	52	52
query93	6915	616	574	574
query94	711	209	211	209
query95	1104	1054	1043	1043
query96	656	333	328	328
query97	6446	6276	6383	6276
query98	206	185	168	168
query99	3062	864	801	801
Total cold run time: 318686 ms
Total hot run time: 203558 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.55 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 3c1e7f8a00cffdf5b203419681a0b020449accea, data reload: false

query1	0.02	0.02	0.02
query2	0.07	0.03	0.02
query3	0.25	0.05	0.05
query4	1.79	0.07	0.06
query5	0.53	0.53	0.52
query6	1.31	0.60	0.60
query7	0.02	0.01	0.01
query8	0.04	0.03	0.03
query9	0.53	0.48	0.48
query10	0.55	0.54	0.54
query11	0.12	0.09	0.09
query12	0.11	0.09	0.09
query13	0.63	0.62	0.62
query14	0.78	0.77	0.80
query15	0.78	0.77	0.75
query16	0.40	0.36	0.40
query17	1.02	1.00	1.04
query18	0.22	0.27	0.26
query19	1.93	1.83	1.86
query20	0.02	0.01	0.01
query21	15.51	0.55	0.56
query22	2.36	1.94	1.46
query23	16.77	1.02	0.93
query24	7.12	1.06	1.36
query25	0.42	0.11	0.04
query26	0.76	0.17	0.15
query27	0.05	0.05	0.03
query28	5.64	0.79	0.76
query29	12.66	2.36	2.22
query30	0.58	0.49	0.51
query31	2.80	0.39	0.37
query32	3.36	0.49	0.50
query33	3.09	3.03	3.08
query34	15.25	4.81	4.75
query35	4.86	4.84	4.83
query36	1.05	1.02	1.03
query37	0.06	0.04	0.04
query38	0.03	0.02	0.02
query39	0.02	0.02	0.02
query40	0.17	0.14	0.14
query41	0.07	0.01	0.01
query42	0.02	0.01	0.02
query43	0.02	0.02	0.02
Total cold run time: 103.79 s
Total hot run time: 30.55 s

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit 3c1e7f8a00cffdf5b203419681a0b020449accea with default session variables
Stream load json:         20 seconds loaded 2358488459 Bytes, about 112 MB/s
Stream load orc:          59 seconds loaded 1101869774 Bytes, about 17 MB/s
Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select:       21.2 seconds inserted 10000000 Rows, about 471K ops/s

@morrySnow morrySnow merged commit 64f7fec into apache:branch-2.0 Jul 12, 2024
mongo360 pushed a commit to mongo360/doris that referenced this pull request Aug 16, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants