Skip to content

Conversation

@yujun777
Copy link
Contributor

@yujun777 yujun777 commented Jun 3, 2024

cherry pick from #35778

@yujun777
Copy link
Contributor Author

yujun777 commented Jun 3, 2024

run buildall

@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@doris-robot
Copy link

TPC-H: Total hot run time: 49603 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit cb95777d2e36c6a2bd4d1f00b9b9e5f0f2974f91, data reload: false

------ Round 1 ----------------------------------
q1	17797	4392	4304	4304
q2	2032	192	148	148
q3	10403	1837	1879	1837
q4	10319	1268	1313	1268
q5	8840	3933	3865	3865
q6	232	122	124	122
q7	2059	1562	1588	1562
q8	9318	2701	2694	2694
q9	10513	10367	10199	10199
q10	8614	3527	3487	3487
q11	423	246	252	246
q12	470	305	309	305
q13	18345	3972	4034	3972
q14	362	328	327	327
q15	495	453	452	452
q16	661	574	590	574
q17	1122	951	957	951
q18	7395	6971	7006	6971
q19	1691	1587	1521	1521
q20	518	332	309	309
q21	4360	4102	4112	4102
q22	504	387	397	387
Total cold run time: 116473 ms
Total hot run time: 49603 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4343	4284	4307	4284
q2	321	248	229	229
q3	4173	4198	4134	4134
q4	2764	2751	2752	2751
q5	7153	7108	7113	7108
q6	234	119	119	119
q7	3214	2903	2809	2809
q8	4429	4443	4464	4443
q9	17002	16740	16893	16740
q10	4226	4317	4323	4317
q11	747	704	693	693
q12	1017	830	861	830
q13	6945	3748	3765	3748
q14	460	430	434	430
q15	505	456	456	456
q16	744	695	689	689
q17	3821	3884	3863	3863
q18	8850	8747	8775	8747
q19	1695	1699	1644	1644
q20	2404	2125	2097	2097
q21	8442	8585	8605	8585
q22	1026	925	921	921
Total cold run time: 84515 ms
Total hot run time: 79637 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 204793 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit cb95777d2e36c6a2bd4d1f00b9b9e5f0f2974f91, data reload: false

query1	932	419	377	377
query2	6526	2555	2657	2555
query3	6916	207	208	207
query4	20049	18226	18064	18064
query5	19724	6475	6567	6475
query6	286	219	227	219
query7	4150	307	319	307
query8	258	259	243	243
query9	3175	2719	2670	2670
query10	419	300	299	299
query11	11346	10758	10766	10758
query12	123	78	77	77
query13	5588	701	683	683
query14	17933	13518	13786	13518
query15	357	220	231	220
query16	6486	290	264	264
query17	1689	1463	880	880
query18	2331	414	415	414
query19	212	151	154	151
query20	78	81	81	81
query21	192	101	103	101
query22	5197	5098	5019	5019
query23	32537	31975	31824	31824
query24	7009	6501	6555	6501
query25	555	442	419	419
query26	525	164	167	164
query27	1827	301	298	298
query28	6128	2344	2320	2320
query29	2811	2747	2889	2747
query30	240	165	169	165
query31	920	741	793	741
query32	74	62	62	62
query33	405	264	257	257
query34	840	486	479	479
query35	1122	929	965	929
query36	1386	1137	1324	1137
query37	91	61	60	60
query38	3119	2921	2966	2921
query39	1384	1325	1316	1316
query40	203	91	95	91
query41	40	38	37	37
query42	83	86	80	80
query43	711	751	723	723
query44	1135	716	724	716
query45	246	238	234	234
query46	1223	977	982	977
query47	1864	1929	1846	1846
query48	992	703	708	703
query49	618	375	386	375
query50	868	578	604	578
query51	4736	4643	4614	4614
query52	88	80	84	80
query53	443	327	316	316
query54	2651	2472	2426	2426
query55	91	72	86	72
query56	242	217	214	214
query57	1176	1185	1207	1185
query58	209	205	213	205
query59	4531	3996	4022	3996
query60	216	215	206	206
query61	100	92	99	92
query62	836	461	591	461
query63	480	354	340	340
query64	2333	1539	1442	1442
query65	3656	3540	3544	3540
query66	857	375	378	375
query67	15857	15681	15718	15681
query68	8964	675	655	655
query69	573	354	349	349
query70	1513	1352	1257	1257
query71	421	324	315	315
query72	6552	3480	3484	3480
query73	743	322	317	317
query74	6306	5839	5825	5825
query75	5339	3768	3822	3768
query76	5411	1136	1127	1127
query77	911	261	268	261
query78	12529	17125	12139	12139
query79	9010	659	678	659
query80	823	422	415	415
query81	500	248	235	235
query82	261	97	98	97
query83	179	140	135	135
query84	264	72	70	70
query85	751	324	313	313
query86	329	288	320	288
query87	3233	3028	3007	3007
query88	4698	2342	2349	2342
query89	352	328	312	312
query90	2694	208	208	208
query91	175	143	140	140
query92	57	54	54	54
query93	1137	566	566	566
query94	1200	211	215	211
query95	1125	1077	1053	1053
query96	638	334	331	331
query97	6510	6331	6427	6331
query98	197	185	171	171
query99	2998	835	888	835
Total cold run time: 307818 ms
Total hot run time: 204793 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.81 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit cb95777d2e36c6a2bd4d1f00b9b9e5f0f2974f91, data reload: false

query1	0.03	0.02	0.02
query2	0.07	0.03	0.02
query3	0.25	0.05	0.06
query4	1.76	0.09	0.08
query5	0.55	0.52	0.53
query6	1.34	0.62	0.62
query7	0.02	0.01	0.01
query8	0.03	0.02	0.02
query9	0.51	0.51	0.48
query10	0.54	0.53	0.56
query11	0.12	0.08	0.09
query12	0.11	0.09	0.10
query13	0.61	0.61	0.61
query14	0.77	0.77	0.79
query15	0.79	0.77	0.76
query16	0.38	0.36	0.36
query17	1.02	1.00	1.02
query18	0.23	0.24	0.24
query19	1.92	1.87	1.83
query20	0.01	0.01	0.01
query21	15.51	0.55	0.56
query22	1.88	2.33	1.65
query23	17.40	1.09	0.94
query24	7.57	1.12	1.26
query25	0.36	0.11	0.05
query26	0.84	0.16	0.15
query27	0.05	0.05	0.04
query28	5.27	0.72	0.78
query29	12.65	2.38	2.18
query30	0.62	0.50	0.53
query31	2.81	0.39	0.38
query32	3.37	0.50	0.50
query33	3.07	3.05	3.07
query34	15.28	4.78	4.78
query35	4.85	4.84	4.86
query36	1.05	1.02	1.01
query37	0.06	0.05	0.05
query38	0.04	0.02	0.02
query39	0.01	0.01	0.01
query40	0.16	0.14	0.14
query41	0.07	0.02	0.01
query42	0.02	0.01	0.01
query43	0.02	0.02	0.01
Total cold run time: 104.02 s
Total hot run time: 30.81 s

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit cb95777d2e36c6a2bd4d1f00b9b9e5f0f2974f91 with default session variables
Stream load json:         20 seconds loaded 2358488459 Bytes, about 112 MB/s
Stream load orc:          59 seconds loaded 1101869774 Bytes, about 17 MB/s
Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select:       21.1 seconds inserted 10000000 Rows, about 473K ops/s

@yujun777 yujun777 closed this Jun 4, 2024
@yujun777 yujun777 deleted the pick_35778_to_upstream_branch-2.0 branch June 4, 2024 03:46
@yujun777 yujun777 reopened this Jun 4, 2024
@yujun777
Copy link
Contributor Author

yujun777 commented Jun 4, 2024

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 49927 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 85b7db13faec8fecc45c9f64927093201939b0a4, data reload: false

------ Round 1 ----------------------------------
q1	17636	4372	4559	4372
q2	2112	154	154	154
q3	10268	1891	1916	1891
q4	10410	1214	1292	1214
q5	8381	3916	3919	3916
q6	256	125	125	125
q7	2027	1590	1593	1590
q8	9514	2735	2705	2705
q9	14078	10457	10488	10457
q10	8633	3546	3482	3482
q11	414	250	249	249
q12	465	299	305	299
q13	18350	3953	4031	3953
q14	346	319	327	319
q15	518	455	472	455
q16	676	575	586	575
q17	1126	927	896	896
q18	7317	6997	6997	6997
q19	1718	1582	1561	1561
q20	546	298	307	298
q21	4455	4157	4041	4041
q22	494	378	396	378
Total cold run time: 119740 ms
Total hot run time: 49927 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4331	4293	4281	4281
q2	321	232	225	225
q3	4165	4179	4128	4128
q4	2739	2742	2749	2742
q5	7171	7218	7177	7177
q6	237	123	122	122
q7	3282	2874	2835	2835
q8	4353	4478	4483	4478
q9	17441	16876	17083	16876
q10	4192	4290	4206	4206
q11	741	663	713	663
q12	1020	869	844	844
q13	7303	3707	3710	3707
q14	469	424	430	424
q15	514	470	456	456
q16	735	681	680	680
q17	3800	3871	3825	3825
q18	8747	8749	8756	8749
q19	1724	1698	1670	1670
q20	2380	2144	2129	2129
q21	8506	8455	8522	8455
q22	1012	915	930	915
Total cold run time: 85183 ms
Total hot run time: 79587 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 203788 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 85b7db13faec8fecc45c9f64927093201939b0a4, data reload: false

query1	938	385	408	385
query2	6527	2810	2507	2507
query3	6922	210	206	206
query4	20026	18118	17947	17947
query5	19769	6470	6625	6470
query6	304	219	248	219
query7	4157	297	303	297
query8	281	242	272	242
query9	3138	2702	2628	2628
query10	417	316	309	309
query11	11262	10721	10729	10721
query12	123	78	75	75
query13	5598	685	666	666
query14	17717	13325	13644	13325
query15	360	224	232	224
query16	6462	296	270	270
query17	1693	1453	910	910
query18	2272	410	409	409
query19	211	152	146	146
query20	81	79	85	79
query21	190	99	103	99
query22	5354	5068	5134	5068
query23	32555	31943	31775	31775
query24	6890	6560	6532	6532
query25	533	429	451	429
query26	530	161	162	161
query27	1878	288	292	288
query28	6163	2352	2289	2289
query29	3016	2716	2816	2716
query30	237	165	167	165
query31	915	745	744	744
query32	70	65	62	62
query33	411	266	257	257
query34	846	460	472	460
query35	1132	935	928	928
query36	1313	1103	1166	1103
query37	94	59	61	59
query38	3064	2907	2908	2907
query39	1365	1338	1320	1320
query40	212	91	93	91
query41	41	37	36	36
query42	84	79	82	79
query43	761	757	640	640
query44	1105	723	720	720
query45	238	231	234	231
query46	1220	983	975	975
query47	1766	1850	1752	1752
query48	983	699	684	684
query49	611	394	369	369
query50	864	646	643	643
query51	4818	4668	4574	4574
query52	99	85	89	85
query53	445	320	309	309
query54	2680	2483	2493	2483
query55	101	77	83	77
query56	239	215	220	215
query57	1268	1097	1078	1078
query58	210	206	207	206
query59	3905	4026	4074	4026
query60	217	217	216	216
query61	102	99	98	98
query62	781	481	558	481
query63	479	328	332	328
query64	2429	1555	1386	1386
query65	3619	3544	3528	3528
query66	809	380	388	380
query67	17148	15763	15598	15598
query68	8582	647	636	636
query69	564	353	350	350
query70	1587	1486	1380	1380
query71	400	306	321	306
query72	6550	3520	3516	3516
query73	732	327	316	316
query74	6297	5863	5938	5863
query75	5470	3748	3749	3748
query76	5279	1056	1204	1056
query77	912	263	259	259
query78	12712	11896	12000	11896
query79	7854	634	622	622
query80	1197	408	394	394
query81	493	238	231	231
query82	1570	96	99	96
query83	175	130	142	130
query84	256	74	74	74
query85	884	326	315	315
query86	346	300	300	300
query87	3233	2980	3094	2980
query88	4996	2316	2308	2308
query89	379	327	301	301
query90	1951	211	212	211
query91	178	143	139	139
query92	61	54	52	52
query93	5258	587	549	549
query94	720	211	215	211
query95	1091	1038	1048	1038
query96	642	329	325	325
query97	6502	6478	6441	6441
query98	185	177	166	166
query99	2967	948	894	894
Total cold run time: 312071 ms
Total hot run time: 203788 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.44 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 85b7db13faec8fecc45c9f64927093201939b0a4, data reload: false

query1	0.02	0.02	0.02
query2	0.07	0.03	0.02
query3	0.25	0.04	0.04
query4	1.80	0.07	0.08
query5	0.54	0.52	0.51
query6	1.24	0.63	0.61
query7	0.01	0.01	0.01
query8	0.04	0.03	0.02
query9	0.52	0.48	0.48
query10	0.55	0.53	0.52
query11	0.12	0.09	0.09
query12	0.11	0.10	0.09
query13	0.62	0.62	0.61
query14	0.79	0.78	0.77
query15	0.77	0.77	0.77
query16	0.37	0.38	0.36
query17	1.00	1.01	1.02
query18	0.21	0.26	0.26
query19	1.92	1.76	1.87
query20	0.02	0.01	0.01
query21	15.46	0.55	0.53
query22	2.16	2.70	1.49
query23	16.79	0.99	1.05
query24	5.87	1.03	0.84
query25	0.35	0.12	0.06
query26	0.64	0.15	0.14
query27	0.05	0.04	0.04
query28	7.38	0.72	0.70
query29	12.80	2.37	2.28
query30	0.62	0.53	0.50
query31	2.84	0.39	0.37
query32	3.40	0.50	0.50
query33	3.07	3.08	3.07
query34	15.28	4.84	4.78
query35	4.88	4.87	4.88
query36	1.09	1.00	1.01
query37	0.06	0.05	0.05
query38	0.04	0.02	0.02
query39	0.02	0.02	0.01
query40	0.15	0.14	0.15
query41	0.06	0.01	0.01
query42	0.02	0.01	0.02
query43	0.03	0.02	0.01
Total cold run time: 104.03 s
Total hot run time: 30.44 s

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit 85b7db13faec8fecc45c9f64927093201939b0a4 with default session variables
Stream load json:         20 seconds loaded 2358488459 Bytes, about 112 MB/s
Stream load orc:          59 seconds loaded 1101869774 Bytes, about 17 MB/s
Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select:       21.2 seconds inserted 10000000 Rows, about 471K ops/s

@dataroaring dataroaring merged commit 5d4be00 into apache:branch-2.0 Jun 5, 2024
mongo360 pushed a commit to mongo360/doris that referenced this pull request Aug 16, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants