Skip to content

Conversation

@w41ter
Copy link
Contributor

@w41ter w41ter commented Jul 25, 2024

Cherry-pick #38321

@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@w41ter
Copy link
Contributor Author

w41ter commented Jul 25, 2024

run buildall

@w41ter w41ter force-pushed the pick/38321_to_2.0 branch from 34ec767 to bf193b6 Compare July 25, 2024 03:12
@w41ter
Copy link
Contributor Author

w41ter commented Jul 25, 2024

run buildall

@w41ter w41ter force-pushed the pick/38321_to_2.0 branch from bf193b6 to 5f61e00 Compare July 25, 2024 09:46
@w41ter
Copy link
Contributor Author

w41ter commented Jul 25, 2024

run buildall

@w41ter w41ter force-pushed the pick/38321_to_2.0 branch from 5f61e00 to b088d41 Compare July 25, 2024 11:13
@w41ter
Copy link
Contributor Author

w41ter commented Jul 25, 2024

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 49682 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit b088d41ef62d73c1cf603353d004ff178ccf424b, data reload: false

------ Round 1 ----------------------------------
q1	17876	4398	4359	4359
q2	2064	158	149	149
q3	10263	1891	1966	1891
q4	10107	1270	1317	1270
q5	8541	3913	3941	3913
q6	232	145	127	127
q7	2044	1625	1599	1599
q8	9519	2737	2689	2689
q9	14361	10428	10228	10228
q10	8639	3550	3504	3504
q11	411	240	256	240
q12	474	300	298	298
q13	18360	3981	4028	3981
q14	350	323	330	323
q15	500	467	458	458
q16	660	580	575	575
q17	1125	971	929	929
q18	7159	6756	6823	6756
q19	1799	1669	1659	1659
q20	571	299	306	299
q21	4393	4205	3995	3995
q22	533	457	440	440
Total cold run time: 119981 ms
Total hot run time: 49682 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4320	4457	4283	4283
q2	320	225	231	225
q3	4173	4125	4154	4125
q4	2749	2732	2746	2732
q5	7148	7095	7093	7093
q6	241	120	120	120
q7	3223	2821	2833	2821
q8	4378	4456	4495	4456
q9	16813	16775	16756	16756
q10	4237	4240	4291	4240
q11	755	673	685	673
q12	1018	851	866	851
q13	7002	3713	3728	3713
q14	454	430	431	430
q15	506	450	454	450
q16	734	683	669	669
q17	3836	3930	3825	3825
q18	8719	8762	8760	8760
q19	1745	1743	1715	1715
q20	2340	2139	2102	2102
q21	8446	8414	8456	8414
q22	1043	993	966	966
Total cold run time: 84200 ms
Total hot run time: 79419 ms

@w41ter
Copy link
Contributor Author

w41ter commented Jul 25, 2024

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 49813 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit c085286016a07c16cc2c686b88b9fa72aed04f1c, data reload: false

------ Round 1 ----------------------------------
q1	18167	4407	4389	4389
q2	2078	154	150	150
q3	10512	1886	1878	1878
q4	10319	1252	1317	1252
q5	8394	3918	3881	3881
q6	235	132	141	132
q7	2026	1600	1603	1600
q8	9545	2736	2717	2717
q9	13985	10260	10272	10260
q10	8647	3547	3506	3506
q11	426	248	247	247
q12	482	310	305	305
q13	18409	3977	4007	3977
q14	359	337	333	333
q15	510	460	457	457
q16	667	581	577	577
q17	1151	962	916	916
q18	7331	6924	6807	6807
q19	1792	1638	1623	1623
q20	532	310	300	300
q21	4402	4174	4055	4055
q22	533	459	451	451
Total cold run time: 120502 ms
Total hot run time: 49813 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4318	4351	4348	4348
q2	326	227	228	227
q3	4192	4195	4126	4126
q4	2749	2741	2737	2737
q5	7128	7176	7048	7048
q6	238	124	123	123
q7	3231	2811	2831	2811
q8	4364	4464	4556	4464
q9	16893	16764	16691	16691
q10	4218	4327	4280	4280
q11	760	689	670	670
q12	1043	862	867	862
q13	7284	3760	3758	3758
q14	441	429	419	419
q15	514	460	446	446
q16	744	682	682	682
q17	3864	3864	3821	3821
q18	8909	8722	8790	8722
q19	1735	1646	1701	1646
q20	2372	2161	2094	2094
q21	8542	8485	8598	8485
q22	1038	986	980	980
Total cold run time: 84903 ms
Total hot run time: 79440 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 203301 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit c085286016a07c16cc2c686b88b9fa72aed04f1c, data reload: false

query1	938	417	380	380
query2	6569	2830	2574	2574
query3	6920	210	208	208
query4	20840	18099	17939	17939
query5	19728	6490	6598	6490
query6	288	220	235	220
query7	4165	297	305	297
query8	447	422	431	422
query9	3136	2716	2650	2650
query10	412	311	320	311
query11	11292	10737	10676	10676
query12	122	80	75	75
query13	5607	697	710	697
query14	17705	13480	13783	13480
query15	363	244	249	244
query16	6474	294	266	266
query17	1720	1461	890	890
query18	2317	424	425	424
query19	214	148	153	148
query20	84	85	86	85
query21	193	92	91	91
query22	5126	5044	4989	4989
query23	32917	32005	32125	32005
query24	7073	6559	6626	6559
query25	512	440	443	440
query26	526	163	163	163
query27	1892	298	301	298
query28	6192	2370	2316	2316
query29	2933	2877	2819	2819
query30	249	170	168	168
query31	943	786	782	782
query32	70	67	62	62
query33	405	258	257	257
query34	848	472	484	472
query35	1157	973	947	947
query36	1321	1376	1046	1046
query37	96	64	64	64
query38	3102	2929	2940	2929
query39	1399	1343	1315	1315
query40	207	97	96	96
query41	46	44	43	43
query42	84	80	84	80
query43	722	667	692	667
query44	1116	713	725	713
query45	250	239	237	237
query46	1231	976	969	969
query47	2005	1749	1775	1749
query48	1011	713	732	713
query49	609	386	365	365
query50	870	634	611	611
query51	4915	4707	4754	4707
query52	100	88	84	84
query53	451	338	319	319
query54	2653	2456	2468	2456
query55	95	76	84	76
query56	239	212	213	212
query57	1270	1167	1097	1097
query58	217	205	206	205
query59	4245	3671	4042	3671
query60	216	190	199	190
query61	114	95	95	95
query62	825	493	492	492
query63	494	349	350	349
query64	2573	1543	1524	1524
query65	3670	3588	3602	3588
query66	815	379	386	379
query67	15709	15867	14757	14757
query68	10304	655	664	655
query69	581	364	354	354
query70	2151	1319	1380	1319
query71	415	315	316	315
query72	6706	3468	3510	3468
query73	741	317	322	317
query74	6339	5826	5943	5826
query75	5333	3687	3735	3687
query76	6815	1166	1210	1166
query77	1173	264	266	264
query78	12624	11880	11677	11677
query79	8479	647	652	647
query80	1202	396	406	396
query81	480	245	229	229
query82	1446	98	99	98
query83	183	139	133	133
query84	261	76	70	70
query85	884	332	331	331
query86	333	287	292	287
query87	3281	3010	3026	3010
query88	4685	2313	2308	2308
query89	481	294	282	282
query90	1995	209	215	209
query91	178	155	145	145
query92	57	53	60	53
query93	6639	559	581	559
query94	702	204	211	204
query95	1089	1056	1061	1056
query96	656	329	321	321
query97	6402	6406	6257	6257
query98	202	183	178	178
query99	3007	853	838	838
Total cold run time: 318871 ms
Total hot run time: 203301 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.63 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit c085286016a07c16cc2c686b88b9fa72aed04f1c, data reload: false

query1	0.02	0.02	0.02
query2	0.07	0.03	0.02
query3	0.25	0.05	0.04
query4	1.81	0.06	0.06
query5	0.54	0.52	0.52
query6	1.23	0.62	0.60
query7	0.01	0.01	0.01
query8	0.03	0.02	0.03
query9	0.53	0.49	0.48
query10	0.52	0.54	0.53
query11	0.12	0.09	0.09
query12	0.12	0.09	0.09
query13	0.62	0.62	0.61
query14	0.77	0.77	0.80
query15	0.78	0.76	0.76
query16	0.36	0.39	0.36
query17	1.00	1.01	1.00
query18	0.23	0.26	0.26
query19	1.93	1.86	1.86
query20	0.02	0.01	0.01
query21	15.47	0.56	0.56
query22	2.16	1.89	1.57
query23	17.36	0.98	0.90
query24	7.08	1.30	0.95
query25	0.35	0.17	0.05
query26	0.68	0.15	0.15
query27	0.04	0.03	0.04
query28	6.14	0.76	0.77
query29	12.60	2.16	2.36
query30	0.62	0.57	0.54
query31	2.80	0.40	0.38
query32	3.35	0.49	0.49
query33	3.09	3.06	3.09
query34	15.26	4.82	4.79
query35	4.86	4.89	4.87
query36	1.08	1.01	1.01
query37	0.06	0.05	0.05
query38	0.04	0.02	0.02
query39	0.02	0.02	0.01
query40	0.16	0.14	0.14
query41	0.08	0.02	0.01
query42	0.03	0.02	0.01
query43	0.02	0.01	0.02
Total cold run time: 104.31 s
Total hot run time: 30.63 s

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit c085286016a07c16cc2c686b88b9fa72aed04f1c with default session variables
Stream load json:         20 seconds loaded 2358488459 Bytes, about 112 MB/s
Stream load orc:          59 seconds loaded 1101869774 Bytes, about 17 MB/s
Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select:       21.1 seconds inserted 10000000 Rows, about 473K ops/s

@w41ter w41ter merged commit f13363a into apache:branch-2.0 Jul 25, 2024
@w41ter w41ter deleted the pick/38321_to_2.0 branch July 25, 2024 12:50
mongo360 pushed a commit to mongo360/doris that referenced this pull request Aug 16, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants