Skip to content

Conversation

@yujun777
Copy link
Contributor

cherry pick from #36893

For a random alg, (max -min) < 5% is too unstable. Make this diff
bigger, change it to 30%.
@yujun777
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@doris-robot
Copy link

TPC-H: Total hot run time: 49804 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit db77243871d513b242ba22402e9996733c2000b5, data reload: false

------ Round 1 ----------------------------------
q1	17982	4377	4315	4315
q2	2061	158	143	143
q3	10272	1898	1943	1898
q4	10362	1262	1301	1262
q5	8501	3861	3869	3861
q6	239	131	127	127
q7	2069	1624	1632	1624
q8	9441	2729	2695	2695
q9	11106	10379	10319	10319
q10	8648	3525	3525	3525
q11	421	242	247	242
q12	466	303	316	303
q13	18338	3962	4016	3962
q14	353	326	330	326
q15	501	451	442	442
q16	671	572	585	572
q17	1127	980	1000	980
q18	7222	6773	6915	6773
q19	1791	1655	1664	1655
q20	539	316	308	308
q21	4471	4108	4037	4037
q22	536	435	450	435
Total cold run time: 117117 ms
Total hot run time: 49804 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4351	4295	4263	4263
q2	326	228	218	218
q3	4201	4157	4163	4157
q4	2743	2752	2754	2752
q5	7176	7093	7059	7059
q6	237	121	116	116
q7	3179	2825	2817	2817
q8	4368	4485	4499	4485
q9	17425	17107	17101	17101
q10	4270	4283	4248	4248
q11	758	736	683	683
q12	1036	860	874	860
q13	7173	3734	3735	3734
q14	457	427	425	425
q15	506	461	444	444
q16	729	684	699	684
q17	3812	3835	3919	3835
q18	8688	8677	8775	8677
q19	1706	1724	1661	1661
q20	2383	2089	2078	2078
q21	8485	8536	8450	8450
q22	995	964	975	964
Total cold run time: 85004 ms
Total hot run time: 79711 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 205300 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit db77243871d513b242ba22402e9996733c2000b5, data reload: false

query1	927	418	389	389
query2	6526	2830	2856	2830
query3	6916	209	208	208
query4	21273	17998	18041	17998
query5	19736	6497	6528	6497
query6	302	238	241	238
query7	4164	304	303	303
query8	424	439	405	405
query9	3110	2661	2607	2607
query10	434	306	294	294
query11	11349	10725	10694	10694
query12	120	79	82	79
query13	5606	697	708	697
query14	18097	13220	13435	13220
query15	373	245	240	240
query16	6538	288	273	273
query17	1510	1471	876	876
query18	2965	415	419	415
query19	696	169	156	156
query20	82	81	83	81
query21	185	101	91	91
query22	5266	5237	5093	5093
query23	32527	32203	32509	32203
query24	7065	6646	6582	6582
query25	588	476	454	454
query26	532	159	161	159
query27	1983	302	311	302
query28	7182	2393	2380	2380
query29	2939	2872	2797	2797
query30	247	169	179	169
query31	1238	751	746	746
query32	70	62	62	62
query33	399	262	250	250
query34	843	484	478	478
query35	1127	982	967	967
query36	1279	1209	1069	1069
query37	91	63	61	61
query38	3131	2959	2918	2918
query39	1360	1327	1321	1321
query40	215	91	95	91
query41	45	48	43	43
query42	91	89	86	86
query43	739	691	679	679
query44	1116	718	713	713
query45	247	240	239	239
query46	1231	963	938	938
query47	1918	1806	1617	1617
query48	1022	722	710	710
query49	623	382	396	382
query50	882	554	628	554
query51	4744	4762	4739	4739
query52	97	76	83	76
query53	451	323	313	313
query54	2647	2449	2438	2438
query55	83	74	84	74
query56	228	225	209	209
query57	1185	1086	1071	1071
query58	222	212	209	209
query59	4051	3914	3718	3718
query60	211	194	208	194
query61	100	97	99	97
query62	835	614	602	602
query63	495	338	340	338
query64	2542	1558	1540	1540
query65	3642	3531	3528	3528
query66	768	389	375	375
query67	18963	16192	17778	16192
query68	8753	653	636	636
query69	568	334	337	334
query70	1624	1546	1539	1539
query71	423	317	312	312
query72	6591	3527	3527	3527
query73	741	327	313	313
query74	6373	5847	6026	5847
query75	5500	3723	3719	3719
query76	5237	1166	1222	1166
query77	911	269	256	256
query78	12730	11586	11734	11586
query79	8455	642	651	642
query80	1438	408	416	408
query81	490	236	239	236
query82	1672	92	96	92
query83	176	135	143	135
query84	259	72	71	71
query85	914	320	325	320
query86	337	313	286	286
query87	3242	3015	2999	2999
query88	5027	2292	2268	2268
query89	397	298	287	287
query90	1943	212	208	208
query91	190	143	145	143
query92	59	55	54	54
query93	5871	564	569	564
query94	714	214	206	206
query95	1106	1041	1052	1041
query96	644	329	321	321
query97	6505	6353	6420	6353
query98	201	175	164	164
query99	2963	900	938	900
Total cold run time: 320647 ms
Total hot run time: 205300 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.9 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit db77243871d513b242ba22402e9996733c2000b5, data reload: false

query1	0.02	0.02	0.02
query2	0.07	0.02	0.02
query3	0.25	0.05	0.05
query4	1.80	0.07	0.06
query5	0.54	0.52	0.51
query6	1.23	0.62	0.68
query7	0.01	0.01	0.02
query8	0.04	0.02	0.03
query9	0.54	0.48	0.48
query10	0.53	0.53	0.53
query11	0.11	0.08	0.09
query12	0.12	0.09	0.08
query13	0.62	0.60	0.62
query14	0.77	0.79	0.80
query15	0.78	0.78	0.76
query16	0.37	0.39	0.37
query17	0.98	1.01	1.02
query18	0.20	0.28	0.22
query19	1.92	1.83	1.90
query20	0.01	0.00	0.01
query21	15.45	0.57	0.56
query22	2.30	2.59	1.62
query23	17.38	1.13	0.92
query24	5.27	1.47	1.10
query25	0.37	0.13	0.05
query26	0.59	0.16	0.15
query27	0.04	0.04	0.04
query28	7.30	0.74	0.75
query29	12.66	2.31	2.33
query30	0.60	0.52	0.50
query31	2.81	0.40	0.37
query32	3.39	0.50	0.49
query33	3.07	3.09	3.12
query34	15.27	4.81	4.79
query35	4.85	4.86	4.87
query36	1.05	1.00	1.01
query37	0.05	0.04	0.05
query38	0.04	0.02	0.02
query39	0.02	0.01	0.02
query40	0.16	0.14	0.14
query41	0.07	0.02	0.01
query42	0.02	0.02	0.01
query43	0.02	0.02	0.02
Total cold run time: 103.69 s
Total hot run time: 30.9 s

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit db77243871d513b242ba22402e9996733c2000b5 with default session variables
Stream load json:         20 seconds loaded 2358488459 Bytes, about 112 MB/s
Stream load orc:          58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select:       21.4 seconds inserted 10000000 Rows, about 467K ops/s

@dataroaring dataroaring merged commit f4a617a into apache:branch-2.0 Jun 28, 2024
mongo360 pushed a commit to mongo360/doris that referenced this pull request Aug 16, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants