Skip to content

Conversation

@yujun777
Copy link
Contributor

@yujun777 yujun777 commented Jun 27, 2024

For a random alg, (max -min) < 5% is too unstable. Make this diff bigger, change it to 30%.

@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@yujun777
Copy link
Contributor Author

run buildall

Copy link
Contributor

@deardeng deardeng left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@github-actions
Copy link
Contributor

PR approved by anyone and no changes requested.

dataroaring
dataroaring previously approved these changes Jun 27, 2024
Copy link
Contributor

@dataroaring dataroaring left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Jun 27, 2024
@github-actions
Copy link
Contributor

PR approved by at least one committer and no changes requested.

@yujun777
Copy link
Contributor Author

run buildall

@github-actions github-actions bot removed the approved Indicates a PR has been approved by one committer. label Jun 27, 2024
@doris-robot
Copy link

TPC-H: Total hot run time: 40177 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 37dbab54fb815b30cb1194949b8421d82571fb53, data reload: false

------ Round 1 ----------------------------------
q1	18045	4436	4424	4424
q2	2641	201	196	196
q3	11014	1280	1155	1155
q4	10805	896	819	819
q5	7543	2786	2648	2648
q6	228	139	138	138
q7	972	607	627	607
q8	9397	2123	2082	2082
q9	8902	6505	6505	6505
q10	8958	3724	3730	3724
q11	462	238	233	233
q12	446	236	223	223
q13	17784	3011	2983	2983
q14	266	219	217	217
q15	512	463	475	463
q16	516	375	370	370
q17	965	588	717	588
q18	7932	7495	7437	7437
q19	6405	1597	1484	1484
q20	665	331	319	319
q21	4911	3217	3258	3217
q22	415	345	349	345
Total cold run time: 119784 ms
Total hot run time: 40177 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4346	4252	4270	4252
q2	380	256	266	256
q3	2968	2710	2725	2710
q4	1877	1611	1606	1606
q5	5249	5304	5300	5300
q6	215	130	128	128
q7	2137	1717	1780	1717
q8	3220	3357	3311	3311
q9	8381	8303	8307	8303
q10	3845	3719	3671	3671
q11	581	492	545	492
q12	812	609	600	600
q13	16609	3046	3028	3028
q14	293	255	255	255
q15	519	481	473	473
q16	478	406	425	406
q17	1775	1477	1460	1460
q18	7558	7540	7437	7437
q19	1757	1575	1508	1508
q20	1987	1800	1791	1791
q21	5068	4660	4676	4660
q22	618	532	552	532
Total cold run time: 70673 ms
Total hot run time: 53896 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 173764 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 37dbab54fb815b30cb1194949b8421d82571fb53, data reload: false

query1	919	381	374	374
query2	6448	2382	2454	2382
query3	6649	206	211	206
query4	18843	17681	17270	17270
query5	4178	480	477	477
query6	258	183	164	164
query7	4603	302	291	291
query8	312	287	300	287
query9	8477	2420	2392	2392
query10	619	303	275	275
query11	10586	10060	10089	10060
query12	135	87	85	85
query13	1635	384	368	368
query14	9857	7254	7760	7254
query15	236	190	185	185
query16	7974	285	276	276
query17	2076	575	544	544
query18	1970	284	280	280
query19	203	162	164	162
query20	94	83	82	82
query21	218	129	127	127
query22	4342	4117	4088	4088
query23	33664	33281	33130	33130
query24	11070	2812	2811	2811
query25	649	382	400	382
query26	1435	157	157	157
query27	2960	316	320	316
query28	7662	2107	2081	2081
query29	975	644	628	628
query30	281	169	162	162
query31	957	725	746	725
query32	100	55	58	55
query33	786	303	308	303
query34	925	482	484	482
query35	768	620	633	620
query36	1083	928	925	925
query37	155	72	72	72
query38	2896	2772	2780	2772
query39	872	806	788	788
query40	213	130	131	130
query41	56	54	58	54
query42	122	100	105	100
query43	606	552	549	549
query44	1204	741	755	741
query45	197	169	169	169
query46	1069	721	757	721
query47	1837	1757	1769	1757
query48	389	313	307	307
query49	1104	426	423	423
query50	775	389	407	389
query51	6803	6762	6714	6714
query52	104	95	95	95
query53	377	301	297	297
query54	896	451	456	451
query55	80	79	77	77
query56	306	284	288	284
query57	1170	1009	1059	1009
query58	261	253	285	253
query59	3324	3502	3228	3228
query60	307	287	281	281
query61	108	90	95	90
query62	669	453	457	453
query63	324	290	290	290
query64	8977	2247	1769	1769
query65	3178	3112	3111	3111
query66	1387	336	327	327
query67	15603	15125	14854	14854
query68	7968	564	565	564
query69	675	469	432	432
query70	1224	1159	1159	1159
query71	512	277	274	274
query72	9259	5547	5241	5241
query73	813	327	326	326
query74	5923	5580	5496	5496
query75	5205	2663	2658	2658
query76	4869	947	936	936
query77	788	343	307	307
query78	10374	9886	9762	9762
query79	7627	523	518	518
query80	992	480	463	463
query81	558	221	227	221
query82	532	109	106	106
query83	340	176	168	168
query84	266	88	88	88
query85	1268	306	270	270
query86	412	305	314	305
query87	3359	3132	3138	3132
query88	4673	2358	2344	2344
query89	537	396	377	377
query90	2011	185	186	185
query91	128	99	100	99
query92	66	54	49	49
query93	5943	525	524	524
query94	1230	188	188	188
query95	397	313	315	313
query96	612	270	261	261
query97	3270	3005	3068	3005
query98	215	198	193	193
query99	1198	847	839	839
Total cold run time: 292560 ms
Total hot run time: 173764 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.27 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 37dbab54fb815b30cb1194949b8421d82571fb53, data reload: false

query1	0.04	0.04	0.03
query2	0.08	0.04	0.04
query3	0.23	0.05	0.04
query4	1.68	0.08	0.07
query5	0.50	0.49	0.48
query6	1.15	0.71	0.73
query7	0.03	0.01	0.01
query8	0.06	0.04	0.04
query9	0.55	0.48	0.49
query10	0.55	0.54	0.55
query11	0.15	0.12	0.11
query12	0.15	0.12	0.12
query13	0.59	0.58	0.60
query14	0.78	0.78	0.78
query15	0.83	0.81	0.83
query16	0.37	0.37	0.35
query17	1.01	1.06	0.97
query18	0.21	0.28	0.23
query19	1.84	1.78	1.85
query20	0.01	0.01	0.01
query21	15.45	0.77	0.66
query22	4.08	6.71	2.62
query23	18.23	1.38	1.25
query24	2.07	0.25	0.22
query25	0.15	0.09	0.08
query26	0.26	0.17	0.18
query27	0.08	0.08	0.08
query28	13.22	1.00	1.00
query29	12.60	3.37	3.31
query30	0.25	0.06	0.07
query31	2.86	0.39	0.40
query32	3.38	0.47	0.47
query33	2.88	2.88	2.92
query34	17.15	4.47	4.38
query35	4.46	4.45	4.47
query36	0.66	0.49	0.48
query37	0.19	0.16	0.16
query38	0.16	0.15	0.14
query39	0.05	0.04	0.03
query40	0.17	0.14	0.15
query41	0.09	0.05	0.04
query42	0.05	0.05	0.04
query43	0.04	0.04	0.04
Total cold run time: 109.34 s
Total hot run time: 31.27 s

@yujun777
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 40385 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit c0f632b01bf80504d986f605b6c4620f4d26b8ea, data reload: false

------ Round 1 ----------------------------------
q1	18218	4402	4355	4355
q2	2831	202	207	202
q3	11048	1149	1136	1136
q4	10584	750	766	750
q5	7843	2678	2650	2650
q6	225	140	140	140
q7	950	611	614	611
q8	9264	2085	2050	2050
q9	8798	6478	6435	6435
q10	8917	3712	3745	3712
q11	458	240	239	239
q12	492	230	226	226
q13	18560	2939	2978	2939
q14	256	231	219	219
q15	542	466	465	465
q16	493	374	371	371
q17	958	614	723	614
q18	7935	7470	7373	7373
q19	7287	1480	1460	1460
q20	650	314	325	314
q21	4968	3784	3922	3784
q22	402	340	345	340
Total cold run time: 121679 ms
Total hot run time: 40385 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4485	4381	4191	4191
q2	371	267	270	267
q3	2979	2791	2696	2696
q4	1855	1630	1593	1593
q5	5245	5290	5248	5248
q6	222	129	128	128
q7	2091	1699	1700	1699
q8	3167	3336	3366	3336
q9	8312	8334	8268	8268
q10	3915	3623	3612	3612
q11	573	511	485	485
q12	801	635	634	634
q13	16776	2996	2975	2975
q14	278	296	260	260
q15	531	479	493	479
q16	483	413	430	413
q17	1759	1491	1462	1462
q18	7713	7561	7359	7359
q19	1717	1561	1582	1561
q20	2027	1777	1769	1769
q21	5368	4735	4776	4735
q22	621	534	560	534
Total cold run time: 71289 ms
Total hot run time: 53704 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 172779 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit c0f632b01bf80504d986f605b6c4620f4d26b8ea, data reload: false

query1	919	383	374	374
query2	6471	2478	2349	2349
query3	6643	205	213	205
query4	18986	17354	17314	17314
query5	4225	460	468	460
query6	270	174	166	166
query7	4610	310	295	295
query8	327	294	307	294
query9	8755	2416	2395	2395
query10	610	288	276	276
query11	10516	10248	9938	9938
query12	135	87	83	83
query13	1645	369	368	368
query14	9494	7665	6787	6787
query15	245	184	190	184
query16	8032	271	260	260
query17	1918	552	520	520
query18	1958	271	266	266
query19	195	150	151	150
query20	89	80	85	80
query21	215	131	124	124
query22	4366	4144	4115	4115
query23	33890	33137	33441	33137
query24	12120	2935	2843	2843
query25	650	351	359	351
query26	1749	151	146	146
query27	2948	309	315	309
query28	7596	2084	2065	2065
query29	1025	621	604	604
query30	266	150	152	150
query31	947	724	757	724
query32	91	50	55	50
query33	788	281	283	281
query34	1172	467	462	462
query35	717	621	635	621
query36	1112	938	922	922
query37	276	70	72	70
query38	2894	2733	2751	2733
query39	865	807	794	794
query40	279	127	127	127
query41	53	50	54	50
query42	122	98	97	97
query43	588	562	545	545
query44	1193	728	727	727
query45	200	159	166	159
query46	1065	700	705	700
query47	1816	1776	1765	1765
query48	381	284	290	284
query49	1195	405	401	401
query50	756	376	378	376
query51	6845	6777	6696	6696
query52	99	89	96	89
query53	360	289	302	289
query54	995	442	435	435
query55	75	71	75	71
query56	280	262	261	261
query57	1139	1066	1073	1066
query58	265	243	264	243
query59	3344	3287	3104	3104
query60	316	282	273	273
query61	95	100	93	93
query62	656	463	450	450
query63	319	292	285	285
query64	9902	2202	1758	1758
query65	3182	3283	3097	3097
query66	1355	326	338	326
query67	15293	14908	14872	14872
query68	6310	553	555	553
query69	601	461	427	427
query70	1234	1020	1105	1020
query71	474	265	272	265
query72	7329	5624	5564	5564
query73	802	327	323	323
query74	5799	5576	5505	5505
query75	3972	2690	2683	2683
query76	4219	947	918	918
query77	651	375	297	297
query78	10430	9876	9748	9748
query79	2112	514	510	510
query80	957	458	469	458
query81	555	218	223	218
query82	845	105	105	105
query83	203	169	173	169
query84	242	88	86	86
query85	1440	294	277	277
query86	460	309	317	309
query87	3285	3064	3110	3064
query88	3471	2349	2327	2327
query89	464	378	382	378
query90	1815	186	191	186
query91	129	100	101	100
query92	61	52	50	50
query93	2178	519	513	513
query94	1152	190	185	185
query95	395	326	316	316
query96	598	272	269	269
query97	3211	3016	3020	3016
query98	219	197	204	197
query99	1197	839	844	839
Total cold run time: 278708 ms
Total hot run time: 172779 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.72 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit c0f632b01bf80504d986f605b6c4620f4d26b8ea, data reload: false

query1	0.04	0.04	0.04
query2	0.08	0.04	0.04
query3	0.22	0.05	0.05
query4	1.67	0.07	0.07
query5	0.50	0.48	0.49
query6	1.13	0.72	0.73
query7	0.03	0.01	0.01
query8	0.05	0.05	0.05
query9	0.56	0.50	0.50
query10	0.56	0.55	0.55
query11	0.14	0.11	0.12
query12	0.14	0.12	0.12
query13	0.59	0.59	0.60
query14	0.78	0.79	0.79
query15	0.85	0.82	0.82
query16	0.35	0.38	0.36
query17	1.01	1.00	1.01
query18	0.22	0.26	0.27
query19	1.87	1.74	1.72
query20	0.01	0.01	0.01
query21	15.44	0.76	0.66
query22	3.90	7.52	1.91
query23	18.28	1.32	1.27
query24	2.12	0.22	0.22
query25	0.16	0.08	0.08
query26	0.28	0.18	0.17
query27	0.08	0.09	0.08
query28	13.23	1.01	1.01
query29	12.66	3.30	3.33
query30	0.25	0.07	0.06
query31	2.88	0.39	0.38
query32	3.28	0.47	0.47
query33	2.88	2.92	2.94
query34	17.07	4.40	4.42
query35	4.53	4.45	4.47
query36	0.65	0.47	0.48
query37	0.19	0.15	0.15
query38	0.15	0.14	0.14
query39	0.04	0.03	0.03
query40	0.19	0.15	0.14
query41	0.10	0.04	0.05
query42	0.06	0.04	0.05
query43	0.05	0.04	0.04
Total cold run time: 109.27 s
Total hot run time: 30.72 s

@yujun777
Copy link
Contributor Author

run p0

3 similar comments
@yujun777
Copy link
Contributor Author

run p0

@yujun777
Copy link
Contributor Author

run p0

@yujun777
Copy link
Contributor Author

run p0

Copy link
Contributor

@dataroaring dataroaring left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@github-actions
Copy link
Contributor

PR approved by at least one committer and no changes requested.

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Jun 27, 2024
@dataroaring dataroaring merged commit 065d65f into apache:master Jun 27, 2024
yujun777 added a commit to yujun777/doris that referenced this pull request Jun 28, 2024
For a random alg, (max -min) < 5% is too unstable. Make this diff
bigger, change it to 30%.
yujun777 added a commit to yujun777/doris that referenced this pull request Jun 28, 2024
For a random alg, (max -min) < 5% is too unstable. Make this diff
bigger, change it to 30%.
dataroaring pushed a commit that referenced this pull request Jun 28, 2024
dataroaring pushed a commit that referenced this pull request Jun 28, 2024
dataroaring pushed a commit that referenced this pull request Jun 28, 2024
For a random alg, (max -min) < 5% is too unstable. Make this diff
bigger, change it to 30%.
mongo360 pushed a commit to mongo360/doris that referenced this pull request Aug 16, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants