Skip to content

Conversation

@w41ter
Copy link
Contributor

@w41ter w41ter commented Jul 22, 2024

delete_if_exists is a temporary solution introduced in #25847, to avoid concurrent testing conflicts.

The docs PR: apache/doris-website#895

…itory

delete_if_exists is a temporary solution introduced in apache#25847, to avoid
concurrent testing conflicts.
@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@w41ter
Copy link
Contributor Author

w41ter commented Jul 22, 2024

run buildall

@github-actions
Copy link
Contributor

PR approved by at least one committer and no changes requested.

@github-actions github-actions bot added approved Indicates a PR has been approved by one committer. reviewed labels Jul 22, 2024
@github-actions
Copy link
Contributor

PR approved by anyone and no changes requested.

@doris-robot
Copy link

TPC-H: Total hot run time: 39950 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit ab0e20fb96f5c4ba0caaff12a5d6e343beda4886, data reload: false

------ Round 1 ----------------------------------
q1	17645	4333	4235	4235
q2	2010	196	184	184
q3	10447	1130	1099	1099
q4	10192	757	794	757
q5	7535	2678	2650	2650
q6	218	136	138	136
q7	943	598	597	597
q8	9220	2052	2073	2052
q9	8754	6579	6560	6560
q10	8859	3769	3762	3762
q11	467	233	236	233
q12	492	226	227	226
q13	17762	2989	3025	2989
q14	281	246	231	231
q15	527	480	486	480
q16	499	381	377	377
q17	957	698	737	698
q18	8069	7530	7481	7481
q19	5547	1391	1377	1377
q20	693	320	346	320
q21	5040	3217	3276	3217
q22	358	289	302	289
Total cold run time: 116515 ms
Total hot run time: 39950 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4401	4408	4247	4247
q2	375	253	265	253
q3	3030	2873	2919	2873
q4	2001	1688	1726	1688
q5	5607	5594	5521	5521
q6	228	134	128	128
q7	2188	1849	1814	1814
q8	3236	3407	3371	3371
q9	8786	8744	8834	8744
q10	4163	3834	3796	3796
q11	593	503	518	503
q12	822	640	644	640
q13	17001	3130	3156	3130
q14	328	282	296	282
q15	519	497	493	493
q16	477	445	431	431
q17	1806	1517	1490	1490
q18	8080	8085	7865	7865
q19	1795	1690	1654	1654
q20	2559	1902	1878	1878
q21	8513	4922	4635	4635
q22	625	511	514	511
Total cold run time: 77133 ms
Total hot run time: 55947 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 175177 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit ab0e20fb96f5c4ba0caaff12a5d6e343beda4886, data reload: false

query1	918	375	369	369
query2	6425	1942	1888	1888
query3	6648	207	216	207
query4	27479	17223	17426	17223
query5	3771	469	505	469
query6	268	190	181	181
query7	4581	281	288	281
query8	245	189	186	186
query9	8499	2458	2429	2429
query10	431	295	276	276
query11	10799	9989	9975	9975
query12	111	87	81	81
query13	1648	374	375	374
query14	10537	7653	7734	7653
query15	225	168	168	168
query16	7709	484	527	484
query17	1587	563	553	553
query18	1956	291	280	280
query19	199	153	152	152
query20	91	82	81	81
query21	205	132	131	131
query22	4298	4165	4083	4083
query23	34208	33601	33487	33487
query24	11058	2875	2912	2875
query25	613	369	397	369
query26	981	148	147	147
query27	2331	278	283	278
query28	6569	2067	2085	2067
query29	893	633	641	633
query30	247	151	156	151
query31	1003	736	779	736
query32	97	57	57	57
query33	772	339	320	320
query34	955	488	487	487
query35	856	752	772	752
query36	1145	999	966	966
query37	141	78	82	78
query38	2950	2856	2867	2856
query39	870	804	799	799
query40	209	120	119	119
query41	46	40	42	40
query42	115	98	101	98
query43	496	469	461	461
query44	1238	739	736	736
query45	185	168	162	162
query46	1083	725	720	720
query47	1860	1760	1764	1760
query48	376	288	289	288
query49	840	407	425	407
query50	781	381	381	381
query51	6723	6721	6623	6623
query52	101	91	87	87
query53	362	284	289	284
query54	880	445	445	445
query55	73	75	71	71
query56	292	268	275	268
query57	1134	1062	1070	1062
query58	230	256	262	256
query59	2831	2675	2641	2641
query60	338	267	297	267
query61	93	95	94	94
query62	762	653	647	647
query63	312	283	287	283
query64	9315	2214	1685	1685
query65	3166	3111	3108	3108
query66	717	323	347	323
query67	15496	15081	15009	15009
query68	4530	536	540	536
query69	530	397	364	364
query70	1194	1146	1182	1146
query71	394	280	283	280
query72	6875	5574	5429	5429
query73	731	321	317	317
query74	6246	5670	5782	5670
query75	3409	2701	2687	2687
query76	2740	933	923	923
query77	487	312	317	312
query78	11145	10391	10782	10391
query79	3336	520	515	515
query80	1151	461	480	461
query81	599	218	216	216
query82	650	138	126	126
query83	280	175	171	171
query84	283	88	88	88
query85	1147	315	301	301
query86	487	315	300	300
query87	3256	3144	3110	3110
query88	4060	2377	2385	2377
query89	479	379	392	379
query90	1785	190	191	190
query91	127	99	102	99
query92	59	51	52	51
query93	3818	511	505	505
query94	1029	285	282	282
query95	407	314	314	314
query96	610	269	268	268
query97	3198	3023	3042	3023
query98	223	200	198	198
query99	1612	1263	1241	1241
Total cold run time: 281250 ms
Total hot run time: 175177 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.77 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit ab0e20fb96f5c4ba0caaff12a5d6e343beda4886, data reload: false

query1	0.04	0.03	0.03
query2	0.08	0.04	0.04
query3	0.23	0.05	0.05
query4	1.68	0.07	0.07
query5	0.50	0.49	0.47
query6	1.12	0.74	0.73
query7	0.02	0.01	0.01
query8	0.05	0.04	0.04
query9	0.56	0.49	0.48
query10	0.54	0.55	0.55
query11	0.15	0.11	0.12
query12	0.14	0.12	0.13
query13	0.59	0.58	0.58
query14	0.75	0.78	0.78
query15	0.85	0.81	0.81
query16	0.34	0.36	0.37
query17	0.97	0.96	1.02
query18	0.23	0.22	0.21
query19	1.82	1.74	1.66
query20	0.01	0.00	0.01
query21	15.41	0.81	0.65
query22	4.38	7.47	2.06
query23	18.28	1.36	1.29
query24	2.12	0.22	0.22
query25	0.15	0.09	0.09
query26	0.30	0.21	0.21
query27	0.45	0.23	0.22
query28	13.29	1.02	1.01
query29	12.63	3.40	3.41
query30	0.25	0.06	0.05
query31	2.90	0.37	0.38
query32	3.26	0.47	0.46
query33	2.88	2.90	2.91
query34	17.02	4.36	4.35
query35	4.48	4.40	4.39
query36	0.65	0.46	0.46
query37	0.18	0.16	0.15
query38	0.16	0.14	0.16
query39	0.04	0.04	0.03
query40	0.14	0.13	0.12
query41	0.09	0.05	0.05
query42	0.05	0.05	0.05
query43	0.05	0.04	0.04
Total cold run time: 109.83 s
Total hot run time: 30.77 s

w41ter added a commit to w41ter/incubator-doris that referenced this pull request Jul 22, 2024
…itory

delete_if_exists is a temporary solution introduced in apache#25847, to avoid
concurrent testing conflicts.

Cherry-pick apache#38190
w41ter added a commit to w41ter/incubator-doris that referenced this pull request Jul 22, 2024
…itory

delete_if_exists is a temporary solution introduced in apache#25847, to avoid
concurrent testing conflicts.

Cherry-pick apache#38190
@w41ter
Copy link
Contributor Author

w41ter commented Jul 22, 2024

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 40178 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 444949a1967f1c5ea60e0609d70f034e404dd003, data reload: false

------ Round 1 ----------------------------------
q1	17705	4778	4322	4322
q2	2027	194	199	194
q3	10498	1158	1135	1135
q4	10198	890	817	817
q5	7612	2751	2662	2662
q6	220	136	135	135
q7	956	601	606	601
q8	9213	2068	2093	2068
q9	8759	6570	6592	6570
q10	8815	3808	3803	3803
q11	464	241	242	241
q12	391	229	223	223
q13	17778	2997	2975	2975
q14	270	240	242	240
q15	523	486	484	484
q16	508	389	379	379
q17	979	651	684	651
q18	8187	7548	7397	7397
q19	7541	1466	1504	1466
q20	683	339	320	320
q21	4928	3213	3246	3213
q22	353	283	282	282
Total cold run time: 118608 ms
Total hot run time: 40178 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4507	4285	4269	4269
q2	378	265	263	263
q3	3074	2950	2946	2946
q4	1974	1768	1734	1734
q5	5615	5550	5512	5512
q6	235	134	134	134
q7	2302	1840	1872	1840
q8	3273	3473	3404	3404
q9	8821	8938	8877	8877
q10	4158	3777	3878	3777
q11	596	508	493	493
q12	828	650	652	650
q13	17174	3131	3195	3131
q14	315	291	283	283
q15	532	494	507	494
q16	479	431	432	431
q17	1828	1532	1528	1528
q18	8218	8200	7900	7900
q19	1755	1495	1665	1495
q20	2126	1875	1855	1855
q21	8465	4753	4962	4753
q22	584	509	508	508
Total cold run time: 77237 ms
Total hot run time: 56277 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 173888 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 444949a1967f1c5ea60e0609d70f034e404dd003, data reload: false

query1	923	373	371	371
query2	6351	2009	1872	1872
query3	6654	210	216	210
query4	28219	17492	17473	17473
query5	3773	479	482	479
query6	265	189	185	185
query7	4607	283	281	281
query8	236	190	193	190
query9	8499	2433	2410	2410
query10	429	296	268	268
query11	11655	10064	10126	10064
query12	115	82	89	82
query13	1633	374	386	374
query14	10125	7508	7515	7508
query15	230	170	173	170
query16	7706	459	471	459
query17	1147	562	538	538
query18	1963	282	290	282
query19	205	157	168	157
query20	94	81	83	81
query21	208	135	133	133
query22	4395	4093	4003	4003
query23	34317	33736	33587	33587
query24	12087	2987	2936	2936
query25	684	398	406	398
query26	1724	155	150	150
query27	2939	282	281	281
query28	7729	2044	2057	2044
query29	1121	654	668	654
query30	257	155	150	150
query31	968	795	746	746
query32	93	57	59	57
query33	851	339	315	315
query34	987	494	505	494
query35	845	754	747	747
query36	1140	966	991	966
query37	292	81	80	80
query38	2988	2854	2816	2816
query39	894	854	844	844
query40	258	126	123	123
query41	48	46	44	44
query42	111	99	99	99
query43	499	464	474	464
query44	1206	713	715	713
query45	190	165	162	162
query46	1087	719	708	708
query47	1876	1761	1772	1761
query48	358	301	284	284
query49	926	397	406	397
query50	783	395	385	385
query51	6803	6691	6517	6517
query52	104	92	90	90
query53	354	282	294	282
query54	900	459	440	440
query55	72	76	71	71
query56	278	292	272	272
query57	1160	1037	1080	1037
query58	247	251	255	251
query59	2941	2739	2795	2739
query60	303	264	284	264
query61	95	94	94	94
query62	782	656	648	648
query63	316	286	284	284
query64	10263	2214	1699	1699
query65	3219	3105	3144	3105
query66	1258	332	328	328
query67	15680	15038	14977	14977
query68	7847	531	536	531
query69	725	448	380	380
query70	1197	1088	1148	1088
query71	522	294	270	270
query72	8681	5829	5310	5310
query73	821	327	321	321
query74	6171	5702	5696	5696
query75	4599	2675	2659	2659
query76	4931	1000	867	867
query77	731	305	305	305
query78	9709	8996	9578	8996
query79	7249	516	518	516
query80	1135	481	462	462
query81	567	223	230	223
query82	593	139	142	139
query83	320	167	166	166
query84	263	88	88	88
query85	1349	308	293	293
query86	397	310	301	301
query87	3299	3203	3125	3125
query88	4164	2465	2461	2461
query89	494	374	372	372
query90	2010	192	195	192
query91	130	100	103	100
query92	61	49	52	49
query93	5699	501	495	495
query94	1218	282	292	282
query95	418	324	363	324
query96	628	273	272	272
query97	3226	3061	3060	3060
query98	209	199	197	197
query99	1575	1255	1295	1255
Total cold run time: 302403 ms
Total hot run time: 173888 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.84 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 444949a1967f1c5ea60e0609d70f034e404dd003, data reload: false

query1	0.05	0.03	0.03
query2	0.08	0.04	0.04
query3	0.23	0.05	0.05
query4	1.74	0.07	0.08
query5	0.51	0.49	0.49
query6	1.12	0.72	0.72
query7	0.02	0.02	0.01
query8	0.05	0.05	0.04
query9	0.55	0.49	0.48
query10	0.53	0.52	0.55
query11	0.15	0.12	0.11
query12	0.15	0.13	0.12
query13	0.61	0.58	0.59
query14	0.77	0.78	0.79
query15	0.85	0.82	0.82
query16	0.36	0.35	0.35
query17	0.98	1.03	0.95
query18	0.24	0.22	0.22
query19	1.84	1.76	1.70
query20	0.02	0.01	0.01
query21	15.42	0.76	0.63
query22	4.21	7.56	2.08
query23	18.28	1.44	1.36
query24	2.17	0.24	0.22
query25	0.17	0.09	0.08
query26	0.30	0.22	0.21
query27	0.46	0.23	0.23
query28	13.17	1.02	1.00
query29	12.57	3.37	3.36
query30	0.25	0.06	0.07
query31	2.85	0.40	0.40
query32	3.27	0.48	0.47
query33	2.96	2.86	2.91
query34	16.96	4.33	4.36
query35	4.44	4.44	4.42
query36	0.65	0.46	0.48
query37	0.20	0.16	0.16
query38	0.15	0.15	0.15
query39	0.05	0.04	0.03
query40	0.14	0.12	0.11
query41	0.09	0.04	0.04
query42	0.05	0.05	0.05
query43	0.04	0.04	0.04
Total cold run time: 109.7 s
Total hot run time: 30.84 s

Copy link
Contributor

@dataroaring dataroaring left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@w41ter w41ter merged commit 10aa083 into apache:master Jul 22, 2024
@w41ter w41ter deleted the remove_delete_if_exists branch July 22, 2024 12:12
dataroaring pushed a commit that referenced this pull request Jul 23, 2024
…itory (#38194)

delete_if_exists is a temporary solution introduced in #25847, to avoid
concurrent testing conflicts.

Cherry-pick #38190
dataroaring pushed a commit that referenced this pull request Jul 23, 2024
…itory (#38192)

delete_if_exists is a temporary solution introduced in #25847, to avoid
concurrent testing conflicts.

Cherry-pick #38190
dataroaring pushed a commit that referenced this pull request Jul 24, 2024
…itory (#38190)

delete_if_exists is a temporary solution introduced in #25847, to avoid
concurrent testing conflicts.
mongo360 pushed a commit to mongo360/doris that referenced this pull request Aug 16, 2024
…itory (apache#38194)

delete_if_exists is a temporary solution introduced in apache#25847, to avoid
concurrent testing conflicts.

Cherry-pick apache#38190
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants