Skip to content

Conversation

@w41ter
Copy link
Contributor

@w41ter w41ter commented Jul 22, 2024

delete_if_exists is a temporary solution introduced in #25847, to avoid concurrent testing conflicts.

Cherry-pick #38190

…itory

delete_if_exists is a temporary solution introduced in apache#25847, to avoid
concurrent testing conflicts.

Cherry-pick apache#38190
@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@w41ter
Copy link
Contributor Author

w41ter commented Jul 22, 2024

run buildall

@github-actions github-actions bot added area/planner Issues or PRs related to the query planner kind/test labels Jul 22, 2024
@doris-robot
Copy link

TPC-H: Total hot run time: 49709 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit a07d5e46036519b44537e943353490c23c15603b, data reload: false

------ Round 1 ----------------------------------
q1	17765	4390	4321	4321
q2	2068	167	150	150
q3	10365	1881	1975	1881
q4	10350	1245	1295	1245
q5	8475	3871	3918	3871
q6	240	143	126	126
q7	2032	1584	1620	1584
q8	9292	2793	2695	2695
q9	10712	10350	10288	10288
q10	8713	3512	3468	3468
q11	426	241	255	241
q12	475	305	306	305
q13	18367	3996	4067	3996
q14	357	326	325	325
q15	515	459	452	452
q16	681	573	569	569
q17	1123	974	945	945
q18	7279	6942	6879	6879
q19	1784	1616	1556	1556
q20	562	306	305	305
q21	4457	4069	4070	4069
q22	537	443	438	438
Total cold run time: 116575 ms
Total hot run time: 49709 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4348	4340	4281	4281
q2	323	223	227	223
q3	4244	4177	4194	4177
q4	2767	2749	2769	2749
q5	7154	7042	7053	7042
q6	237	119	118	118
q7	3253	2862	2875	2862
q8	4348	4420	4481	4420
q9	16957	16911	16764	16764
q10	4216	4330	4300	4300
q11	765	709	684	684
q12	1061	913	899	899
q13	6866	3720	3726	3720
q14	435	423	420	420
q15	519	473	459	459
q16	769	701	694	694
q17	3854	3864	3915	3864
q18	8897	8990	8876	8876
q19	1711	1730	1683	1683
q20	2351	2162	2140	2140
q21	8502	8499	8468	8468
q22	1093	982	992	982
Total cold run time: 84670 ms
Total hot run time: 79825 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 205147 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit a07d5e46036519b44537e943353490c23c15603b, data reload: false

query1	937	425	381	381
query2	6526	2829	2710	2710
query3	6917	208	205	205
query4	20194	18020	18003	18003
query5	19716	6503	6579	6503
query6	277	218	235	218
query7	4172	309	328	309
query8	414	411	409	409
query9	3143	2656	2579	2579
query10	420	310	314	310
query11	11282	10616	10672	10616
query12	123	79	74	74
query13	5599	708	699	699
query14	17805	13402	13597	13402
query15	364	249	241	241
query16	6489	289	262	262
query17	1693	1471	894	894
query18	2302	417	425	417
query19	216	152	149	149
query20	82	79	82	79
query21	191	95	92	92
query22	5343	5095	5170	5095
query23	32747	32213	31935	31935
query24	6994	6494	6516	6494
query25	537	425	419	419
query26	527	166	167	166
query27	1826	298	305	298
query28	6102	2351	2310	2310
query29	2779	2799	2892	2799
query30	245	166	166	166
query31	915	790	781	781
query32	69	66	62	62
query33	392	259	264	259
query34	846	497	475	475
query35	1129	970	920	920
query36	1328	1404	1132	1132
query37	91	61	60	60
query38	3053	2909	2926	2909
query39	1395	1330	1311	1311
query40	215	96	101	96
query41	49	45	44	44
query42	84	86	77	77
query43	751	651	705	651
query44	1130	705	718	705
query45	257	236	236	236
query46	1217	995	953	953
query47	1856	1861	1808	1808
query48	1022	728	741	728
query49	611	381	373	373
query50	845	597	568	568
query51	4778	4675	4645	4645
query52	91	80	77	77
query53	449	321	329	321
query54	2682	2441	2454	2441
query55	88	76	96	76
query56	244	228	207	207
query57	1212	1138	1066	1066
query58	219	209	202	202
query59	4089	4295	3922	3922
query60	219	193	214	193
query61	97	93	92	92
query62	802	465	481	465
query63	498	352	348	348
query64	2232	1526	1492	1492
query65	3639	3520	3533	3520
query66	751	369	381	369
query67	15366	17267	16558	16558
query68	8694	652	645	645
query69	569	350	351	350
query70	1551	1345	1306	1306
query71	402	320	315	315
query72	6542	3469	3486	3469
query73	733	321	319	319
query74	6251	5771	5756	5756
query75	4827	3722	3767	3722
query76	4883	1134	1207	1134
query77	693	254	257	254
query78	12431	11831	11680	11680
query79	9158	645	641	641
query80	1325	404	416	404
query81	502	239	236	236
query82	1542	96	96	96
query83	187	133	134	133
query84	258	71	72	71
query85	884	333	330	330
query86	334	304	297	297
query87	3301	3059	3007	3007
query88	4728	2302	2288	2288
query89	463	293	275	275
query90	1939	220	213	213
query91	174	137	142	137
query92	59	54	52	52
query93	6384	568	568	568
query94	751	214	207	207
query95	1123	1069	1074	1069
query96	653	322	323	322
query97	6514	6389	6384	6384
query98	205	174	165	165
query99	2970	996	926	926
Total cold run time: 311703 ms
Total hot run time: 205147 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.01 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit a07d5e46036519b44537e943353490c23c15603b, data reload: false

query1	0.03	0.03	0.02
query2	0.07	0.02	0.02
query3	0.26	0.05	0.05
query4	1.79	0.06	0.07
query5	0.54	0.52	0.51
query6	1.37	0.61	0.61
query7	0.01	0.01	0.01
query8	0.03	0.03	0.02
query9	0.54	0.50	0.49
query10	0.54	0.55	0.53
query11	0.12	0.08	0.08
query12	0.12	0.09	0.08
query13	0.62	0.62	0.61
query14	0.80	0.78	0.77
query15	0.78	0.75	0.76
query16	0.38	0.36	0.36
query17	1.01	1.02	1.00
query18	0.20	0.27	0.24
query19	1.90	1.87	1.85
query20	0.01	0.01	0.01
query21	15.47	0.55	0.56
query22	2.15	2.48	1.59
query23	16.74	1.04	0.95
query24	6.49	1.18	1.24
query25	0.37	0.11	0.05
query26	0.75	0.16	0.17
query27	0.05	0.04	0.03
query28	6.34	0.74	0.75
query29	12.65	2.31	2.35
query30	0.61	0.59	0.59
query31	2.82	0.39	0.38
query32	3.37	0.50	0.49
query33	3.05	3.06	3.10
query34	15.30	4.79	4.78
query35	4.85	4.82	4.84
query36	1.06	1.02	1.01
query37	0.06	0.05	0.04
query38	0.04	0.02	0.02
query39	0.02	0.01	0.01
query40	0.16	0.13	0.14
query41	0.06	0.02	0.01
query42	0.02	0.02	0.02
query43	0.02	0.02	0.02
Total cold run time: 103.57 s
Total hot run time: 31.01 s

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit a07d5e46036519b44537e943353490c23c15603b with default session variables
Stream load json:         20 seconds loaded 2358488459 Bytes, about 112 MB/s
Stream load orc:          58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select:       21.5 seconds inserted 10000000 Rows, about 465K ops/s

@dataroaring dataroaring merged commit f02c8c7 into apache:branch-2.0 Jul 23, 2024
@w41ter w41ter deleted the pick/38190_to_2.0 branch July 23, 2024 06:14
mongo360 pushed a commit to mongo360/doris that referenced this pull request Aug 16, 2024
…itory (apache#38194)

delete_if_exists is a temporary solution introduced in apache#25847, to avoid
concurrent testing conflicts.

Cherry-pick apache#38190
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

area/planner Issues or PRs related to the query planner kind/behavior-changed kind/test

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants