Skip to content

Conversation

@zddr
Copy link
Contributor

@zddr zddr commented Jul 9, 2024

The fixed issue is the same as #37342

There are significant differences in metadata, so instead of directly picking, errors are ignored to achieve the effect of not affecting FE startup

@zddr
Copy link
Contributor Author

zddr commented Jul 9, 2024

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 50041 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit edc4642c9773a18f12c35ee7d1353265294134bb, data reload: false

------ Round 1 ----------------------------------
q1	17876	4348	4312	4312
q2	2060	157	155	155
q3	10289	1869	1896	1869
q4	10383	1264	1338	1264
q5	8452	3918	3927	3918
q6	250	126	143	126
q7	2039	1600	1621	1600
q8	9311	2727	2694	2694
q9	11005	10633	10419	10419
q10	8690	3502	3525	3502
q11	419	247	239	239
q12	512	306	315	306
q13	18330	3981	4057	3981
q14	372	317	338	317
q15	511	470	460	460
q16	682	579	579	579
q17	1125	963	961	961
q18	7377	6947	6963	6947
q19	1769	1656	1585	1585
q20	549	313	301	301
q21	4438	4083	4111	4083
q22	524	423	455	423
Total cold run time: 116963 ms
Total hot run time: 50041 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4314	4313	4307	4307
q2	324	234	227	227
q3	4162	4150	4171	4150
q4	2745	2729	2732	2729
q5	7142	7092	7063	7063
q6	234	119	122	119
q7	3217	2803	2800	2800
q8	4395	4432	4466	4432
q9	17348	17053	17173	17053
q10	4229	4275	4267	4267
q11	754	691	699	691
q12	1041	852	865	852
q13	6544	3764	3756	3756
q14	457	426	416	416
q15	508	459	460	459
q16	754	684	677	677
q17	3886	3921	3879	3879
q18	8745	8692	8856	8692
q19	1714	1720	1653	1653
q20	2384	2147	2065	2065
q21	8508	8529	8446	8446
q22	1036	1014	967	967
Total cold run time: 84441 ms
Total hot run time: 79700 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 204069 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit edc4642c9773a18f12c35ee7d1353265294134bb, data reload: false

query1	924	432	387	387
query2	6561	2473	2512	2473
query3	6918	202	199	199
query4	19951	18071	18154	18071
query5	19916	6573	6535	6535
query6	332	220	230	220
query7	4528	306	331	306
query8	431	409	388	388
query9	3117	2683	2607	2607
query10	445	298	314	298
query11	11570	10890	10975	10890
query12	118	74	76	74
query13	5765	709	714	709
query14	19179	13864	13941	13864
query15	388	262	258	258
query16	6530	326	277	277
query17	1584	1571	910	910
query18	2339	413	419	413
query19	208	153	151	151
query20	82	76	79	76
query21	195	101	96	96
query22	5314	4882	5032	4882
query23	32634	31911	31810	31810
query24	6753	6556	6514	6514
query25	524	428	423	423
query26	535	166	163	163
query27	1831	309	303	303
query28	6146	2333	2279	2279
query29	3019	2630	2803	2630
query30	248	171	171	171
query31	918	745	725	725
query32	72	62	59	59
query33	404	256	268	256
query34	863	478	488	478
query35	1146	881	1002	881
query36	1246	1043	1259	1043
query37	89	63	61	61
query38	3074	2888	2919	2888
query39	1402	1331	1316	1316
query40	200	100	94	94
query41	47	46	44	44
query42	87	85	90	85
query43	835	675	631	631
query44	1146	735	724	724
query45	252	236	236	236
query46	1240	964	974	964
query47	1838	1767	1692	1692
query48	1024	740	724	724
query49	608	378	373	373
query50	875	602	588	588
query51	4761	4681	4701	4681
query52	91	86	91	86
query53	447	330	318	318
query54	2663	2454	2462	2454
query55	88	89	78	78
query56	234	213	219	213
query57	1145	1200	1095	1095
query58	203	219	211	211
query59	4098	3807	3718	3718
query60	209	194	227	194
query61	97	97	101	97
query62	870	472	481	472
query63	492	342	355	342
query64	2590	1552	1501	1501
query65	3613	3540	3545	3540
query66	770	381	383	381
query67	16702	16893	15486	15486
query68	5788	644	640	640
query69	554	336	365	336
query70	1430	1259	1541	1259
query71	413	306	335	306
query72	6461	3480	3465	3465
query73	740	329	335	329
query74	6269	5889	5812	5812
query75	4369	3821	3791	3791
query76	3373	1166	1198	1166
query77	547	255	263	255
query78	12602	11698	11881	11698
query79	6864	653	657	653
query80	2944	418	414	414
query81	549	240	232	232
query82	1419	106	97	97
query83	223	134	135	134
query84	223	75	75	75
query85	1604	345	336	336
query86	379	301	329	301
query87	3252	3023	3052	3023
query88	4926	2335	2324	2324
query89	355	301	340	301
query90	1780	213	216	213
query91	174	142	140	140
query92	60	56	54	54
query93	2645	577	592	577
query94	1061	213	213	213
query95	1150	1085	1056	1056
query96	645	320	323	320
query97	6578	6456	6409	6409
query98	184	170	171	170
query99	2323	888	864	864
Total cold run time: 306408 ms
Total hot run time: 204069 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.28 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit edc4642c9773a18f12c35ee7d1353265294134bb, data reload: false

query1	0.02	0.02	0.02
query2	0.07	0.02	0.02
query3	0.24	0.05	0.05
query4	1.78	0.06	0.07
query5	0.54	0.52	0.51
query6	1.24	0.63	0.61
query7	0.01	0.01	0.02
query8	0.04	0.03	0.02
query9	0.52	0.49	0.48
query10	0.55	0.52	0.53
query11	0.12	0.08	0.08
query12	0.11	0.08	0.09
query13	0.61	0.61	0.62
query14	0.77	0.79	0.80
query15	0.77	0.77	0.76
query16	0.37	0.38	0.36
query17	1.00	1.01	1.02
query18	0.22	0.25	0.25
query19	1.85	1.86	1.81
query20	0.01	0.02	0.01
query21	15.47	0.56	0.55
query22	2.20	2.51	1.33
query23	16.92	0.99	0.94
query24	4.05	2.90	0.84
query25	0.34	0.11	0.06
query26	0.68	0.16	0.16
query27	0.05	0.04	0.04
query28	7.29	0.75	0.70
query29	12.65	2.22	2.29
query30	0.66	0.49	0.52
query31	2.81	0.39	0.38
query32	3.36	0.50	0.50
query33	3.06	3.10	3.05
query34	15.25	4.84	4.82
query35	4.87	4.87	4.85
query36	1.07	1.02	1.03
query37	0.06	0.05	0.05
query38	0.04	0.02	0.02
query39	0.02	0.01	0.01
query40	0.16	0.14	0.15
query41	0.07	0.02	0.02
query42	0.02	0.02	0.01
query43	0.02	0.02	0.02
Total cold run time: 101.96 s
Total hot run time: 30.28 s

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit edc4642c9773a18f12c35ee7d1353265294134bb with default session variables
Stream load json:         20 seconds loaded 2358488459 Bytes, about 112 MB/s
Stream load orc:          59 seconds loaded 1101869774 Bytes, about 17 MB/s
Stream load parquet:      32 seconds loaded 861443392 Bytes, about 25 MB/s
Insert into select:       21.9 seconds inserted 10000000 Rows, about 456K ops/s

@xiaokang xiaokang merged commit 12e6648 into apache:branch-2.0 Jul 9, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants