Skip to content

Conversation

@morrySnow
Copy link
Contributor

pick from master #35571

bug introduced by #18747

getTableInMinidumpCache use wrong way to compare table's qualified name. we remove it temporary since it not use in productive env anymore

pick from master apache#35571

bug introduced by apache#18747

getTableInMinidumpCache use wrong way to compare table's qualified name.
we remove it temporary since it not use in productive env anymore
@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@morrySnow
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 49404 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 11e139fa1252fe65be07f086ef0a27ede378a9dd, data reload: false

------ Round 1 ----------------------------------
q1	17902	4376	4347	4347
q2	2035	190	151	151
q3	10389	1897	1901	1897
q4	10336	1252	1320	1252
q5	8705	3880	3911	3880
q6	232	124	127	124
q7	2051	1593	1610	1593
q8	9289	2704	2699	2699
q9	10589	10302	10056	10056
q10	8639	3487	3503	3487
q11	431	240	253	240
q12	463	301	304	301
q13	18361	3971	4038	3971
q14	348	322	327	322
q15	525	455	457	455
q16	681	588	571	571
q17	1130	965	967	965
q18	7302	6820	6820	6820
q19	1684	1594	1521	1521
q20	525	307	292	292
q21	4415	4087	4065	4065
q22	482	397	395	395
Total cold run time: 116514 ms
Total hot run time: 49404 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4290	4348	4274	4274
q2	321	224	224	224
q3	4183	4156	4098	4098
q4	2745	2741	2755	2741
q5	7139	7088	7040	7040
q6	241	118	123	118
q7	3223	2796	2818	2796
q8	4368	4455	4487	4455
q9	16786	16651	16669	16651
q10	4213	4230	4237	4230
q11	744	690	709	690
q12	1026	843	845	843
q13	7257	3717	3716	3716
q14	458	419	424	419
q15	502	459	457	457
q16	733	683	675	675
q17	3853	3926	3924	3924
q18	8738	8689	8755	8689
q19	1701	1696	1679	1679
q20	2377	2130	2119	2119
q21	8588	8386	8435	8386
q22	1024	967	912	912
Total cold run time: 84510 ms
Total hot run time: 79136 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 203684 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 11e139fa1252fe65be07f086ef0a27ede378a9dd, data reload: false

query1	922	395	382	382
query2	6577	2943	2739	2739
query3	6921	212	209	209
query4	20440	18039	18050	18039
query5	19730	6497	6576	6497
query6	289	226	236	226
query7	4166	304	322	304
query8	253	235	267	235
query9	3077	2700	2590	2590
query10	417	299	299	299
query11	11428	10808	10784	10784
query12	119	76	72	72
query13	5591	697	684	684
query14	17931	13686	13690	13686
query15	364	225	230	225
query16	6486	284	264	264
query17	1703	1464	889	889
query18	2306	414	409	409
query19	210	147	150	147
query20	76	80	84	80
query21	192	94	100	94
query22	5262	5022	5065	5022
query23	32490	31823	31757	31757
query24	6962	6570	6542	6542
query25	541	417	440	417
query26	534	162	161	161
query27	1800	298	301	298
query28	6151	2356	2304	2304
query29	2809	2687	2705	2687
query30	243	166	166	166
query31	908	756	718	718
query32	71	69	60	60
query33	415	275	246	246
query34	859	485	483	483
query35	1123	900	960	900
query36	1618	1405	1335	1335
query37	96	61	61	61
query38	3084	2906	2985	2906
query39	1361	1320	1311	1311
query40	218	98	98	98
query41	41	37	37	37
query42	84	84	79	79
query43	704	706	697	697
query44	1147	718	720	718
query45	243	229	224	224
query46	1228	1003	1010	1003
query47	2012	1852	1738	1738
query48	1036	753	732	732
query49	618	383	371	371
query50	878	659	622	622
query51	4779	4724	4773	4724
query52	88	87	85	85
query53	450	311	317	311
query54	2664	2439	2431	2431
query55	92	75	87	75
query56	244	221	219	219
query57	1169	1194	1065	1065
query58	191	211	210	210
query59	4039	3988	3977	3977
query60	219	195	207	195
query61	95	92	93	92
query62	841	487	476	476
query63	496	339	338	338
query64	2395	1560	1499	1499
query65	3622	3604	3582	3582
query66	780	381	382	381
query67	16645	15973	15008	15008
query68	5639	654	657	654
query69	544	343	350	343
query70	1559	1549	1356	1356
query71	387	304	309	304
query72	6342	3490	3471	3471
query73	725	328	320	320
query74	6284	5896	5844	5844
query75	4410	3584	3699	3584
query76	3311	1151	1223	1151
query77	557	252	256	252
query78	12591	11788	11477	11477
query79	8175	640	658	640
query80	3070	414	397	397
query81	533	234	230	230
query82	1644	107	100	100
query83	273	131	134	131
query84	259	71	74	71
query85	1499	330	318	318
query86	383	300	306	300
query87	3270	2984	3005	2984
query88	5261	2364	2348	2348
query89	380	299	265	265
query90	1717	207	212	207
query91	182	140	151	140
query92	59	54	52	52
query93	4120	547	594	547
query94	899	218	210	210
query95	1100	1047	1048	1047
query96	653	331	328	328
query97	6525	6490	6371	6371
query98	203	174	166	166
query99	3069	861	943	861
Total cold run time: 308166 ms
Total hot run time: 203684 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.96 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 11e139fa1252fe65be07f086ef0a27ede378a9dd, data reload: false

query1	0.02	0.02	0.02
query2	0.07	0.02	0.02
query3	0.25	0.05	0.05
query4	1.79	0.11	0.11
query5	0.54	0.53	0.52
query6	1.27	0.60	0.60
query7	0.02	0.01	0.01
query8	0.03	0.03	0.02
query9	0.52	0.49	0.49
query10	0.55	0.53	0.54
query11	0.12	0.08	0.09
query12	0.12	0.09	0.09
query13	0.62	0.62	0.62
query14	0.78	0.76	0.78
query15	0.80	0.76	0.76
query16	0.36	0.36	0.36
query17	1.02	1.02	1.03
query18	0.23	0.26	0.25
query19	1.92	1.83	1.81
query20	0.01	0.01	0.01
query21	15.44	0.56	0.55
query22	2.16	2.24	1.90
query23	16.92	0.97	0.86
query24	4.74	3.18	1.03
query25	0.35	0.14	0.05
query26	0.70	0.17	0.16
query27	0.04	0.04	0.03
query28	6.36	0.75	0.71
query29	12.65	2.27	2.23
query30	0.55	0.54	0.57
query31	2.82	0.39	0.38
query32	3.37	0.51	0.49
query33	3.04	3.03	3.07
query34	15.26	4.80	4.78
query35	4.86	4.83	4.85
query36	1.06	1.02	1.03
query37	0.06	0.05	0.05
query38	0.03	0.02	0.02
query39	0.02	0.02	0.01
query40	0.17	0.14	0.13
query41	0.07	0.02	0.01
query42	0.02	0.02	0.01
query43	0.03	0.01	0.02
Total cold run time: 101.76 s
Total hot run time: 30.96 s

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit 11e139fa1252fe65be07f086ef0a27ede378a9dd with default session variables
Stream load json:         19 seconds loaded 2358488459 Bytes, about 118 MB/s
Stream load orc:          58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select:       21.3 seconds inserted 10000000 Rows, about 469K ops/s

@morrySnow morrySnow merged commit 0443fc1 into apache:branch-2.0 May 29, 2024
@morrySnow morrySnow deleted the 2.0_35571 branch May 29, 2024 07:29
mongo360 pushed a commit to mongo360/doris that referenced this pull request Aug 16, 2024
pick from master apache#35571

bug introduced by apache#18747

getTableInMinidumpCache use wrong way to compare table's qualified name.
we remove it temporary since it not use in productive env anymore
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants