Skip to content

Conversation

@Jibing-Li
Copy link
Contributor

Deencapsulation.getField sometime doesn't work as expected, which may cause FE unit test timeout. Add get function in source code to make it easier.
backport: #36456

…36456)

Deencapsulation.getField sometime doesn't work as expected, which may
cause FE unit test timeout. Add get function in source code to make it
easier.
@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@Jibing-Li Jibing-Li marked this pull request as ready for review June 27, 2024 11:25
@Jibing-Li
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 49572 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 3cf5a991a679296e8da82283d2cc8a67a1b5af61, data reload: false

------ Round 1 ----------------------------------
q1	18122	4354	4300	4300
q2	2077	157	145	145
q3	10272	1916	1941	1916
q4	10343	1238	1320	1238
q5	8431	3881	3912	3881
q6	249	125	126	125
q7	2025	1604	1618	1604
q8	9299	2716	2691	2691
q9	10658	10339	10251	10251
q10	8630	3494	3492	3492
q11	422	238	243	238
q12	471	310	307	307
q13	18349	3943	3984	3943
q14	356	321	327	321
q15	503	451	456	451
q16	681	574	567	567
q17	1117	974	940	940
q18	7215	6865	6766	6766
q19	1812	1663	1638	1638
q20	542	318	284	284
q21	4389	4057	4035	4035
q22	540	439	441	439
Total cold run time: 116503 ms
Total hot run time: 49572 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4370	4293	4271	4271
q2	322	236	225	225
q3	4158	4143	4125	4125
q4	2725	2738	2736	2736
q5	7155	7123	7029	7029
q6	238	124	120	120
q7	3240	2749	2807	2749
q8	4369	4447	4472	4447
q9	16816	16692	16676	16676
q10	4201	4270	4202	4202
q11	741	695	680	680
q12	1035	864	843	843
q13	7017	3728	3722	3722
q14	450	429	421	421
q15	498	450	463	450
q16	736	671	684	671
q17	3800	3818	3893	3818
q18	8795	8674	8823	8674
q19	1744	1705	1673	1673
q20	2382	2128	2085	2085
q21	8487	8455	8467	8455
q22	1058	951	946	946
Total cold run time: 84337 ms
Total hot run time: 79018 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 204134 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 3cf5a991a679296e8da82283d2cc8a67a1b5af61, data reload: false

query1	943	422	378	378
query2	6551	2754	2702	2702
query3	6923	203	206	203
query4	21547	17828	17879	17828
query5	19731	6520	6498	6498
query6	313	214	231	214
query7	4158	305	313	305
query8	460	460	400	400
query9	3181	2713	2665	2665
query10	417	293	317	293
query11	11305	10769	10657	10657
query12	123	74	72	72
query13	5599	707	703	703
query14	17762	13613	13415	13415
query15	369	249	251	249
query16	6464	295	267	267
query17	1688	1453	871	871
query18	2455	416	414	414
query19	208	159	157	157
query20	71	79	80	79
query21	201	95	94	94
query22	5206	5113	5027	5027
query23	32800	31944	32347	31944
query24	6999	6622	6614	6614
query25	556	490	459	459
query26	1333	179	199	179
query27	2739	325	329	325
query28	7369	2440	2393	2393
query29	2962	2806	2814	2806
query30	245	162	168	162
query31	918	757	746	746
query32	81	71	64	64
query33	896	275	352	275
query34	1553	502	485	485
query35	1614	957	932	932
query36	1285	1236	1186	1186
query37	88	62	64	62
query38	3118	2916	2925	2916
query39	1403	1330	1307	1307
query40	206	94	95	94
query41	48	44	44	44
query42	84	84	88	84
query43	727	705	607	607
query44	1144	733	726	726
query45	249	238	239	238
query46	1221	985	974	974
query47	1885	1906	1786	1786
query48	1017	725	693	693
query49	629	377	367	367
query50	870	621	647	621
query51	4749	4691	4666	4666
query52	96	83	83	83
query53	443	326	327	326
query54	2667	2423	2454	2423
query55	83	84	84	84
query56	237	229	204	204
query57	1224	1197	1118	1118
query58	216	198	206	198
query59	4173	4101	4297	4101
query60	211	234	209	209
query61	95	94	95	94
query62	793	446	471	446
query63	485	351	345	345
query64	2598	1516	1483	1483
query65	3619	3553	3583	3553
query66	803	372	380	372
query67	15599	15363	14780	14780
query68	10611	681	680	680
query69	573	360	350	350
query70	2046	1318	1321	1318
query71	428	321	324	321
query72	6596	3470	3493	3470
query73	745	325	331	325
query74	6387	5854	5868	5854
query75	5560	3740	3633	3633
query76	6845	1156	1165	1156
query77	1202	262	280	262
query78	12671	11868	12216	11868
query79	9214	668	673	668
query80	861	408	406	406
query81	498	233	225	225
query82	923	104	100	100
query83	167	131	135	131
query84	253	72	71	71
query85	885	316	317	316
query86	334	294	310	294
query87	3230	2991	3068	2991
query88	4315	2336	2324	2324
query89	443	279	290	279
query90	2068	223	217	217
query91	172	141	139	139
query92	63	52	54	52
query93	6212	586	586	586
query94	741	214	216	214
query95	1123	1069	1054	1054
query96	657	326	334	326
query97	6497	6407	6399	6399
query98	190	173	170	170
query99	3021	870	989	870
Total cold run time: 323336 ms
Total hot run time: 204134 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.55 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 3cf5a991a679296e8da82283d2cc8a67a1b5af61, data reload: false

query1	0.03	0.03	0.02
query2	0.07	0.03	0.02
query3	0.25	0.05	0.05
query4	1.77	0.06	0.06
query5	0.55	0.51	0.53
query6	1.28	0.61	0.63
query7	0.01	0.02	0.01
query8	0.03	0.03	0.03
query9	0.53	0.48	0.49
query10	0.52	0.54	0.52
query11	0.12	0.08	0.09
query12	0.12	0.09	0.09
query13	0.62	0.61	0.62
query14	0.78	0.79	0.78
query15	0.79	0.75	0.77
query16	0.37	0.37	0.39
query17	0.97	1.02	1.01
query18	0.24	0.24	0.26
query19	1.93	1.84	1.86
query20	0.02	0.01	0.01
query21	15.46	0.56	0.54
query22	2.01	2.41	1.74
query23	17.09	1.18	1.10
query24	5.52	1.47	1.51
query25	0.32	0.11	0.05
query26	0.69	0.15	0.16
query27	0.04	0.03	0.04
query28	7.01	0.72	0.73
query29	12.76	2.30	2.28
query30	0.61	0.54	0.52
query31	2.84	0.39	0.38
query32	3.36	0.49	0.49
query33	3.10	3.05	3.03
query34	15.27	4.81	4.81
query35	4.88	4.85	4.88
query36	1.09	1.05	1.05
query37	0.06	0.05	0.05
query38	0.04	0.02	0.02
query39	0.02	0.02	0.01
query40	0.17	0.14	0.15
query41	0.07	0.01	0.01
query42	0.02	0.02	0.01
query43	0.02	0.02	0.01
Total cold run time: 103.45 s
Total hot run time: 31.55 s

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit 3cf5a991a679296e8da82283d2cc8a67a1b5af61 with default session variables
Stream load json:         20 seconds loaded 2358488459 Bytes, about 112 MB/s
Stream load orc:          58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select:       21.4 seconds inserted 10000000 Rows, about 467K ops/s

@Jibing-Li
Copy link
Contributor Author

run external

@Jibing-Li Jibing-Li merged commit 2a99862 into apache:branch-2.0 Jun 28, 2024
@Jibing-Li Jibing-Li deleted the fixut2.0 branch June 28, 2024 03:28
mongo360 pushed a commit to mongo360/doris that referenced this pull request Aug 16, 2024
…36456) (apache#36943)

Deencapsulation.getField sometime doesn't work as expected, which may
cause FE unit test timeout. Add get function in source code to make it
easier.
backport: apache#36456
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants