Skip to content

Conversation

@zclllyybb
Copy link
Contributor

Proposed changes

Issue Number: close #xxx

@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@zclllyybb
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 38682 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 9b3702562ea9e43380cb736d8eecb9c2017fe742, data reload: false

------ Round 1 ----------------------------------
q1	17865	4442	4341	4341
q2	2077	219	208	208
q3	11715	972	1189	972
q4	10548	781	775	775
q5	7795	2895	2841	2841
q6	267	159	164	159
q7	1020	667	656	656
q8	9399	2113	2117	2113
q9	7203	6573	6590	6573
q10	7097	2359	2194	2194
q11	539	277	283	277
q12	426	251	256	251
q13	17801	3042	3020	3020
q14	313	259	253	253
q15	556	511	504	504
q16	527	421	405	405
q17	988	774	722	722
q18	7392	6847	6945	6847
q19	1443	1121	1138	1121
q20	728	371	366	366
q21	4046	3061	3108	3061
q22	1166	1023	1055	1023
Total cold run time: 110911 ms
Total hot run time: 38682 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4385	4335	4333	4333
q2	401	291	285	285
q3	2902	2685	2704	2685
q4	1946	1704	1711	1704
q5	5677	5696	5692	5692
q6	252	157	157	157
q7	2319	1926	1889	1889
q8	3355	3448	3418	3418
q9	8882	8810	8856	8810
q10	3588	3287	3352	3287
q11	651	549	530	530
q12	876	714	695	695
q13	16001	3265	3270	3265
q14	348	313	313	313
q15	579	521	531	521
q16	524	452	452	452
q17	1805	1521	1525	1521
q18	8212	7873	7745	7745
q19	2108	1622	1485	1485
q20	2116	1890	1896	1890
q21	5660	5489	5584	5489
q22	1170	1087	1107	1087
Total cold run time: 73757 ms
Total hot run time: 57253 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 198111 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 9b3702562ea9e43380cb736d8eecb9c2017fe742, data reload: false

query1	1323	899	887	887
query2	6434	1928	1988	1928
query3	10652	3954	4000	3954
query4	59292	23933	23320	23320
query5	5816	728	726	726
query6	481	206	207	206
query7	5807	329	343	329
query8	515	427	447	427
query9	8730	2558	2542	2542
query10	565	347	328	328
query11	18199	15119	15486	15119
query12	207	176	132	132
query13	1579	447	435	435
query14	11466	7985	7873	7873
query15	264	191	201	191
query16	7131	501	504	501
query17	1185	627	623	623
query18	1931	361	354	354
query19	320	171	180	171
query20	150	137	139	137
query21	247	144	145	144
query22	4569	4451	4448	4448
query23	34374	33966	34250	33966
query24	6093	3001	2945	2945
query25	566	431	432	431
query26	709	187	200	187
query27	1726	316	313	313
query28	3726	2156	2142	2142
query29	711	458	453	453
query30	233	190	199	190
query31	1049	848	877	848
query32	118	85	81	81
query33	492	364	353	353
query34	938	530	510	510
query35	878	786	752	752
query36	1086	949	988	949
query37	160	107	112	107
query38	4016	3850	4018	3850
query39	1530	1449	1448	1448
query40	234	159	157	157
query41	140	139	139	139
query42	136	117	116	116
query43	525	506	502	502
query44	1148	795	801	795
query45	226	194	193	193
query46	1138	778	778	778
query47	2007	1866	1915	1866
query48	407	343	341	341
query49	911	576	587	576
query50	859	462	481	462
query51	7288	7128	7095	7095
query52	118	105	109	105
query53	298	226	219	219
query54	615	510	516	510
query55	91	89	86	86
query56	338	324	316	316
query57	1243	1155	1131	1131
query58	301	301	305	301
query59	3126	2740	2670	2670
query60	353	339	332	332
query61	150	147	149	147
query62	797	697	718	697
query63	260	256	226	226
query64	4111	2383	1863	1863
query65	3237	3213	3244	3213
query66	998	685	677	677
query67	15426	15346	15352	15346
query68	4435	600	595	595
query69	486	329	321	321
query70	1181	1157	1021	1021
query71	410	320	322	320
query72	2689	2154	2084	2084
query73	745	368	365	365
query74	9196	8835	8840	8835
query75	3486	2750	2749	2749
query76	1903	1039	970	970
query77	682	466	450	450
query78	10067	9580	9098	9098
query79	1099	563	558	558
query80	947	603	618	603
query81	590	264	260	260
query82	312	162	156	156
query83	249	214	214	214
query84	286	98	101	98
query85	926	369	354	354
query86	336	293	323	293
query87	4547	4225	4262	4225
query88	3341	2533	2524	2524
query89	424	321	317	317
query90	1902	233	232	232
query91	151	148	131	131
query92	87	75	73	73
query93	1110	557	545	545
query94	776	338	334	334
query95	387	306	307	306
query96	607	286	294	286
query97	3241	3144	3119	3119
query98	246	222	235	222
query99	1605	1294	1301	1294
Total cold run time: 310198 ms
Total hot run time: 198111 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.59 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 9b3702562ea9e43380cb736d8eecb9c2017fe742, data reload: false

query1	0.05	0.05	0.04
query2	0.08	0.05	0.04
query3	0.23	0.04	0.06
query4	1.68	0.08	0.07
query5	0.53	0.52	0.50
query6	1.13	0.73	0.74
query7	0.03	0.02	0.02
query8	0.06	0.04	0.05
query9	0.55	0.48	0.49
query10	0.54	0.55	0.55
query11	0.17	0.12	0.12
query12	0.16	0.13	0.13
query13	0.62	0.60	0.59
query14	0.77	0.80	0.78
query15	0.85	0.82	0.83
query16	0.39	0.38	0.36
query17	1.08	1.06	1.05
query18	0.22	0.22	0.21
query19	1.84	1.88	1.80
query20	0.02	0.02	0.01
query21	15.42	0.68	0.68
query22	4.69	6.62	2.13
query23	18.33	1.36	1.37
query24	2.17	0.23	0.24
query25	0.16	0.08	0.08
query26	0.28	0.18	0.18
query27	0.09	0.09	0.09
query28	13.25	1.04	1.01
query29	12.66	3.48	3.42
query30	0.43	0.25	0.21
query31	2.80	0.40	0.40
query32	3.25	0.48	0.49
query33	2.94	3.02	3.02
query34	17.02	4.40	4.38
query35	4.38	4.37	4.44
query36	0.67	0.47	0.47
query37	0.21	0.18	0.17
query38	0.18	0.16	0.17
query39	0.06	0.05	0.05
query40	0.17	0.14	0.15
query41	0.11	0.06	0.07
query42	0.07	0.07	0.06
query43	0.06	0.06	0.06
Total cold run time: 110.4 s
Total hot run time: 31.59 s

@zclllyybb zclllyybb marked this pull request as ready for review August 22, 2024 06:44
@zclllyybb
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 37683 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 8dd7da7cda7854f70334b2433ca1f678fff4703b, data reload: false

------ Round 1 ----------------------------------
q1	17645	4332	4282	4282
q2	2042	183	175	175
q3	11554	929	1031	929
q4	10521	696	711	696
q5	7763	2858	2806	2806
q6	226	142	145	142
q7	983	621	603	603
q8	9324	2040	2063	2040
q9	7221	6499	6503	6499
q10	6998	2182	2249	2182
q11	477	245	251	245
q12	392	216	222	216
q13	18750	3093	3040	3040
q14	274	237	231	231
q15	519	494	474	474
q16	495	403	382	382
q17	977	679	736	679
q18	7406	6829	6888	6829
q19	1388	1009	1006	1006
q20	698	343	336	336
q21	4320	3132	2884	2884
q22	1117	1007	1028	1007
Total cold run time: 111090 ms
Total hot run time: 37683 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4393	4305	4350	4305
q2	390	266	273	266
q3	2943	2682	2633	2633
q4	1952	1635	1653	1635
q5	5669	5693	5817	5693
q6	232	139	142	139
q7	2267	1853	1843	1843
q8	3311	3440	3514	3440
q9	8888	9126	8981	8981
q10	3810	3438	3348	3348
q11	604	516	547	516
q12	858	725	715	715
q13	15846	3391	3279	3279
q14	326	304	287	287
q15	552	502	528	502
q16	492	461	470	461
q17	1869	1559	1596	1559
q18	8232	7916	7814	7814
q19	1873	1662	1576	1576
q20	2161	1946	1907	1907
q21	5858	5390	5518	5390
q22	1166	1098	1063	1063
Total cold run time: 73692 ms
Total hot run time: 57352 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 191875 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 8dd7da7cda7854f70334b2433ca1f678fff4703b, data reload: false

query1	1247	875	878	875
query2	6311	1950	1883	1883
query3	10545	4019	3877	3877
query4	59345	25199	23160	23160
query5	5431	494	501	494
query6	412	157	168	157
query7	5893	305	308	305
query8	287	207	205	205
query9	9098	2449	2431	2431
query10	480	266	258	258
query11	18374	15006	15094	15006
query12	162	104	107	104
query13	1616	399	383	383
query14	11283	7348	7397	7348
query15	236	174	178	174
query16	7639	471	477	471
query17	1143	588	594	588
query18	2115	327	307	307
query19	307	154	157	154
query20	120	114	130	114
query21	206	102	103	102
query22	4692	4255	4405	4255
query23	34483	33715	33549	33549
query24	5905	2878	2847	2847
query25	554	402	395	395
query26	696	162	157	157
query27	1785	291	282	282
query28	3946	2029	2014	2014
query29	728	420	433	420
query30	233	152	149	149
query31	943	768	767	767
query32	89	58	60	58
query33	470	289	301	289
query34	860	478	477	477
query35	842	729	715	715
query36	1060	927	956	927
query37	142	86	82	82
query38	4075	3827	3844	3827
query39	1442	1408	1422	1408
query40	207	126	120	120
query41	45	45	47	45
query42	122	97	97	97
query43	506	476	471	471
query44	1089	753	761	753
query45	195	168	168	168
query46	1089	745	727	727
query47	1881	1793	1810	1793
query48	389	309	304	304
query49	777	448	447	447
query50	834	410	416	410
query51	7169	6951	7074	6951
query52	102	89	90	89
query53	262	188	181	181
query54	566	461	477	461
query55	77	75	75	75
query56	286	271	267	267
query57	1200	1095	1085	1085
query58	226	229	270	229
query59	2957	2843	2882	2843
query60	307	285	275	275
query61	133	123	119	119
query62	744	627	672	627
query63	221	190	189	189
query64	3995	2341	1767	1767
query65	3235	3186	3165	3165
query66	658	330	343	330
query67	15436	15255	15169	15169
query68	4483	561	563	561
query69	527	349	287	287
query70	1166	1111	1112	1111
query71	444	279	287	279
query72	6554	2375	2081	2081
query73	772	322	323	322
query74	9663	8947	8882	8882
query75	3394	2710	2689	2689
query76	2103	946	928	928
query77	583	356	309	309
query78	9795	9209	9034	9034
query79	1776	528	524	524
query80	805	516	509	509
query81	565	230	230	230
query82	371	132	139	132
query83	218	152	146	146
query84	272	76	81	76
query85	934	323	291	291
query86	409	298	307	298
query87	4331	4195	4268	4195
query88	4309	2342	2360	2342
query89	393	286	287	286
query90	2008	193	191	191
query91	123	100	101	100
query92	58	52	51	51
query93	1931	526	529	526
query94	763	278	301	278
query95	349	266	261	261
query96	589	267	271	267
query97	3202	3122	3078	3078
query98	224	202	196	196
query99	1639	1288	1244	1244
Total cold run time: 314656 ms
Total hot run time: 191875 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.21 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 8dd7da7cda7854f70334b2433ca1f678fff4703b, data reload: false

query1	0.05	0.05	0.03
query2	0.08	0.03	0.04
query3	0.22	0.06	0.04
query4	1.67	0.08	0.08
query5	0.53	0.49	0.52
query6	1.13	0.73	0.72
query7	0.02	0.01	0.01
query8	0.05	0.04	0.04
query9	0.55	0.48	0.47
query10	0.52	0.54	0.52
query11	0.16	0.12	0.11
query12	0.14	0.12	0.13
query13	0.62	0.59	0.58
query14	0.77	0.81	0.78
query15	0.85	0.82	0.80
query16	0.37	0.37	0.39
query17	1.03	1.07	1.07
query18	0.20	0.21	0.19
query19	1.95	1.77	1.83
query20	0.02	0.01	0.01
query21	15.39	0.69	0.67
query22	4.35	6.64	2.39
query23	18.27	1.45	1.22
query24	2.09	0.24	0.23
query25	0.15	0.08	0.08
query26	0.26	0.18	0.18
query27	0.07	0.08	0.07
query28	13.19	1.02	1.00
query29	12.63	3.39	3.40
query30	0.25	0.06	0.05
query31	2.88	0.40	0.38
query32	3.28	0.47	0.47
query33	2.97	3.02	2.98
query34	17.09	4.42	4.39
query35	4.43	4.45	4.39
query36	0.67	0.50	0.50
query37	0.19	0.16	0.15
query38	0.15	0.14	0.14
query39	0.05	0.04	0.03
query40	0.16	0.14	0.13
query41	0.10	0.05	0.05
query42	0.06	0.05	0.05
query43	0.04	0.04	0.04
Total cold run time: 109.65 s
Total hot run time: 31.21 s

@github-actions
Copy link
Contributor

PR approved by anyone and no changes requested.

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Aug 22, 2024
@github-actions
Copy link
Contributor

PR approved by at least one committer and no changes requested.

@BiteTheDDDDt BiteTheDDDDt merged commit 8fe11aa into apache:master Aug 23, 2024
@zclllyybb zclllyybb deleted the ap_errmsg branch August 23, 2024 03:38
zclllyybb added a commit to zclllyybb/doris that referenced this pull request Aug 23, 2024
zclllyybb added a commit to zclllyybb/doris that referenced this pull request Aug 23, 2024
yiguolei pushed a commit that referenced this pull request Aug 24, 2024
## Proposed changes

Issue Number: close #xxx

#38385 optimize parsing datetime
#38978 make stream load failure
message more clear and disable some error's stacktrace by default
#39255 fix random function coredump
#39324 fix function corr
inconsistency with doc
#39449 check auto partitoin nullity
when creating partition
#39695 make
DynamicPartitionScheduler immediately know interval's change
#39754 Add some partition expr check
on creating table
dataroaring pushed a commit that referenced this pull request Oct 9, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

approved Indicates a PR has been approved by one committer. dev/2.1.6-merged dev/3.0.3-merged reviewed

Projects

None yet

Development

Successfully merging this pull request may close these issues.

7 participants