Skip to content

Conversation

@zclllyybb
Copy link
Contributor

@zclllyybb zclllyybb commented Jun 4, 2024

Proposed changes

Issue Number: close #xxx

before:
crash

now:

mysql> SELECT  DATE_FORMAT('2011-06-24', '%f %V %f %l %V %I %S %p %w %r %j %f %l %I %D %w %j %D %e %s %V %f %D %M %s %X %U %v %c %u %x %r %j %a %h %s %m %a %v %u %b');
+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| date_format(cast('2011-06-24' as DATETIMEV2(0)), '%f %V %f %l %V %I %S %p %w %r %j %f %l %I %D %w %j %D %e %s %V %f %D %M %s %X %U %v %c %u %x %r %j %a %h %s %m %a %v %u %b') |
+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| NULL                                                                                                                                                                           |
+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
1 row in set (0.80 sec)

@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@zclllyybb
Copy link
Contributor Author

run buildall

Copy link
Contributor

@github-actions github-actions bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

clang-tidy made some suggestions

@doris-robot
Copy link

TPC-H: Total hot run time: 41096 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 40bfc5d0a3a12cc3505a24dacf8bd460e990d3bd, data reload: false

------ Round 1 ----------------------------------
q1	17617	4454	4307	4307
q2	2034	194	191	191
q3	10453	1217	1195	1195
q4	10192	865	824	824
q5	7501	2718	2737	2718
q6	237	136	137	136
q7	983	624	601	601
q8	9216	2165	2123	2123
q9	9198	6739	6785	6739
q10	9189	3942	3861	3861
q11	447	242	238	238
q12	431	241	249	241
q13	17300	3167	3223	3167
q14	265	237	230	230
q15	517	461	476	461
q16	478	388	381	381
q17	1007	608	589	589
q18	8438	7881	7727	7727
q19	6220	1394	1473	1394
q20	673	313	325	313
q21	5111	3319	4090	3319
q22	407	345	341	341
Total cold run time: 117914 ms
Total hot run time: 41096 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4546	4496	4508	4496
q2	394	266	270	266
q3	3131	2940	3016	2940
q4	2019	1622	1677	1622
q5	5431	5557	5498	5498
q6	231	128	128	128
q7	2166	1805	1805	1805
q8	3272	3471	3432	3432
q9	8708	8656	8679	8656
q10	4103	3812	3818	3812
q11	576	491	491	491
q12	764	627	613	613
q13	17075	3172	3145	3145
q14	311	268	261	261
q15	540	482	497	482
q16	480	437	428	428
q17	1831	1540	1511	1511
q18	8188	7592	7421	7421
q19	1798	1621	1573	1573
q20	4092	1786	1809	1786
q21	13190	4685	4798	4685
q22	620	547	556	547
Total cold run time: 83466 ms
Total hot run time: 55598 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 168908 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 40bfc5d0a3a12cc3505a24dacf8bd460e990d3bd, data reload: false

query1	926	375	380	375
query2	6439	2446	2519	2446
query3	6650	206	208	206
query4	21486	17318	17312	17312
query5	4131	463	472	463
query6	251	160	154	154
query7	4589	304	296	296
query8	332	291	287	287
query9	8475	2368	2356	2356
query10	455	299	298	298
query11	10595	10004	10031	10004
query12	133	89	90	89
query13	1649	378	368	368
query14	10083	7658	6139	6139
query15	229	191	185	185
query16	7314	270	264	264
query17	1310	517	544	517
query18	1911	291	274	274
query19	188	160	150	150
query20	89	87	83	83
query21	209	131	128	128
query22	4356	3967	3959	3959
query23	33762	32961	33037	32961
query24	10843	2784	2866	2784
query25	578	349	362	349
query26	719	156	155	155
query27	2284	325	336	325
query28	5691	2052	2061	2052
query29	858	611	594	594
query30	269	145	153	145
query31	951	749	735	735
query32	88	51	65	51
query33	669	290	300	290
query34	889	473	480	473
query35	752	609	631	609
query36	1113	955	945	945
query37	141	64	71	64
query38	2880	2743	2758	2743
query39	847	812	804	804
query40	210	127	125	125
query41	53	57	50	50
query42	128	101	99	99
query43	591	560	560	560
query44	1082	730	756	730
query45	201	170	169	169
query46	1076	732	717	717
query47	1861	1796	1771	1771
query48	381	292	313	292
query49	968	401	408	401
query50	780	379	381	379
query51	6974	6755	6835	6755
query52	109	95	93	93
query53	357	287	284	284
query54	902	453	441	441
query55	75	74	75	74
query56	278	262	264	262
query57	1155	1059	1052	1052
query58	259	256	250	250
query59	3642	3493	3265	3265
query60	284	271	271	271
query61	103	89	88	88
query62	633	440	456	440
query63	317	286	284	284
query64	8620	2201	1744	1744
query65	3178	3098	3144	3098
query66	867	324	325	324
query67	15401	14745	14813	14745
query68	4498	533	530	530
query69	468	304	305	304
query70	1110	1152	1145	1145
query71	362	289	286	286
query72	6998	2710	2571	2571
query73	761	327	322	322
query74	5934	5467	5467	5467
query75	3354	2683	2617	2617
query76	2269	954	868	868
query77	457	299	294	294
query78	10156	9766	9616	9616
query79	2472	509	517	509
query80	1207	468	458	458
query81	576	222	217	217
query82	701	103	99	99
query83	237	172	170	170
query84	248	92	81	81
query85	1580	288	289	288
query86	489	308	340	308
query87	3306	3111	3200	3111
query88	3849	2454	2453	2453
query89	468	395	380	380
query90	1821	185	189	185
query91	126	100	96	96
query92	59	49	49	49
query93	2098	516	500	500
query94	1193	186	183	183
query95	415	315	315	315
query96	590	267	270	267
query97	3162	2986	3001	2986
query98	239	224	221	221
query99	1400	817	842	817
Total cold run time: 268222 ms
Total hot run time: 168908 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.59 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 40bfc5d0a3a12cc3505a24dacf8bd460e990d3bd, data reload: false

query1	0.04	0.03	0.03
query2	0.08	0.04	0.04
query3	0.23	0.05	0.05
query4	1.68	0.06	0.06
query5	0.49	0.47	0.50
query6	1.12	0.74	0.73
query7	0.02	0.02	0.01
query8	0.05	0.04	0.04
query9	0.55	0.48	0.49
query10	0.54	0.54	0.54
query11	0.15	0.12	0.12
query12	0.15	0.12	0.12
query13	0.60	0.59	0.60
query14	0.79	0.77	0.80
query15	0.82	0.81	0.80
query16	0.37	0.36	0.36
query17	0.95	0.98	0.96
query18	0.22	0.24	0.24
query19	1.92	1.72	1.71
query20	0.02	0.01	0.01
query21	15.43	0.70	0.69
query22	4.61	5.89	3.02
query23	18.62	1.41	1.24
query24	1.95	0.23	0.22
query25	0.15	0.08	0.09
query26	0.28	0.17	0.18
query27	0.08	0.07	0.08
query28	13.32	1.00	1.02
query29	13.28	3.36	3.24
query30	0.24	0.05	0.07
query31	2.87	0.39	0.38
query32	3.26	0.47	0.46
query33	2.86	2.95	2.90
query34	17.19	4.41	4.44
query35	4.53	4.49	4.61
query36	0.65	0.47	0.46
query37	0.18	0.16	0.15
query38	0.15	0.14	0.14
query39	0.04	0.04	0.04
query40	0.17	0.17	0.14
query41	0.08	0.04	0.05
query42	0.05	0.04	0.05
query43	0.04	0.04	0.03
Total cold run time: 110.82 s
Total hot run time: 31.59 s

@zclllyybb zclllyybb marked this pull request as ready for review June 5, 2024 04:41
@zclllyybb
Copy link
Contributor Author

run buildall

Copy link
Contributor

@github-actions github-actions bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

clang-tidy made some suggestions

@doris-robot
Copy link

TPC-H: Total hot run time: 41794 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 63c5b626edd90e678796e0dea0a4404898cd357f, data reload: false

------ Round 1 ----------------------------------
q1	17634	4981	4319	4319
q2	2041	196	194	194
q3	10471	1228	1076	1076
q4	10180	837	893	837
q5	7525	2682	2820	2682
q6	223	135	141	135
q7	983	607	616	607
q8	9217	2171	2136	2136
q9	9243	6767	6796	6767
q10	9722	3960	3849	3849
q11	440	248	255	248
q12	458	247	237	237
q13	17415	3237	3229	3229
q14	273	209	230	209
q15	519	475	474	474
q16	505	393	404	393
q17	1014	765	609	609
q18	8486	7880	7867	7867
q19	7485	1400	1238	1238
q20	658	330	317	317
q21	5102	4025	4021	4021
q22	404	365	350	350
Total cold run time: 119998 ms
Total hot run time: 41794 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4653	4458	4504	4458
q2	401	287	282	282
q3	3155	3034	2745	2745
q4	1893	1636	1696	1636
q5	5494	5536	5494	5494
q6	222	128	125	125
q7	2198	1837	1795	1795
q8	3232	3407	3356	3356
q9	8635	8722	8765	8722
q10	4108	3778	3654	3654
q11	582	498	503	498
q12	810	659	631	631
q13	17140	3119	3140	3119
q14	309	273	260	260
q15	529	469	494	469
q16	491	426	463	426
q17	1836	1490	1516	1490
q18	7981	7613	7436	7436
q19	1699	1623	1611	1611
q20	2079	1783	1773	1773
q21	10288	4738	4555	4555
q22	609	547	533	533
Total cold run time: 78344 ms
Total hot run time: 55068 ms

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 36.41% (8985/24675)
Line Coverage: 27.93% (73433/262952)
Region Coverage: 27.39% (38090/139059)
Branch Coverage: 23.98% (19340/80634)
Coverage Report: http://coverage.selectdb-in.cc/coverage/63c5b626edd90e678796e0dea0a4404898cd357f_63c5b626edd90e678796e0dea0a4404898cd357f/report/index.html

@doris-robot
Copy link

TPC-DS: Total hot run time: 173175 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 63c5b626edd90e678796e0dea0a4404898cd357f, data reload: false

query1	936	395	385	385
query2	6477	2434	2423	2423
query3	6642	212	211	211
query4	19177	17481	17401	17401
query5	4171	462	467	462
query6	272	167	168	167
query7	4606	303	294	294
query8	345	307	312	307
query9	8663	2458	2450	2450
query10	468	309	278	278
query11	10708	10055	10097	10055
query12	137	90	87	87
query13	1651	368	388	368
query14	10242	6917	7483	6917
query15	234	190	187	187
query16	7467	271	274	271
query17	1388	541	567	541
query18	1881	296	283	283
query19	206	159	164	159
query20	96	91	88	88
query21	202	139	133	133
query22	4293	4148	3941	3941
query23	33642	33125	32941	32941
query24	11359	2935	2855	2855
query25	677	373	382	373
query26	1324	165	161	161
query27	2851	326	319	319
query28	7471	2063	2048	2048
query29	933	631	625	625
query30	280	154	153	153
query31	973	733	741	733
query32	98	57	59	57
query33	788	318	293	293
query34	952	485	474	474
query35	781	631	626	626
query36	1114	964	957	957
query37	146	71	72	71
query38	2859	2738	2721	2721
query39	901	785	792	785
query40	210	128	125	125
query41	63	57	57	57
query42	119	98	100	98
query43	596	517	544	517
query44	1205	742	754	742
query45	204	171	170	170
query46	1081	708	728	708
query47	1869	1770	1793	1770
query48	371	304	308	304
query49	1097	428	433	428
query50	800	428	395	395
query51	6798	6608	6584	6584
query52	110	90	93	90
query53	359	292	295	292
query54	900	463	444	444
query55	75	75	74	74
query56	299	276	275	275
query57	1130	1050	1071	1050
query58	281	278	253	253
query59	3363	3496	3211	3211
query60	313	295	280	280
query61	110	110	113	110
query62	671	473	448	448
query63	331	296	290	290
query64	9135	2334	1860	1860
query65	3239	3119	3154	3119
query66	1067	348	342	342
query67	15492	14920	15012	14920
query68	4589	540	526	526
query69	551	420	431	420
query70	1107	1176	1077	1077
query71	412	295	290	290
query72	7574	5128	5652	5128
query73	774	323	325	323
query74	5892	5516	5500	5500
query75	3377	2672	2678	2672
query76	2603	901	983	901
query77	688	309	300	300
query78	10277	9882	9786	9786
query79	2416	520	513	513
query80	904	490	482	482
query81	548	230	228	228
query82	835	101	102	101
query83	265	180	174	174
query84	247	88	90	88
query85	1368	340	371	340
query86	457	376	282	282
query87	3217	3097	3064	3064
query88	4365	2367	2376	2367
query89	481	405	383	383
query90	1747	194	197	194
query91	136	105	110	105
query92	64	51	52	51
query93	1919	523	497	497
query94	1180	208	197	197
query95	421	327	320	320
query96	591	274	271	271
query97	3253	3005	2996	2996
query98	243	234	222	222
query99	1193	821	840	821
Total cold run time: 272393 ms
Total hot run time: 173175 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.45 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 63c5b626edd90e678796e0dea0a4404898cd357f, data reload: false

query1	0.04	0.03	0.04
query2	0.08	0.04	0.04
query3	0.23	0.05	0.05
query4	1.66	0.10	0.09
query5	0.49	0.48	0.48
query6	1.11	0.72	0.73
query7	0.02	0.02	0.01
query8	0.05	0.05	0.05
query9	0.53	0.48	0.49
query10	0.54	0.55	0.54
query11	0.16	0.12	0.11
query12	0.14	0.11	0.12
query13	0.59	0.59	0.59
query14	0.76	0.79	0.78
query15	0.82	0.81	0.82
query16	0.36	0.36	0.36
query17	1.02	1.00	1.06
query18	0.24	0.24	0.24
query19	1.79	1.74	1.69
query20	0.01	0.02	0.01
query21	15.44	0.70	0.68
query22	4.96	6.50	1.92
query23	18.32	1.44	1.18
query24	1.75	0.30	0.21
query25	0.13	0.08	0.08
query26	0.27	0.18	0.17
query27	0.08	0.07	0.07
query28	13.27	1.02	0.99
query29	13.28	3.39	3.31
query30	0.24	0.05	0.05
query31	2.87	0.38	0.39
query32	3.30	0.46	0.46
query33	2.87	2.91	2.95
query34	17.19	4.38	4.45
query35	4.48	4.48	4.65
query36	0.65	0.46	0.45
query37	0.17	0.14	0.15
query38	0.14	0.14	0.13
query39	0.05	0.03	0.03
query40	0.17	0.13	0.14
query41	0.09	0.04	0.05
query42	0.06	0.04	0.04
query43	0.04	0.03	0.04
Total cold run time: 110.46 s
Total hot run time: 30.45 s

Copy link
Contributor

@zhiqiang-hhhh zhiqiang-hhhh left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@github-actions
Copy link
Contributor

github-actions bot commented Jun 5, 2024

PR approved by anyone and no changes requested.

@zclllyybb
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 36.38% (8985/24696)
Line Coverage: 27.91% (73458/263174)
Region Coverage: 27.37% (38096/139192)
Branch Coverage: 23.96% (19335/80698)
Coverage Report: http://coverage.selectdb-in.cc/coverage/3398b789345e1ce7b4e0fcf8b57ae684a16fed2a_3398b789345e1ce7b4e0fcf8b57ae684a16fed2a/report/index.html

@doris-robot
Copy link

TPC-H: Total hot run time: 41385 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 3398b789345e1ce7b4e0fcf8b57ae684a16fed2a, data reload: false

------ Round 1 ----------------------------------
q1	17626	5090	4422	4422
q2	2320	201	210	201
q3	10445	1146	1055	1055
q4	10195	819	762	762
q5	7540	2746	2711	2711
q6	222	135	145	135
q7	976	631	611	611
q8	9223	2175	2144	2144
q9	9374	6705	6692	6692
q10	9161	3836	3974	3836
q11	455	236	241	236
q12	579	228	228	228
q13	17280	3260	3283	3260
q14	278	229	225	225
q15	531	486	481	481
q16	515	398	392	392
q17	1017	723	760	723
q18	8297	7817	7867	7817
q19	7658	1355	1332	1332
q20	691	314	324	314
q21	5157	3468	4080	3468
q22	402	356	340	340
Total cold run time: 119942 ms
Total hot run time: 41385 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4544	4478	4478	4478
q2	386	262	271	262
q3	3145	2958	2907	2907
q4	1945	1707	1712	1707
q5	5349	5501	5526	5501
q6	234	127	129	127
q7	2163	1813	1808	1808
q8	3232	3438	3385	3385
q9	8641	8586	8640	8586
q10	4066	3909	3868	3868
q11	589	489	493	489
q12	783	622	586	586
q13	16985	3114	3195	3114
q14	304	272	270	270
q15	517	490	493	490
q16	471	436	418	418
q17	1811	1501	1480	1480
q18	8126	7871	7274	7274
q19	1811	1612	1644	1612
q20	4144	1807	1771	1771
q21	7974	4668	4827	4668
q22	597	536	556	536
Total cold run time: 77817 ms
Total hot run time: 55337 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 171704 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 3398b789345e1ce7b4e0fcf8b57ae684a16fed2a, data reload: false

query1	939	381	371	371
query2	6459	2437	2348	2348
query3	6641	212	211	211
query4	19229	17375	17350	17350
query5	4123	452	447	447
query6	262	160	160	160
query7	4588	312	294	294
query8	305	282	297	282
query9	8719	2352	2383	2352
query10	451	289	280	280
query11	10513	10131	9931	9931
query12	135	86	89	86
query13	1651	392	366	366
query14	10051	6849	6936	6849
query15	224	186	190	186
query16	7158	263	267	263
query17	1017	522	522	522
query18	1920	270	282	270
query19	202	147	144	144
query20	92	81	82	81
query21	208	134	132	132
query22	4303	4131	3914	3914
query23	33580	33206	33279	33206
query24	11172	2799	2840	2799
query25	592	365	357	357
query26	724	151	150	150
query27	2332	318	318	318
query28	6746	2031	2029	2029
query29	853	605	592	592
query30	285	150	148	148
query31	942	745	744	744
query32	94	52	54	52
query33	757	286	275	275
query34	976	462	463	462
query35	735	599	588	588
query36	1102	912	919	912
query37	130	69	68	68
query38	2845	2742	2747	2742
query39	865	773	804	773
query40	214	123	122	122
query41	57	52	53	52
query42	117	100	97	97
query43	590	550	550	550
query44	1167	743	737	737
query45	213	164	170	164
query46	1076	721	731	721
query47	1840	1772	1774	1772
query48	370	312	303	303
query49	967	405	429	405
query50	780	379	399	379
query51	6853	6714	6788	6714
query52	102	88	96	88
query53	353	280	289	280
query54	874	445	444	444
query55	74	72	73	72
query56	273	253	258	253
query57	1107	1023	1095	1023
query58	262	242	240	240
query59	3315	3151	3134	3134
query60	301	268	282	268
query61	96	91	90	90
query62	658	444	464	444
query63	313	292	288	288
query64	8690	2235	1732	1732
query65	3144	3104	3093	3093
query66	944	330	341	330
query67	15217	14876	14758	14758
query68	4472	548	555	548
query69	500	323	313	313
query70	1094	1089	1150	1089
query71	364	259	265	259
query72	7195	6051	5007	5007
query73	739	336	321	321
query74	5891	5426	5540	5426
query75	3365	2657	2711	2657
query76	2372	883	931	883
query77	480	302	290	290
query78	10150	9694	9712	9694
query79	2476	518	514	514
query80	1004	466	450	450
query81	545	221	216	216
query82	1388	107	103	103
query83	244	167	171	167
query84	268	87	86	86
query85	1419	276	267	267
query86	486	315	297	297
query87	3295	3047	3077	3047
query88	4200	2448	2446	2446
query89	482	399	379	379
query90	1778	193	197	193
query91	136	109	110	109
query92	60	50	51	50
query93	2322	517	496	496
query94	1171	194	195	194
query95	402	324	317	317
query96	601	281	265	265
query97	3245	2981	3015	2981
query98	240	203	203	203
query99	1266	830	837	830
Total cold run time: 267537 ms
Total hot run time: 171704 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.53 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 3398b789345e1ce7b4e0fcf8b57ae684a16fed2a, data reload: false

query1	0.04	0.04	0.03
query2	0.08	0.04	0.04
query3	0.23	0.05	0.05
query4	1.67	0.07	0.07
query5	0.49	0.49	0.50
query6	1.13	0.73	0.73
query7	0.02	0.02	0.01
query8	0.05	0.04	0.05
query9	0.53	0.48	0.50
query10	0.55	0.55	0.54
query11	0.16	0.11	0.11
query12	0.15	0.12	0.12
query13	0.59	0.58	0.60
query14	0.76	0.76	0.77
query15	0.84	0.81	0.80
query16	0.36	0.35	0.36
query17	1.00	0.97	1.03
query18	0.21	0.26	0.25
query19	1.90	1.81	1.75
query20	0.01	0.00	0.01
query21	15.75	0.65	0.65
query22	3.84	7.28	1.97
query23	18.31	1.41	1.15
query24	2.14	0.22	0.23
query25	0.16	0.08	0.08
query26	0.26	0.18	0.17
query27	0.08	0.08	0.07
query28	13.17	1.03	1.07
query29	13.28	3.40	3.29
query30	0.24	0.06	0.05
query31	2.87	0.38	0.38
query32	3.28	0.48	0.46
query33	2.87	2.95	2.92
query34	16.97	4.43	4.50
query35	4.54	4.46	4.58
query36	0.67	0.46	0.48
query37	0.18	0.15	0.15
query38	0.14	0.13	0.14
query39	0.04	0.03	0.04
query40	0.16	0.14	0.14
query41	0.09	0.05	0.04
query42	0.05	0.05	0.04
query43	0.04	0.04	0.04
Total cold run time: 109.9 s
Total hot run time: 30.53 s

@zclllyybb
Copy link
Contributor Author

run buildall

Copy link
Contributor

@github-actions github-actions bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

clang-tidy made some suggestions

@zclllyybb zclllyybb changed the title [fix](function) fix date_format core when meet long format string [fix](function) fix date_format and from_unixtime core when meet long format string Jun 6, 2024
@doris-robot
Copy link

TPC-H: Total hot run time: 41025 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 5a03af562726d4fd3803b6921b9038e16a7590f3, data reload: false

------ Round 1 ----------------------------------
q1	17623	4614	4271	4271
q2	2034	200	187	187
q3	10432	1290	1077	1077
q4	10187	907	839	839
q5	7469	2761	2887	2761
q6	227	138	137	137
q7	993	632	610	610
q8	9218	2119	2107	2107
q9	9260	6689	6787	6689
q10	9143	3865	3957	3865
q11	499	242	239	239
q12	446	238	251	238
q13	17458	3222	3226	3222
q14	286	233	246	233
q15	516	473	492	473
q16	502	395	398	395
q17	999	752	695	695
q18	8353	7826	7767	7767
q19	6741	1276	1375	1276
q20	663	317	322	317
q21	5044	3294	4018	3294
q22	374	335	333	333
Total cold run time: 118467 ms
Total hot run time: 41025 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4539	4439	4467	4439
q2	380	271	268	268
q3	3146	2950	2888	2888
q4	2061	1683	1555	1555
q5	5315	5532	5480	5480
q6	222	127	130	127
q7	2175	1804	1797	1797
q8	3194	3354	3418	3354
q9	8718	8651	8711	8651
q10	4177	3886	3890	3886
q11	580	481	483	481
q12	784	566	574	566
q13	16850	3103	3164	3103
q14	300	260	280	260
q15	527	486	478	478
q16	506	420	427	420
q17	1815	1523	1470	1470
q18	8105	7723	7499	7499
q19	1744	1647	1624	1624
q20	3013	1796	1775	1775
q21	8228	4803	4781	4781
q22	606	533	522	522
Total cold run time: 76985 ms
Total hot run time: 55424 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 171259 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 5a03af562726d4fd3803b6921b9038e16a7590f3, data reload: false

query1	904	379	365	365
query2	6447	2324	2139	2139
query3	6661	210	212	210
query4	19314	17388	17230	17230
query5	4126	471	463	463
query6	243	173	177	173
query7	4600	294	298	294
query8	294	269	273	269
query9	8682	2393	2382	2382
query10	430	293	280	280
query11	10591	10064	9969	9969
query12	141	84	96	84
query13	1638	373	371	371
query14	10304	7436	6800	6800
query15	222	186	186	186
query16	7813	266	258	258
query17	1719	541	507	507
query18	1888	271	261	261
query19	199	149	143	143
query20	88	85	88	85
query21	203	132	122	122
query22	4297	3892	4002	3892
query23	33677	32867	32967	32867
query24	10830	2853	2792	2792
query25	577	358	373	358
query26	913	157	157	157
query27	2287	322	328	322
query28	6464	2061	2057	2057
query29	874	618	610	610
query30	280	149	147	147
query31	983	765	734	734
query32	95	53	62	53
query33	761	281	281	281
query34	950	475	473	473
query35	746	608	611	608
query36	1066	949	935	935
query37	137	70	71	70
query38	2864	2750	2759	2750
query39	871	780	795	780
query40	207	127	121	121
query41	53	50	53	50
query42	116	99	96	96
query43	576	529	537	529
query44	1268	735	747	735
query45	196	162	159	159
query46	1070	700	738	700
query47	1855	1741	1785	1741
query48	375	298	287	287
query49	972	410	405	405
query50	777	394	389	389
query51	6786	6684	6695	6684
query52	108	91	98	91
query53	358	291	292	291
query54	841	447	441	441
query55	76	73	75	73
query56	287	255	283	255
query57	1121	1021	1067	1021
query58	243	255	253	253
query59	3324	3242	2852	2852
query60	298	306	275	275
query61	89	85	87	85
query62	638	458	445	445
query63	332	293	290	290
query64	8656	2213	1749	1749
query65	3183	3121	3112	3112
query66	797	348	345	345
query67	15504	14956	14990	14956
query68	6239	556	566	556
query69	648	507	394	394
query70	1121	1135	1089	1089
query71	447	275	282	275
query72	7507	5020	5665	5020
query73	795	327	325	325
query74	5907	5577	5509	5509
query75	3688	2681	2666	2666
query76	3197	1005	946	946
query77	644	300	306	300
query78	10266	9894	9757	9757
query79	2089	513	518	513
query80	773	493	450	450
query81	562	218	230	218
query82	1339	104	103	103
query83	192	169	170	169
query84	256	85	84	84
query85	1279	269	312	269
query86	459	329	317	317
query87	3232	3070	3070	3070
query88	4042	2353	2343	2343
query89	473	401	383	383
query90	1782	186	191	186
query91	128	99	101	99
query92	60	50	51	50
query93	2141	528	503	503
query94	1188	188	181	181
query95	393	313	304	304
query96	593	266	265	265
query97	3146	2993	2989	2989
query98	214	206	195	195
query99	1374	824	852	824
Total cold run time: 271459 ms
Total hot run time: 171259 ms

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 36.38% (8989/24710)
Line Coverage: 27.92% (73423/262987)
Region Coverage: 27.35% (38010/138983)
Branch Coverage: 23.96% (19291/80530)
Coverage Report: http://coverage.selectdb-in.cc/coverage/5a03af562726d4fd3803b6921b9038e16a7590f3_5a03af562726d4fd3803b6921b9038e16a7590f3/report/index.html

@doris-robot
Copy link

ClickBench: Total hot run time: 30.84 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 5a03af562726d4fd3803b6921b9038e16a7590f3, data reload: false

query1	0.04	0.03	0.03
query2	0.08	0.03	0.04
query3	0.22	0.05	0.05
query4	1.68	0.07	0.07
query5	0.48	0.48	0.53
query6	1.12	0.71	0.72
query7	0.02	0.02	0.01
query8	0.06	0.04	0.05
query9	0.56	0.47	0.49
query10	0.54	0.54	0.55
query11	0.16	0.12	0.11
query12	0.14	0.12	0.12
query13	0.59	0.60	0.58
query14	0.81	0.79	0.78
query15	0.83	0.83	0.81
query16	0.36	0.37	0.35
query17	1.03	1.00	0.97
query18	0.19	0.24	0.25
query19	1.79	1.72	1.70
query20	0.01	0.01	0.01
query21	15.48	0.66	0.64
query22	4.08	7.10	2.21
query23	18.30	1.33	1.27
query24	2.13	0.23	0.21
query25	0.17	0.08	0.08
query26	0.28	0.19	0.18
query27	0.08	0.08	0.08
query28	13.21	1.03	1.00
query29	12.87	3.35	3.34
query30	0.24	0.05	0.06
query31	2.87	0.39	0.39
query32	3.28	0.46	0.48
query33	2.92	2.94	2.89
query34	17.01	4.38	4.41
query35	4.53	4.47	4.49
query36	0.66	0.49	0.50
query37	0.18	0.16	0.16
query38	0.15	0.14	0.14
query39	0.04	0.04	0.04
query40	0.16	0.14	0.15
query41	0.08	0.05	0.05
query42	0.05	0.04	0.04
query43	0.04	0.03	0.03
Total cold run time: 109.52 s
Total hot run time: 30.84 s

@zclllyybb
Copy link
Contributor Author

run buildall

Copy link
Contributor

@github-actions github-actions bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

clang-tidy made some suggestions

@doris-robot
Copy link

TPC-H: Total hot run time: 40538 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 68ae1519610e76e7a9ab840564b70e7c6850b558, data reload: false

------ Round 1 ----------------------------------
q1	17614	4425	4279	4279
q2	2027	200	211	200
q3	10413	1146	1149	1146
q4	10180	773	792	773
q5	7550	2708	2679	2679
q6	219	137	141	137
q7	947	633	595	595
q8	9235	2076	2055	2055
q9	8999	6498	6477	6477
q10	9006	3723	3695	3695
q11	443	245	247	245
q12	551	241	223	223
q13	18904	3015	3005	3005
q14	274	223	224	223
q15	520	478	486	478
q16	524	382	375	375
q17	972	688	627	627
q18	8212	7446	7421	7421
q19	7315	1539	1423	1423
q20	650	325	308	308
q21	4982	3837	3878	3837
q22	402	337	337	337
Total cold run time: 119939 ms
Total hot run time: 40538 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4379	4215	4223	4215
q2	363	267	261	261
q3	3143	2958	2919	2919
q4	1980	1750	1759	1750
q5	5445	5500	5533	5500
q6	237	135	137	135
q7	2233	1874	1848	1848
q8	3321	3420	3470	3420
q9	8706	8778	8674	8674
q10	4126	3730	3827	3730
q11	590	482	488	482
q12	840	664	639	639
q13	16254	3196	3167	3167
q14	307	273	274	273
q15	521	501	491	491
q16	502	436	425	425
q17	1865	1541	1507	1507
q18	7951	8100	7725	7725
q19	1848	1745	1701	1701
q20	2187	1863	1857	1857
q21	5017	4982	4761	4761
q22	627	570	594	570
Total cold run time: 72442 ms
Total hot run time: 56050 ms

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 36.44% (8976/24630)
Line Coverage: 27.98% (73370/262201)
Region Coverage: 27.38% (38023/138855)
Branch Coverage: 24.00% (19309/80446)
Coverage Report: http://coverage.selectdb-in.cc/coverage/68ae1519610e76e7a9ab840564b70e7c6850b558_68ae1519610e76e7a9ab840564b70e7c6850b558/report/index.html

@doris-robot
Copy link

TPC-DS: Total hot run time: 173881 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 68ae1519610e76e7a9ab840564b70e7c6850b558, data reload: false

query1	920	378	379	378
query2	6456	2372	2329	2329
query3	6630	205	207	205
query4	18926	17388	17071	17071
query5	3617	498	462	462
query6	251	160	165	160
query7	4583	301	292	292
query8	317	280	298	280
query9	8614	2387	2390	2387
query10	556	306	285	285
query11	10590	10087	9920	9920
query12	120	88	91	88
query13	1633	362	362	362
query14	10345	7661	7953	7661
query15	238	188	192	188
query16	7659	274	261	261
query17	1881	554	518	518
query18	1760	272	270	270
query19	202	155	154	154
query20	90	95	89	89
query21	214	129	127	127
query22	4538	4115	3968	3968
query23	33658	33578	33611	33578
query24	10882	2973	3026	2973
query25	621	391	362	362
query26	716	170	165	165
query27	2218	324	338	324
query28	5845	2119	2111	2111
query29	866	638	623	623
query30	256	156	154	154
query31	962	781	759	759
query32	92	55	53	53
query33	655	312	287	287
query34	917	487	500	487
query35	769	655	647	647
query36	1126	960	977	960
query37	149	73	74	73
query38	2951	2837	2910	2837
query39	904	828	826	826
query40	204	139	136	136
query41	57	57	52	52
query42	115	100	103	100
query43	605	556	555	555
query44	1150	753	728	728
query45	192	161	161	161
query46	1081	731	744	731
query47	1850	1777	1772	1772
query48	366	294	290	290
query49	838	413	414	413
query50	765	383	404	383
query51	6821	6761	6758	6758
query52	109	87	95	87
query53	371	317	289	289
query54	875	469	445	445
query55	73	73	73	73
query56	280	263	261	261
query57	1107	1023	1025	1023
query58	257	241	247	241
query59	3666	3191	3172	3172
query60	313	288	289	288
query61	106	102	139	102
query62	607	438	459	438
query63	317	291	290	290
query64	8480	2225	1720	1720
query65	3166	3113	3071	3071
query66	738	326	320	320
query67	15548	15103	14798	14798
query68	5261	543	547	543
query69	639	473	382	382
query70	1206	1072	1080	1072
query71	455	276	336	276
query72	7565	5530	5352	5352
query73	776	323	319	319
query74	5876	5528	5508	5508
query75	3594	2653	2653	2653
query76	3104	898	903	898
query77	626	317	296	296
query78	10615	9744	9597	9597
query79	2476	524	521	521
query80	1601	471	475	471
query81	594	220	217	217
query82	1297	104	109	104
query83	289	169	167	167
query84	246	91	91	91
query85	1330	281	288	281
query86	480	330	333	330
query87	3234	3097	3059	3059
query88	4103	2333	2323	2323
query89	477	381	405	381
query90	1711	198	199	198
query91	136	110	107	107
query92	62	52	52	52
query93	2115	520	517	517
query94	1178	184	186	184
query95	403	324	316	316
query96	583	269	262	262
query97	3198	2994	2991	2991
query98	219	194	195	194
query99	1322	848	867	848
Total cold run time: 270555 ms
Total hot run time: 173881 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.5 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 68ae1519610e76e7a9ab840564b70e7c6850b558, data reload: false

query1	0.04	0.03	0.03
query2	0.07	0.04	0.04
query3	0.23	0.05	0.05
query4	1.68	0.07	0.07
query5	0.54	0.48	0.48
query6	1.12	0.73	0.72
query7	0.02	0.01	0.01
query8	0.05	0.04	0.05
query9	0.54	0.48	0.47
query10	0.54	0.55	0.53
query11	0.15	0.11	0.12
query12	0.15	0.12	0.11
query13	0.60	0.59	0.60
query14	0.78	0.81	0.77
query15	0.84	0.81	0.81
query16	0.37	0.37	0.38
query17	0.96	0.97	1.02
query18	0.22	0.25	0.24
query19	1.79	1.68	1.71
query20	0.01	0.01	0.01
query21	15.41	0.66	0.65
query22	4.28	7.50	1.92
query23	18.68	1.40	1.36
query24	2.10	0.22	0.23
query25	0.16	0.09	0.08
query26	0.28	0.17	0.18
query27	0.09	0.07	0.08
query28	13.23	1.01	0.99
query29	12.62	3.30	3.34
query30	0.26	0.06	0.06
query31	2.86	0.38	0.40
query32	3.27	0.48	0.46
query33	2.86	2.91	2.89
query34	17.05	4.39	4.40
query35	4.45	4.43	4.46
query36	0.66	0.46	0.48
query37	0.20	0.16	0.15
query38	0.15	0.15	0.14
query39	0.04	0.03	0.04
query40	0.16	0.14	0.15
query41	0.09	0.05	0.04
query42	0.05	0.04	0.04
query43	0.04	0.04	0.03
Total cold run time: 109.69 s
Total hot run time: 30.5 s

Copy link
Contributor

@HappenLee HappenLee left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@github-actions
Copy link
Contributor

PR approved by at least one committer and no changes requested.

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Jun 11, 2024
@BiteTheDDDDt BiteTheDDDDt merged commit 9d56ef1 into apache:master Jun 11, 2024
zclllyybb added a commit to zclllyybb/doris that referenced this pull request Jun 12, 2024
… format string (apache#35883)

## Proposed changes
before:
crash

now:
```sql
mysql> SELECT  DATE_FORMAT('2011-06-24', '%f %V %f %l %V %I %S %p %w %r %j %f %l %I %D %w %j %D %e %s %V %f %D %M %s %X %U %v %c %u %x %r %j %a %h %s %m %a %v %u %b');
+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| date_format(cast('2011-06-24' as DATETIMEV2(0)), '%f %V %f %l %V %I %S %p %w %r %j %f %l %I %D %w %j %D %e %s %V %f %D %M %s %X %U %v %c %u %x %r %j %a %h %s %m %a %v %u %b') |
+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| NULL                                                                                                                                                                           |
+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
1 row in set (0.80 sec)
```
dataroaring pushed a commit that referenced this pull request Jun 13, 2024
… format string (#35883)

## Proposed changes
before:
crash

now:
```sql
mysql> SELECT  DATE_FORMAT('2011-06-24', '%f %V %f %l %V %I %S %p %w %r %j %f %l %I %D %w %j %D %e %s %V %f %D %M %s %X %U %v %c %u %x %r %j %a %h %s %m %a %v %u %b');
+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| date_format(cast('2011-06-24' as DATETIMEV2(0)), '%f %V %f %l %V %I %S %p %w %r %j %f %l %I %D %w %j %D %e %s %V %f %D %M %s %X %U %v %c %u %x %r %j %a %h %s %m %a %v %u %b') |
+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| NULL                                                                                                                                                                           |
+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
1 row in set (0.80 sec)
```
morningman pushed a commit that referenced this pull request Jul 1, 2024
zclllyybb added a commit to zclllyybb/doris that referenced this pull request Jul 2, 2024
… format string (apache#35883)

before:
crash

now:
```sql
mysql> SELECT  DATE_FORMAT('2011-06-24', '%f %V %f %l %V %I %S %p %w %r %j %f %l %I %D %w %j %D %e %s %V %f %D %M %s %X %U %v %c %u %x %r %j %a %h %s %m %a %v %u %b');
+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| date_format(cast('2011-06-24' as DATETIMEV2(0)), '%f %V %f %l %V %I %S %p %w %r %j %f %l %I %D %w %j %D %e %s %V %f %D %M %s %X %U %v %c %u %x %r %j %a %h %s %m %a %v %u %b') |
+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| NULL                                                                                                                                                                           |
+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
1 row in set (0.80 sec)
```
zclllyybb added a commit to zclllyybb/doris that referenced this pull request Jul 2, 2024
… format string (apache#35883)

before:
crash

now:
```sql
mysql> SELECT  DATE_FORMAT('2011-06-24', '%f %V %f %l %V %I %S %p %w %r %j %f %l %I %D %w %j %D %e %s %V %f %D %M %s %X %U %v %c %u %x %r %j %a %h %s %m %a %v %u %b');
+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| date_format(cast('2011-06-24' as DATETIMEV2(0)), '%f %V %f %l %V %I %S %p %w %r %j %f %l %I %D %w %j %D %e %s %V %f %D %M %s %X %U %v %c %u %x %r %j %a %h %s %m %a %v %u %b') |
+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| NULL                                                                                                                                                                           |
+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
1 row in set (0.80 sec)
```
HappenLee pushed a commit that referenced this pull request Jul 3, 2024
mongo360 pushed a commit to mongo360/doris that referenced this pull request Aug 16, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

9 participants