Skip to content

Conversation

@LiBinfeng-01
Copy link
Contributor

@LiBinfeng-01 LiBinfeng-01 commented May 13, 2024

Proposed changes

Problem:
When using current_date as input of functions like date_sub, fold constant would failed cause of missing of function signature
in Planner
Solved:
Add complete function signature of functions like date_sub

Further comments

If this is a relatively large or complex change, kick off the discussion at dev@doris.apache.org by explaining why you chose the solution you did and what alternatives you considered, etc...

@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@LiBinfeng-01
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 40017 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 6dab5b50e2aad0c07c29930fcedd9b94bdac9d36, data reload: false

------ Round 1 ----------------------------------
q1	4785	4662	4240	4240
q2	417	190	196	190
q3	6061	1138	1183	1138
q4	1007	802	712	712
q5	2639	2692	2663	2663
q6	219	139	140	139
q7	1021	585	708	585
q8	2207	2161	2127	2127
q9	6571	6494	6493	6493
q10	3806	3731	3774	3731
q11	357	241	236	236
q12	377	221	215	215
q13	17785	2963	2993	2963
q14	254	224	211	211
q15	523	466	486	466
q16	491	382	376	376
q17	947	636	726	636
q18	7948	7533	7498	7498
q19	2726	1553	1465	1465
q20	919	309	307	307
q21	13934	3927	3344	3344
q22	354	282	289	282
Total cold run time: 75348 ms
Total hot run time: 40017 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4227	4235	4343	4235
q2	374	269	262	262
q3	3006	2783	2759	2759
q4	1855	1595	1627	1595
q5	5294	5274	5312	5274
q6	212	127	126	126
q7	2241	1905	1907	1905
q8	3221	3348	3359	3348
q9	8334	8329	8320	8320
q10	3849	3680	3661	3661
q11	597	499	488	488
q12	753	610	565	565
q13	3497	3036	2956	2956
q14	277	259	261	259
q15	517	487	481	481
q16	471	414	413	413
q17	1749	1500	1454	1454
q18	7559	7726	7538	7538
q19	1655	1576	1523	1523
q20	1944	1787	1763	1763
q21	4939	4811	4836	4811
q22	586	481	488	481
Total cold run time: 57157 ms
Total hot run time: 54217 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 186855 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 6dab5b50e2aad0c07c29930fcedd9b94bdac9d36, data reload: false

query1	917	366	347	347
query2	7600	2297	2377	2297
query3	6645	214	211	211
query4	23955	21227	21319	21227
query5	4176	417	416	416
query6	279	173	174	173
query7	4583	292	285	285
query8	244	188	191	188
query9	8590	2428	2414	2414
query10	433	241	239	239
query11	14760	14241	14201	14201
query12	134	91	89	89
query13	1659	378	373	373
query14	10608	8292	7534	7534
query15	251	169	173	169
query16	8175	262	250	250
query17	1864	564	536	536
query18	2095	272	270	270
query19	237	150	151	150
query20	90	85	84	84
query21	189	126	123	123
query22	5071	4768	4882	4768
query23	34299	33617	33515	33515
query24	10751	3015	2889	2889
query25	633	370	359	359
query26	1383	155	152	152
query27	2872	316	316	316
query28	7612	2070	2065	2065
query29	878	601	599	599
query30	296	165	151	151
query31	999	758	741	741
query32	94	52	56	52
query33	750	257	246	246
query34	1048	481	477	477
query35	798	672	664	664
query36	1068	975	938	938
query37	140	70	69	69
query38	2891	2761	2785	2761
query39	1630	1566	1623	1566
query40	206	126	130	126
query41	45	41	40	40
query42	105	95	98	95
query43	573	565	567	565
query44	1201	722	746	722
query45	267	261	258	258
query46	1124	725	718	718
query47	1975	1870	1865	1865
query48	377	302	301	301
query49	1065	398	387	387
query50	763	394	396	394
query51	6810	6589	6607	6589
query52	103	87	91	87
query53	345	281	276	276
query54	873	430	440	430
query55	74	72	72	72
query56	235	216	221	216
query57	1244	1139	1154	1139
query58	232	197	203	197
query59	3534	3173	3332	3173
query60	265	230	236	230
query61	119	91	86	86
query62	692	476	470	470
query63	305	288	281	281
query64	8893	7366	7350	7350
query65	3110	3147	3065	3065
query66	945	331	350	331
query67	15357	15000	14891	14891
query68	4737	531	528	528
query69	501	311	305	305
query70	1135	1122	1104	1104
query71	418	265	266	265
query72	7948	2585	2372	2372
query73	705	328	327	327
query74	6570	6155	6084	6084
query75	3476	2635	2623	2623
query76	2874	957	972	957
query77	413	274	258	258
query78	10441	10146	10028	10028
query79	2347	509	508	508
query80	1178	438	440	438
query81	527	217	220	217
query82	955	96	100	96
query83	248	176	176	176
query84	241	94	94	94
query85	1365	322	324	322
query86	456	293	309	293
query87	3262	3108	3106	3106
query88	3526	2429	2437	2429
query89	476	392	373	373
query90	1960	191	186	186
query91	122	96	97	96
query92	63	48	49	48
query93	1962	508	490	490
query94	1220	180	180	180
query95	390	296	301	296
query96	582	280	273	273
query97	3169	3047	3026	3026
query98	254	226	218	218
query99	1165	881	892	881
Total cold run time: 286220 ms
Total hot run time: 186855 ms

@LiBinfeng-01
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 40258 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit b54070e9d39cf078ba053f7297a081c3fbe3940f, data reload: false

------ Round 1 ----------------------------------
q1	17611	5214	4295	4295
q2	2018	194	203	194
q3	10462	1196	1194	1194
q4	10148	949	755	755
q5	7463	2838	2675	2675
q6	218	130	138	130
q7	980	543	522	522
q8	9234	2132	2112	2112
q9	9255	6685	6581	6581
q10	9002	3832	3804	3804
q11	456	244	237	237
q12	452	224	230	224
q13	17764	2955	2965	2955
q14	265	217	230	217
q15	518	485	492	485
q16	516	389	378	378
q17	977	666	692	666
q18	8267	7536	7525	7525
q19	1614	1555	1519	1519
q20	638	308	297	297
q21	5146	3217	3987	3217
q22	345	283	276	276
Total cold run time: 113349 ms
Total hot run time: 40258 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4281	4273	4312	4273
q2	373	284	267	267
q3	3037	2745	2752	2745
q4	1849	1588	1607	1588
q5	5298	5313	5278	5278
q6	211	124	127	124
q7	1744	1379	1375	1375
q8	3244	3343	3325	3325
q9	8459	8411	8397	8397
q10	4021	3814	3840	3814
q11	605	482	500	482
q12	787	599	611	599
q13	16375	2964	2958	2958
q14	291	252	256	252
q15	534	486	470	470
q16	477	415	423	415
q17	1851	1529	1468	1468
q18	7890	7538	7614	7538
q19	3245	1579	1507	1507
q20	2011	1778	1798	1778
q21	4994	5088	5005	5005
q22	563	483	480	480
Total cold run time: 72140 ms
Total hot run time: 54138 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 187683 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit b54070e9d39cf078ba053f7297a081c3fbe3940f, data reload: false

query1	908	375	355	355
query2	6454	2443	2341	2341
query3	6655	202	209	202
query4	22949	21289	21193	21193
query5	4134	441	434	434
query6	270	172	175	172
query7	4585	303	292	292
query8	246	194	200	194
query9	8426	2454	2445	2445
query10	451	255	263	255
query11	14775	14236	14123	14123
query12	145	97	91	91
query13	1644	398	393	393
query14	10496	7939	8751	7939
query15	286	164	177	164
query16	8182	273	261	261
query17	1842	569	567	567
query18	2094	275	268	268
query19	222	151	155	151
query20	100	91	95	91
query21	197	131	131	131
query22	5003	4903	4835	4835
query23	34065	33881	33339	33339
query24	10479	2969	2893	2893
query25	573	378	376	376
query26	704	160	160	160
query27	2200	336	334	334
query28	5725	2060	2074	2060
query29	853	643	618	618
query30	282	159	153	153
query31	958	755	761	755
query32	97	52	55	52
query33	648	254	256	254
query34	896	494	496	494
query35	813	711	688	688
query36	1119	950	946	946
query37	118	65	75	65
query38	2868	2803	2772	2772
query39	1631	1571	1550	1550
query40	196	129	128	128
query41	44	38	38	38
query42	107	98	101	98
query43	595	559	537	537
query44	1106	730	753	730
query45	280	254	261	254
query46	1096	761	742	742
query47	1932	1867	1847	1847
query48	376	323	305	305
query49	1045	404	438	404
query50	787	396	392	392
query51	6860	6666	6785	6666
query52	105	92	91	91
query53	362	292	289	289
query54	864	435	441	435
query55	74	73	74	73
query56	243	228	224	224
query57	1222	1145	1143	1143
query58	223	203	204	203
query59	3378	3235	3241	3235
query60	253	241	254	241
query61	90	93	89	89
query62	685	498	466	466
query63	327	293	290	290
query64	8621	7447	7410	7410
query65	3179	3095	3088	3088
query66	829	348	351	348
query67	15558	14850	14899	14850
query68	4655	539	536	536
query69	495	312	319	312
query70	1090	1099	1157	1099
query71	418	278	285	278
query72	7526	2603	2400	2400
query73	727	338	346	338
query74	6568	6096	6214	6096
query75	3436	2709	2644	2644
query76	2977	1120	955	955
query77	449	271	272	271
query78	10673	10273	10044	10044
query79	2494	527	529	527
query80	1145	446	446	446
query81	536	225	224	224
query82	731	101	92	92
query83	260	163	166	163
query84	246	93	92	92
query85	1547	273	266	266
query86	523	293	286	286
query87	3287	3068	3085	3068
query88	4276	2446	2454	2446
query89	482	401	399	399
query90	1994	193	190	190
query91	126	97	99	97
query92	59	51	50	50
query93	1723	512	494	494
query94	1148	183	189	183
query95	401	316	308	308
query96	616	281	272	272
query97	3179	2969	3018	2969
query98	232	219	219	219
query99	1237	906	897	897
Total cold run time: 279786 ms
Total hot run time: 187683 ms

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label May 15, 2024
@github-actions
Copy link
Contributor

PR approved by at least one committer and no changes requested.

@github-actions
Copy link
Contributor

PR approved by anyone and no changes requested.

@morrySnow morrySnow merged commit 0905133 into apache:master May 15, 2024
morrySnow pushed a commit that referenced this pull request May 15, 2024
…ture (#34760)

pick from master #34761

Problem:
When using current_date as input of functions like date_sub, fold constant would failed cause of missing of function signature in Planner

Solved:
Add complete function signature of functions like date_sub
yiguolei pushed a commit that referenced this pull request May 18, 2024
…ture (#34761)

Problem:
When using current_date as input of functions like date_sub,
fold constant would failed cause of missing of function signature in Planner

Solved:
Add complete function signature of functions like date_sub
mongo360 pushed a commit to mongo360/doris that referenced this pull request Aug 16, 2024
…ture (apache#34760)

pick from master apache#34761

Problem:
When using current_date as input of functions like date_sub, fold constant would failed cause of missing of function signature in Planner

Solved:
Add complete function signature of functions like date_sub
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

6 participants