[Feature](Prepared Statment) Implement in nereids planner #35318

eldenmoon · 2024-05-23T14:26:04Z

Proposed changes

This is the first step to implement prepared statment in nererids.

Issue Number: close #xxx

Further comments

If this is a relatively large or complex change, kick off the discussion at dev@doris.apache.org by explaining why you chose the solution you did and what alternatives you considered, etc...

doris-robot · 2024-05-23T14:26:10Z

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

eldenmoon · 2024-05-23T14:29:19Z

run buildall

eldenmoon · 2024-05-27T01:48:28Z

run buildall

doris-robot · 2024-05-27T02:44:36Z

TPC-H: Total hot run time: 41720 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 8ddb39999f4f3ca4099efb3bf5c6d73e10c97798, data reload: false

------ Round 1 ----------------------------------
q1	17594	4328	4273	4273
q2	2019	188	191	188
q3	10533	1170	1234	1170
q4	10200	853	726	726
q5	7486	2708	2693	2693
q6	227	128	135	128
q7	968	628	597	597
q8	9219	2112	2085	2085
q9	9328	6707	6652	6652
q10	9138	3884	3906	3884
q11	490	244	253	244
q12	456	225	233	225
q13	17197	3202	3304	3202
q14	264	219	223	219
q15	508	478	461	461
q16	481	390	404	390
q17	978	605	748	605
q18	8323	7897	7917	7897
q19	4482	1576	1548	1548
q20	650	323	322	322
q21	5133	3931	3981	3931
q22	357	280	281	280
Total cold run time: 116031 ms
Total hot run time: 41720 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4563	4391	4404	4391
q2	374	284	265	265
q3	3154	2949	2906	2906
q4	1931	1675	1636	1636
q5	5460	5464	5430	5430
q6	217	129	131	129
q7	2130	1798	1795	1795
q8	3230	3345	3416	3345
q9	8591	8687	8710	8687
q10	3993	3713	3870	3713
q11	580	491	499	491
q12	798	617	637	617
q13	15924	3164	3150	3150
q14	324	294	273	273
q15	533	479	473	473
q16	490	456	442	442
q17	1799	1550	1485	1485
q18	7645	7685	7530	7530
q19	1652	1514	1533	1514
q20	1982	1785	1808	1785
q21	7362	4803	4760	4760
q22	571	485	490	485
Total cold run time: 73303 ms
Total hot run time: 55302 ms

doris-robot · 2024-05-27T02:55:10Z

TPC-DS: Total hot run time: 168944 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 8ddb39999f4f3ca4099efb3bf5c6d73e10c97798, data reload: false

query1	913	384	371	371
query2	6436	2350	2332	2332
query3	6664	213	209	209
query4	19171	17442	17505	17442
query5	4136	436	420	420
query6	245	168	152	152
query7	4587	307	289	289
query8	238	190	190	190
query9	8556	2370	2365	2365
query10	459	294	270	270
query11	10300	10122	10141	10122
query12	141	93	90	90
query13	1664	371	364	364
query14	9319	7672	6210	6210
query15	212	174	174	174
query16	7742	277	271	271
query17	1295	545	532	532
query18	1965	278	280	278
query19	215	164	163	163
query20	98	92	87	87
query21	198	134	132	132
query22	4288	3901	3841	3841
query23	33477	32956	33130	32956
query24	6869	2822	2825	2822
query25	460	357	376	357
query26	701	165	167	165
query27	1860	324	316	316
query28	3672	2050	2056	2050
query29	844	605	618	605
query30	248	176	174	174
query31	942	762	741	741
query32	61	75	53	53
query33	502	269	262	262
query34	847	489	474	474
query35	704	614	602	602
query36	1057	949	852	852
query37	115	70	75	70
query38	2880	2777	2785	2777
query39	859	811	789	789
query40	197	129	129	129
query41	47	46	45	45
query42	105	98	97	97
query43	570	564	562	562
query44	1068	724	736	724
query45	185	171	169	169
query46	1072	714	734	714
query47	1859	1737	1787	1737
query48	387	295	293	293
query49	777	382	394	382
query50	773	389	393	389
query51	6905	6781	6735	6735
query52	100	99	91	91
query53	358	289	291	289
query54	537	430	422	422
query55	76	74	73	73
query56	266	248	245	245
query57	1139	1034	1013	1013
query58	230	219	214	214
query59	3317	3204	3166	3166
query60	289	286	260	260
query61	94	117	86	86
query62	556	453	466	453
query63	315	289	288	288
query64	2539	1738	1718	1718
query65	3172	3119	3100	3100
query66	789	335	329	329
query67	15305	14773	14844	14773
query68	4609	543	551	543
query69	458	273	284	273
query70	1174	1138	1166	1138
query71	383	279	273	273
query72	6996	5340	2712	2712
query73	732	323	322	322
query74	6058	5629	5517	5517
query75	3287	2639	2678	2639
query76	2278	1060	1064	1060
query77	417	273	271	271
query78	10321	9882	9729	9729
query79	2479	526	521	521
query80	1102	445	443	443
query81	539	251	248	248
query82	674	100	96	96
query83	252	176	171	171
query84	245	134	84	84
query85	1368	263	257	257
query86	540	287	313	287
query87	3319	3123	3137	3123
query88	4030	2353	2318	2318
query89	484	394	381	381
query90	2059	192	195	192
query91	125	99	99	99
query92	66	50	50	50
query93	2594	519	509	509
query94	1229	186	184	184
query95	404	316	309	309
query96	586	269	263	263
query97	3194	3023	3036	3023
query98	256	213	220	213
query99	1187	889	831	831
Total cold run time: 251412 ms
Total hot run time: 168944 ms

doris-robot · 2024-05-27T03:00:40Z

ClickBench: Total hot run time: 30.09 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 8ddb39999f4f3ca4099efb3bf5c6d73e10c97798, data reload: false

query1	0.04	0.03	0.03
query2	0.08	0.04	0.04
query3	0.23	0.06	0.05
query4	1.66	0.07	0.06
query5	0.50	0.50	0.52
query6	1.13	0.73	0.72
query7	0.02	0.01	0.01
query8	0.04	0.04	0.04
query9	0.54	0.48	0.49
query10	0.53	0.55	0.54
query11	0.15	0.12	0.11
query12	0.15	0.12	0.12
query13	0.59	0.59	0.61
query14	0.77	0.81	0.76
query15	0.83	0.82	0.81
query16	0.36	0.36	0.37
query17	1.02	1.00	1.02
query18	0.23	0.25	0.24
query19	1.80	1.73	1.81
query20	0.01	0.01	0.02
query21	15.74	0.67	0.67
query22	4.29	7.89	1.34
query23	18.16	1.43	1.26
query24	1.85	0.28	0.20
query25	0.16	0.08	0.08
query26	0.25	0.17	0.16
query27	0.08	0.08	0.08
query28	13.25	1.02	0.99
query29	13.43	3.31	3.35
query30	0.24	0.06	0.06
query31	2.85	0.39	0.39
query32	3.29	0.47	0.47
query33	2.84	2.91	2.89
query34	16.86	4.42	4.46
query35	4.52	4.51	4.54
query36	0.70	0.48	0.47
query37	0.17	0.15	0.16
query38	0.15	0.14	0.15
query39	0.04	0.03	0.04
query40	0.17	0.14	0.16
query41	0.09	0.05	0.05
query42	0.05	0.05	0.05
query43	0.04	0.04	0.03
Total cold run time: 109.9 s
Total hot run time: 30.09 s

fe/fe-core/src/main/antlr4/org/apache/doris/nereids/DorisLexer.g4

fe/fe-core/src/main/java/org/apache/doris/nereids/trees/expressions/PlaceholderExpr.java

fe/fe-core/src/main/java/org/apache/doris/nereids/trees/plans/commands/PreparedCommand.java

fe/fe-core/src/main/java/org/apache/doris/qe/MysqlConnectProcessor.java

eldenmoon · 2024-05-28T10:10:57Z

run buildall

doris-robot · 2024-05-28T11:10:57Z

TPC-H: Total hot run time: 40105 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 5ebec7e34dd32ee601563b97551f1642fbd915d9, data reload: false

------ Round 1 ----------------------------------
q1	17620	4431	4294	4294
q2	2026	215	195	195
q3	10721	1331	1214	1214
q4	10701	786	774	774
q5	7816	2698	2785	2698
q6	220	136	138	136
q7	964	620	625	620
q8	9556	2134	2115	2115
q9	9002	6604	6565	6565
q10	9421	3706	3708	3706
q11	455	252	237	237
q12	512	227	218	218
q13	17762	2982	2974	2974
q14	294	236	215	215
q15	504	469	463	463
q16	518	379	386	379
q17	956	624	724	624
q18	8252	7424	7448	7424
q19	2803	1553	1490	1490
q20	672	312	309	309
q21	4994	3174	3834	3174
q22	341	281	289	281
Total cold run time: 116110 ms
Total hot run time: 40105 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4407	4222	4218	4218
q2	363	265	275	265
q3	2932	2894	2701	2701
q4	1924	1593	1616	1593
q5	5239	5324	5296	5296
q6	208	124	128	124
q7	2140	1698	1710	1698
q8	3213	3314	3325	3314
q9	8347	8349	8346	8346
q10	3869	3662	3682	3662
q11	573	484	494	484
q12	747	582	583	582
q13	16586	2983	3010	2983
q14	303	271	265	265
q15	517	470	473	470
q16	486	420	409	409
q17	1766	1497	1456	1456
q18	7696	7631	7603	7603
q19	1658	1572	1540	1540
q20	1987	1794	1811	1794
q21	4855	4707	4737	4707
q22	617	475	465	465
Total cold run time: 70433 ms
Total hot run time: 53975 ms

doris-robot · 2024-05-28T11:21:55Z

TPC-DS: Total hot run time: 172805 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 5ebec7e34dd32ee601563b97551f1642fbd915d9, data reload: false

query1	914	390	370	370
query2	6465	2398	2214	2214
query3	6665	207	204	204
query4	19370	17311	17361	17311
query5	4138	415	414	414
query6	248	154	166	154
query7	4581	300	298	298
query8	251	183	188	183
query9	8631	2437	2437	2437
query10	447	290	281	281
query11	10733	10044	10362	10044
query12	137	88	91	88
query13	1646	362	368	362
query14	8820	7842	7549	7549
query15	240	168	169	168
query16	7990	271	258	258
query17	1840	524	505	505
query18	1953	268	274	268
query19	198	153	150	150
query20	90	86	92	86
query21	201	135	128	128
query22	4241	4191	3859	3859
query23	33599	32888	32929	32888
query24	11663	2797	2836	2797
query25	644	344	351	344
query26	1783	161	157	157
query27	2963	336	329	329
query28	7545	2091	2093	2091
query29	1026	615	609	609
query30	272	149	148	148
query31	1011	754	760	754
query32	91	53	52	52
query33	758	268	265	265
query34	1030	483	470	470
query35	725	622	598	598
query36	1102	922	925	922
query37	179	63	65	63
query38	2884	2784	2743	2743
query39	840	778	803	778
query40	273	127	125	125
query41	46	45	46	45
query42	109	97	100	97
query43	583	549	550	549
query44	1257	731	751	731
query45	178	162	158	158
query46	1073	732	727	727
query47	1834	1760	1815	1760
query48	382	305	301	301
query49	1202	376	381	376
query50	769	397	392	392
query51	6834	6828	6834	6828
query52	98	89	95	89
query53	348	289	308	289
query54	1024	445	439	439
query55	75	71	71	71
query56	304	244	242	242
query57	1140	1039	1048	1039
query58	224	229	211	211
query59	3418	3236	3208	3208
query60	272	260	252	252
query61	87	85	83	83
query62	669	468	454	454
query63	310	286	287	286
query64	9772	2274	1728	1728
query65	3171	3124	3113	3113
query66	1362	324	331	324
query67	15171	14780	14804	14780
query68	4598	548	555	548
query69	438	264	273	264
query70	1186	1130	1111	1111
query71	411	267	259	259
query72	7365	5424	5497	5424
query73	737	337	329	329
query74	6195	5765	5581	5581
query75	3482	2645	2617	2617
query76	2905	985	1027	985
query77	429	262	261	261
query78	10320	9986	9769	9769
query79	2212	512	520	512
query80	995	449	428	428
query81	522	220	226	220
query82	638	93	88	88
query83	259	168	169	168
query84	240	83	89	83
query85	1907	295	260	260
query86	498	295	317	295
query87	3302	3052	3127	3052
query88	4299	2452	2434	2434
query89	486	371	382	371
query90	2035	195	191	191
query91	124	97	97	97
query92	60	50	48	48
query93	2244	523	518	518
query94	1193	187	191	187
query95	407	315	319	315
query96	587	268	269	268
query97	3196	3039	3026	3026
query98	235	227	208	208
query99	1076	852	869	852
Total cold run time: 274480 ms
Total hot run time: 172805 ms

doris-robot · 2024-05-28T11:27:25Z

ClickBench: Total hot run time: 30.92 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 5ebec7e34dd32ee601563b97551f1642fbd915d9, data reload: false

query1	0.04	0.04	0.03
query2	0.08	0.04	0.05
query3	0.23	0.05	0.05
query4	1.68	0.07	0.08
query5	0.51	0.48	0.48
query6	1.13	0.72	0.72
query7	0.02	0.02	0.01
query8	0.05	0.04	0.04
query9	0.55	0.49	0.49
query10	0.53	0.56	0.54
query11	0.16	0.11	0.11
query12	0.15	0.12	0.12
query13	0.59	0.59	0.58
query14	0.78	0.77	0.78
query15	0.81	0.81	0.81
query16	0.37	0.37	0.38
query17	1.04	0.98	1.03
query18	0.25	0.24	0.22
query19	1.75	1.73	1.70
query20	0.02	0.01	0.01
query21	15.46	0.71	0.67
query22	4.41	6.85	2.32
query23	18.32	1.31	1.24
query24	1.64	0.27	0.22
query25	0.15	0.09	0.08
query26	0.25	0.16	0.18
query27	0.08	0.08	0.09
query28	13.34	1.00	0.99
query29	13.19	3.26	3.21
query30	0.24	0.06	0.05
query31	2.88	0.38	0.38
query32	3.31	0.48	0.46
query33	2.91	2.92	2.91
query34	17.19	4.42	4.45
query35	4.46	4.52	4.54
query36	0.65	0.47	0.46
query37	0.18	0.15	0.15
query38	0.15	0.15	0.14
query39	0.05	0.04	0.03
query40	0.16	0.14	0.15
query41	0.10	0.05	0.05
query42	0.06	0.06	0.06
query43	0.04	0.04	0.04
Total cold run time: 109.96 s
Total hot run time: 30.92 s

fe/fe-core/src/main/java/org/apache/doris/nereids/StatementContext.java

fe/fe-core/src/main/java/org/apache/doris/nereids/parser/LogicalPlanBuilder.java

fe/fe-core/src/main/java/org/apache/doris/nereids/rules/analysis/ExpressionAnalyzer.java

fe/fe-core/src/main/java/org/apache/doris/nereids/trees/expressions/Placeholder.java

fe/fe-core/src/main/java/org/apache/doris/nereids/trees/plans/commands/PreparedCommand.java

fe/fe-core/src/main/java/org/apache/doris/nereids/trees/plans/commands/ExecuteCommand.java

fe/fe-core/src/main/java/org/apache/doris/qe/PreparedStatementContext.java

eldenmoon · 2024-05-30T11:28:20Z

run buildall

doris-robot · 2024-05-30T11:49:30Z

TPC-H: Total hot run time: 40138 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit a89590140243d16b09ebf9c89da9c2daa92fe6e2, data reload: false

------ Round 1 ----------------------------------
q1	17670	4377	4242	4242
q2	2034	200	194	194
q3	10734	1301	1200	1200
q4	10588	782	732	732
q5	7516	2710	2756	2710
q6	221	136	138	136
q7	963	608	594	594
q8	9250	2096	2073	2073
q9	9250	6615	6592	6592
q10	9119	3744	3690	3690
q11	456	232	239	232
q12	564	228	222	222
q13	17753	2980	2995	2980
q14	261	232	223	223
q15	524	465	471	465
q16	523	394	382	382
q17	967	717	681	681
q18	7997	7496	7402	7402
q19	4382	1597	1560	1560
q20	657	314	301	301
q21	5032	3206	3936	3206
q22	378	321	329	321
Total cold run time: 116839 ms
Total hot run time: 40138 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4366	4282	4210	4210
q2	367	267	260	260
q3	2955	2789	2744	2744
q4	1852	1595	1559	1559
q5	5228	5265	5238	5238
q6	212	122	123	122
q7	2116	1736	1724	1724
q8	3211	3308	3285	3285
q9	8298	8289	8335	8289
q10	3846	3688	3690	3688
q11	598	496	490	490
q12	753	577	596	577
q13	16367	2962	3014	2962
q14	294	252	259	252
q15	510	469	493	469
q16	470	413	410	410
q17	1773	1484	1440	1440
q18	7641	7468	7386	7386
q19	1693	1608	1556	1556
q20	1977	1757	1776	1757
q21	4907	4709	4560	4560
q22	615	520	518	518
Total cold run time: 70049 ms
Total hot run time: 53496 ms

doris-robot · 2024-05-30T12:00:24Z

TPC-DS: Total hot run time: 168642 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit a89590140243d16b09ebf9c89da9c2daa92fe6e2, data reload: false

query1	932	384	366	366
query2	6459	2435	2465	2435
query3	6663	209	211	209
query4	19787	17262	17480	17262
query5	4179	421	424	421
query6	248	165	177	165
query7	4576	295	305	295
query8	314	288	302	288
query9	8581	2397	2377	2377
query10	449	292	265	265
query11	10612	10246	10104	10104
query12	135	98	87	87
query13	1641	369	359	359
query14	8984	6875	7499	6875
query15	235	193	185	185
query16	7804	257	262	257
query17	1851	530	527	527
query18	1976	274	270	270
query19	198	150	162	150
query20	97	88	101	88
query21	194	129	130	129
query22	4282	4245	3921	3921
query23	33601	33153	32729	32729
query24	11937	2708	2817	2708
query25	696	375	359	359
query26	1825	155	159	155
query27	3041	315	315	315
query28	7436	2071	2083	2071
query29	1166	611	600	600
query30	307	146	153	146
query31	946	740	758	740
query32	86	54	55	54
query33	771	263	255	255
query34	1018	478	462	462
query35	769	613	574	574
query36	1053	912	899	899
query37	192	69	65	65
query38	2896	2776	2736	2736
query39	826	788	799	788
query40	272	122	123	122
query41	52	51	52	51
query42	100	96	95	95
query43	596	603	570	570
query44	1212	728	744	728
query45	188	164	173	164
query46	1082	740	710	710
query47	1861	1789	1800	1789
query48	369	299	282	282
query49	1197	383	383	383
query50	781	368	382	368
query51	6765	6700	6615	6615
query52	97	96	85	85
query53	351	276	282	276
query54	996	431	432	431
query55	75	74	76	74
query56	275	272	247	247
query57	1138	1047	1036	1036
query58	237	208	215	208
query59	3453	3238	3147	3147
query60	288	251	251	251
query61	89	91	86	86
query62	633	465	452	452
query63	315	282	284	282
query64	9796	2242	1707	1707
query65	3247	3087	3111	3087
query66	1388	345	330	330
query67	15120	14933	14760	14760
query68	4982	553	543	543
query69	478	264	265	264
query70	1117	1099	1060	1060
query71	432	265	260	260
query72	7751	2706	2543	2543
query73	761	321	323	321
query74	6068	5670	5681	5670
query75	3638	2620	2598	2598
query76	3190	1023	947	947
query77	665	271	261	261
query78	10171	9625	9802	9625
query79	2617	514	518	514
query80	1240	431	421	421
query81	540	223	222	222
query82	1360	91	93	91
query83	275	174	171	171
query84	234	85	86	85
query85	1569	290	268	268
query86	474	309	297	297
query87	3310	3085	3126	3085
query88	4048	2340	2340	2340
query89	486	395	382	382
query90	2167	191	186	186
query91	132	108	108	108
query92	60	51	50	50
query93	2192	523	505	505
query94	1237	192	187	187
query95	472	307	300	300
query96	585	272	260	260
query97	3189	2992	3007	2992
query98	231	212	213	212
query99	1179	847	850	847
Total cold run time: 277586 ms
Total hot run time: 168642 ms

doris-robot · 2024-05-30T12:05:53Z

ClickBench: Total hot run time: 30.21 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit a89590140243d16b09ebf9c89da9c2daa92fe6e2, data reload: false

query1	0.04	0.04	0.03
query2	0.08	0.04	0.04
query3	0.23	0.04	0.04
query4	1.70	0.07	0.07
query5	0.51	0.48	0.50
query6	1.11	0.71	0.72
query7	0.02	0.01	0.02
query8	0.04	0.04	0.04
query9	0.54	0.51	0.49
query10	0.53	0.55	0.54
query11	0.15	0.11	0.11
query12	0.14	0.12	0.11
query13	0.59	0.60	0.60
query14	0.79	0.77	0.79
query15	0.81	0.80	0.80
query16	0.37	0.36	0.38
query17	0.98	1.03	0.99
query18	0.23	0.22	0.26
query19	1.83	1.69	1.68
query20	0.01	0.01	0.01
query21	15.45	0.73	0.66
query22	4.35	7.63	1.75
query23	18.27	1.25	1.29
query24	1.53	0.36	0.21
query25	0.14	0.08	0.08
query26	0.27	0.16	0.16
query27	0.09	0.08	0.08
query28	13.29	1.01	1.01
query29	12.95	3.26	3.23
query30	0.24	0.06	0.06
query31	2.87	0.38	0.38
query32	3.30	0.46	0.46
query33	2.87	2.82	2.92
query34	17.01	4.48	4.46
query35	4.48	4.45	4.56
query36	0.64	0.46	0.48
query37	0.19	0.16	0.16
query38	0.15	0.14	0.15
query39	0.05	0.04	0.04
query40	0.17	0.15	0.14
query41	0.09	0.04	0.04
query42	0.05	0.05	0.04
query43	0.03	0.04	0.03
Total cold run time: 109.18 s
Total hot run time: 30.21 s

fe/fe-core/src/main/java/org/apache/doris/nereids/trees/expressions/Placeholder.java

...core/src/main/java/org/apache/doris/nereids/trees/expressions/visitor/ExpressionVisitor.java

fe/fe-core/src/main/java/org/apache/doris/nereids/rules/analysis/ExpressionAnalyzer.java

fe/fe-core/src/main/java/org/apache/doris/nereids/trees/plans/commands/PrepareCommand.java

github-actions · 2024-05-31T07:42:20Z

PR approved by at least one committer and no changes requested.

github-actions · 2024-05-31T07:42:22Z

PR approved by anyone and no changes requested.

eldenmoon · 2024-05-31T07:51:49Z

run buildall

doris-robot · 2024-05-31T08:22:38Z

TPC-H: Total hot run time: 40937 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 0567d52d578b2f0d4ea119762b23d2ff2ded4fc0, data reload: false

------ Round 1 ----------------------------------
q1	17626	4325	4248	4248
q2	2046	194	194	194
q3	10457	1257	1175	1175
q4	10187	774	867	774
q5	7487	2706	2671	2671
q6	227	134	131	131
q7	943	628	615	615
q8	9225	2114	2078	2078
q9	10266	6670	6776	6670
q10	9356	3887	3920	3887
q11	444	269	234	234
q12	429	227	222	222
q13	17292	3161	3218	3161
q14	277	224	225	224
q15	506	457	479	457
q16	465	377	394	377
q17	963	720	800	720
q18	8379	7767	7743	7743
q19	6631	1559	1560	1559
q20	634	343	319	319
q21	5046	3876	3158	3158
q22	389	322	320	320
Total cold run time: 119275 ms
Total hot run time: 40937 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4535	4435	4474	4435
q2	364	261	281	261
q3	3146	2909	2899	2899
q4	1907	1571	1591	1571
q5	5396	5499	5527	5499
q6	210	128	131	128
q7	2154	1785	1810	1785
q8	3246	3382	3347	3347
q9	8502	8733	8690	8690
q10	4008	3665	3881	3665
q11	599	514	495	495
q12	794	592	625	592
q13	17084	3152	3141	3141
q14	308	272	262	262
q15	522	474	476	474
q16	490	442	432	432
q17	1826	1534	1482	1482
q18	7664	7468	7414	7414
q19	1641	1455	1438	1438
q20	1970	1789	1769	1769
q21	10713	4799	4739	4739
q22	600	524	525	524
Total cold run time: 77679 ms
Total hot run time: 55042 ms

doris-robot · 2024-05-31T08:33:02Z

TPC-DS: Total hot run time: 168154 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 0567d52d578b2f0d4ea119762b23d2ff2ded4fc0, data reload: false

query1	931	395	369	369
query2	6526	2415	2283	2283
query3	6656	205	207	205
query4	20119	17297	17376	17297
query5	4112	439	414	414
query6	251	175	156	156
query7	4586	305	300	300
query8	314	273	274	273
query9	8410	2381	2389	2381
query10	468	277	257	257
query11	10383	9857	10038	9857
query12	136	87	85	85
query13	1631	363	366	363
query14	9754	6404	6563	6404
query15	215	188	181	181
query16	7212	257	263	257
query17	1360	519	504	504
query18	1864	273	269	269
query19	197	161	154	154
query20	88	82	81	81
query21	194	132	127	127
query22	4276	3858	4008	3858
query23	33642	32875	33118	32875
query24	5111	2864	2802	2802
query25	482	355	358	355
query26	688	154	154	154
query27	1844	318	327	318
query28	3712	2043	2064	2043
query29	825	604	601	601
query30	216	150	148	148
query31	925	786	751	751
query32	59	53	54	53
query33	413	272	277	272
query34	854	493	473	473
query35	753	601	585	585
query36	1034	943	896	896
query37	101	65	67	65
query38	2838	2771	2754	2754
query39	859	807	789	789
query40	196	128	127	127
query41	51	49	51	49
query42	100	97	100	97
query43	575	541	545	541
query44	1061	725	738	725
query45	179	172	168	168
query46	1061	722	718	718
query47	1875	1772	1765	1765
query48	371	298	303	298
query49	762	387	409	387
query50	757	389	385	385
query51	6843	6671	6650	6650
query52	101	96	91	91
query53	352	291	287	287
query54	524	440	438	438
query55	75	71	71	71
query56	258	244	242	242
query57	1126	1038	1022	1022
query58	230	229	209	209
query59	3433	3057	3015	3015
query60	283	253	260	253
query61	93	100	136	100
query62	528	437	447	437
query63	319	293	294	293
query64	2505	1768	1783	1768
query65	3182	3146	3136	3136
query66	677	341	344	341
query67	15111	14772	14578	14578
query68	4612	549	541	541
query69	454	279	285	279
query70	1148	1035	1122	1035
query71	407	276	271	271
query72	7544	2877	2674	2674
query73	708	323	328	323
query74	5948	5618	5567	5567
query75	3298	2652	2650	2650
query76	2290	931	981	931
query77	387	266	268	266
query78	10418	9849	9765	9765
query79	2355	501	510	501
query80	1041	449	448	448
query81	515	223	222	222
query82	695	96	87	87
query83	247	177	179	177
query84	246	87	87	87
query85	1280	324	312	312
query86	473	309	315	309
query87	3328	3138	3113	3113
query88	4169	2350	2350	2350
query89	481	400	375	375
query90	2044	191	184	184
query91	137	107	108	107
query92	60	51	50	50
query93	2498	514	496	496
query94	1238	190	188	188
query95	414	322	316	316
query96	613	277	269	269
query97	3182	3030	2996	2996
query98	256	220	221	220
query99	1228	857	845	845
Total cold run time: 250381 ms
Total hot run time: 168154 ms

doris-robot · 2024-05-31T08:38:31Z

ClickBench: Total hot run time: 30.4 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 0567d52d578b2f0d4ea119762b23d2ff2ded4fc0, data reload: false

query1	0.04	0.03	0.03
query2	0.07	0.04	0.05
query3	0.23	0.05	0.06
query4	1.68	0.08	0.10
query5	0.50	0.49	0.52
query6	1.13	0.73	0.75
query7	0.02	0.02	0.01
query8	0.04	0.04	0.03
query9	0.54	0.50	0.49
query10	0.55	0.54	0.55
query11	0.15	0.11	0.11
query12	0.15	0.12	0.11
query13	0.60	0.59	0.60
query14	0.78	0.77	0.78
query15	0.82	0.81	0.80
query16	0.36	0.36	0.37
query17	1.01	0.99	0.94
query18	0.23	0.24	0.25
query19	1.84	1.67	1.67
query20	0.02	0.01	0.01
query21	15.73	0.65	0.65
query22	4.46	7.06	1.78
query23	18.29	1.35	1.28
query24	1.53	0.34	0.20
query25	0.15	0.10	0.08
query26	0.26	0.16	0.17
query27	0.08	0.08	0.08
query28	13.39	1.01	0.99
query29	13.39	3.33	3.30
query30	0.24	0.05	0.04
query31	2.89	0.38	0.38
query32	3.30	0.46	0.46
query33	2.86	2.91	2.91
query34	17.29	4.45	4.48
query35	4.48	4.52	4.57
query36	0.70	0.47	0.46
query37	0.18	0.16	0.16
query38	0.15	0.14	0.14
query39	0.04	0.03	0.04
query40	0.18	0.13	0.15
query41	0.08	0.04	0.04
query42	0.06	0.04	0.05
query43	0.03	0.03	0.04
Total cold run time: 110.52 s
Total hot run time: 30.4 s

github-actions · 2024-05-31T09:54:03Z

PR approved by at least one committer and no changes requested.

This is the first step to implement prepared statment in nererids.

…36172)

step2: support short circuit query and short circuit(full) prepared step1 PR: #35318 original implementation in legacy planner: #15491

eldenmoon force-pushed the nererids-prep branch from aa6871d to 8ddb399 Compare May 24, 2024 06:37

eldenmoon requested a review from morrySnow May 27, 2024 06:18

morrySnow reviewed May 27, 2024

View reviewed changes

eldenmoon requested a review from morrySnow May 29, 2024 02:29

morrySnow reviewed May 30, 2024

View reviewed changes

morrySnow previously approved these changes May 31, 2024

View reviewed changes

github-actions bot added the approved Indicates a PR has been approved by one committer. label May 31, 2024

github-actions bot added the reviewed label May 31, 2024

eldenmoon added 6 commits May 31, 2024 15:45

implement prepared statement in nererids

8d4ef76

fix profile and auditlog

463c75d

refactor some code

ea17de3

add test case

8910771

refactor

31ee3b5

modify according to cr

c3c8244

2

0567d52

eldenmoon dismissed morrySnow’s stale review via 0567d52 May 31, 2024 07:51

eldenmoon force-pushed the nererids-prep branch from a895901 to 0567d52 Compare May 31, 2024 07:51

github-actions bot removed the approved Indicates a PR has been approved by one committer. label May 31, 2024

qidaye approved these changes May 31, 2024

View reviewed changes

eldenmoon requested a review from morrySnow May 31, 2024 09:53

github-actions bot added the approved Indicates a PR has been approved by one committer. label May 31, 2024

morrySnow approved these changes May 31, 2024

View reviewed changes

eldenmoon merged commit dc72931 into apache:master May 31, 2024

eldenmoon deleted the nererids-prep branch May 31, 2024 09:58

dataroaring pushed a commit that referenced this pull request May 31, 2024

[Feature](Prepared Statment) Implement in nereids planner (#35318)

f638c8e

This is the first step to implement prepared statment in nererids.

eldenmoon mentioned this pull request Jun 4, 2024

[Feature](Point Query) fully support in nereids #35823

Merged

seawinde pushed a commit to seawinde/doris that referenced this pull request Jun 5, 2024

[Feature](Prepared Statment) Implement in nereids planner (apache#35318)

9afa192

This is the first step to implement prepared statment in nererids.

xiaokang added the dev/2.1.x label Jun 7, 2024

eldenmoon added a commit to eldenmoon/incubator-doris that referenced this pull request Jun 12, 2024

[Feature](Prepared Statment) Implement in nereids planner (apache#35318)

0ada698

This is the first step to implement prepared statment in nererids.

xiaokang pushed a commit that referenced this pull request Jun 12, 2024

[Feature](Prepared Statment) Implement in nereids planner (#35318) (#…

9708ca8

…36172)

xiaokang mentioned this pull request Jun 12, 2024

[Feature](Prepared Statment) Implement in nereids planner (#35318) #36172

Merged

xiaokang added dev/2.1.4-merged and removed dev/2.1.x labels Jun 12, 2024

eldenmoon added a commit that referenced this pull request Jun 13, 2024

[Feature](Point Query) fully support in nereids (#35823)

2f517a9

step2: support short circuit query and short circuit(full) prepared step1 PR: #35318 original implementation in legacy planner: #15491

dataroaring pushed a commit that referenced this pull request Jun 13, 2024

[Feature](Point Query) fully support in nereids (#35823)

166ef6d

step2: support short circuit query and short circuit(full) prepared step1 PR: #35318 original implementation in legacy planner: #15491

dataroaring added the dev/3.0.0-merged label Aug 5, 2024

[Feature](Prepared Statment) Implement in nereids planner #35318

[Feature](Prepared Statment) Implement in nereids planner #35318

Uh oh!

Conversation

eldenmoon commented May 23, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Proposed changes

Further comments

Uh oh!

doris-robot commented May 23, 2024

Uh oh!

eldenmoon commented May 23, 2024

Uh oh!

eldenmoon commented May 27, 2024

Uh oh!

doris-robot commented May 27, 2024

Uh oh!

doris-robot commented May 27, 2024

Uh oh!

doris-robot commented May 27, 2024

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

eldenmoon commented May 28, 2024

Uh oh!

doris-robot commented May 28, 2024

Uh oh!

doris-robot commented May 28, 2024

Uh oh!

doris-robot commented May 28, 2024

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

eldenmoon commented May 30, 2024

Uh oh!

doris-robot commented May 30, 2024

Uh oh!

doris-robot commented May 30, 2024

Uh oh!

doris-robot commented May 30, 2024

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

github-actions bot commented May 31, 2024

Uh oh!

github-actions bot commented May 31, 2024

Uh oh!

eldenmoon commented May 31, 2024

Uh oh!

doris-robot commented May 31, 2024

Uh oh!

doris-robot commented May 31, 2024

Uh oh!

doris-robot commented May 31, 2024

Uh oh!

github-actions bot commented May 31, 2024

Uh oh!

Reviewers

Assignees

eldenmoon commented May 23, 2024 •

edited

Loading