Skip to content

Conversation

@LiBinfeng-01
Copy link
Contributor

Proposed changes

Problem:
when ntile using 0 as parameter, be would core because no checking of parameter
Solved:
check parameter in fe analyze

Further comments

If this is a relatively large or complex change, kick off the discussion at dev@doris.apache.org by explaining why you chose the solution you did and what alternatives you considered, etc...

@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@LiBinfeng-01
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 37354 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 51146867783b921ea7c5ebbeb77803db1d8a5160, data reload: false

------ Round 1 ----------------------------------
q1	17658	4138	4073	4073
q2	2101	150	154	150
q3	10592	1174	1176	1174
q4	10242	725	824	725
q5	7466	2920	2912	2912
q6	202	127	122	122
q7	1011	573	574	573
q8	9321	1973	1961	1961
q9	6945	6348	6275	6275
q10	8443	3444	3543	3444
q11	431	220	209	209
q12	403	197	192	192
q13	17795	2849	2848	2848
q14	240	206	203	203
q15	505	464	462	462
q16	482	371	367	367
q17	940	523	638	523
q18	6996	6430	6360	6360
q19	4647	1462	1401	1401
q20	549	246	245	245
q21	3531	2849	2850	2849
q22	344	299	286	286
Total cold run time: 110844 ms
Total hot run time: 37354 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4104	4053	4028	4028
q2	319	228	228	228
q3	2940	2838	2786	2786
q4	1812	1520	1499	1499
q5	5186	5208	5242	5208
q6	197	115	116	115
q7	2162	1794	1792	1792
q8	3139	3255	3258	3255
q9	8389	8425	8379	8379
q10	3826	3792	3971	3792
q11	550	460	456	456
q12	755	593	575	575
q13	17114	3029	3058	3029
q14	314	261	276	261
q15	506	494	483	483
q16	506	448	469	448
q17	1760	1537	1538	1537
q18	7969	7682	7474	7474
q19	1626	1585	1490	1490
q20	2020	1817	1842	1817
q21	4929	4783	4756	4756
q22	545	466	450	450
Total cold run time: 70668 ms
Total hot run time: 53858 ms

@LiBinfeng-01
Copy link
Contributor Author

run buildall

@LiBinfeng-01
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 37852 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit d8f8e356d28171e3940b0b55fb625abdb0ad142a, data reload: false

------ Round 1 ----------------------------------
q1	17694	4317	4244	4244
q2	2339	161	156	156
q3	11623	1166	1249	1166
q4	10385	740	831	740
q5	7662	2955	2939	2939
q6	205	130	130	130
q7	1067	596	581	581
q8	9349	2032	1999	1999
q9	7036	6302	6334	6302
q10	8423	3487	3588	3487
q11	427	233	222	222
q12	368	205	199	199
q13	17791	2869	2903	2869
q14	243	210	195	195
q15	519	475	454	454
q16	456	376	369	369
q17	936	533	570	533
q18	7214	6587	6442	6442
q19	1537	1456	1377	1377
q20	564	270	259	259
q21	3685	2995	2901	2901
q22	342	293	288	288
Total cold run time: 109865 ms
Total hot run time: 37852 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4069	4066	4060	4060
q2	333	252	233	233
q3	2933	2870	2839	2839
q4	1889	1591	1566	1566
q5	5193	5253	5248	5248
q6	196	116	116	116
q7	2211	1809	1819	1809
q8	3179	3275	3337	3275
q9	8509	8406	8429	8406
q10	3796	3817	3788	3788
q11	542	445	457	445
q12	737	558	536	536
q13	16993	2892	2854	2854
q14	305	252	257	252
q15	505	449	462	449
q16	473	418	429	418
q17	1736	1489	1456	1456
q18	7419	7092	7239	7092
q19	1603	1521	1580	1521
q20	1895	1734	1720	1720
q21	4806	4695	4657	4657
q22	516	456	453	453
Total cold run time: 69838 ms
Total hot run time: 53193 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 182310 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit d8f8e356d28171e3940b0b55fb625abdb0ad142a, data reload: false

query1	938	356	355	355
query2	6533	2092	1871	1871
query3	6706	218	219	218
query4	31721	21399	21409	21399
query5	4321	418	401	401
query6	278	181	167	167
query7	4633	304	297	297
query8	233	173	172	172
query9	9324	2312	2280	2280
query10	528	261	280	261
query11	15507	14206	14292	14206
query12	144	97	88	88
query13	1627	434	436	434
query14	9233	7827	8091	7827
query15	241	190	181	181
query16	8220	268	267	267
query17	1986	583	570	570
query18	2075	290	298	290
query19	334	167	155	155
query20	101	87	90	87
query21	206	127	127	127
query22	5005	4840	4803	4803
query23	33743	32928	32791	32791
query24	11680	2938	2859	2859
query25	672	384	391	384
query26	1799	158	162	158
query27	2900	327	321	321
query28	7947	1913	1892	1892
query29	1042	622	591	591
query30	305	146	145	145
query31	965	716	740	716
query32	86	57	53	53
query33	759	256	253	253
query34	1065	480	492	480
query35	893	693	694	693
query36	1031	903	912	903
query37	169	66	65	65
query38	3574	3445	3515	3445
query39	1580	1563	1543	1543
query40	287	106	110	106
query41	48	47	46	46
query42	108	96	101	96
query43	490	457	445	445
query44	1220	730	743	730
query45	273	243	260	243
query46	1103	702	704	702
query47	1942	1839	1839	1839
query48	434	369	369	369
query49	1216	338	336	336
query50	770	377	383	377
query51	6687	6718	6482	6482
query52	106	90	93	90
query53	337	268	274	268
query54	310	254	243	243
query55	89	76	77	76
query56	250	227	235	227
query57	1214	1114	1121	1114
query58	233	209	210	209
query59	2729	2618	2531	2531
query60	259	245	260	245
query61	101	100	96	96
query62	648	456	443	443
query63	313	277	275	275
query64	6709	4036	4137	4036
query65	3128	3019	3052	3019
query66	1445	369	372	369
query67	15497	15162	15274	15162
query68	5380	550	545	545
query69	561	380	398	380
query70	1208	1170	1151	1151
query71	434	274	275	274
query72	6326	2687	2494	2494
query73	712	333	339	333
query74	6749	6510	6426	6426
query75	2981	2231	2240	2231
query76	3537	755	870	755
query77	403	274	264	264
query78	10935	10077	10122	10077
query79	8471	536	542	536
query80	1650	379	371	371
query81	526	220	213	213
query82	884	89	93	89
query83	217	154	151	151
query84	287	80	79	79
query85	1527	307	299	299
query86	462	313	307	307
query87	3779	3543	3512	3512
query88	5381	2424	2425	2424
query89	501	403	370	370
query90	2058	180	183	180
query91	177	133	139	133
query92	61	49	51	49
query93	6819	510	489	489
query94	1140	184	179	179
query95	408	320	316	316
query96	620	275	279	275
query97	2656	2458	2453	2453
query98	236	218	212	212
query99	1229	857	821	821
Total cold run time: 306365 ms
Total hot run time: 182310 ms

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit d8f8e356d28171e3940b0b55fb625abdb0ad142a with default session variables
Stream load json:         18 seconds loaded 2358488459 Bytes, about 124 MB/s
Stream load orc:          59 seconds loaded 1101869774 Bytes, about 17 MB/s
Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select:       13.8 seconds inserted 10000000 Rows, about 724K ops/s

@LiBinfeng-01
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 38079 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit d8f8e356d28171e3940b0b55fb625abdb0ad142a, data reload: false

------ Round 1 ----------------------------------
q1	17633	4432	4204	4204
q2	2076	184	188	184
q3	10443	1125	1132	1125
q4	10190	741	747	741
q5	7471	2750	2781	2750
q6	213	130	131	130
q7	1047	616	588	588
q8	9225	2025	1989	1989
q9	8207	6536	6494	6494
q10	8488	3439	3552	3439
q11	445	241	244	241
q12	433	223	219	219
q13	17773	2952	2961	2952
q14	262	229	237	229
q15	525	480	473	473
q16	501	381	388	381
q17	953	573	559	559
q18	7235	6657	6737	6657
q19	6975	1463	1419	1419
q20	943	310	298	298
q21	3439	2706	2743	2706
q22	366	301	311	301
Total cold run time: 114843 ms
Total hot run time: 38079 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4345	4189	4216	4189
q2	463	267	280	267
q3	2976	2652	2660	2652
q4	1859	1524	1501	1501
q5	5232	5215	5193	5193
q6	209	123	122	122
q7	2197	1865	1859	1859
q8	3208	3297	3282	3282
q9	8530	8544	8647	8544
q10	4043	3895	3801	3801
q11	597	512	505	505
q12	784	644	618	618
q13	18050	3340	3270	3270
q14	319	294	278	278
q15	512	475	492	475
q16	521	449	473	449
q17	1798	1515	1490	1490
q18	8052	8027	7900	7900
q19	1636	1534	1520	1520
q20	2014	1862	1830	1830
q21	8022	5012	4971	4971
q22	533	474	447	447
Total cold run time: 75900 ms
Total hot run time: 55163 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 182268 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit d8f8e356d28171e3940b0b55fb625abdb0ad142a, data reload: false

query1	878	1124	1123	1123
query2	6299	2183	1937	1937
query3	6653	216	212	212
query4	25407	21351	21295	21295
query5	4126	402	405	402
query6	280	193	170	170
query7	4594	292	284	284
query8	223	165	170	165
query9	8418	2321	2278	2278
query10	411	238	238	238
query11	15029	14286	14269	14269
query12	132	88	89	88
query13	1635	362	394	362
query14	8650	6978	6966	6966
query15	228	188	184	184
query16	6747	278	274	274
query17	967	592	564	564
query18	1801	288	291	288
query19	201	159	171	159
query20	94	89	93	89
query21	202	130	129	129
query22	4949	4777	4830	4777
query23	33321	32589	32733	32589
query24	11560	2984	2978	2978
query25	624	406	423	406
query26	736	180	169	169
query27	3127	368	373	368
query28	6265	1909	1918	1909
query29	928	655	678	655
query30	315	157	158	157
query31	1065	731	754	731
query32	94	60	55	55
query33	728	259	255	255
query34	1199	510	510	510
query35	910	722	759	722
query36	1112	941	933	933
query37	109	71	75	71
query38	3837	3694	3620	3620
query39	1100	1046	1058	1046
query40	170	136	140	136
query41	49	47	49	47
query42	109	110	102	102
query43	488	478	452	452
query44	1190	754	745	745
query45	295	282	285	282
query46	1095	742	735	735
query47	2041	1957	1945	1945
query48	392	334	323	323
query49	895	388	381	381
query50	808	447	425	425
query51	6835	6815	6774	6774
query52	105	98	93	93
query53	375	288	291	288
query54	280	238	234	234
query55	82	78	79	78
query56	248	229	225	225
query57	1217	1137	1127	1127
query58	222	199	208	199
query59	2715	2641	2551	2551
query60	254	227	229	227
query61	93	91	93	91
query62	592	439	425	425
query63	305	284	278	278
query64	5207	4164	4104	4104
query65	3083	3042	3030	3030
query66	869	343	340	340
query67	15690	14965	14762	14762
query68	9168	542	559	542
query69	578	312	311	311
query70	1422	1160	1116	1116
query71	478	265	264	264
query72	6973	2638	2462	2462
query73	1664	331	324	324
query74	7067	6376	6405	6376
query75	3820	2331	2225	2225
query76	5055	930	1036	930
query77	613	249	261	249
query78	11068	10099	10273	10099
query79	13026	538	540	538
query80	1990	439	440	439
query81	510	227	218	218
query82	448	93	93	93
query83	219	171	172	171
query84	269	84	82	82
query85	866	291	275	275
query86	342	301	292	292
query87	3875	3525	3531	3525
query88	5554	2437	2427	2427
query89	527	384	383	383
query90	2036	176	180	176
query91	128	100	97	97
query92	62	48	49	48
query93	6892	504	505	504
query94	1338	185	181	181
query95	434	318	310	310
query96	609	270	274	270
query97	2648	2465	2474	2465
query98	246	217	217	217
query99	1119	833	860	833
Total cold run time: 301702 ms
Total hot run time: 182268 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.15 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit d8f8e356d28171e3940b0b55fb625abdb0ad142a, data reload: false

query1	0.04	0.04	0.03
query2	0.09	0.04	0.04
query3	0.23	0.06	0.06
query4	1.65	0.10	0.10
query5	0.50	0.50	0.53
query6	1.13	0.65	0.66
query7	0.02	0.01	0.01
query8	0.05	0.04	0.04
query9	0.54	0.50	0.49
query10	0.56	0.54	0.54
query11	0.17	0.10	0.11
query12	0.14	0.12	0.11
query13	0.59	0.57	0.58
query14	0.78	0.77	0.79
query15	0.82	0.81	0.80
query16	0.38	0.35	0.36
query17	0.97	0.99	0.97
query18	0.22	0.23	0.23
query19	1.76	1.71	1.74
query20	0.01	0.01	0.01
query21	15.54	0.66	0.66
query22	2.56	2.61	2.52
query23	17.19	0.98	0.79
query24	1.14	0.22	0.19
query25	0.08	0.08	0.08
query26	0.23	0.16	0.17
query27	0.08	0.07	0.07
query28	14.17	0.94	0.93
query29	12.55	3.22	3.19
query30	0.28	0.09	0.08
query31	2.86	0.37	0.38
query32	3.25	0.46	0.44
query33	2.78	2.78	2.85
query34	16.67	4.35	4.44
query35	4.50	4.41	4.50
query36	0.61	0.47	0.46
query37	0.18	0.15	0.14
query38	0.14	0.14	0.14
query39	0.04	0.03	0.04
query40	0.18	0.15	0.15
query41	0.09	0.05	0.05
query42	0.05	0.04	0.05
query43	0.05	0.04	0.04
Total cold run time: 105.87 s
Total hot run time: 30.15 s

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit d8f8e356d28171e3940b0b55fb625abdb0ad142a with default session variables
Stream load json:         18 seconds loaded 2358488459 Bytes, about 124 MB/s
Stream load orc:          59 seconds loaded 1101869774 Bytes, about 17 MB/s
Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select:       13.7 seconds inserted 10000000 Rows, about 729K ops/s

@LiBinfeng-01
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 38326 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit d2b7da88c8194e7867914c0fb8fc0a8af241152d, data reload: false

------ Round 1 ----------------------------------
q1	17644	4100	4030	4030
q2	2089	197	186	186
q3	10469	1180	1383	1180
q4	10202	863	1035	863
q5	7501	2930	2900	2900
q6	214	134	133	133
q7	1082	629	630	629
q8	9409	1970	2001	1970
q9	6750	6183	6119	6119
q10	8463	3478	3493	3478
q11	430	247	237	237
q12	383	219	210	210
q13	17772	2900	2890	2890
q14	282	238	241	238
q15	535	475	469	469
q16	506	391	384	384
q17	944	867	869	867
q18	7256	6470	6391	6391
q19	1593	1530	1537	1530
q20	595	313	305	305
q21	3515	3086	3019	3019
q22	339	298	308	298
Total cold run time: 107973 ms
Total hot run time: 38326 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4056	4077	4020	4020
q2	333	228	220	220
q3	2937	2933	2949	2933
q4	1855	1820	1785	1785
q5	5250	5196	5195	5195
q6	208	125	127	125
q7	2224	1846	1818	1818
q8	3196	3292	3246	3246
q9	8484	8462	8487	8462
q10	3717	3908	3998	3908
q11	551	471	486	471
q12	783	571	604	571
q13	15051	3060	3119	3060
q14	308	294	277	277
q15	562	518	500	500
q16	522	454	443	443
q17	1764	1726	1747	1726
q18	8319	7794	7487	7487
q19	1673	1664	1662	1662
q20	2027	1835	1847	1835
q21	5065	4910	4873	4873
q22	491	435	418	418
Total cold run time: 69376 ms
Total hot run time: 55035 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 181949 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit d2b7da88c8194e7867914c0fb8fc0a8af241152d, data reload: false

query1	1209	1134	1118	1118
query2	6338	1945	1828	1828
query3	6661	217	204	204
query4	24842	21537	21483	21483
query5	4196	397	381	381
query6	259	180	175	175
query7	4601	302	305	302
query8	242	174	180	174
query9	8479	2223	2227	2223
query10	453	250	251	250
query11	15019	14519	14571	14519
query12	141	92	104	92
query13	1626	375	387	375
query14	8541	6905	6971	6905
query15	217	172	177	172
query16	6841	278	275	275
query17	982	601	575	575
query18	1859	288	279	279
query19	203	162	162	162
query20	99	96	93	93
query21	199	131	138	131
query22	4941	4814	4762	4762
query23	33522	32703	32460	32460
query24	12505	3206	3241	3206
query25	734	438	434	434
query26	1907	171	174	171
query27	3135	382	380	380
query28	7056	1895	1868	1868
query29	1425	615	614	614
query30	299	158	166	158
query31	982	776	750	750
query32	105	64	64	64
query33	702	260	249	249
query34	1132	509	510	509
query35	877	739	731	731
query36	996	862	888	862
query37	268	82	80	80
query38	3715	3603	3526	3526
query39	1657	1590	1587	1587
query40	250	155	141	141
query41	48	46	45	45
query42	115	117	119	117
query43	458	398	412	398
query44	1169	734	738	734
query45	334	265	257	257
query46	1125	859	796	796
query47	2028	1872	1937	1872
query48	397	328	310	310
query49	934	377	380	377
query50	836	413	420	413
query51	6944	6863	6814	6814
query52	111	105	113	105
query53	364	310	297	297
query54	286	242	240	240
query55	92	90	85	85
query56	247	244	240	240
query57	1279	1182	1210	1182
query58	239	247	238	238
query59	2663	2636	2330	2330
query60	256	234	238	234
query61	93	95	92	92
query62	650	474	441	441
query63	313	283	288	283
query64	5824	3293	3088	3088
query65	3100	2990	3019	2990
query66	1329	334	333	333
query67	15763	15013	14988	14988
query68	8970	579	574	574
query69	594	322	318	318
query70	1395	1092	1112	1092
query71	512	273	271	271
query72	6453	2583	2432	2432
query73	1556	327	327	327
query74	6629	6429	6258	6258
query75	3802	2322	2300	2300
query76	5743	1133	1138	1133
query77	567	244	237	237
query78	11012	10177	10090	10090
query79	12564	542	515	515
query80	2222	433	423	423
query81	496	1081	223	223
query82	350	100	102	100
query83	202	163	164	163
query84	270	84	87	84
query85	1097	304	299	299
query86	347	304	259	259
query87	3693	3490	3489	3489
query88	4342	2313	2279	2279
query89	535	370	368	368
query90	1968	169	176	169
query91	137	104	107	104
query92	60	50	48	48
query93	6755	531	528	528
query94	1277	198	198	198
query95	436	335	322	322
query96	612	271	269	269
query97	2674	2514	2479	2479
query98	240	221	216	216
query99	1140	815	823	815
Total cold run time: 304862 ms
Total hot run time: 181949 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.91 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit d2b7da88c8194e7867914c0fb8fc0a8af241152d, data reload: false

query1	0.04	0.03	0.03
query2	0.07	0.04	0.04
query3	0.24	0.04	0.04
query4	1.68	0.07	0.06
query5	0.49	0.47	0.48
query6	1.15	0.66	0.65
query7	0.02	0.01	0.01
query8	0.06	0.05	0.05
query9	0.57	0.52	0.50
query10	0.57	0.59	0.56
query11	0.14	0.12	0.11
query12	0.14	0.12	0.12
query13	0.60	0.60	0.59
query14	0.77	0.79	0.78
query15	0.86	0.85	0.85
query16	0.36	0.35	0.35
query17	0.99	1.00	0.95
query18	0.24	0.25	0.26
query19	1.82	1.74	1.75
query20	0.01	0.00	0.01
query21	15.55	0.73	0.69
query22	3.01	4.68	2.34
query23	17.50	1.33	1.01
query24	1.50	0.23	0.23
query25	0.11	0.09	0.09
query26	0.27	0.17	0.19
query27	0.08	0.09	0.09
query28	13.80	0.96	0.97
query29	12.56	3.49	3.68
query30	0.28	0.08	0.07
query31	2.82	0.39	0.38
query32	3.28	0.47	0.48
query33	2.84	2.90	2.91
query34	15.57	4.35	4.35
query35	4.37	4.39	4.39
query36	0.67	0.49	0.48
query37	0.20	0.17	0.17
query38	0.16	0.16	0.16
query39	0.04	0.03	0.05
query40	0.17	0.17	0.15
query41	0.09	0.05	0.05
query42	0.06	0.05	0.05
query43	0.04	0.04	0.04
Total cold run time: 105.79 s
Total hot run time: 30.91 s

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit d2b7da88c8194e7867914c0fb8fc0a8af241152d with default session variables
Stream load json:         18 seconds loaded 2358488459 Bytes, about 124 MB/s
Stream load orc:          59 seconds loaded 1101869774 Bytes, about 17 MB/s
Stream load parquet:      32 seconds loaded 861443392 Bytes, about 25 MB/s
Insert into select:       16.3 seconds inserted 10000000 Rows, about 613K ops/s

@Override
public void checkLegalityBeforeTypeCoercion() {
DataType type = getBuckets().getDataType();
if (!type.isNumericType()) {
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

isIntegralType ?

@LiBinfeng-01
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 38944 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit b97a8dd201459143fb0226c091476f68aad80475, data reload: false

------ Round 1 ----------------------------------
q1	17718	4134	4076	4076
q2	2016	189	185	185
q3	10499	1198	1434	1198
q4	10541	935	1060	935
q5	7752	3036	3023	3023
q6	228	139	143	139
q7	1177	673	651	651
q8	10385	2109	2054	2054
q9	6760	6224	6176	6176
q10	8447	3518	3505	3505
q11	414	241	243	241
q12	390	222	218	218
q13	17769	2917	2919	2917
q14	275	243	242	242
q15	543	484	467	467
q16	485	401	392	392
q17	956	898	882	882
q18	7429	6474	6369	6369
q19	1600	1544	1541	1541
q20	618	328	334	328
q21	3555	3099	3114	3099
q22	368	306	325	306
Total cold run time: 109925 ms
Total hot run time: 38944 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4070	4069	4048	4048
q2	331	227	229	227
q3	2969	2967	2963	2963
q4	1871	1844	1852	1844
q5	5263	5246	5227	5227
q6	211	131	128	128
q7	2240	1819	1824	1819
q8	3199	3269	3277	3269
q9	8461	8476	8479	8476
q10	3740	3848	3829	3829
q11	537	462	435	435
q12	727	568	559	559
q13	8951	2883	2891	2883
q14	290	277	258	258
q15	518	469	471	469
q16	455	394	419	394
q17	1728	1680	1678	1678
q18	7612	7265	7162	7162
q19	1654	1646	1636	1636
q20	1955	1722	1725	1722
q21	4949	4671	4737	4671
q22	475	417	422	417
Total cold run time: 62206 ms
Total hot run time: 54114 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 181701 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit b97a8dd201459143fb0226c091476f68aad80475, data reload: false

query1	1220	1141	1129	1129
query2	6494	1868	1793	1793
query3	6667	209	207	207
query4	24897	21516	21365	21365
query5	4197	418	408	408
query6	277	191	183	183
query7	4608	311	295	295
query8	238	177	180	177
query9	8473	2256	2252	2252
query10	592	256	260	256
query11	14873	14502	14602	14502
query12	151	98	97	97
query13	1649	389	389	389
query14	8774	6800	6759	6759
query15	220	193	177	177
query16	6919	287	273	273
query17	988	602	577	577
query18	1840	300	300	300
query19	207	175	168	168
query20	100	97	97	97
query21	200	128	131	128
query22	4955	4793	4779	4779
query23	33686	32894	33069	32894
query24	12545	3148	3161	3148
query25	676	382	390	382
query26	1913	173	167	167
query27	3007	323	335	323
query28	6749	1820	1816	1816
query29	1132	579	573	573
query30	297	147	150	147
query31	976	750	738	738
query32	97	68	54	54
query33	698	246	251	246
query34	1038	498	520	498
query35	827	696	705	696
query36	1001	880	896	880
query37	240	72	76	72
query38	3552	3376	3391	3376
query39	1582	1530	1533	1530
query40	295	138	137	137
query41	47	45	44	44
query42	111	101	107	101
query43	435	404	402	402
query44	1088	719	703	703
query45	268	269	262	262
query46	1052	780	775	775
query47	1889	1830	1834	1830
query48	371	311	298	298
query49	1156	368	357	357
query50	800	394	403	394
query51	6871	6716	6734	6716
query52	112	94	100	94
query53	364	291	289	289
query54	320	251	246	246
query55	100	88	77	77
query56	252	230	229	229
query57	1238	1134	1169	1134
query58	251	224	231	224
query59	2509	2458	2383	2383
query60	261	253	245	245
query61	109	110	108	108
query62	718	446	461	446
query63	317	290	296	290
query64	6658	3240	3362	3240
query65	3088	3068	3016	3016
query66	1513	347	336	336
query67	15342	14811	14922	14811
query68	6624	582	569	569
query69	524	337	325	325
query70	1199	1128	1089	1089
query71	487	278	278	278
query72	6406	2714	2527	2527
query73	798	327	320	320
query74	6682	6412	6274	6274
query75	3253	2284	2285	2284
query76	4331	1141	1154	1141
query77	589	252	253	252
query78	10839	10260	10133	10133
query79	8658	545	536	536
query80	1467	435	419	419
query81	500	233	221	221
query82	733	109	104	104
query83	201	167	162	162
query84	265	90	92	90
query85	1442	301	276	276
query86	461	284	275	275
query87	3760	3505	3576	3505
query88	4348	2282	2288	2282
query89	558	389	376	376
query90	1931	188	183	183
query91	138	115	109	109
query92	58	54	56	54
query93	6967	551	537	537
query94	1099	199	196	196
query95	445	348	343	343
query96	614	273	269	269
query97	2671	2499	2508	2499
query98	235	214	212	212
query99	1253	836	823	823
Total cold run time: 295626 ms
Total hot run time: 181701 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 29.7 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit b97a8dd201459143fb0226c091476f68aad80475, data reload: false

query1	0.05	0.04	0.03
query2	0.08	0.04	0.04
query3	0.23	0.04	0.04
query4	1.68	0.07	0.07
query5	0.48	0.47	0.50
query6	1.14	0.66	0.64
query7	0.02	0.01	0.01
query8	0.06	0.05	0.05
query9	0.56	0.51	0.52
query10	0.56	0.58	0.56
query11	0.16	0.11	0.12
query12	0.15	0.11	0.12
query13	0.61	0.59	0.61
query14	0.76	0.78	0.79
query15	0.86	0.84	0.82
query16	0.36	0.36	0.38
query17	0.98	0.94	0.97
query18	0.24	0.25	0.26
query19	1.80	1.72	1.78
query20	0.02	0.01	0.01
query21	15.44	0.76	0.68
query22	3.20	5.31	1.33
query23	17.66	1.30	1.11
query24	1.84	0.25	0.21
query25	0.15	0.09	0.09
query26	0.29	0.17	0.19
query27	0.10	0.09	0.07
query28	13.39	0.97	0.95
query29	12.76	3.59	3.45
query30	0.26	0.06	0.06
query31	2.86	0.38	0.38
query32	3.29	0.47	0.48
query33	2.86	2.84	2.85
query34	15.49	4.33	4.32
query35	4.39	4.38	4.37
query36	0.67	0.46	0.47
query37	0.19	0.18	0.16
query38	0.18	0.16	0.16
query39	0.05	0.04	0.04
query40	0.19	0.15	0.15
query41	0.09	0.05	0.04
query42	0.06	0.04	0.05
query43	0.04	0.04	0.04
Total cold run time: 106.25 s
Total hot run time: 29.7 s

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit b97a8dd201459143fb0226c091476f68aad80475 with default session variables
Stream load json:         18 seconds loaded 2358488459 Bytes, about 124 MB/s
Stream load orc:          59 seconds loaded 1101869774 Bytes, about 17 MB/s
Stream load parquet:      32 seconds loaded 861443392 Bytes, about 25 MB/s
Insert into select:       17.1 seconds inserted 10000000 Rows, about 584K ops/s

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Apr 2, 2024
@github-actions
Copy link
Contributor

github-actions bot commented Apr 2, 2024

PR approved by at least one committer and no changes requested.

@github-actions
Copy link
Contributor

github-actions bot commented Apr 2, 2024

PR approved by anyone and no changes requested.

@morrySnow morrySnow merged commit ffbc246 into apache:master Apr 2, 2024
yiguolei pushed a commit that referenced this pull request Apr 10, 2024
Problem:
when ntile using 0 as parameter, be would core because no checking of parameter
Solved:
check parameter in fe analyze
yiguolei pushed a commit that referenced this pull request Apr 10, 2024
Problem:
when ntile using 0 as parameter, be would core because no checking of parameter
Solved:
check parameter in fe analyze
LiBinfeng-01 added a commit to LiBinfeng-01/doris that referenced this pull request Apr 18, 2024
Problem:
when ntile using 0 as parameter, be would core because no checking of parameter
Solved:
check parameter in fe analyze
LiBinfeng-01 added a commit to LiBinfeng-01/doris that referenced this pull request May 10, 2024
Problem:
when ntile using 0 as parameter, be would core because no checking of parameter
Solved:
check parameter in fe analyze
morrySnow pushed a commit that referenced this pull request May 17, 2024
pick from master #32994

Problem:
when ntile using 0 as parameter, be would core because no checking of parameter

Solved:
check parameter in fe analyze
mongo360 pushed a commit to mongo360/doris that referenced this pull request Aug 16, 2024
…pache#34661)

pick from master apache#32994

Problem:
when ntile using 0 as parameter, be would core because no checking of parameter

Solved:
check parameter in fe analyze
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

approved Indicates a PR has been approved by one committer. dev/2.0.11-merged reviewed

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants