[Fix](planner) fix create view star except and modify cast to sql #35324

feiniaofeiafei · 2024-05-24T02:53:57Z

cherry-pick #25951 to branch-2.0
cherry-pick #33726 to branch-2.0

doris-robot · 2024-05-24T02:54:02Z

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

feiniaofeiafei · 2024-05-24T02:54:10Z

run buildall

doris-robot · 2024-05-24T03:20:42Z

TPC-H: Total hot run time: 49399 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 2c331f409a1a28354c18fe345249879a1dad4ee6, data reload: false

------ Round 1 ----------------------------------
q1	17742	4364	4373	4364
q2	2026	148	142	142
q3	10427	1902	1913	1902
q4	10334	1257	1345	1257
q5	8492	3843	3879	3843
q6	236	123	121	121
q7	2054	1567	1600	1567
q8	9281	2701	2700	2700
q9	10463	10417	10085	10085
q10	8622	3541	3505	3505
q11	425	234	255	234
q12	465	287	304	287
q13	18332	3928	4025	3928
q14	355	339	329	329
q15	498	466	447	447
q16	672	573	581	573
q17	1145	963	953	953
q18	7343	6903	6957	6903
q19	1680	1573	1534	1534
q20	516	305	287	287
q21	4407	4073	4050	4050
q22	508	388	388	388
Total cold run time: 116023 ms
Total hot run time: 49399 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4346	4321	4301	4301
q2	318	226	223	223
q3	4145	4107	4115	4107
q4	2742	2744	2752	2744
q5	7089	7109	7098	7098
q6	236	118	121	118
q7	3204	2875	2846	2846
q8	4360	4457	4516	4457
q9	16785	16771	16736	16736
q10	4169	4240	4216	4216
q11	753	744	687	687
q12	1024	852	863	852
q13	7028	3715	3740	3715
q14	450	430	420	420
q15	515	467	449	449
q16	722	680	684	680
q17	3969	3996	3826	3826
q18	8814	8695	8862	8695
q19	1705	1716	1659	1659
q20	2339	2119	2091	2091
q21	8413	8441	8443	8441
q22	1037	942	979	942
Total cold run time: 84163 ms
Total hot run time: 79303 ms

doris-robot · 2024-05-24T03:33:19Z

TPC-DS: Total hot run time: 203074 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 2c331f409a1a28354c18fe345249879a1dad4ee6, data reload: false

query1	926	390	375	375
query2	6548	2777	2843	2777
query3	6924	210	213	210
query4	20156	17956	17978	17956
query5	19751	6542	6504	6504
query6	284	223	221	221
query7	4154	292	303	292
query8	268	243	231	231
query9	3119	2687	2608	2608
query10	403	292	295	292
query11	11378	10587	10812	10587
query12	125	75	76	75
query13	5581	709	683	683
query14	17858	13360	13254	13254
query15	355	216	229	216
query16	6464	269	256	256
query17	1734	1456	878	878
query18	2327	397	399	397
query19	207	152	147	147
query20	78	74	76	74
query21	195	95	95	95
query22	5327	5074	5024	5024
query23	32461	31892	32133	31892
query24	7070	6478	6532	6478
query25	500	416	432	416
query26	525	161	157	157
query27	1902	297	289	289
query28	6182	2377	2345	2345
query29	2791	2759	2682	2682
query30	237	160	164	160
query31	910	730	749	730
query32	64	62	59	59
query33	404	257	240	240
query34	860	469	491	469
query35	1103	882	904	882
query36	1349	1248	1337	1248
query37	91	61	63	61
query38	3081	2965	2913	2913
query39	1387	1349	1335	1335
query40	205	94	90	90
query41	42	36	42	36
query42	96	79	82	79
query43	709	773	806	773
query44	1144	735	739	735
query45	248	237	238	237
query46	1260	998	982	982
query47	1828	1922	1870	1870
query48	1031	705	703	703
query49	617	371	382	371
query50	863	578	575	575
query51	4744	4697	4668	4668
query52	99	81	94	81
query53	441	315	325	315
query54	2664	2468	2428	2428
query55	83	82	83	82
query56	231	209	193	193
query57	1209	1055	1152	1055
query58	227	189	203	189
query59	4379	4142	4175	4142
query60	211	208	202	202
query61	88	85	85	85
query62	705	506	491	491
query63	472	334	331	331
query64	2562	1510	1401	1401
query65	3647	3599	3566	3566
query66	767	400	380	380
query67	15561	16696	15013	15013
query68	8972	652	645	645
query69	569	351	344	344
query70	1539	1480	1441	1441
query71	411	345	319	319
query72	6465	3382	3434	3382
query73	731	331	327	327
query74	6332	5834	5845	5834
query75	5396	3771	3623	3623
query76	5682	1145	1208	1145
query77	994	261	258	258
query78	12594	11482	11661	11482
query79	7076	651	664	651
query80	978	394	383	383
query81	485	227	232	227
query82	1478	100	97	97
query83	168	129	135	129
query84	262	71	71	71
query85	869	296	303	296
query86	345	290	289	289
query87	3188	3008	3002	3002
query88	4961	2378	2375	2375
query89	383	295	286	286
query90	1955	210	201	201
query91	168	136	146	136
query92	56	51	53	51
query93	4938	596	589	589
query94	696	206	205	205
query95	1106	1061	1045	1045
query96	654	335	325	325
query97	6547	6307	6414	6307
query98	194	175	172	172
query99	2953	895	856	856
Total cold run time: 310357 ms
Total hot run time: 203074 ms

doris-robot · 2024-05-24T03:38:46Z

ClickBench: Total hot run time: 31.01 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 2c331f409a1a28354c18fe345249879a1dad4ee6, data reload: false

query1	0.02	0.02	0.03
query2	0.07	0.03	0.02
query3	0.25	0.05	0.04
query4	1.83	0.06	0.07
query5	0.53	0.52	0.52
query6	1.31	0.66	0.61
query7	0.02	0.01	0.01
query8	0.03	0.03	0.03
query9	0.55	0.48	0.47
query10	0.54	0.52	0.52
query11	0.13	0.08	0.09
query12	0.12	0.09	0.08
query13	0.62	0.61	0.62
query14	0.78	0.78	0.79
query15	0.79	0.76	0.77
query16	0.37	0.36	0.36
query17	0.94	1.01	1.00
query18	0.23	0.23	0.27
query19	1.94	1.87	1.82
query20	0.02	0.01	0.01
query21	15.50	0.55	0.55
query22	1.99	1.94	2.04
query23	17.09	0.96	1.03
query24	7.37	0.94	0.90
query25	0.35	0.10	0.06
query26	0.80	0.14	0.14
query27	0.07	0.04	0.04
query28	5.92	0.76	0.81
query29	12.72	2.41	2.27
query30	0.56	0.53	0.54
query31	2.80	0.38	0.38
query32	3.38	0.50	0.51
query33	3.09	3.06	3.10
query34	15.25	4.80	4.78
query35	4.86	4.84	4.86
query36	1.06	1.01	1.01
query37	0.06	0.04	0.05
query38	0.04	0.02	0.02
query39	0.02	0.01	0.02
query40	0.16	0.14	0.15
query41	0.06	0.02	0.01
query42	0.02	0.02	0.02
query43	0.02	0.02	0.02
Total cold run time: 104.28 s
Total hot run time: 31.01 s

doris-robot · 2024-05-24T03:41:59Z

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit 2c331f409a1a28354c18fe345249879a1dad4ee6 with default session variables
Stream load json:         20 seconds loaded 2358488459 Bytes, about 112 MB/s
Stream load orc:          58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select:       21.4 seconds inserted 10000000 Rows, about 467K ops/s

feiniaofeiafei · 2024-05-24T04:04:36Z

run buildall

doris-robot · 2024-05-24T04:45:26Z

TPC-H: Total hot run time: 50049 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 97055c733f9c71c27146f52ee401416293f95e30, data reload: false

------ Round 1 ----------------------------------
q1	18161	4476	4395	4395
q2	2040	156	148	148
q3	10477	1951	1922	1922
q4	10355	1244	1340	1244
q5	8508	3880	3910	3880
q6	243	127	127	127
q7	2046	1615	1607	1607
q8	9461	2776	2752	2752
q9	10717	10395	10387	10387
q10	8676	3547	3554	3547
q11	422	237	240	237
q12	468	297	299	297
q13	18332	3984	4017	3984
q14	353	327	319	319
q15	505	465	453	453
q16	661	576	579	576
q17	1148	973	970	970
q18	7381	6862	7116	6862
q19	1743	1581	1524	1524
q20	541	316	295	295
q21	4443	4148	4128	4128
q22	516	402	395	395
Total cold run time: 117197 ms
Total hot run time: 50049 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4358	4293	4323	4293
q2	319	227	225	225
q3	4202	4175	4203	4175
q4	2767	2753	2759	2753
q5	7196	7178	7181	7178
q6	240	118	117	117
q7	3271	2856	2851	2851
q8	4386	4525	4529	4525
q9	16970	16825	16856	16825
q10	4284	4253	4277	4253
q11	746	674	654	654
q12	1043	854	873	854
q13	7093	3723	3738	3723
q14	465	439	428	428
q15	497	455	455	455
q16	742	690	686	686
q17	3917	3850	3854	3850
q18	8918	8853	8805	8805
q19	1735	1732	1685	1685
q20	2395	2125	2155	2125
q21	8703	8560	8557	8557
q22	995	967	908	908
Total cold run time: 85242 ms
Total hot run time: 79925 ms

doris-robot · 2024-05-24T04:58:12Z

TPC-DS: Total hot run time: 202952 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 97055c733f9c71c27146f52ee401416293f95e30, data reload: false

query1	926	387	386	386
query2	6538	2797	2468	2468
query3	6913	213	212	212
query4	20258	18048	18026	18026
query5	19719	6515	6508	6508
query6	283	222	237	222
query7	4158	300	311	300
query8	243	237	243	237
query9	3099	2712	2622	2622
query10	411	302	301	301
query11	11401	10797	10782	10782
query12	120	82	74	74
query13	5592	674	674	674
query14	17667	13181	13268	13181
query15	357	224	222	222
query16	6461	274	257	257
query17	1721	1461	871	871
query18	2316	416	400	400
query19	210	147	146	146
query20	74	79	79	79
query21	189	99	92	92
query22	5313	5135	5196	5135
query23	32617	31846	31950	31846
query24	7003	6546	6534	6534
query25	496	423	426	423
query26	529	163	166	163
query27	1873	299	293	293
query28	6102	2367	2303	2303
query29	2950	2650	2757	2650
query30	241	165	163	163
query31	920	722	724	722
query32	65	58	63	58
query33	405	257	238	238
query34	851	473	481	473
query35	1105	941	916	916
query36	1305	1130	1210	1130
query37	92	61	58	58
query38	3063	2939	2937	2937
query39	1350	1338	1332	1332
query40	204	92	92	92
query41	38	40	35	35
query42	87	84	76	76
query43	713	719	758	719
query44	1126	716	721	716
query45	248	229	225	225
query46	1223	970	982	970
query47	1900	1662	1725	1662
query48	1005	717	710	710
query49	627	374	361	361
query50	875	640	576	576
query51	4781	4664	4671	4664
query52	90	82	80	80
query53	446	314	314	314
query54	2662	2456	2521	2456
query55	97	76	87	76
query56	207	216	212	212
query57	1277	1065	1030	1030
query58	204	211	193	193
query59	4195	4178	3985	3985
query60	215	183	199	183
query61	89	84	86	84
query62	883	440	470	440
query63	473	340	345	340
query64	2308	1531	1451	1451
query65	3658	3549	3548	3548
query66	777	381	370	370
query67	17341	15756	15274	15274
query68	7055	652	652	652
query69	564	355	343	343
query70	1532	1464	1355	1355
query71	416	314	308	308
query72	6525	3529	3436	3436
query73	730	324	321	321
query74	6339	5973	5869	5869
query75	4624	3700	3762	3700
query76	4410	1165	1102	1102
query77	530	246	247	246
query78	12647	11684	12964	11684
query79	14175	665	642	642
query80	3206	393	388	388
query81	522	237	231	231
query82	1155	94	95	94
query83	185	135	133	133
query84	258	67	67	67
query85	1404	302	291	291
query86	358	284	290	284
query87	3217	3031	3027	3027
query88	5532	2379	2361	2361
query89	471	293	276	276
query90	1787	207	211	207
query91	169	142	135	135
query92	57	55	53	53
query93	5972	615	553	553
query94	974	209	207	207
query95	1086	1062	1045	1045
query96	645	331	343	331
query97	6379	6345	6300	6300
query98	188	175	174	174
query99	2787	861	869	861
Total cold run time: 318584 ms
Total hot run time: 202952 ms

doris-robot · 2024-05-24T05:03:39Z

ClickBench: Total hot run time: 30.8 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 97055c733f9c71c27146f52ee401416293f95e30, data reload: false

query1	0.02	0.03	0.02
query2	0.07	0.02	0.02
query3	0.26	0.05	0.04
query4	1.79	0.06	0.06
query5	0.53	0.52	0.52
query6	1.28	0.61	0.62
query7	0.02	0.01	0.02
query8	0.03	0.02	0.02
query9	0.51	0.48	0.48
query10	0.51	0.52	0.54
query11	0.13	0.08	0.09
query12	0.11	0.09	0.09
query13	0.62	0.61	0.62
query14	0.78	0.78	0.78
query15	0.78	0.77	0.75
query16	0.36	0.37	0.36
query17	1.04	1.01	0.98
query18	0.22	0.24	0.26
query19	1.97	1.82	1.84
query20	0.02	0.01	0.01
query21	15.84	0.55	0.55
query22	2.02	2.74	1.49
query23	17.29	0.82	0.84
query24	4.67	1.32	1.70
query25	0.37	0.11	0.06
query26	0.61	0.15	0.16
query27	0.04	0.05	0.04
query28	7.81	0.78	0.73
query29	12.67	2.33	2.31
query30	0.63	0.48	0.48
query31	2.79	0.41	0.39
query32	3.36	0.51	0.48
query33	3.18	3.10	3.08
query34	15.26	4.80	4.79
query35	4.88	4.85	4.82
query36	1.05	1.02	1.03
query37	0.05	0.04	0.05
query38	0.04	0.02	0.02
query39	0.01	0.01	0.02
query40	0.15	0.15	0.15
query41	0.07	0.01	0.02
query42	0.02	0.02	0.01
query43	0.02	0.01	0.02
Total cold run time: 103.88 s
Total hot run time: 30.8 s

doris-robot · 2024-05-24T05:06:50Z

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit 97055c733f9c71c27146f52ee401416293f95e30 with default session variables
Stream load json:         19 seconds loaded 2358488459 Bytes, about 118 MB/s
Stream load orc:          58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select:       21.1 seconds inserted 10000000 Rows, about 473K ops/s

…ache#33726)

feiniaofeiafei · 2024-05-24T13:11:57Z

run buildall

…ache#33726)

feiniaofeiafei · 2024-05-27T06:37:57Z

run buildall

feiniaofeiafei · 2024-05-27T10:00:57Z

run p0

…ache#35324) cherry-pick apache#25951 to branch-2.0 cherry-pick apache#33726 to branch-2.0 --------- Co-authored-by: morrySnow <101034200+morrySnow@users.noreply.github.com> Co-authored-by: feiniaofeiafei <moailing@selectdb.com>

github-actions bot added area/planner Issues or PRs related to the query planner kind/test labels May 24, 2024

feiniaofeiafei force-pushed the pick_fix_old_create_view branch from 2c331f4 to 97055c7 Compare May 24, 2024 04:04

morrySnow and others added 2 commits May 24, 2024 21:07

[minor](planner) remove len on integral type toSql (apache#25951)

0b414ba

[Fix](planner) fix create view star except and modify cast to sql (ap…

01c06f3

…ache#33726)

feiniaofeiafei force-pushed the pick_fix_old_create_view branch from 97055c7 to 01c06f3 Compare May 24, 2024 13:10

[Fix](planner) fix create view star except and modify cast to sql (ap…

a07c169

…ache#33726)

morrySnow merged commit b1a15f9 into apache:branch-2.0 May 27, 2024

[Fix](planner) fix create view star except and modify cast to sql #35324

[Fix](planner) fix create view star except and modify cast to sql #35324

Uh oh!

Conversation

feiniaofeiafei commented May 24, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

doris-robot commented May 24, 2024

Uh oh!

feiniaofeiafei commented May 24, 2024

Uh oh!

doris-robot commented May 24, 2024

Uh oh!

doris-robot commented May 24, 2024

Uh oh!

doris-robot commented May 24, 2024

Uh oh!

doris-robot commented May 24, 2024

Uh oh!

feiniaofeiafei commented May 24, 2024

Uh oh!

doris-robot commented May 24, 2024

Uh oh!

doris-robot commented May 24, 2024

Uh oh!

doris-robot commented May 24, 2024

Uh oh!

doris-robot commented May 24, 2024

Uh oh!

feiniaofeiafei commented May 24, 2024

Uh oh!

feiniaofeiafei commented May 27, 2024

Uh oh!

feiniaofeiafei commented May 27, 2024

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

feiniaofeiafei commented May 24, 2024 •

edited

Loading