Skip to content

Conversation

@feiniaofeiafei
Copy link
Contributor

cherry-pick #37274 to branch-2.0

feiniaofeiafei and others added 2 commits July 5, 2024 17:06
PR apache#33726 does not correctly fix the create view problem of the legacy
optimizer caused by the toSql bug (* except syntax). The results of the
regression test cases are also problematic. This pr fix the problem.

---------

Co-authored-by: feiniaofeiafei <moailing@selectdb.com>
@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@github-actions github-actions bot added area/planner Issues or PRs related to the query planner kind/test labels Jul 5, 2024
@feiniaofeiafei
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 49645 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit b34a026b55e1883e5e3c284076757b52b89195bb, data reload: false

------ Round 1 ----------------------------------
q1	17683	4339	4336	4336
q2	2068	157	146	146
q3	10441	1864	1954	1864
q4	10312	1261	1307	1261
q5	8660	3805	3897	3805
q6	264	125	126	125
q7	2025	1605	1602	1602
q8	9313	2792	2695	2695
q9	10592	10202	10165	10165
q10	8670	3497	3487	3487
q11	426	248	259	248
q12	479	308	313	308
q13	18331	3993	4029	3993
q14	365	330	324	324
q15	503	468	464	464
q16	687	569	583	569
q17	1126	998	970	970
q18	7280	7021	6932	6932
q19	1796	1599	1544	1544
q20	507	309	309	309
q21	4392	4092	4057	4057
q22	526	442	441	441
Total cold run time: 116446 ms
Total hot run time: 49645 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4292	4290	4307	4290
q2	323	228	230	228
q3	4150	4152	4121	4121
q4	2749	2770	2753	2753
q5	7126	7051	7098	7051
q6	235	122	120	120
q7	3238	2819	2789	2789
q8	4317	4470	4489	4470
q9	16902	16886	16786	16786
q10	4281	4282	4289	4282
q11	746	681	694	681
q12	1037	835	862	835
q13	6797	3804	3791	3791
q14	478	441	440	440
q15	507	454	450	450
q16	762	728	684	684
q17	3832	3780	3895	3780
q18	8878	8780	8763	8763
q19	1750	1727	1679	1679
q20	2377	2135	2101	2101
q21	8531	8368	8348	8348
q22	1008	991	931	931
Total cold run time: 84316 ms
Total hot run time: 79373 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 203253 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit b34a026b55e1883e5e3c284076757b52b89195bb, data reload: false

query1	931	388	409	388
query2	6539	3074	2892	2892
query3	6917	207	202	202
query4	21100	17925	18059	17925
query5	19723	6510	6580	6510
query6	281	220	232	220
query7	4162	304	316	304
query8	423	400	395	395
query9	3193	2715	2628	2628
query10	420	318	286	286
query11	11312	10687	10674	10674
query12	120	80	77	77
query13	5621	688	708	688
query14	18538	13111	13397	13111
query15	364	245	249	245
query16	6450	285	274	274
query17	1689	1455	868	868
query18	2336	414	403	403
query19	219	145	155	145
query20	79	75	81	75
query21	192	100	97	97
query22	5165	4773	5077	4773
query23	32641	31854	32026	31854
query24	6909	6548	6555	6548
query25	528	445	424	424
query26	528	172	176	172
query27	1844	299	296	296
query28	6189	2365	2317	2317
query29	2908	2835	2650	2650
query30	242	164	165	164
query31	927	748	730	730
query32	68	68	62	62
query33	402	254	269	254
query34	880	486	473	473
query35	1124	977	894	894
query36	1520	1241	1316	1241
query37	87	64	59	59
query38	3082	2912	2905	2905
query39	1385	1362	1330	1330
query40	205	103	97	97
query41	47	47	45	45
query42	86	83	85	83
query43	868	771	629	629
query44	1162	712	732	712
query45	253	249	234	234
query46	1225	976	988	976
query47	2061	1643	1828	1643
query48	1013	717	703	703
query49	615	383	384	383
query50	870	631	598	598
query51	4768	4706	4611	4611
query52	85	91	81	81
query53	453	332	324	324
query54	2703	2470	2528	2470
query55	98	86	93	86
query56	216	228	216	216
query57	1232	1170	1187	1170
query58	228	218	192	192
query59	4137	4341	4218	4218
query60	225	205	197	197
query61	96	94	96	94
query62	914	486	494	486
query63	490	349	348	348
query64	2619	1558	1523	1523
query65	3616	3587	3583	3583
query66	769	381	388	381
query67	16278	17439	15071	15071
query68	8819	653	672	653
query69	591	340	348	340
query70	1680	1406	1293	1293
query71	429	299	309	299
query72	6601	3571	3521	3521
query73	741	327	318	318
query74	6278	5854	5812	5812
query75	5300	3693	3713	3693
query76	5287	1187	1189	1187
query77	888	264	255	255
query78	12463	11549	11540	11540
query79	8824	635	638	635
query80	1385	407	411	407
query81	492	235	232	232
query82	1619	102	102	102
query83	164	136	134	134
query84	263	71	69	69
query85	890	335	342	335
query86	340	290	302	290
query87	3236	2964	3045	2964
query88	4671	2302	2302	2302
query89	487	282	283	282
query90	1969	213	211	211
query91	181	143	151	143
query92	59	53	52	52
query93	6427	547	599	547
query94	712	221	208	208
query95	1106	1054	1059	1054
query96	628	329	320	320
query97	6452	6265	6322	6265
query98	186	168	175	168
query99	3059	934	915	915
Total cold run time: 316597 ms
Total hot run time: 203253 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.87 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit b34a026b55e1883e5e3c284076757b52b89195bb, data reload: false

query1	0.03	0.02	0.02
query2	0.07	0.02	0.02
query3	0.25	0.06	0.05
query4	1.77	0.06	0.06
query5	0.53	0.52	0.52
query6	1.30	0.62	0.61
query7	0.01	0.01	0.01
query8	0.03	0.03	0.02
query9	0.53	0.48	0.51
query10	0.54	0.54	0.53
query11	0.12	0.08	0.09
query12	0.12	0.08	0.09
query13	0.62	0.61	0.60
query14	0.79	0.78	0.80
query15	0.80	0.75	0.76
query16	0.37	0.37	0.40
query17	1.00	1.03	1.03
query18	0.22	0.26	0.23
query19	1.93	1.86	1.88
query20	0.01	0.01	0.01
query21	15.49	0.55	0.55
query22	2.02	2.42	1.45
query23	17.09	1.06	1.12
query24	4.83	1.05	3.52
query25	0.37	0.09	0.06
query26	0.84	0.17	0.16
query27	0.04	0.04	0.04
query28	5.72	0.74	0.73
query29	12.74	2.34	2.40
query30	0.62	0.47	0.48
query31	2.81	0.39	0.37
query32	3.40	0.50	0.50
query33	3.09	3.10	3.11
query34	15.27	4.81	4.79
query35	4.88	4.85	4.84
query36	1.06	1.02	1.01
query37	0.06	0.05	0.04
query38	0.04	0.02	0.02
query39	0.02	0.01	0.01
query40	0.16	0.14	0.14
query41	0.07	0.02	0.01
query42	0.02	0.01	0.02
query43	0.03	0.02	0.01
Total cold run time: 101.71 s
Total hot run time: 30.87 s

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit b34a026b55e1883e5e3c284076757b52b89195bb with default session variables
Stream load json:         20 seconds loaded 2358488459 Bytes, about 112 MB/s
Stream load orc:          58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select:       21.8 seconds inserted 10000000 Rows, about 458K ops/s

@feiniaofeiafei
Copy link
Contributor Author

run external

1 similar comment
@morrySnow
Copy link
Contributor

run external

@morrySnow morrySnow merged commit 42a52d8 into apache:branch-2.0 Jul 8, 2024
mongo360 pushed a commit to mongo360/doris that referenced this pull request Aug 16, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

area/planner Issues or PRs related to the query planner kind/test

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants