Skip to content

Conversation

@nextdreamblue
Copy link
Contributor

Proposed changes

cherry pick from #33033

Further comments

If this is a relatively large or complex change, kick off the discussion at dev@doris.apache.org by explaining why you chose the solution you did and what alternatives you considered, etc...

…is not materialized

Signed-off-by: nextdreamblue <zxw520blue1@163.com>
@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@nextdreamblue
Copy link
Contributor Author

run buildall

@github-actions github-actions bot added area/planner Issues or PRs related to the query planner kind/test labels Mar 29, 2024
@lide-reed lide-reed self-requested a review March 29, 2024 10:57
Copy link
Contributor

@lide-reed lide-reed left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@github-actions
Copy link
Contributor

PR approved by at least one committer and no changes requested.

@github-actions github-actions bot added approved Indicates a PR has been approved by one committer. reviewed labels Mar 29, 2024
@github-actions
Copy link
Contributor

PR approved by anyone and no changes requested.

Copy link
Contributor

@cambyzju cambyzju left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@doris-robot
Copy link

TPC-H: Total hot run time: 49740 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 1694ec27fc4827da45f0c52edc759cb7ec5acf36, data reload: false

------ Round 1 ----------------------------------
q1	17622	4387	4321	4321
q2	2036	147	141	141
q3	10448	1906	1946	1906
q4	10377	1227	1309	1227
q5	8386	3939	3974	3939
q6	225	125	124	124
q7	1991	1600	1568	1568
q8	9506	2700	2701	2700
q9	13207	10488	10596	10488
q10	8605	3419	3462	3419
q11	418	229	241	229
q12	459	298	302	298
q13	18343	3926	3995	3926
q14	352	314	325	314
q15	501	444	458	444
q16	682	600	592	592
q17	1136	962	966	962
q18	7247	6881	6895	6881
q19	1678	1559	1484	1484
q20	535	303	305	303
q21	4445	4090	4078	4078
q22	498	402	396	396
Total cold run time: 118697 ms
Total hot run time: 49740 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4311	4277	4258	4258
q2	314	221	224	221
q3	4159	4166	4125	4125
q4	2740	2728	2740	2728
q5	7268	7172	7169	7169
q6	234	120	119	119
q7	3259	2803	2826	2803
q8	4342	4488	4484	4484
q9	17070	17020	16857	16857
q10	4209	4237	4231	4231
q11	770	687	717	687
q12	1018	858	861	858
q13	7507	3738	3718	3718
q14	454	423	430	423
q15	498	444	445	444
q16	748	698	687	687
q17	3870	3798	3797	3797
q18	8871	8782	8773	8773
q19	1672	1664	1678	1664
q20	2405	2121	2116	2116
q21	8461	8549	8511	8511
q22	1031	965	915	915
Total cold run time: 85211 ms
Total hot run time: 79588 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 200863 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 1694ec27fc4827da45f0c52edc759cb7ec5acf36, data reload: false

query1	939	392	392	392
query2	6551	2069	1849	1849
query3	6921	199	191	191
query4	20091	18026	17861	17861
query5	19718	6519	6528	6519
query6	296	219	212	212
query7	4144	305	301	301
query8	272	239	263	239
query9	3191	2766	2684	2684
query10	437	286	307	286
query11	11252	10681	10701	10681
query12	119	74	73	73
query13	5578	641	624	624
query14	17776	13212	13270	13212
query15	357	234	235	234
query16	6449	272	253	253
query17	1569	1461	883	883
query18	2258	409	403	403
query19	206	142	146	142
query20	75	74	75	74
query21	192	95	87	87
query22	5240	5067	5022	5022
query23	32574	31681	31809	31681
query24	6949	6548	6417	6417
query25	514	415	420	415
query26	488	166	159	159
query27	1760	306	292	292
query28	6146	2280	2232	2232
query29	2887	2792	2704	2704
query30	244	164	162	162
query31	906	713	718	713
query32	60	59	58	58
query33	397	251	242	242
query34	831	459	478	459
query35	1129	932	911	911
query36	1267	1235	1200	1200
query37	93	62	58	58
query38	3095	2911	2929	2911
query39	1375	1323	1293	1293
query40	200	96	96	96
query41	36	32	33	32
query42	84	90	89	89
query43	631	596	648	596
query44	1141	720	723	720
query45	238	223	226	223
query46	1229	974	989	974
query47	1821	1834	1915	1834
query48	982	678	669	669
query49	610	360	387	360
query50	860	595	606	595
query51	4693	4633	4597	4597
query52	81	79	72	72
query53	439	322	320	320
query54	2632	2464	2456	2456
query55	89	74	84	74
query56	215	213	210	210
query57	1107	1055	1088	1055
query58	212	203	201	201
query59	3361	3289	3142	3142
query60	213	181	204	181
query61	87	84	91	84
query62	787	480	468	468
query63	464	337	326	326
query64	2237	1505	1458	1458
query65	3660	3538	3536	3536
query66	769	369	395	369
query67	16755	15552	14927	14927
query68	8385	651	695	651
query69	564	339	334	334
query70	1773	1360	1570	1360
query71	402	299	292	292
query72	6552	3438	3419	3419
query73	730	319	323	319
query74	6252	5864	5889	5864
query75	4613	3696	3770	3696
query76	4706	1144	1231	1144
query77	649	256	242	242
query78	12407	16096	12042	12042
query79	10612	649	654	649
query80	703	400	409	400
query81	498	228	232	228
query82	265	92	94	92
query83	162	136	128	128
query84	254	70	69	69
query85	784	289	286	286
query86	334	291	287	287
query87	3245	3058	3012	3012
query88	4902	2308	2311	2308
query89	352	286	304	286
query90	1947	206	213	206
query91	153	117	115	115
query92	58	48	52	48
query93	1182	573	599	573
query94	790	208	204	204
query95	1139	1045	1039	1039
query96	645	329	322	322
query97	6538	6433	6394	6394
query98	199	182	155	155
query99	2687	976	906	906
Total cold run time: 304461 ms
Total hot run time: 200863 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.69 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 1694ec27fc4827da45f0c52edc759cb7ec5acf36, data reload: false

query1	0.03	0.02	0.02
query2	0.07	0.02	0.02
query3	0.24	0.04	0.05
query4	1.80	0.09	0.07
query5	0.54	0.52	0.52
query6	1.24	0.62	0.61
query7	0.02	0.01	0.01
query8	0.03	0.02	0.02
query9	0.52	0.49	0.47
query10	0.54	0.54	0.53
query11	0.12	0.09	0.08
query12	0.12	0.09	0.09
query13	0.62	0.61	0.61
query14	0.79	0.78	0.78
query15	0.77	0.77	0.77
query16	0.36	0.39	0.38
query17	1.00	0.96	1.03
query18	0.20	0.29	0.22
query19	1.89	1.78	1.82
query20	0.02	0.01	0.01
query21	15.50	0.58	0.55
query22	2.07	2.42	1.53
query23	16.84	1.01	0.85
query24	5.06	1.46	1.14
query25	0.34	0.12	0.05
query26	0.63	0.16	0.16
query27	0.04	0.04	0.04
query28	7.51	0.78	0.72
query29	12.63	2.33	2.36
query30	0.58	0.53	0.53
query31	2.82	0.39	0.38
query32	3.37	0.50	0.49
query33	3.10	3.09	3.07
query34	15.28	4.77	4.79
query35	4.86	4.85	4.83
query36	1.05	1.01	1.01
query37	0.06	0.05	0.04
query38	0.04	0.02	0.02
query39	0.02	0.02	0.02
query40	0.16	0.14	0.14
query41	0.07	0.01	0.02
query42	0.02	0.01	0.01
query43	0.02	0.02	0.01
Total cold run time: 102.99 s
Total hot run time: 30.69 s

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit 1694ec27fc4827da45f0c52edc759cb7ec5acf36 with default session variables
Stream load json:         20 seconds loaded 2358488459 Bytes, about 112 MB/s
Stream load orc:          59 seconds loaded 1101869774 Bytes, about 17 MB/s
Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select:       21.0 seconds inserted 10000000 Rows, about 476K ops/s

@nextdreamblue nextdreamblue merged commit 5711332 into apache:branch-2.0 Mar 29, 2024
mongo360 pushed a commit to mongo360/doris that referenced this pull request Aug 16, 2024
…is not materialized (apache#33044)

Signed-off-by: nextdreamblue <zxw520blue1@163.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

approved Indicates a PR has been approved by one committer. area/planner Issues or PRs related to the query planner kind/test reviewed

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants