Skip to content

Conversation

@wuwenchi
Copy link
Contributor

@wuwenchi wuwenchi commented Feb 1, 2024

Proposed changes

mirror #30478

Further comments

If this is a relatively large or complex change, kick off the discussion at dev@doris.apache.org by explaining why you chose the solution you did and what alternatives you considered, etc...

@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

@wuwenchi
Copy link
Contributor Author

wuwenchi commented Feb 1, 2024

run buildall

@github-actions github-actions bot added area/planner Issues or PRs related to the query planner kind/test labels Feb 1, 2024
@doris-robot
Copy link

TPC-H: Total hot run time: 49633 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit c5ffd688c5c0557409bcb75bdf6b6d02fd2f00e6, data reload: false

------ Round 1 ----------------------------------
q1	18122	4401	4346	4346
q2	2043	149	141	141
q3	10274	1884	1950	1884
q4	10349	1248	1330	1248
q5	8429	3899	3994	3899
q6	231	123	118	118
q7	2045	1603	1615	1603
q8	9260	2688	2694	2688
q9	10535	10528	10275	10275
q10	8653	3498	3519	3498
q11	429	241	238	238
q12	463	296	292	292
q13	18345	3951	4049	3951
q14	346	323	331	323
q15	500	452	438	438
q16	676	600	597	597
q17	1125	954	971	954
q18	7233	6916	6904	6904
q19	1681	1522	1489	1489
q20	527	302	294	294
q21	4414	4113	4054	4054
q22	498	404	399	399
Total cold run time: 116178 ms
Total hot run time: 49633 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4331	4281	4277	4277
q2	318	229	230	229
q3	4166	4141	4144	4141
q4	2741	2717	2748	2717
q5	7250	7198	7140	7140
q6	234	116	115	115
q7	3254	2812	2818	2812
q8	4331	4482	4480	4480
q9	16956	16897	16832	16832
q10	4223	4260	4276	4260
q11	782	690	660	660
q12	1010	805	847	805
q13	6393	3777	3740	3740
q14	478	413	425	413
q15	488	449	457	449
q16	751	701	700	700
q17	3851	3868	3787	3787
q18	8721	8701	8810	8701
q19	1694	1685	1681	1681
q20	2366	2169	2101	2101
q21	8608	8503	8513	8503
q22	1036	945	972	945
Total cold run time: 83982 ms
Total hot run time: 79488 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 241942 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit c5ffd688c5c0557409bcb75bdf6b6d02fd2f00e6, data reload: false

query1	918	401	378	378
query2	6523	2283	1989	1989
query3	6912	204	207	204
query4	20755	18320	18221	18221
query5	20540	6360	6277	6277
query6	266	211	216	211
query7	4150	302	305	302
query8	265	258	242	242
query9	3077	2674	2606	2606
query10	420	288	299	288
query11	11559	11302	11522	11302
query12	127	84	82	82
query13	5784	736	658	658
query14	18974	13365	13191	13191
query15	383	231	235	231
query16	6736	260	256	256
query17	3238	873	870	870
query18	2279	398	414	398
query19	199	145	141	141
query20	78	75	75	75
query21	188	91	97	91
query22	5287	5124	5077	5077
query23	32702	31977	31975	31975
query24	6796	6508	6500	6500
query25	525	432	415	415
query26	498	163	161	161
query27	1695	295	292	292
query28	6069	2235	2159	2159
query29	2815	2684	2914	2684
query30	242	161	158	158
query31	911	706	755	706
query32	67	57	57	57
query33	403	273	252	252
query34	860	471	469	469
query35	1126	935	936	935
query36	1429	1362	1473	1362
query37	92	61	61	61
query38	3076	2939	2928	2928
query39	1362	1324	1314	1314
query40	199	98	94	94
query41	37	32	31	31
query42	84	85	81	81
query43	689	633	582	582
query44	1130	713	730	713
query45	238	235	226	226
query46	1248	970	952	952
query47	1922	1733	1667	1667
query48	975	680	675	675
query49	604	376	361	361
query50	849	613	593	593
query51	5563	5546	5471	5471
query52	89	69	74	69
query53	445	320	317	317
query54	2422	2265	2255	2255
query55	82	80	83	80
query56	224	201	195	195
query57	1175	1115	1054	1054
query58	222	193	202	193
query59	3517	3376	3208	3208
query60	200	187	189	187
query61	86	88	83	83
query62	866	484	493	484
query63	476	336	331	331
query64	1988	1318	1304	1304
query65	3709	3631	3623	3623
query66	844	383	368	368
query67	15947	18140	15377	15377
query68	8294	660	672	660
query69	559	341	354	341
query70	2219	2094	1841	1841
query71	406	308	301	301
query72	4530	3345	3351	3345
query73	720	321	329	321
query74	6304	5846	5902	5846
query75	4285	3574	3498	3498
query76	4653	1187	1209	1187
query77	575	248	262	248
query78	30781	54042	50514	50514
query79	15782	670	673	670
query80	4786	381	404	381
query81	579	231	228	228
query82	1285	104	94	94
query83	424	139	130	130
query84	263	68	70	68
query85	2341	276	277	276
query86	454	377	393	377
query87	3296	3013	2991	2991
query88	7223	2378	2313	2313
query89	473	280	305	280
query90	2515	212	212	212
query91	155	126	123	123
query92	65	52	51	51
query93	7124	583	576	576
query94	1666	204	209	204
query95	1132	1065	1062	1062
query96	670	346	329	329
query97	6389	6355	6373	6355
query98	178	182	171	171
query99	3771	857	1010	857
Total cold run time: 349053 ms
Total hot run time: 241942 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.89 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit c5ffd688c5c0557409bcb75bdf6b6d02fd2f00e6, data reload: false

query1	0.03	0.02	0.02
query2	0.06	0.02	0.02
query3	0.24	0.04	0.05
query4	1.83	0.06	0.06
query5	0.53	0.52	0.52
query6	1.28	0.62	0.62
query7	0.02	0.01	0.00
query8	0.04	0.02	0.02
query9	0.53	0.49	0.48
query10	0.54	0.53	0.53
query11	0.12	0.09	0.08
query12	0.11	0.08	0.10
query13	0.64	0.63	0.62
query14	0.79	0.80	0.79
query15	0.78	0.77	0.76
query16	0.37	0.36	0.38
query17	1.02	1.01	1.02
query18	0.20	0.28	0.25
query19	1.95	1.85	1.86
query20	0.02	0.01	0.01
query21	15.49	0.62	0.55
query22	1.87	1.86	1.62
query23	17.35	1.04	1.08
query24	8.60	0.98	1.09
query25	1.56	0.11	0.11
query26	0.40	0.15	0.13
query27	0.11	0.11	0.11
query28	5.42	0.80	0.74
query29	12.61	2.29	2.19
query30	0.55	0.53	0.51
query31	2.82	0.38	0.39
query32	3.42	0.49	0.51
query33	3.07	3.06	3.05
query34	15.29	4.80	4.81
query35	4.85	4.82	4.84
query36	1.05	1.01	1.01
query37	0.05	0.04	0.05
query38	0.03	0.02	0.02
query39	0.02	0.01	0.01
query40	0.16	0.14	0.14
query41	0.06	0.01	0.01
query42	0.02	0.01	0.01
query43	0.02	0.01	0.02
Total cold run time: 105.92 s
Total hot run time: 30.89 s

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit c5ffd688c5c0557409bcb75bdf6b6d02fd2f00e6 with default session variables
Stream load json:         19 seconds loaded 2358488459 Bytes, about 118 MB/s
Stream load orc:          58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select:       21.4 seconds inserted 10000000 Rows, about 467K ops/s

@morningman morningman merged commit dc13a9c into apache:branch-2.0 Feb 1, 2024
mongo360 pushed a commit to mongo360/doris that referenced this pull request Aug 16, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

area/planner Issues or PRs related to the query planner kind/test

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants