Skip to content

Conversation

@cambyzju
Copy link
Contributor

Proposed changes

cherry-pick #32545

issue:
#28807
#32539

related pr:
#28808

Further comments

If this is a relatively large or complex change, kick off the discussion at dev@doris.apache.org by explaining why you chose the solution you did and what alternatives you considered, etc...

@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@cambyzju
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 49944 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 2ee81fdc5edd23ff0882c215974412e4b6162af7, data reload: false

------ Round 1 ----------------------------------
q1	17652	4410	4382	4382
q2	2051	147	141	141
q3	10505	1917	1888	1888
q4	10305	1268	1323	1268
q5	8941	3942	3877	3877
q6	226	120	122	120
q7	2014	1603	1584	1584
q8	9262	2664	2699	2664
q9	11113	10950	10638	10638
q10	8683	3494	3503	3494
q11	416	244	241	241
q12	458	287	294	287
q13	18355	3973	3983	3973
q14	347	319	334	319
q15	497	452	444	444
q16	693	587	595	587
q17	1117	954	958	954
q18	7263	6855	6825	6825
q19	1672	1583	1519	1519
q20	516	308	302	302
q21	4424	4112	4049	4049
q22	506	398	388	388
Total cold run time: 117016 ms
Total hot run time: 49944 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4338	4286	4317	4286
q2	319	227	215	215
q3	4168	4151	4143	4143
q4	2750	2744	2741	2741
q5	7265	7218	7243	7218
q6	235	119	116	116
q7	3241	2834	2872	2834
q8	4360	4437	4440	4437
q9	17642	16958	17305	16958
q10	4213	4263	4274	4263
q11	744	710	655	655
q12	1037	851	831	831
q13	4731	3694	3754	3694
q14	443	421	415	415
q15	503	449	441	441
q16	751	683	695	683
q17	3743	3791	3786	3786
q18	8796	8802	8783	8783
q19	1692	1692	1655	1655
q20	2353	2133	2057	2057
q21	8486	8426	8601	8426
q22	1035	981	957	957
Total cold run time: 82845 ms
Total hot run time: 79594 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 200427 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 2ee81fdc5edd23ff0882c215974412e4b6162af7, data reload: false

query1	919	391	387	387
query2	6555	2081	2120	2081
query3	6913	209	201	201
query4	20150	17941	17946	17941
query5	19704	6557	6540	6540
query6	292	205	220	205
query7	4155	296	294	294
query8	239	249	223	223
query9	3036	2642	2573	2573
query10	423	285	284	284
query11	11404	10780	10804	10780
query12	115	80	74	74
query13	5593	644	619	619
query14	18056	13183	13445	13183
query15	356	230	242	230
query16	6425	267	262	262
query17	1762	1453	864	864
query18	2333	408	414	408
query19	202	142	148	142
query20	81	72	73	72
query21	185	89	97	89
query22	5317	5075	4879	4879
query23	32377	31799	31839	31799
query24	6811	6413	6443	6413
query25	525	436	408	408
query26	526	155	156	155
query27	1882	291	286	286
query28	6057	2244	2221	2221
query29	2982	2787	2803	2787
query30	237	159	162	159
query31	912	713	699	699
query32	63	56	61	56
query33	385	259	259	259
query34	851	464	480	464
query35	1115	930	958	930
query36	1280	1118	1184	1118
query37	90	64	61	61
query38	3097	2886	2864	2864
query39	1368	1324	1304	1304
query40	197	90	97	90
query41	36	32	31	31
query42	87	85	86	85
query43	584	535	575	535
query44	1117	712	719	712
query45	240	231	228	228
query46	1223	978	960	960
query47	1895	1632	1664	1632
query48	959	659	673	659
query49	614	373	359	359
query50	865	598	598	598
query51	4699	4691	4594	4594
query52	87	77	83	77
query53	441	304	310	304
query54	2636	2449	2440	2440
query55	84	76	84	76
query56	193	186	198	186
query57	1186	1173	1278	1173
query58	205	191	206	191
query59	3412	3355	3330	3330
query60	205	208	206	206
query61	84	81	83	81
query62	886	522	471	471
query63	476	331	326	326
query64	2499	1472	1349	1349
query65	3638	3610	3609	3609
query66	782	378	365	365
query67	16521	15455	14979	14979
query68	8452	658	682	658
query69	548	360	336	336
query70	1470	1376	1375	1375
query71	396	293	314	293
query72	6378	3466	3427	3427
query73	733	328	321	321
query74	6219	5855	5897	5855
query75	5023	3736	3654	3654
query76	4964	1123	1169	1123
query77	685	253	251	251
query78	12962	11607	11719	11607
query79	8262	646	640	640
query80	1391	385	401	385
query81	505	227	230	227
query82	1694	100	95	95
query83	169	132	134	132
query84	257	67	71	67
query85	843	285	275	275
query86	319	288	293	288
query87	3275	3060	2998	2998
query88	5110	2323	2340	2323
query89	388	293	280	280
query90	1968	204	205	204
query91	147	113	116	113
query92	56	51	51	51
query93	6138	570	572	570
query94	723	199	202	199
query95	1097	1043	1058	1043
query96	633	316	331	316
query97	6593	6341	6427	6341
query98	193	170	166	166
query99	2968	925	854	854
Total cold run time: 311183 ms
Total hot run time: 200427 ms

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit 2ee81fdc5edd23ff0882c215974412e4b6162af7 with default session variables
Stream load json:         20 seconds loaded 2358488459 Bytes, about 112 MB/s
Stream load orc:          59 seconds loaded 1101869774 Bytes, about 17 MB/s
Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select:       22.4 seconds inserted 10000000 Rows, about 446K ops/s

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Mar 27, 2024
@github-actions
Copy link
Contributor

PR approved by at least one committer and no changes requested.

@github-actions
Copy link
Contributor

PR approved by anyone and no changes requested.

Copy link
Contributor

@lide-reed lide-reed left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@cambyzju cambyzju merged commit 2ae85e4 into apache:branch-2.0 Mar 29, 2024
mongo360 pushed a commit to mongo360/doris that referenced this pull request Aug 16, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

approved Indicates a PR has been approved by one committer. reviewed

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants