Skip to content

Conversation

@nextdreamblue
Copy link
Contributor

@nextdreamblue nextdreamblue commented Mar 22, 2024

Proposed changes

cherry-pick from #32646

Further comments

If this is a relatively large or complex change, kick off the discussion at dev@doris.apache.org by explaining why you chose the solution you did and what alternatives you considered, etc...

Signed-off-by: nextdreamblue <zxw520blue1@163.com>
@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@nextdreamblue
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 50332 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 09b0e59e0a116849b389ac23ff3f768f0da3061f, data reload: false

------ Round 1 ----------------------------------
q1	18502	4488	4414	4414
q2	2101	148	136	136
q3	10541	1923	1908	1908
q4	11204	1246	1307	1246
q5	8597	4309	3972	3972
q6	230	126	121	121
q7	2033	1611	1611	1611
q8	9525	2699	2711	2699
q9	13397	10988	10652	10652
q10	8834	3637	3586	3586
q11	417	240	247	240
q12	462	300	299	299
q13	19256	4020	4140	4020
q14	368	344	343	343
q15	519	461	460	460
q16	690	615	599	599
q17	1137	971	955	955
q18	7341	6756	6988	6756
q19	1644	1553	1527	1527
q20	547	306	300	300
q21	4430	4197	4079	4079
q22	493	409	411	409
Total cold run time: 122268 ms
Total hot run time: 50332 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4334	4329	4267	4267
q2	316	218	224	218
q3	4170	4120	4125	4120
q4	2733	2739	2738	2738
q5	7284	7181	7249	7181
q6	235	115	121	115
q7	3210	2892	2849	2849
q8	4359	4471	4549	4471
q9	17017	16912	16896	16896
q10	4189	4246	4211	4211
q11	758	695	671	671
q12	1019	861	845	845
q13	6728	3732	3754	3732
q14	448	425	412	412
q15	494	460	444	444
q16	767	697	692	692
q17	3878	3903	3920	3903
q18	8755	8720	8904	8720
q19	1731	1661	1659	1659
q20	2387	2148	2081	2081
q21	8536	8429	8420	8420
q22	1021	959	963	959
Total cold run time: 84369 ms
Total hot run time: 79604 ms

Copy link
Contributor

@cambyzju cambyzju left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Mar 22, 2024
@github-actions
Copy link
Contributor

PR approved by at least one committer and no changes requested.

@github-actions
Copy link
Contributor

PR approved by anyone and no changes requested.

Copy link
Member

@xy720 xy720 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@doris-robot
Copy link

TPC-DS: Total hot run time: 201204 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 09b0e59e0a116849b389ac23ff3f768f0da3061f, data reload: false

query1	926	383	397	383
query2	6519	2176	2019	2019
query3	6911	206	203	203
query4	19990	17902	17927	17902
query5	19721	6501	6508	6501
query6	285	214	223	214
query7	4157	299	293	293
query8	246	266	239	239
query9	3120	2698	2612	2612
query10	405	288	312	288
query11	11363	10766	10667	10667
query12	119	80	69	69
query13	5571	643	639	639
query14	17893	13440	13262	13262
query15	360	224	241	224
query16	6442	272	277	272
query17	1704	1463	859	859
query18	2318	406	398	398
query19	204	147	150	147
query20	78	76	72	72
query21	188	88	98	88
query22	5198	5014	5058	5014
query23	32539	32270	32020	32020
query24	6861	6580	6553	6553
query25	524	410	424	410
query26	521	164	161	161
query27	1898	297	294	294
query28	6105	2247	2195	2195
query29	2938	2774	2802	2774
query30	245	165	163	163
query31	904	755	714	714
query32	70	63	58	58
query33	385	251	247	247
query34	844	462	473	462
query35	1111	907	943	907
query36	1279	1219	1127	1127
query37	93	59	56	56
query38	3077	2921	2935	2921
query39	1355	1313	1301	1301
query40	202	92	93	92
query41	34	31	30	30
query42	84	88	82	82
query43	670	620	611	611
query44	1118	721	726	721
query45	244	224	231	224
query46	1253	973	961	961
query47	1820	1901	1925	1901
query48	980	680	649	649
query49	613	368	361	361
query50	875	607	632	607
query51	4790	4686	4700	4686
query52	84	76	77	76
query53	452	319	307	307
query54	2623	2441	2472	2441
query55	91	81	76	76
query56	212	213	211	211
query57	1142	1117	1092	1092
query58	212	205	191	191
query59	3410	3502	3095	3095
query60	202	199	192	192
query61	81	80	82	80
query62	807	530	431	431
query63	466	325	334	325
query64	2546	1509	1375	1375
query65	3664	3542	3532	3532
query66	757	369	358	358
query67	15781	15392	15670	15392
query68	8466	665	673	665
query69	567	355	333	333
query70	1818	1259	1737	1259
query71	427	294	288	288
query72	6673	3469	3409	3409
query73	727	330	326	326
query74	6221	5861	5876	5861
query75	4584	3758	3596	3596
query76	4653	1169	1185	1169
query77	554	248	240	240
query78	12597	11963	11540	11540
query79	7901	619	647	619
query80	1540	388	369	369
query81	496	234	227	227
query82	1525	100	95	95
query83	160	130	128	128
query84	266	69	69	69
query85	1135	280	270	270
query86	341	328	335	328
query87	3204	2952	2978	2952
query88	5170	2356	2365	2356
query89	354	280	296	280
query90	1980	211	219	211
query91	150	115	115	115
query92	57	53	50	50
query93	4493	593	589	589
query94	879	195	208	195
query95	1081	1066	1055	1055
query96	630	323	330	323
query97	6456	6348	6407	6348
query98	184	170	153	153
query99	2991	959	971	959
Total cold run time: 307960 ms
Total hot run time: 201204 ms

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit 09b0e59e0a116849b389ac23ff3f768f0da3061f with default session variables
Stream load json:         20 seconds loaded 2358488459 Bytes, about 112 MB/s
Stream load orc:          58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select:       22.3 seconds inserted 10000000 Rows, about 448K ops/s

@xiaokang xiaokang merged commit f7745c5 into apache:branch-2.0 Mar 22, 2024
mongo360 pushed a commit to mongo360/doris that referenced this pull request Aug 16, 2024
…32693)

Signed-off-by: nextdreamblue <zxw520blue1@163.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

approved Indicates a PR has been approved by one committer. reviewed

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants