Skip to content

Conversation

@nextdreamblue
Copy link
Contributor

Proposed changes

Issue Number: close #32645

Further comments

If this is a relatively large or complex change, kick off the discussion at dev@doris.apache.org by explaining why you chose the solution you did and what alternatives you considered, etc...

Signed-off-by: nextdreamblue <zxw520blue1@163.com>
@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@nextdreamblue
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 38334 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 8b10b22994e9bc8f5d0317b151ee0d7c2240b916, data reload: false

------ Round 1 ----------------------------------
q1	17804	4518	4248	4248
q2	2104	171	146	146
q3	11186	1167	1254	1167
q4	10650	810	835	810
q5	7987	3065	3042	3042
q6	221	130	129	129
q7	1072	618	606	606
q8	9459	2039	2026	2026
q9	7169	6531	6458	6458
q10	8404	3376	3535	3376
q11	439	233	231	231
q12	373	204	204	204
q13	17816	2912	2888	2888
q14	255	208	220	208
q15	509	466	452	452
q16	466	361	358	358
q17	966	579	574	574
q18	7249	6590	6515	6515
q19	1757	1453	1510	1453
q20	537	268	250	250
q21	3639	2967	2894	2894
q22	340	300	299	299
Total cold run time: 110402 ms
Total hot run time: 38334 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4104	4194	4087	4087
q2	325	227	221	221
q3	3027	2889	2894	2889
q4	1867	1554	1548	1548
q5	5235	5292	5286	5286
q6	192	119	123	119
q7	2242	1863	1856	1856
q8	3195	3345	3298	3298
q9	8589	8564	8588	8564
q10	3705	3753	3690	3690
q11	538	432	457	432
q12	733	555	568	555
q13	16934	2911	2837	2837
q14	279	237	250	237
q15	492	446	440	440
q16	467	423	414	414
q17	1735	1478	1482	1478
q18	7581	7299	7149	7149
q19	1638	1514	1544	1514
q20	1896	1706	1732	1706
q21	4823	4735	4713	4713
q22	545	448	440	440
Total cold run time: 70142 ms
Total hot run time: 53473 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 181349 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 8b10b22994e9bc8f5d0317b151ee0d7c2240b916, data reload: false

query1	926	362	330	330
query2	7398	2058	1973	1973
query3	6730	213	225	213
query4	31166	20635	20716	20635
query5	4324	397	410	397
query6	274	180	171	171
query7	4627	289	281	281
query8	222	181	168	168
query9	9952	2294	2285	2285
query10	486	239	240	239
query11	15001	14073	14264	14073
query12	135	90	87	87
query13	1632	417	411	411
query14	12052	10937	10946	10937
query15	261	202	195	195
query16	8057	266	257	257
query17	1956	572	541	541
query18	2047	281	267	267
query19	243	149	144	144
query20	88	86	86	86
query21	196	124	127	124
query22	4672	4466	4422	4422
query23	31945	30922	31005	30922
query24	11621	2801	2858	2801
query25	636	372	365	365
query26	1758	150	154	150
query27	3028	351	336	336
query28	7916	1881	1839	1839
query29	986	628	596	596
query30	307	144	148	144
query31	954	745	720	720
query32	95	61	55	55
query33	760	262	259	259
query34	1063	480	474	474
query35	825	608	610	608
query36	961	904	849	849
query37	158	79	79	79
query38	3528	3460	3450	3450
query39	1445	1368	1422	1368
query40	300	116	113	113
query41	50	53	46	46
query42	101	99	93	93
query43	492	453	466	453
query44	1323	725	721	721
query45	249	263	268	263
query46	1086	697	701	697
query47	1681	1613	1591	1591
query48	443	357	353	353
query49	1218	345	345	345
query50	758	369	367	367
query51	6656	6590	6561	6561
query52	114	89	98	89
query53	340	274	280	274
query54	340	258	260	258
query55	83	79	78	78
query56	249	243	241	241
query57	1096	1022	1031	1022
query58	237	205	208	205
query59	2771	2646	2613	2613
query60	284	256	266	256
query61	113	112	115	112
query62	602	401	398	398
query63	299	284	277	277
query64	6435	3926	3811	3811
query65	3090	3030	3014	3014
query66	1421	362	352	352
query67	14691	14491	14519	14491
query68	8923	515	534	515
query69	629	401	387	387
query70	1277	1176	1109	1109
query71	525	291	278	278
query72	6447	2671	2489	2489
query73	961	311	309	309
query74	7058	6585	6626	6585
query75	4406	2801	2854	2801
query76	5297	961	1004	961
query77	752	253	252	252
query78	10339	9671	9657	9657
query79	10759	518	507	507
query80	1824	391	394	391
query81	501	209	215	209
query82	834	202	204	202
query83	212	142	137	137
query84	285	74	77	74
query85	1458	325	308	308
query86	403	327	286	286
query87	3776	3543	3501	3501
query88	4802	2287	2293	2287
query89	508	362	365	362
query90	1988	173	172	172
query91	164	150	151	150
query92	64	46	45	45
query93	6970	489	479	479
query94	1209	168	173	168
query95	424	320	323	320
query96	592	275	264	264
query97	3038	2888	2853	2853
query98	232	222	203	203
query99	1244	743	767	743
Total cold run time: 314854 ms
Total hot run time: 181349 ms

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit 8b10b22994e9bc8f5d0317b151ee0d7c2240b916 with default session variables
Stream load json:         19 seconds loaded 2358488459 Bytes, about 118 MB/s
Stream load orc:          59 seconds loaded 1101869774 Bytes, about 17 MB/s
Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select:       21.3 seconds inserted 10000000 Rows, about 469K ops/s

@github-actions
Copy link
Contributor

PR approved by anyone and no changes requested.

@lide-reed lide-reed self-requested a review March 22, 2024 02:19
Copy link
Contributor

@lide-reed lide-reed left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@github-actions
Copy link
Contributor

PR approved by at least one committer and no changes requested.

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Mar 22, 2024
Copy link
Contributor

@cambyzju cambyzju left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

approved Indicates a PR has been approved by one committer. dev/2.0.7-merged reviewed

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[Bug] when backup job cancelled, it will retain snapshotinfos and backupmeta which take a lot of memory

6 participants