Skip to content

Conversation

@suxiaogang223
Copy link
Contributor

Proposed changes

backport: #33786

Issue Number: close #xxx

Further comments

If this is a relatively large or complex change, kick off the discussion at dev@doris.apache.org by explaining why you chose the solution you did and what alternatives you considered, etc...

@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@suxiaogang223
Copy link
Contributor Author

run build

@morningman
Copy link
Contributor

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 49222 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 056017d4bb96a8ab6cb65c9819e29a59cfdd8922, data reload: false

------ Round 1 ----------------------------------
q1	17657	4372	4305	4305
q2	2028	152	145	145
q3	10414	1860	1933	1860
q4	10349	1213	1309	1213
q5	8388	3804	3880	3804
q6	227	122	122	122
q7	2012	1596	1583	1583
q8	9262	2695	2702	2695
q9	10465	10314	10111	10111
q10	8649	3540	3526	3526
q11	424	240	230	230
q12	462	297	313	297
q13	18363	3948	4048	3948
q14	348	323	336	323
q15	504	460	456	456
q16	690	580	582	580
q17	1112	944	934	934
q18	7286	6812	6835	6812
q19	1703	1572	1530	1530
q20	527	310	316	310
q21	4426	4095	4047	4047
q22	482	391	397	391
Total cold run time: 115778 ms
Total hot run time: 49222 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4291	4303	4262	4262
q2	311	220	216	216
q3	4153	4133	4141	4133
q4	2722	2731	2734	2731
q5	7184	7072	7099	7072
q6	233	118	116	116
q7	3203	2899	2845	2845
q8	4350	4446	4501	4446
q9	16970	16714	16641	16641
q10	4186	4244	4260	4244
q11	770	666	678	666
q12	1028	849	845	845
q13	6607	3727	3767	3727
q14	446	423	435	423
q15	512	451	455	451
q16	753	688	710	688
q17	3852	3845	3861	3845
q18	8741	8698	8857	8698
q19	1711	1728	1632	1632
q20	2351	2106	2105	2105
q21	8460	8490	8494	8490
q22	1068	964	937	937
Total cold run time: 83902 ms
Total hot run time: 79213 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 203215 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 056017d4bb96a8ab6cb65c9819e29a59cfdd8922, data reload: false

query1	934	384	381	381
query2	6547	2766	2703	2703
query3	6915	196	192	192
query4	21087	18060	18113	18060
query5	19721	6520	6542	6520
query6	297	221	227	221
query7	4202	302	309	302
query8	253	255	222	222
query9	3189	2745	2667	2667
query10	432	284	295	284
query11	11266	10697	10688	10688
query12	118	80	70	70
query13	5579	689	678	678
query14	17898	13274	13474	13274
query15	361	218	224	218
query16	6445	271	252	252
query17	1558	1454	882	882
query18	2281	412	407	407
query19	201	139	143	139
query20	79	80	75	75
query21	188	99	92	92
query22	5347	4999	5097	4999
query23	32584	32189	32012	32012
query24	6913	6595	6484	6484
query25	528	426	411	411
query26	525	167	168	167
query27	1896	299	297	297
query28	6229	2424	2371	2371
query29	2820	2656	2759	2656
query30	238	161	166	161
query31	904	715	749	715
query32	72	59	56	56
query33	393	268	256	256
query34	860	462	488	462
query35	1099	903	924	903
query36	1309	1220	1151	1151
query37	91	62	60	60
query38	3079	2927	2892	2892
query39	1384	1333	1329	1329
query40	202	96	96	96
query41	36	38	33	33
query42	89	81	86	81
query43	739	676	706	676
query44	1143	722	726	722
query45	241	228	226	226
query46	1224	968	970	968
query47	1937	1676	1915	1676
query48	1022	721	728	721
query49	615	362	380	362
query50	866	587	551	551
query51	4743	4643	4622	4622
query52	87	80	76	76
query53	450	313	317	313
query54	2650	2500	2473	2473
query55	87	77	81	77
query56	213	199	189	189
query57	1168	1039	1208	1039
query58	207	195	198	195
query59	4389	3838	3971	3838
query60	209	196	207	196
query61	91	82	83	82
query62	851	518	517	517
query63	476	338	338	338
query64	2573	1616	1502	1502
query65	3644	3596	3559	3559
query66	787	375	399	375
query67	17196	15148	15932	15148
query68	6452	663	670	663
query69	562	355	340	340
query70	1514	1371	1363	1363
query71	393	312	300	300
query72	6476	3441	3479	3441
query73	728	322	314	314
query74	6283	5910	5863	5863
query75	4540	3626	3716	3626
query76	4323	1163	1183	1163
query77	554	247	258	247
query78	12602	11884	14998	11884
query79	6616	637	661	637
query80	2152	399	415	399
query81	518	234	228	228
query82	490	102	99	99
query83	189	130	134	130
query84	262	75	68	68
query85	1391	310	303	303
query86	345	310	309	309
query87	3195	3045	3009	3009
query88	4472	2316	2303	2303
query89	366	310	318	310
query90	1650	209	204	204
query91	177	135	139	135
query92	57	52	51	51
query93	1000	560	617	560
query94	735	203	204	203
query95	1126	1073	1080	1073
query96	630	326	329	326
query97	6523	6360	6239	6239
query98	182	176	169	169
query99	2688	896	928	896
Total cold run time: 302948 ms
Total hot run time: 203215 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.51 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 056017d4bb96a8ab6cb65c9819e29a59cfdd8922, data reload: false

query1	0.03	0.02	0.02
query2	0.08	0.03	0.02
query3	0.24	0.05	0.06
query4	1.80	0.09	0.10
query5	0.53	0.52	0.52
query6	1.24	0.61	0.62
query7	0.02	0.01	0.01
query8	0.04	0.02	0.02
query9	0.52	0.47	0.49
query10	0.53	0.53	0.53
query11	0.12	0.09	0.08
query12	0.12	0.09	0.10
query13	0.61	0.62	0.62
query14	0.77	0.78	0.79
query15	0.79	0.75	0.78
query16	0.37	0.38	0.37
query17	1.02	1.02	1.02
query18	0.23	0.25	0.25
query19	1.91	1.86	1.86
query20	0.02	0.02	0.01
query21	15.47	0.59	0.54
query22	2.31	2.21	1.92
query23	17.29	1.09	0.96
query24	6.56	1.46	1.80
query25	0.38	0.08	0.05
query26	0.81	0.15	0.15
query27	0.05	0.04	0.04
query28	5.72	0.76	0.76
query29	12.66	2.17	2.28
query30	0.62	0.53	0.52
query31	2.80	0.39	0.38
query32	3.37	0.49	0.48
query33	3.08	3.08	3.08
query34	15.26	4.82	4.78
query35	4.86	4.86	4.81
query36	1.04	1.01	1.00
query37	0.06	0.04	0.04
query38	0.04	0.02	0.02
query39	0.02	0.02	0.01
query40	0.16	0.14	0.13
query41	0.06	0.02	0.02
query42	0.02	0.01	0.01
query43	0.03	0.02	0.01
Total cold run time: 103.66 s
Total hot run time: 31.51 s

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit 056017d4bb96a8ab6cb65c9819e29a59cfdd8922 with default session variables
Stream load json:         20 seconds loaded 2358488459 Bytes, about 112 MB/s
Stream load orc:          58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select:       21.8 seconds inserted 10000000 Rows, about 458K ops/s

@morningman morningman merged commit 7237743 into apache:branch-2.0 Apr 28, 2024
@suxiaogang223 suxiaogang223 deleted the paimon_struct_20 branch August 15, 2024 08:51
mongo360 pushed a commit to mongo360/doris that referenced this pull request Aug 16, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants