Skip to content

Conversation

@morningman
Copy link
Contributor

Proposed changes

Follow up #28532

Further comments

If this is a relatively large or complex change, kick off the discussion at dev@doris.apache.org by explaining why you chose the solution you did and what alternatives you considered, etc...

Copy link
Contributor

@swjtu-zhanglei swjtu-zhanglei left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@github-actions
Copy link
Contributor

PR approved by anyone and no changes requested.

@yiguolei
Copy link
Contributor

run buildall

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Jan 25, 2024
@github-actions
Copy link
Contributor

PR approved by at least one committer and no changes requested.

@doris-robot
Copy link

TPC-H: Total hot run time: 39098 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit b95ed4f481d67c754a7c4cb90d6814ca5a258980, data reload: false

------ Round 1 ----------------------------------
q1	17650	5364	5362	5362
q2	2043	135	129	129
q3	10797	1194	1145	1145
q4	10393	747	813	747
q5	7900	3186	3180	3180
q6	199	119	119	119
q7	873	509	486	486
q8	9248	1967	1958	1958
q9	7331	6397	6345	6345
q10	8206	3026	3066	3026
q11	417	194	207	194
q12	356	191	189	189
q13	17997	3371	3351	3351
q14	242	209	215	209
q15	549	505	500	500
q16	421	378	380	378
q17	959	552	499	499
q18	7584	6940	6945	6940
q19	1795	1307	1425	1307
q20	601	285	282	282
q21	2809	2480	2462	2462
q22	375	315	290	290
Total cold run time: 108745 ms
Total hot run time: 39098 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5542	5282	5247	5247
q2	332	218	216	216
q3	3356	3269	3233	3233
q4	2064	2068	2070	2068
q5	6041	5945	5965	5945
q6	200	118	119	118
q7	2296	1937	1843	1843
q8	3251	3393	3390	3390
q9	8942	8842	8817	8817
q10	3971	3828	3844	3828
q11	544	455	441	441
q12	817	614	633	614
q13	16938	3139	3153	3139
q14	281	255	262	255
q15	546	506	506	506
q16	517	467	466	466
q17	1851	1861	1898	1861
q18	9464	19589	9527	9527
q19	24789	1666	1511	1511
q20	4557	1922	1914	1914
q21	14564	5330	5499	5330
q22	967	520	555	520
Total cold run time: 111830 ms
Total hot run time: 60789 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 185565 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit b95ed4f481d67c754a7c4cb90d6814ca5a258980, data reload: false

query1	956	329	325	325
query2	6594	2140	1878	1878
query3	6699	202	200	200
query4	31208	22024	22155	22024
query5	4449	432	421	421
query6	245	146	156	146
query7	4602	259	253	253
query8	220	171	178	171
query9	8314	2586	2576	2576
query10	420	226	235	226
query11	16939	15626	15396	15396
query12	116	67	64	64
query13	1672	371	374	371
query14	10565	6967	7025	6967
query15	218	189	179	179
query16	5783	252	249	249
query17	957	477	461	461
query18	1794	251	248	248
query19	173	132	131	131
query20	65	70	69	69
query21	199	119	132	119
query22	4919	4724	4853	4724
query23	31362	30858	30693	30693
query24	12546	2828	2807	2807
query25	574	306	308	306
query26	1803	140	137	137
query27	3222	282	286	282
query28	7260	1829	1817	1817
query29	2111	628	638	628
query30	285	135	146	135
query31	935	721	729	721
query32	69	50	50	50
query33	708	202	206	202
query34	1182	450	459	450
query35	879	766	740	740
query36	1234	1169	1135	1135
query37	92	55	56	55
query38	3343	3248	3221	3221
query39	1308	1255	1265	1255
query40	345	86	82	82
query41	37	35	34	34
query42	100	78	86	78
query43	488	461	497	461
query44	1094	684	692	684
query45	189	176	171	171
query46	1079	627	648	627
query47	1583	1581	1537	1537
query48	384	306	304	304
query49	1214	287	280	280
query50	664	298	309	298
query51	5289	5218	5221	5218
query52	94	72	75	72
query53	315	261	248	248
query54	236	182	180	180
query55	82	71	78	71
query56	172	167	164	164
query57	1033	959	948	948
query58	173	153	155	153
query59	2865	2746	2761	2746
query60	210	183	182	182
query61	81	88	80	80
query62	614	360	342	342
query63	280	260	263	260
query64	6133	1795	1736	1736
query65	3334	3250	3225	3225
query66	1402	326	306	306
query67	15730	14950	15205	14950
query68	12307	527	528	527
query69	592	295	288	288
query70	1683	1483	1496	1483
query71	10472	10197	10201	10197
query72	4857	2812	2827	2812
query73	2685	308	314	308
query74	6888	6360	6284	6284
query75	5049	2314	2275	2275
query76	6697	1077	991	991
query77	637	226	238	226
query78	9036	8789	8465	8465
query79	1634	481	479	479
query80	564	313	317	313
query81	444	203	201	201
query82	201	78	75	75
query83	141	114	113	113
query84	266	67	66	66
query85	1093	324	326	324
query86	381	382	382	382
query87	3538	3365	3311	3311
query88	3079	2177	2172	2172
query89	434	352	359	352
query90	2018	184	181	181
query91	150	119	121	119
query92	55	43	42	42
query93	2206	414	440	414
query94	1272	151	150	150
query95	496	463	433	433
query96	609	323	316	316
query97	4265	4130	4158	4130
query98	205	199	184	184
query99	1014	683	716	683
Total cold run time: 306208 ms
Total hot run time: 185565 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.39 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit b95ed4f481d67c754a7c4cb90d6814ca5a258980, data reload: false

query1	0.04	0.03	0.02
query2	0.05	0.02	0.02
query3	0.23	0.05	0.05
query4	1.70	0.07	0.07
query5	0.53	0.52	0.52
query6	1.26	0.62	0.63
query7	0.02	0.02	0.01
query8	0.04	0.03	0.02
query9	0.54	0.51	0.49
query10	0.55	0.55	0.55
query11	0.12	0.09	0.09
query12	0.11	0.09	0.09
query13	0.61	0.60	0.60
query14	0.77	0.80	0.81
query15	0.79	0.78	0.76
query16	0.39	0.36	0.37
query17	1.00	1.02	1.01
query18	0.21	0.25	0.24
query19	1.86	1.77	1.78
query20	0.01	0.01	0.01
query21	15.44	0.57	0.57
query22	2.46	2.13	2.03
query23	17.43	0.88	0.68
query24	2.44	1.79	1.27
query25	0.40	0.22	0.22
query26	0.64	0.14	0.14
query27	0.04	0.05	0.04
query28	10.59	0.78	0.76
query29	12.49	3.28	3.16
query30	0.56	0.50	0.54
query31	2.78	0.35	0.34
query32	3.37	0.48	0.50
query33	3.20	3.22	3.22
query34	15.78	4.31	4.30
query35	4.32	4.27	4.29
query36	1.12	1.06	1.07
query37	0.06	0.05	0.05
query38	0.03	0.02	0.03
query39	0.02	0.02	0.01
query40	0.16	0.13	0.16
query41	0.08	0.02	0.01
query42	0.03	0.02	0.01
query43	0.02	0.02	0.02
Total cold run time: 104.29 s
Total hot run time: 31.39 s

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit b95ed4f481d67c754a7c4cb90d6814ca5a258980 with default session variables
Stream load json:         19 seconds loaded 2358488459 Bytes, about 118 MB/s
Stream load orc:          58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select:       15.0 seconds inserted 10000000 Rows, about 666K ops/s

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

approved Indicates a PR has been approved by one committer. dev/2.1.0-merged dev/3.0.0-merged reviewed

Projects

None yet

Development

Successfully merging this pull request may close these issues.

6 participants