Skip to content

Conversation

@starocean999
Copy link
Contributor

Proposed changes

pick from master #31084

Further comments

If this is a relatively large or complex change, kick off the discussion at dev@doris.apache.org by explaining why you chose the solution you did and what alternatives you considered, etc...

@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

@starocean999
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 50036 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 4b2920d9c4c17147484be228855658af6102e264, data reload: false

------ Round 1 ----------------------------------
q1	17915	4370	4355	4355
q2	2019	146	143	143
q3	10347	1953	1922	1922
q4	10110	1224	1336	1224
q5	8504	4019	3962	3962
q6	232	120	125	120
q7	2034	1596	1598	1596
q8	9343	2726	2730	2726
q9	11127	10665	10741	10665
q10	8634	3530	3522	3522
q11	421	227	238	227
q12	462	288	301	288
q13	18385	3948	4018	3948
q14	363	326	319	319
q15	503	455	447	447
q16	688	596	590	590
q17	1140	982	947	947
q18	7205	6890	6771	6771
q19	1673	1530	1436	1436
q20	539	314	310	310
q21	4424	4145	4119	4119
q22	506	399	403	399
Total cold run time: 116574 ms
Total hot run time: 50036 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4301	4305	4275	4275
q2	320	230	216	216
q3	4165	4131	4146	4131
q4	2748	2733	2742	2733
q5	7356	7216	7244	7216
q6	232	118	116	116
q7	3204	2775	2820	2775
q8	4368	4532	4446	4446
q9	17558	17203	17103	17103
q10	4241	4250	4301	4250
q11	727	666	674	666
q12	1016	856	836	836
q13	6911	3725	3759	3725
q14	459	448	435	435
q15	510	455	456	455
q16	769	687	702	687
q17	3811	3836	3876	3836
q18	8744	8804	8788	8788
q19	1718	1722	1664	1664
q20	2401	2124	2134	2124
q21	8465	8483	8389	8389
q22	1079	993	1012	993
Total cold run time: 85103 ms
Total hot run time: 79859 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 243380 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 4b2920d9c4c17147484be228855658af6102e264, data reload: false

query1	914	380	375	375
query2	6532	2218	2227	2218
query3	6912	203	205	203
query4	21176	17953	17989	17953
query5	19717	6489	6512	6489
query6	288	208	222	208
query7	4148	292	300	292
query8	254	222	237	222
query9	3122	2703	2653	2653
query10	414	267	298	267
query11	11368	10702	10627	10627
query12	114	73	72	72
query13	5574	638	619	619
query14	17748	13834	13455	13455
query15	354	232	229	229
query16	6519	266	259	259
query17	1875	1454	855	855
query18	2321	399	394	394
query19	210	145	144	144
query20	77	76	76	76
query21	185	93	89	89
query22	5303	5143	5148	5143
query23	32525	32137	31974	31974
query24	6963	6509	6422	6422
query25	505	438	410	410
query26	532	153	157	153
query27	1877	288	283	283
query28	6117	2219	2180	2180
query29	2934	2786	2869	2786
query30	247	164	160	160
query31	895	713	730	713
query32	61	59	56	56
query33	386	247	250	247
query34	850	463	475	463
query35	1152	888	900	888
query36	1562	1531	1322	1322
query37	83	67	57	57
query38	3031	2910	2863	2863
query39	1371	1318	1321	1318
query40	195	92	90	90
query41	36	40	31	31
query42	80	79	79	79
query43	694	618	575	575
query44	1127	708	707	707
query45	242	223	230	223
query46	1238	974	997	974
query47	1838	1816	1741	1741
query48	991	665	653	653
query49	611	363	359	359
query50	843	585	608	585
query51	5539	5478	5411	5411
query52	80	80	75	75
query53	438	304	308	304
query54	2644	2465	2481	2465
query55	96	90	84	84
query56	195	208	199	199
query57	1290	1070	1002	1002
query58	214	190	207	190
query59	3404	3290	3337	3290
query60	193	197	190	190
query61	83	84	82	82
query62	770	469	519	469
query63	471	331	326	326
query64	2487	1487	1377	1377
query65	3603	3588	3566	3566
query66	764	378	360	360
query67	16713	15666	16354	15666
query68	8084	642	674	642
query69	559	348	345	345
query70	2036	1855	1766	1766
query71	408	302	305	302
query72	6461	3398	3419	3398
query73	722	321	324	321
query74	6251	5760	5787	5760
query75	4500	3714	3674	3674
query76	4629	1160	1217	1160
query77	572	245	251	245
query78	31920	53572	51643	51643
query79	15141	654	637	637
query80	4608	381	378	378
query81	562	226	227	226
query82	1231	95	94	94
query83	335	134	131	131
query84	259	67	72	67
query85	1721	285	271	271
query86	461	380	397	380
query87	3274	2970	3011	2970
query88	6775	2340	2319	2319
query89	425	306	291	291
query90	2512	206	205	205
query91	167	126	116	116
query92	61	51	51	51
query93	5262	553	551	551
query94	1660	214	212	212
query95	1115	1074	1058	1058
query96	651	333	327	327
query97	6545	6428	6430	6428
query98	189	172	175	172
query99	3730	1030	1116	1030
Total cold run time: 345921 ms
Total hot run time: 243380 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.26 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 4b2920d9c4c17147484be228855658af6102e264, data reload: false

query1	0.02	0.02	0.02
query2	0.06	0.02	0.02
query3	0.24	0.05	0.05
query4	1.82	0.08	0.10
query5	0.54	0.52	0.54
query6	1.25	0.62	0.62
query7	0.01	0.01	0.01
query8	0.04	0.03	0.03
query9	0.52	0.48	0.47
query10	0.53	0.53	0.53
query11	0.11	0.09	0.08
query12	0.11	0.10	0.09
query13	0.61	0.61	0.62
query14	0.79	0.78	0.80
query15	0.76	0.76	0.75
query16	0.37	0.39	0.36
query17	1.01	1.02	1.01
query18	0.23	0.26	0.26
query19	1.88	1.86	1.81
query20	0.02	0.01	0.01
query21	15.47	0.56	0.55
query22	1.96	1.99	2.06
query23	17.46	0.90	0.91
query24	8.66	0.96	1.06
query25	1.57	0.12	0.11
query26	0.44	0.14	0.13
query27	0.10	0.11	0.11
query28	5.85	0.74	0.71
query29	12.73	2.37	2.32
query30	0.61	0.52	0.51
query31	2.82	0.37	0.40
query32	3.40	0.50	0.50
query33	3.05	3.07	3.09
query34	15.28	4.81	4.82
query35	4.85	4.86	4.85
query36	1.08	1.02	1.02
query37	0.06	0.04	0.05
query38	0.03	0.02	0.02
query39	0.02	0.01	0.01
query40	0.15	0.14	0.14
query41	0.06	0.02	0.01
query42	0.02	0.01	0.02
query43	0.02	0.02	0.01
Total cold run time: 106.61 s
Total hot run time: 31.26 s

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit 4b2920d9c4c17147484be228855658af6102e264 with default session variables
Stream load json:         19 seconds loaded 2358488459 Bytes, about 118 MB/s
Stream load orc:          58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select:       21.0 seconds inserted 10000000 Rows, about 476K ops/s

@xiaokang xiaokang merged commit 8d133e6 into apache:branch-2.0 Feb 19, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants