Skip to content

Conversation

@starocean999
Copy link
Contributor

Proposed changes

pick from master #34035

Further comments

If this is a relatively large or complex change, kick off the discussion at dev@doris.apache.org by explaining why you chose the solution you did and what alternatives you considered, etc...

@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@starocean999
Copy link
Contributor Author

run buildall

@github-actions github-actions bot added area/planner Issues or PRs related to the query planner kind/test labels Apr 23, 2024
@doris-robot
Copy link

TPC-H: Total hot run time: 50272 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 8b9ad5905e636065d00bb467aca5438d83cdeb66, data reload: false

------ Round 1 ----------------------------------
q1	17532	4476	4359	4359
q2	2029	151	140	140
q3	10274	2033	1896	1896
q4	10103	1248	1334	1248
q5	8428	3948	3920	3920
q6	230	122	127	122
q7	2048	1617	1580	1580
q8	9256	2699	2704	2699
q9	10897	11142	10828	10828
q10	8649	3530	3539	3530
q11	423	241	237	237
q12	467	302	307	302
q13	18363	3926	4035	3926
q14	350	325	329	325
q15	517	463	465	463
q16	705	596	588	588
q17	1129	951	937	937
q18	7239	6843	6849	6843
q19	1710	1593	1573	1573
q20	508	301	309	301
q21	4442	4049	4066	4049
q22	508	412	406	406
Total cold run time: 115807 ms
Total hot run time: 50272 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4346	4346	4256	4256
q2	320	222	219	219
q3	4153	4166	4134	4134
q4	2754	2736	2740	2736
q5	7193	7111	7160	7111
q6	233	119	118	118
q7	3271	2837	2798	2798
q8	4318	4393	4445	4393
q9	17179	16936	16949	16936
q10	4192	4269	4236	4236
q11	716	667	674	667
q12	1033	834	847	834
q13	4325	3764	3720	3720
q14	457	427	436	427
q15	499	448	466	448
q16	739	712	683	683
q17	3754	3845	3878	3845
q18	8894	8738	8708	8708
q19	1707	1721	1662	1662
q20	2407	2178	2104	2104
q21	8518	8458	8444	8444
q22	1061	983	938	938
Total cold run time: 82069 ms
Total hot run time: 79417 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 203666 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 8b9ad5905e636065d00bb467aca5438d83cdeb66, data reload: false

query1	932	389	387	387
query2	6542	3029	2570	2570
query3	6914	199	200	199
query4	20263	17907	17884	17884
query5	19708	6515	6516	6515
query6	278	226	248	226
query7	4164	300	292	292
query8	274	257	258	257
query9	3149	2722	2633	2633
query10	414	284	302	284
query11	11306	10717	10755	10717
query12	123	78	69	69
query13	5581	723	679	679
query14	17660	13650	13137	13137
query15	379	232	233	232
query16	6466	268	256	256
query17	1575	1473	837	837
query18	2308	411	400	400
query19	203	146	155	146
query20	76	76	75	75
query21	188	91	98	91
query22	5249	5119	5180	5119
query23	32454	31909	31806	31806
query24	7006	6481	6505	6481
query25	528	430	420	420
query26	617	163	159	159
query27	2047	292	290	290
query28	6210	2401	2347	2347
query29	2912	2641	2710	2641
query30	246	163	159	159
query31	888	716	741	716
query32	64	57	57	57
query33	375	252	241	241
query34	850	471	488	471
query35	1109	896	920	896
query36	1406	1248	1065	1065
query37	88	60	59	59
query38	3097	2950	2903	2903
query39	1370	1316	1315	1315
query40	194	94	94	94
query41	37	35	36	35
query42	85	79	78	78
query43	795	615	618	615
query44	1187	740	737	737
query45	238	224	223	223
query46	1233	970	965	965
query47	1964	1782	1650	1650
query48	995	703	710	703
query49	620	366	372	366
query50	861	602	578	578
query51	4810	4661	4645	4645
query52	84	75	78	75
query53	440	315	317	315
query54	2629	2473	2450	2450
query55	84	70	78	70
query56	201	205	204	204
query57	1158	1067	1196	1067
query58	221	211	202	202
query59	4415	4058	4046	4046
query60	207	185	195	185
query61	86	81	82	81
query62	806	533	528	528
query63	471	336	324	324
query64	2490	1485	1300	1300
query65	3623	3547	3554	3547
query66	797	366	358	358
query67	17839	16415	17367	16415
query68	8515	656	677	656
query69	568	334	335	334
query70	1684	1584	1489	1489
query71	383	314	306	306
query72	6495	3435	3418	3418
query73	724	324	322	322
query74	6336	5799	5842	5799
query75	4814	3710	3737	3710
query76	5136	1177	1238	1177
query77	713	260	254	254
query78	12443	11801	14577	11801
query79	8573	634	663	634
query80	1518	396	395	395
query81	500	234	226	226
query82	328	101	96	96
query83	177	128	128	128
query84	258	66	66	66
query85	1034	290	295	290
query86	351	292	298	292
query87	3217	3009	2970	2970
query88	4584	2321	2305	2305
query89	354	278	303	278
query90	1827	212	206	206
query91	173	129	149	129
query92	57	52	53	52
query93	1847	589	601	589
query94	723	205	199	199
query95	1123	1077	1060	1060
query96	646	322	318	318
query97	6283	6324	6302	6302
query98	189	179	165	165
query99	2986	813	1078	813
Total cold run time: 308148 ms
Total hot run time: 203666 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.9 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 8b9ad5905e636065d00bb467aca5438d83cdeb66, data reload: false

query1	0.03	0.02	0.02
query2	0.07	0.02	0.02
query3	0.24	0.05	0.04
query4	1.81	0.07	0.08
query5	0.52	0.52	0.52
query6	1.25	0.62	0.62
query7	0.02	0.01	0.01
query8	0.03	0.03	0.03
query9	0.52	0.49	0.49
query10	0.55	0.54	0.55
query11	0.12	0.09	0.08
query12	0.12	0.09	0.09
query13	0.61	0.61	0.62
query14	0.77	0.79	0.79
query15	0.77	0.75	0.77
query16	0.36	0.37	0.38
query17	0.98	0.99	1.00
query18	0.22	0.26	0.23
query19	1.90	1.84	1.83
query20	0.01	0.01	0.01
query21	15.48	0.57	0.56
query22	2.05	1.98	1.73
query23	17.16	0.92	0.92
query24	4.58	3.30	1.10
query25	0.35	0.11	0.06
query26	0.75	0.16	0.15
query27	0.05	0.04	0.04
query28	6.28	0.72	0.70
query29	12.62	2.35	2.26
query30	0.58	0.52	0.52
query31	2.83	0.40	0.37
query32	3.39	0.50	0.49
query33	3.06	3.07	3.03
query34	15.23	4.79	4.79
query35	4.85	4.83	4.84
query36	1.08	1.00	1.02
query37	0.06	0.04	0.04
query38	0.03	0.02	0.02
query39	0.02	0.01	0.02
query40	0.15	0.14	0.14
query41	0.06	0.02	0.01
query42	0.02	0.02	0.01
query43	0.02	0.01	0.02
Total cold run time: 101.6 s
Total hot run time: 30.9 s

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit 8b9ad5905e636065d00bb467aca5438d83cdeb66 with default session variables
Stream load json:         20 seconds loaded 2358488459 Bytes, about 112 MB/s
Stream load orc:          58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select:       21.8 seconds inserted 10000000 Rows, about 458K ops/s

@starocean999 starocean999 marked this pull request as ready for review April 24, 2024 02:30
@starocean999 starocean999 merged commit 93471ca into apache:branch-2.0 Apr 25, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

area/planner Issues or PRs related to the query planner kind/test

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants