Skip to content

Conversation

@ByteYue
Copy link
Contributor

@ByteYue ByteYue commented Jul 24, 2024

Proposed changes

same as master #37492

@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@ByteYue
Copy link
Contributor Author

ByteYue commented Jul 24, 2024

run buildall

@github-actions github-actions bot added the area/planner Issues or PRs related to the query planner label Jul 24, 2024
@doris-robot
Copy link

TPC-H: Total hot run time: 49739 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit a136f16a68ffda87c9e428a4e27aa0cb1b57fee2, data reload: false

------ Round 1 ----------------------------------
q1	17639	4481	4357	4357
q2	2076	159	146	146
q3	10266	1899	1878	1878
q4	10116	1260	1319	1260
q5	8504	3822	3886	3822
q6	237	145	127	127
q7	2061	1631	1573	1573
q8	9517	2728	2711	2711
q9	13921	10435	10216	10216
q10	8617	3538	3520	3520
q11	415	239	257	239
q12	483	305	301	301
q13	18343	3968	4015	3968
q14	352	339	328	328
q15	503	465	452	452
q16	668	588	571	571
q17	1122	956	926	926
q18	7330	6901	7032	6901
q19	1788	1643	1621	1621
q20	549	313	290	290
q21	4405	4136	4087	4087
q22	519	456	445	445
Total cold run time: 119431 ms
Total hot run time: 49739 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4319	4326	4270	4270
q2	323	231	226	226
q3	4182	4127	4129	4127
q4	2782	2765	2761	2761
q5	7129	7172	7128	7128
q6	240	123	118	118
q7	3249	2875	2860	2860
q8	4378	4429	4491	4429
q9	16839	16847	16666	16666
q10	4228	4286	4251	4251
q11	766	707	683	683
q12	1023	853	832	832
q13	6954	3731	3725	3725
q14	452	429	413	413
q15	504	454	463	454
q16	724	704	671	671
q17	3832	3795	3878	3795
q18	8783	8801	8707	8707
q19	1717	1654	1737	1654
q20	2380	2119	2130	2119
q21	8462	8485	8465	8465
q22	1025	995	997	995
Total cold run time: 84291 ms
Total hot run time: 79349 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 204084 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit a136f16a68ffda87c9e428a4e27aa0cb1b57fee2, data reload: false

query1	934	430	384	384
query2	6530	2876	2847	2847
query3	6919	214	205	205
query4	20427	18098	17990	17990
query5	19717	6520	6564	6520
query6	294	221	233	221
query7	4152	314	320	314
query8	428	470	410	410
query9	3153	2718	2649	2649
query10	450	327	297	297
query11	11262	10665	10736	10665
query12	124	78	75	75
query13	5604	710	703	703
query14	17768	13306	13558	13306
query15	369	250	249	249
query16	6448	292	265	265
query17	1697	1450	887	887
query18	2292	417	415	415
query19	205	149	153	149
query20	83	77	85	77
query21	196	96	105	96
query22	5315	5034	5090	5034
query23	32653	31984	31886	31886
query24	6981	6525	6489	6489
query25	531	434	424	424
query26	527	174	168	168
query27	1864	298	309	298
query28	6143	2406	2328	2328
query29	2957	2798	2744	2744
query30	246	173	176	173
query31	902	733	750	733
query32	68	63	63	63
query33	407	273	263	263
query34	848	480	482	480
query35	1125	920	974	920
query36	1184	1129	1352	1129
query37	90	60	62	60
query38	3104	2968	2973	2968
query39	1399	1351	1331	1331
query40	204	95	101	95
query41	55	47	48	47
query42	91	80	86	80
query43	758	761	713	713
query44	1148	712	719	712
query45	249	245	239	239
query46	1219	977	999	977
query47	2041	1694	1783	1694
query48	1025	724	731	724
query49	629	379	385	379
query50	854	614	610	610
query51	4695	4625	4696	4625
query52	94	83	82	82
query53	456	339	331	331
query54	2662	2473	2473	2473
query55	92	87	94	87
query56	246	200	214	200
query57	1241	1151	1135	1135
query58	220	210	203	203
query59	4213	4106	4040	4040
query60	224	200	200	200
query61	99	96	108	96
query62	825	489	475	475
query63	494	343	343	343
query64	2480	1552	1416	1416
query65	3630	3574	3544	3544
query66	793	381	390	381
query67	15503	15127	15884	15127
query68	8679	676	659	659
query69	589	342	339	339
query70	1786	1300	1592	1300
query71	418	308	319	308
query72	6726	3533	3511	3511
query73	739	323	324	323
query74	6320	5842	5800	5800
query75	5147	3776	3703	3703
query76	5074	1127	1176	1127
query77	871	252	269	252
query78	12900	11671	15062	11671
query79	9251	665	664	664
query80	799	414	425	414
query81	494	238	232	232
query82	510	102	99	99
query83	174	136	133	133
query84	264	72	72	72
query85	727	334	337	334
query86	328	320	290	290
query87	3300	3053	3026	3026
query88	4239	2380	2371	2371
query89	357	300	284	284
query90	1934	214	203	203
query91	176	141	151	141
query92	60	55	57	55
query93	2280	538	573	538
query94	695	214	206	206
query95	1127	1069	1052	1052
query96	646	333	333	333
query97	6433	6410	6431	6410
query98	202	184	173	173
query99	3069	988	818	818
Total cold run time: 307950 ms
Total hot run time: 204084 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.78 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit a136f16a68ffda87c9e428a4e27aa0cb1b57fee2, data reload: false

query1	0.02	0.03	0.03
query2	0.08	0.02	0.02
query3	0.24	0.05	0.06
query4	1.78	0.08	0.07
query5	0.53	0.53	0.53
query6	1.24	0.62	0.63
query7	0.02	0.01	0.01
query8	0.03	0.02	0.02
query9	0.52	0.48	0.49
query10	0.53	0.52	0.54
query11	0.12	0.08	0.08
query12	0.12	0.09	0.10
query13	0.62	0.62	0.61
query14	0.78	0.79	0.79
query15	0.77	0.77	0.76
query16	0.37	0.37	0.36
query17	1.01	0.99	1.01
query18	0.23	0.26	0.23
query19	1.94	1.81	1.83
query20	0.02	0.01	0.01
query21	15.48	0.56	0.56
query22	1.87	1.77	1.58
query23	16.86	1.08	0.95
query24	6.17	1.10	1.27
query25	0.38	0.05	0.06
query26	0.76	0.17	0.17
query27	0.05	0.04	0.04
query28	6.70	0.77	0.73
query29	12.79	2.20	2.25
query30	0.64	0.53	0.53
query31	2.81	0.39	0.37
query32	3.39	0.52	0.50
query33	3.08	3.06	3.10
query34	15.25	4.78	4.80
query35	4.86	4.85	4.83
query36	1.04	1.03	1.01
query37	0.05	0.04	0.04
query38	0.03	0.02	0.02
query39	0.02	0.01	0.01
query40	0.16	0.14	0.14
query41	0.06	0.02	0.01
query42	0.02	0.02	0.01
query43	0.03	0.02	0.01
Total cold run time: 103.47 s
Total hot run time: 30.78 s

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit a136f16a68ffda87c9e428a4e27aa0cb1b57fee2 with default session variables
Stream load json:         20 seconds loaded 2358488459 Bytes, about 112 MB/s
Stream load orc:          59 seconds loaded 1101869774 Bytes, about 17 MB/s
Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select:       21.3 seconds inserted 10000000 Rows, about 469K ops/s

@dataroaring dataroaring merged commit 8e6ee5a into apache:branch-2.0 Jul 31, 2024
mongo360 pushed a commit to mongo360/doris that referenced this pull request Dec 11, 2024
…replica for scanning first" (apache#38323)

## Proposed changes

<!--Describe your changes.-->

same as master apache#37492
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

area/planner Issues or PRs related to the query planner

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants