Skip to content

Conversation

@morrySnow
Copy link
Contributor

Proposed changes

Issue Number: close #xxx

Further comments

If this is a relatively large or complex change, kick off the discussion at dev@doris.apache.org by explaining why you chose the solution you did and what alternatives you considered, etc...

@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@morrySnow
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 49772 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 7afef0e83325ea40bd2d37e24f06f428994dd562, data reload: false

------ Round 1 ----------------------------------
q1	18128	4387	4309	4309
q2	2030	150	148	148
q3	10447	1905	1922	1905
q4	10319	1264	1317	1264
q5	8686	3873	3918	3873
q6	227	126	125	125
q7	2008	1595	1573	1573
q8	9280	2718	2705	2705
q9	10994	10462	10653	10462
q10	8651	3512	3509	3509
q11	417	245	247	245
q12	468	305	304	304
q13	18361	3974	4009	3974
q14	373	328	334	328
q15	503	475	463	463
q16	675	564	565	564
q17	1118	921	976	921
q18	7313	6939	6939	6939
q19	1686	1571	1476	1476
q20	528	315	289	289
q21	4386	4135	4007	4007
q22	492	389	390	389
Total cold run time: 117090 ms
Total hot run time: 49772 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4325	4276	4258	4258
q2	325	230	225	225
q3	4200	4130	4162	4130
q4	2757	2768	2760	2760
q5	7194	7178	7116	7116
q6	236	119	117	117
q7	3262	2863	2845	2845
q8	4334	4445	4464	4445
q9	17380	16921	17216	16921
q10	4255	4233	4323	4233
q11	769	729	701	701
q12	1029	882	861	861
q13	6866	3741	3729	3729
q14	460	429	423	423
q15	495	469	450	450
q16	727	684	670	670
q17	3837	3807	3831	3807
q18	8725	8849	8939	8849
q19	1692	1694	1676	1676
q20	2406	2115	2101	2101
q21	8516	8485	8389	8389
q22	1054	991	928	928
Total cold run time: 84844 ms
Total hot run time: 79634 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 203606 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 7afef0e83325ea40bd2d37e24f06f428994dd562, data reload: false

query1	945	386	376	376
query2	6539	3579	2616	2616
query3	6919	214	207	207
query4	20562	18053	17988	17988
query5	19731	6468	6456	6456
query6	284	221	230	221
query7	4165	305	300	300
query8	259	287	254	254
query9	3170	2696	2613	2613
query10	409	299	293	293
query11	11285	10800	10674	10674
query12	127	75	75	75
query13	5580	663	687	663
query14	17487	13490	13173	13173
query15	363	227	229	227
query16	6474	283	258	258
query17	1715	1456	886	886
query18	2309	416	408	408
query19	209	152	151	151
query20	81	79	83	79
query21	194	96	93	93
query22	5308	5152	4860	4860
query23	32472	31773	31873	31773
query24	7011	6507	6470	6470
query25	516	426	422	422
query26	612	161	164	161
query27	2020	288	297	288
query28	6231	2387	2337	2337
query29	2939	2844	2788	2788
query30	247	168	162	162
query31	888	720	736	720
query32	66	61	60	60
query33	395	258	257	257
query34	858	474	476	474
query35	1129	936	969	936
query36	1451	1208	1317	1208
query37	89	62	60	60
query38	3104	2979	3021	2979
query39	1374	1317	1327	1317
query40	205	95	96	95
query41	43	38	37	37
query42	80	78	89	78
query43	791	684	631	631
query44	1094	708	720	708
query45	242	240	231	231
query46	1231	979	969	969
query47	1987	1769	1823	1769
query48	1003	684	712	684
query49	622	379	380	379
query50	836	610	582	582
query51	4747	4676	4672	4672
query52	94	76	84	76
query53	443	309	308	308
query54	2624	2459	2481	2459
query55	80	83	81	81
query56	234	208	213	208
query57	1249	1067	1120	1067
query58	218	190	205	190
query59	4173	4107	3796	3796
query60	204	194	211	194
query61	89	88	89	88
query62	824	510	449	449
query63	482	328	334	328
query64	2385	1500	1421	1421
query65	3650	3563	3539	3539
query66	807	376	386	376
query67	17274	16023	16678	16023
query68	6314	646	654	646
query69	575	362	378	362
query70	1505	1473	1482	1473
query71	404	301	300	300
query72	6384	3482	3444	3444
query73	733	316	318	316
query74	6383	5919	5902	5902
query75	4533	3696	3716	3696
query76	4082	1137	1151	1137
query77	539	256	261	256
query78	12916	11571	12463	11571
query79	8454	651	658	651
query80	3039	402	389	389
query81	535	235	229	229
query82	1084	98	98	98
query83	214	140	135	135
query84	264	70	71	70
query85	1409	311	296	296
query86	359	297	298	297
query87	3255	3055	3022	3022
query88	5077	2363	2350	2350
query89	365	276	290	276
query90	1714	200	205	200
query91	192	135	134	134
query92	61	51	54	51
query93	4554	564	549	549
query94	901	211	208	208
query95	1094	1068	1056	1056
query96	661	334	328	328
query97	6556	6418	6460	6418
query98	193	185	180	180
query99	2965	910	845	845
Total cold run time: 310542 ms
Total hot run time: 203606 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.73 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 7afef0e83325ea40bd2d37e24f06f428994dd562, data reload: false

query1	0.02	0.02	0.03
query2	0.06	0.02	0.02
query3	0.25	0.05	0.05
query4	1.78	0.07	0.07
query5	0.53	0.53	0.52
query6	1.22	0.63	0.62
query7	0.01	0.01	0.01
query8	0.04	0.03	0.02
query9	0.52	0.50	0.48
query10	0.54	0.53	0.53
query11	0.12	0.09	0.08
query12	0.12	0.09	0.09
query13	0.61	0.62	0.61
query14	0.77	0.79	0.80
query15	0.78	0.75	0.77
query16	0.36	0.37	0.37
query17	1.03	1.03	1.04
query18	0.21	0.26	0.24
query19	1.91	1.85	1.83
query20	0.01	0.01	0.01
query21	15.47	0.55	0.57
query22	1.99	1.79	1.69
query23	17.34	1.09	0.88
query24	7.28	0.86	0.96
query25	0.39	0.12	0.06
query26	0.70	0.14	0.17
query27	0.04	0.03	0.04
query28	6.17	0.72	0.70
query29	12.77	2.32	2.35
query30	0.57	0.52	0.53
query31	2.83	0.39	0.37
query32	3.43	0.49	0.50
query33	3.07	3.08	3.08
query34	15.26	4.84	4.80
query35	4.89	4.84	4.87
query36	1.07	1.02	1.02
query37	0.05	0.04	0.04
query38	0.03	0.02	0.02
query39	0.02	0.01	0.01
query40	0.16	0.13	0.14
query41	0.06	0.02	0.01
query42	0.02	0.01	0.02
query43	0.02	0.02	0.02
Total cold run time: 104.52 s
Total hot run time: 30.73 s

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit 7afef0e83325ea40bd2d37e24f06f428994dd562 with default session variables
Stream load json:         21 seconds loaded 2358488459 Bytes, about 107 MB/s
Stream load orc:          59 seconds loaded 1101869774 Bytes, about 17 MB/s
Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select:       21.2 seconds inserted 10000000 Rows, about 471K ops/s

@morrySnow morrySnow merged commit 7bee558 into apache:branch-2.0 May 20, 2024
@morrySnow morrySnow deleted the fix_push_down branch May 27, 2024 09:07
mongo360 pushed a commit to mongo360/doris that referenced this pull request Aug 16, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants