Skip to content

Conversation

@mrhhsg
Copy link
Member

@mrhhsg mrhhsg commented Mar 7, 2024

Proposed changes

pick #31928

Further comments

If this is a relatively large or complex change, kick off the discussion at dev@doris.apache.org by explaining why you chose the solution you did and what alternatives you considered, etc...

@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

@mrhhsg
Copy link
Member Author

mrhhsg commented Mar 7, 2024

run buildall

@github-actions
Copy link
Contributor

github-actions bot commented Mar 7, 2024

clang-tidy review says "All clean, LGTM! 👍"

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 37.79% (8035/21263)
Line Coverage: 29.48% (65561/222421)
Region Coverage: 28.94% (33737/116569)
Branch Coverage: 24.79% (17312/69846)
Coverage Report: http://coverage.selectdb-in.cc/coverage/3e596cac536ef4acc4b288e6a28e961a16d4d77d_3e596cac536ef4acc4b288e6a28e961a16d4d77d/report/index.html

@doris-robot
Copy link

TPC-H: Total hot run time: 49956 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 3e596cac536ef4acc4b288e6a28e961a16d4d77d, data reload: false

------ Round 1 ----------------------------------
q1	17888	4356	4339	4339
q2	2030	148	137	137
q3	10461	1870	1907	1870
q4	10311	1258	1317	1258
q5	8486	3929	4015	3929
q6	227	123	122	122
q7	2010	1577	1607	1577
q8	9270	2700	2700	2700
q9	11156	10780	10622	10622
q10	8693	3530	3545	3530
q11	418	237	242	237
q12	455	291	295	291
q13	18336	3954	3955	3954
q14	357	325	327	325
q15	500	456	454	454
q16	679	593	591	591
q17	1121	969	976	969
q18	7143	6798	6778	6778
q19	1691	1589	1496	1496
q20	521	304	299	299
q21	4428	4092	4117	4092
q22	477	386	390	386
Total cold run time: 116658 ms
Total hot run time: 49956 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4301	4294	4268	4268
q2	322	215	216	215
q3	4140	4112	4120	4112
q4	2738	2731	2743	2731
q5	7273	7158	7196	7158
q6	235	121	118	118
q7	3239	2855	2827	2827
q8	4327	4450	4439	4439
q9	17593	17296	17255	17255
q10	4264	4218	4267	4218
q11	773	669	682	669
q12	1021	868	846	846
q13	7288	3724	3755	3724
q14	464	428	420	420
q15	489	457	445	445
q16	747	699	707	699
q17	3770	3848	3891	3848
q18	8888	8776	8810	8776
q19	1703	1705	1649	1649
q20	2342	2118	2138	2118
q21	8515	8438	8416	8416
q22	1039	968	940	940
Total cold run time: 85471 ms
Total hot run time: 79891 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 201758 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 3e596cac536ef4acc4b288e6a28e961a16d4d77d, data reload: false

query1	916	384	388	384
query2	6539	2175	2167	2167
query3	6917	202	195	195
query4	21056	18032	18114	18032
query5	19720	6494	6537	6494
query6	283	210	234	210
query7	4152	304	298	298
query8	250	247	229	229
query9	3063	2648	2560	2560
query10	430	289	297	289
query11	11608	10929	10938	10929
query12	121	75	72	72
query13	5573	641	618	618
query14	17889	13270	13318	13270
query15	356	228	229	228
query16	6439	276	269	269
query17	1706	1445	866	866
query18	2323	423	406	406
query19	208	144	147	144
query20	77	78	78	78
query21	183	91	92	91
query22	5139	5116	4913	4913
query23	32273	31712	31824	31712
query24	6944	6476	6442	6442
query25	529	430	426	426
query26	520	159	159	159
query27	1890	293	294	293
query28	6083	2194	2192	2192
query29	2889	2735	2759	2735
query30	237	162	160	160
query31	900	719	730	719
query32	66	60	58	58
query33	396	257	246	246
query34	846	459	468	459
query35	1106	909	947	909
query36	1413	1375	1364	1364
query37	87	62	59	59
query38	3144	2885	2908	2885
query39	1393	1310	1322	1310
query40	198	97	93	93
query41	36	34	32	32
query42	80	84	81	81
query43	730	577	643	577
query44	1143	715	719	715
query45	233	229	223	223
query46	1253	978	970	970
query47	1828	1781	1714	1714
query48	966	671	648	648
query49	617	357	353	353
query50	863	605	583	583
query51	4692	4664	4705	4664
query52	94	75	76	75
query53	434	332	318	318
query54	2642	2472	2451	2451
query55	83	74	73	73
query56	212	209	215	209
query57	1266	1040	1103	1040
query58	212	184	186	184
query59	3644	3074	3163	3074
query60	202	208	183	183
query61	90	86	86	86
query62	802	486	482	482
query63	474	330	333	330
query64	2524	1490	1469	1469
query65	3599	3590	3544	3544
query66	781	376	368	368
query67	15535	14995	16252	14995
query68	8495	641	664	641
query69	559	327	361	327
query70	1957	1656	1550	1550
query71	413	307	316	307
query72	6523	3556	3459	3459
query73	784	317	311	311
query74	6358	6016	5963	5963
query75	4719	3732	3679	3679
query76	4788	1114	1153	1114
query77	673	257	255	255
query78	13208	12281	11933	11933
query79	6756	627	623	623
query80	1604	379	407	379
query81	497	232	235	232
query82	1287	101	91	91
query83	158	137	132	132
query84	251	75	67	67
query85	1263	307	285	285
query86	417	365	417	365
query87	3267	2996	2988	2988
query88	5124	2344	2316	2316
query89	350	293	305	293
query90	1766	207	195	195
query91	150	120	118	118
query92	58	50	48	48
query93	2488	569	551	551
query94	855	208	206	206
query95	1139	1062	1067	1062
query96	636	329	320	320
query97	6621	6481	6469	6469
query98	181	172	169	169
query99	2899	953	906	906
Total cold run time: 307141 ms
Total hot run time: 201758 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 29.95 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 3e596cac536ef4acc4b288e6a28e961a16d4d77d, data reload: false

query1	0.02	0.02	0.02
query2	0.06	0.02	0.02
query3	0.24	0.06	0.04
query4	1.82	0.10	0.09
query5	0.52	0.52	0.51
query6	1.23	0.63	0.62
query7	0.01	0.01	0.01
query8	0.04	0.02	0.02
query9	0.52	0.47	0.46
query10	0.54	0.54	0.51
query11	0.11	0.09	0.09
query12	0.12	0.09	0.09
query13	0.61	0.61	0.62
query14	0.77	0.79	0.79
query15	0.78	0.76	0.76
query16	0.36	0.39	0.36
query17	1.02	1.03	1.00
query18	0.20	0.29	0.24
query19	1.92	1.85	1.83
query20	0.01	0.01	0.00
query21	15.48	0.57	0.57
query22	1.92	2.75	1.20
query23	17.28	1.02	0.90
query24	4.90	0.67	1.21
query25	0.46	0.08	0.04
query26	0.51	0.15	0.14
query27	0.04	0.04	0.04
query28	8.42	0.71	0.75
query29	12.67	2.26	2.34
query30	0.61	0.53	0.52
query31	2.81	0.38	0.38
query32	3.44	0.49	0.50
query33	3.07	3.05	3.08
query34	15.26	4.80	4.79
query35	4.92	4.89	4.87
query36	1.05	1.00	1.02
query37	0.05	0.05	0.04
query38	0.03	0.02	0.02
query39	0.01	0.02	0.02
query40	0.15	0.14	0.13
query41	0.07	0.02	0.02
query42	0.01	0.01	0.01
query43	0.02	0.02	0.01
Total cold run time: 104.08 s
Total hot run time: 29.95 s

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit 3e596cac536ef4acc4b288e6a28e961a16d4d77d with default session variables
Stream load json:         21 seconds loaded 2358488459 Bytes, about 107 MB/s
Stream load orc:          59 seconds loaded 1101869774 Bytes, about 17 MB/s
Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select:       20.7 seconds inserted 10000000 Rows, about 483K ops/s

@yiguolei yiguolei merged commit cafe6af into apache:branch-2.0 Mar 7, 2024
@mrhhsg mrhhsg deleted the pick_fix_map_agg branch March 7, 2024 14:14
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants