Skip to content

Conversation

@zclllyybb
Copy link
Contributor

@zclllyybb zclllyybb commented Mar 29, 2024

Proposed changes

Issue Number: close #xxx

mysql> select uuid_to_int("6ce4766f-6783-4b30-b357-bba1c7600348");
+-----------------------------------------------------+
| uuid_to_int('6ce4766f-6783-4b30-b357-bba1c7600348') |
+-----------------------------------------------------+
| 95721955514869408091759290071393952876              |
+-----------------------------------------------------+
1 row in set (0.13 sec)

mysql> select int_to_uuid(95721955514869408091759290071393952876);
+-----------------------------------------------------+
| int_to_uuid(95721955514869408091759290071393952876) |
+-----------------------------------------------------+
| 6ce4766f-6783-4b30-b357-bba1c7600348                |
+-----------------------------------------------------+
1 row in set (0.12 sec)

auto-vectorization checked. see https://godbolt.org/z/c7dvnrrc6

doc pr: apache/doris-website#489

Further comments

If this is a relatively large or complex change, kick off the discussion at dev@doris.apache.org by explaining why you chose the solution you did and what alternatives you considered, etc...

@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

Copy link
Contributor

@github-actions github-actions bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

clang-tidy made some suggestions

@zclllyybb
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 35.60% (8840/24830)
Line Coverage: 27.31% (72411/265170)
Region Coverage: 26.54% (37558/141512)
Branch Coverage: 23.34% (19152/82044)
Coverage Report: http://coverage.selectdb-in.cc/coverage/51e86ede27453b0e2cd64abe90b714fe2d8250af_51e86ede27453b0e2cd64abe90b714fe2d8250af/report/index.html

@doris-robot
Copy link

TPC-H: Total hot run time: 37537 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 51e86ede27453b0e2cd64abe90b714fe2d8250af, data reload: false

------ Round 1 ----------------------------------
q1	17597	4280	4079	4079
q2	2122	169	154	154
q3	10573	1134	1198	1134
q4	10232	807	772	772
q5	7457	2937	2905	2905
q6	197	122	125	122
q7	1028	571	571	571
q8	9356	1988	1961	1961
q9	6946	6301	6278	6278
q10	8492	3454	3580	3454
q11	429	227	227	227
q12	407	206	198	198
q13	17806	2861	2853	2853
q14	249	200	204	200
q15	524	472	461	461
q16	481	371	367	367
q17	945	636	544	544
q18	7152	6507	6476	6476
q19	4106	1394	1456	1394
q20	570	251	271	251
q21	3555	2839	3049	2839
q22	357	297	302	297
Total cold run time: 110581 ms
Total hot run time: 37537 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4154	4035	4044	4035
q2	333	235	235	235
q3	2991	2859	2874	2859
q4	1840	1541	1530	1530
q5	5191	5195	5246	5195
q6	195	116	118	116
q7	2242	1804	1807	1804
q8	3154	3297	3284	3284
q9	8409	8401	8454	8401
q10	3780	3918	3958	3918
q11	567	469	461	461
q12	770	619	579	579
q13	16954	3049	3116	3049
q14	298	267	252	252
q15	520	501	500	500
q16	527	462	464	462
q17	1765	1540	1538	1538
q18	7856	7465	7596	7465
q19	1678	1603	1532	1532
q20	2000	1809	1806	1806
q21	5022	4741	4720	4720
q22	601	473	469	469
Total cold run time: 70847 ms
Total hot run time: 54210 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 182325 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 51e86ede27453b0e2cd64abe90b714fe2d8250af, data reload: false

query1	919	350	341	341
query2	6778	1977	1863	1863
query3	6702	212	215	212
query4	31868	21311	21257	21257
query5	4290	392	392	392
query6	265	177	170	170
query7	4627	290	289	289
query8	242	172	167	167
query9	9315	2295	2282	2282
query10	414	255	264	255
query11	14792	14293	14357	14293
query12	140	88	85	85
query13	1641	452	434	434
query14	10663	7841	7995	7841
query15	324	181	184	181
query16	8243	268	267	267
query17	2156	585	582	582
query18	2110	302	294	294
query19	362	161	166	161
query20	96	87	94	87
query21	205	128	130	128
query22	4951	4828	4825	4825
query23	33588	32902	33337	32902
query24	11214	3000	2950	2950
query25	625	431	424	424
query26	1095	167	168	167
query27	2962	376	366	366
query28	7613	1949	1933	1933
query29	916	659	666	659
query30	306	160	166	160
query31	1036	754	743	743
query32	98	58	61	58
query33	762	278	268	268
query34	1166	498	530	498
query35	916	720	730	720
query36	1080	949	906	906
query37	128	68	66	66
query38	3776	3667	3762	3667
query39	1098	1093	1048	1048
query40	177	110	107	107
query41	49	48	45	45
query42	110	103	103	103
query43	515	461	443	443
query44	1272	769	756	756
query45	296	239	266	239
query46	1141	697	707	697
query47	2002	1917	1903	1903
query48	455	370	376	370
query49	883	346	354	346
query50	814	391	389	389
query51	6829	6698	6811	6698
query52	111	89	95	89
query53	349	278	285	278
query54	289	266	235	235
query55	87	79	79	79
query56	246	233	232	232
query57	1281	1193	1180	1180
query58	233	207	208	207
query59	2948	2702	2595	2595
query60	260	245	237	237
query61	100	92	94	92
query62	586	449	439	439
query63	300	278	267	267
query64	5170	4067	4132	4067
query65	3029	2995	3008	2995
query66	783	359	348	348
query67	15239	15112	14812	14812
query68	8963	532	533	532
query69	629	367	372	367
query70	1344	1200	1120	1120
query71	507	261	267	261
query72	6418	2653	2361	2361
query73	1615	316	318	316
query74	8256	6485	6339	6339
query75	3687	2232	2209	2209
query76	5394	827	852	827
query77	593	252	262	252
query78	11037	10161	10055	10055
query79	11711	548	542	542
query80	2258	381	385	381
query81	526	217	209	209
query82	236	84	86	84
query83	237	150	151	150
query84	283	78	78	78
query85	1240	318	328	318
query86	357	298	328	298
query87	3738	3567	3539	3539
query88	5345	2473	2408	2408
query89	483	366	376	366
query90	2431	176	176	176
query91	176	137	141	137
query92	63	46	48	46
query93	6964	494	495	494
query94	1545	177	176	176
query95	412	305	311	305
query96	605	280	275	275
query97	2644	2502	2462	2462
query98	220	215	217	215
query99	1022	858	838	838
Total cold run time: 315975 ms
Total hot run time: 182325 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 29.67 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 51e86ede27453b0e2cd64abe90b714fe2d8250af, data reload: false

query1	0.04	0.04	0.04
query2	0.07	0.03	0.03
query3	0.23	0.06	0.06
query4	1.65	0.10	0.09
query5	0.50	0.48	0.48
query6	1.13	0.64	0.64
query7	0.02	0.01	0.01
query8	0.03	0.02	0.03
query9	0.57	0.51	0.49
query10	0.55	0.55	0.54
query11	0.12	0.09	0.09
query12	0.11	0.09	0.09
query13	0.57	0.57	0.58
query14	0.76	0.76	0.78
query15	0.81	0.79	0.80
query16	0.37	0.39	0.36
query17	0.98	1.02	0.94
query18	0.20	0.26	0.22
query19	1.76	1.70	1.68
query20	0.02	0.01	0.01
query21	15.55	0.56	0.56
query22	2.95	1.94	1.36
query23	17.26	1.02	0.75
query24	3.19	2.26	1.46
query25	0.16	0.11	0.14
query26	0.77	0.13	0.11
query27	0.03	0.04	0.04
query28	10.59	0.93	0.96
query29	12.77	3.25	3.22
query30	0.28	0.09	0.08
query31	2.82	0.36	0.35
query32	3.35	0.45	0.44
query33	2.82	2.82	2.83
query34	16.09	4.34	4.42
query35	4.50	4.42	4.40
query36	0.66	0.47	0.47
query37	0.07	0.06	0.06
query38	0.05	0.03	0.03
query39	0.03	0.02	0.03
query40	0.18	0.14	0.14
query41	0.07	0.03	0.02
query42	0.04	0.02	0.02
query43	0.04	0.03	0.03
Total cold run time: 104.76 s
Total hot run time: 29.67 s

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit 51e86ede27453b0e2cd64abe90b714fe2d8250af with default session variables
Stream load json:         18 seconds loaded 2358488459 Bytes, about 124 MB/s
Stream load orc:          59 seconds loaded 1101869774 Bytes, about 17 MB/s
Stream load parquet:      33 seconds loaded 861443392 Bytes, about 24 MB/s
Insert into select:       13.4 seconds inserted 10000000 Rows, about 746K ops/s

@HappenLee
Copy link
Contributor

ADD UT

@zclllyybb
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 35.59% (8854/24877)
Line Coverage: 27.32% (72591/265728)
Region Coverage: 26.54% (37580/141617)
Branch Coverage: 23.33% (19155/82096)
Coverage Report: http://coverage.selectdb-in.cc/coverage/a6dda2091915de9992a7791c799e45ef6bb258c3_a6dda2091915de9992a7791c799e45ef6bb258c3/report/index.html

@doris-robot
Copy link

TPC-H: Total hot run time: 38258 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit a6dda2091915de9992a7791c799e45ef6bb258c3, data reload: false

------ Round 1 ----------------------------------
q1	17617	4322	4250	4250
q2	2088	191	183	183
q3	10444	1208	1166	1166
q4	10184	733	739	733
q5	7467	2781	2794	2781
q6	212	130	135	130
q7	1047	601	606	601
q8	9236	1993	2057	1993
q9	8052	6499	6553	6499
q10	8629	3535	3549	3535
q11	462	900262	232	232
q12	498	210	211	210
q13	18565	2949	2948	2948
q14	258	227	223	223
q15	504	466	460	460
q16	504	389	380	380
q17	961	594	632	594
q18	7274	6776	6562	6562
q19	5689	1428	1395	1395
q20	991	301	300	300
q21	3509	2777	2875	2777
q22	360	306	308	306
Total cold run time: 114551 ms
Total hot run time: 38258 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4329	4178	4145	4145
q2	459	270	271	270
q3	2996	2643	2717	2643
q4	1871	1521	1484	1484
q5	5258	5222	5193	5193
q6	203	118	120	118
q7	2233	1892	1874	1874
q8	3186	3343	3290	3290
q9	8486	8566	8506	8506
q10	3897	3631	3673	3631
q11	564	489	475	475
q12	739	564	593	564
q13	17189	2945	2933	2933
q14	296	262	268	262
q15	500	467	461	461
q16	497	421	423	421
q17	1770	1416	1407	1407
q18	7855	7418	7372	7372
q19	2521	1499	1545	1499
q20	2021	1728	1720	1720
q21	11590	4673	4645	4645
q22	514	451	453	451
Total cold run time: 78974 ms
Total hot run time: 53364 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 182492 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit a6dda2091915de9992a7791c799e45ef6bb258c3, data reload: false

query1	893	1125	1113	1113
query2	6466	1964	1914	1914
query3	6653	227	228	227
query4	24117	21395	21352	21352
query5	4089	404	399	399
query6	258	188	174	174
query7	4597	302	293	293
query8	222	179	183	179
query9	8423	2320	2318	2318
query10	531	241	255	241
query11	15566	14264	14248	14248
query12	143	98	92	92
query13	1634	377	376	376
query14	8925	6934	6942	6934
query15	211	178	188	178
query16	7131	268	270	268
query17	1009	600	561	561
query18	1916	315	292	292
query19	205	154	159	154
query20	94	90	88	88
query21	201	134	128	128
query22	4982	4799	4813	4799
query23	34147	32822	32837	32822
query24	4952	2815	2848	2815
query25	485	389	404	389
query26	691	162	156	156
query27	2356	321	325	321
query28	3939	1867	1858	1858
query29	865	639	626	626
query30	246	153	150	150
query31	930	711	722	711
query32	64	62	60	60
query33	396	265	257	257
query34	865	482	503	482
query35	815	705	676	676
query36	1058	928	907	907
query37	105	68	69	68
query38	3521	3405	3443	3405
query39	1818	1622	1533	1533
query40	214	127	123	123
query41	50	45	46	45
query42	107	101	100	100
query43	493	479	447	447
query44	1063	716	716	716
query45	276	258	269	258
query46	1072	691	704	691
query47	1943	1835	1844	1835
query48	381	300	303	300
query49	702	355	371	355
query50	777	396	394	394
query51	6740	6588	6572	6572
query52	112	97	93	93
query53	353	279	279	279
query54	253	229	239	229
query55	81	83	79	79
query56	248	229	224	224
query57	1189	1137	1145	1137
query58	220	208	209	208
query59	2810	2740	2678	2678
query60	260	238	246	238
query61	104	94	95	94
query62	549	434	434	434
query63	308	278	283	278
query64	4547	4199	4174	4174
query65	3102	3024	3084	3024
query66	677	356	339	339
query67	15148	15038	14939	14939
query68	5417	548	543	543
query69	506	342	331	331
query70	1260	1173	1215	1173
query71	472	286	280	280
query72	7296	2789	2612	2612
query73	703	339	341	339
query74	6873	6437	6357	6357
query75	2998	2290	2375	2290
query76	3119	861	987	861
query77	679	261	274	261
query78	10903	10330	10200	10200
query79	9393	539	521	521
query80	1859	456	460	456
query81	542	219	216	216
query82	1629	91	91	91
query83	316	173	169	169
query84	266	85	81	81
query85	1143	273	267	267
query86	459	292	284	284
query87	3769	3466	3575	3466
query88	5353	2423	2377	2377
query89	540	377	372	372
query90	1977	181	184	181
query91	128	103	98	98
query92	64	48	49	48
query93	6373	518	509	509
query94	1155	181	181	181
query95	404	314	314	314
query96	616	270	271	270
query97	2647	2449	2458	2449
query98	241	217	212	212
query99	1161	836	849	836
Total cold run time: 279559 ms
Total hot run time: 182492 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 29.57 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit a6dda2091915de9992a7791c799e45ef6bb258c3, data reload: false

query1	0.04	0.04	0.03
query2	0.08	0.04	0.04
query3	0.23	0.05	0.05
query4	1.67	0.08	0.08
query5	0.50	0.48	0.50
query6	1.12	0.66	0.65
query7	0.02	0.01	0.01
query8	0.05	0.04	0.04
query9	0.55	0.51	0.49
query10	0.54	0.55	0.55
query11	0.15	0.10	0.12
query12	0.15	0.12	0.10
query13	0.61	0.58	0.58
query14	0.76	0.78	0.79
query15	0.82	0.79	0.79
query16	0.37	0.37	0.36
query17	0.94	1.02	0.93
query18	0.21	0.25	0.24
query19	1.95	1.72	1.69
query20	0.02	0.01	0.01
query21	15.56	0.64	0.64
query22	2.45	2.63	1.74
query23	17.22	1.01	0.82
query24	1.18	0.24	0.20
query25	0.09	0.09	0.08
query26	0.23	0.17	0.17
query27	0.08	0.08	0.08
query28	14.10	0.94	0.94
query29	12.52	3.26	3.23
query30	0.28	0.09	0.08
query31	2.86	0.37	0.37
query32	3.28	0.45	0.45
query33	2.85	2.81	2.86
query34	16.80	4.41	4.45
query35	4.49	4.48	4.48
query36	0.62	0.47	0.47
query37	0.19	0.15	0.15
query38	0.14	0.14	0.14
query39	0.06	0.04	0.04
query40	0.17	0.15	0.15
query41	0.08	0.04	0.05
query42	0.06	0.05	0.04
query43	0.04	0.05	0.04
Total cold run time: 106.13 s
Total hot run time: 29.57 s

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit a6dda2091915de9992a7791c799e45ef6bb258c3 with default session variables
Stream load json:         19 seconds loaded 2358488459 Bytes, about 118 MB/s
Stream load orc:          59 seconds loaded 1101869774 Bytes, about 17 MB/s
Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select:       14.3 seconds inserted 10000000 Rows, about 699K ops/s

@zclllyybb
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 35.59% (8855/24884)
Line Coverage: 27.31% (72640/265951)
Region Coverage: 26.51% (37589/141767)
Branch Coverage: 23.32% (19172/82198)
Coverage Report: http://coverage.selectdb-in.cc/coverage/c6d2e16294d7a2d56d782125ed25fe755a5cde99_c6d2e16294d7a2d56d782125ed25fe755a5cde99/report/index.html

@doris-robot
Copy link

TPC-H: Total hot run time: 39080 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit c6d2e16294d7a2d56d782125ed25fe755a5cde99, data reload: false

------ Round 1 ----------------------------------
q1	17603	4392	4233	4233
q2	2002	180	178	178
q3	10709	1280	1422	1280
q4	10529	842	1029	842
q5	7480	2982	2955	2955
q6	217	131	133	131
q7	1116	632	623	623
q8	9565	2118	2087	2087
q9	7807	6208	6182	6182
q10	8408	3518	3501	3501
q11	413	234	243	234
q12	388	226	211	211
q13	17787	2878	2909	2878
q14	282	252	247	247
q15	516	473	473	473
q16	495	387	376	376
q17	995	923	910	910
q18	7413	6513	6565	6513
q19	1616	1548	1547	1547
q20	609	316	314	314
q21	3549	3068	3095	3068
q22	357	297	299	297
Total cold run time: 109856 ms
Total hot run time: 39080 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4075	4042	4049	4042
q2	334	225	229	225
q3	2990	2945	2957	2945
q4	1899	1830	1876	1830
q5	5272	5248	5250	5248
q6	209	124	125	124
q7	2258	1805	1866	1805
q8	3247	3315	3310	3310
q9	8444	8492	8451	8451
q10	3758	3812	3829	3812
q11	533	444	451	444
q12	714	605	536	536
q13	12635	2921	2916	2916
q14	284	261	263	261
q15	510	470	469	469
q16	447	418	418	418
q17	1713	1699	1699	1699
q18	7714	7761	7658	7658
q19	1711	1701	1726	1701
q20	2014	1927	1852	1852
q21	5328	4911	4889	4889
q22	508	428	447	428
Total cold run time: 66597 ms
Total hot run time: 55063 ms

@zclllyybb
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 38776 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 992a4add26445e03cb3f49e7373ab75f1037e4a0, data reload: false

------ Round 1 ----------------------------------
q1	17910	4106	4097	4097
q2	2005	191	180	180
q3	10487	1195	1391	1195
q4	10500	913	1022	913
q5	7508	2948	2934	2934
q6	220	135	134	134
q7	1116	619	593	593
q8	9398	2081	2047	2047
q9	6768	6225	6171	6171
q10	8440	3514	3515	3514
q11	412	239	234	234
q12	376	217	212	212
q13	17777	2905	2913	2905
q14	270	242	241	241
q15	528	493	484	484
q16	491	397	387	387
q17	954	925	897	897
q18	7292	6567	6404	6404
q19	1600	1529	1536	1529
q20	610	315	304	304
q21	3617	3098	3091	3091
q22	376	310	320	310
Total cold run time: 108655 ms
Total hot run time: 38776 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4067	4059	4072	4059
q2	330	220	221	220
q3	2980	2951	2968	2951
q4	1892	1846	1818	1818
q5	5236	5204	5228	5204
q6	209	128	129	128
q7	2240	1840	1788	1788
q8	3231	3278	3295	3278
q9	8464	8498	8489	8489
q10	3754	3806	3793	3793
q11	537	438	456	438
q12	726	540	532	532
q13	16779	2877	2918	2877
q14	287	264	261	261
q15	524	471	476	471
q16	453	411	402	402
q17	1739	1684	1699	1684
q18	7652	7161	7238	7161
q19	1641	1639	1644	1639
q20	1941	1719	1738	1719
q21	4961	4799	4753	4753
q22	479	413	450	413
Total cold run time: 70122 ms
Total hot run time: 54078 ms

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 35.58% (8854/24884)
Line Coverage: 27.31% (72627/265950)
Region Coverage: 26.51% (37586/141766)
Branch Coverage: 23.32% (19167/82196)
Coverage Report: http://coverage.selectdb-in.cc/coverage/992a4add26445e03cb3f49e7373ab75f1037e4a0_992a4add26445e03cb3f49e7373ab75f1037e4a0/report/index.html

@doris-robot
Copy link

TPC-DS: Total hot run time: 181551 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 992a4add26445e03cb3f49e7373ab75f1037e4a0, data reload: false

query1	1208	1131	1108	1108
query2	6497	1846	1848	1846
query3	6670	214	217	214
query4	23628	21527	21632	21527
query5	4196	403	411	403
query6	288	184	185	184
query7	4607	317	301	301
query8	240	190	193	190
query9	8468	2245	2236	2236
query10	595	263	255	255
query11	15206	14435	14576	14435
query12	147	98	96	96
query13	1650	377	392	377
query14	8726	6828	6795	6795
query15	205	180	173	173
query16	7155	276	270	270
query17	1003	609	603	603
query18	1864	309	291	291
query19	217	163	165	163
query20	100	95	98	95
query21	202	129	132	129
query22	5002	4899	4957	4899
query23	33510	32646	32894	32646
query24	12624	3213	3134	3134
query25	686	406	409	406
query26	1904	178	166	166
query27	2999	327	332	327
query28	6703	1832	1819	1819
query29	1324	602	602	602
query30	302	156	150	150
query31	994	727	723	723
query32	99	65	64	64
query33	712	265	262	262
query34	1003	502	513	502
query35	848	685	700	685
query36	991	883	855	855
query37	282	80	77	77
query38	3589	3380	3383	3380
query39	1602	1532	1525	1525
query40	302	143	138	138
query41	50	46	47	46
query42	111	106	106	106
query43	440	398	406	398
query44	1087	720	705	705
query45	288	262	258	258
query46	1064	768	776	768
query47	1922	1802	1800	1800
query48	386	306	310	306
query49	1168	366	356	356
query50	798	393	393	393
query51	6838	6735	6690	6690
query52	111	99	102	99
query53	367	294	291	291
query54	319	247	262	247
query55	97	83	79	79
query56	245	233	229	229
query57	1219	1133	1130	1130
query58	252	230	226	226
query59	2467	2375	2298	2298
query60	259	239	251	239
query61	124	110	109	109
query62	689	440	460	440
query63	317	293	287	287
query64	6483	3099	3350	3099
query65	3090	3025	3007	3007
query66	1442	329	324	324
query67	15698	14884	14924	14884
query68	7212	562	580	562
query69	542	327	327	327
query70	1230	1109	1092	1092
query71	524	288	277	277
query72	6379	2571	2404	2404
query73	805	327	320	320
query74	6847	6415	6295	6295
query75	3527	2296	2334	2296
query76	5258	1128	1213	1128
query77	606	252	255	252
query78	10791	10357	10272	10272
query79	9714	523	540	523
query80	1500	430	417	417
query81	499	238	221	221
query82	477	102	101	101
query83	208	160	164	160
query84	271	90	96	90
query85	1212	302	291	291
query86	377	283	277	277
query87	3658	3535	3515	3515
query88	3604	2278	2290	2278
query89	553	371	371	371
query90	2138	174	181	174
query91	136	108	109	108
query92	57	52	57	52
query93	6908	544	539	539
query94	1323	194	197	194
query95	452	338	330	330
query96	610	273	271	271
query97	2646	2484	2480	2480
query98	224	224	211	211
query99	1252	870	858	858
Total cold run time: 297219 ms
Total hot run time: 181551 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 992a4add26445e03cb3f49e7373ab75f1037e4a0, data reload: false

query1	0.04	0.04	0.03
query2	0.08	0.04	0.04
query3	0.23	0.04	0.04
query4	1.69	0.06	0.07
query5	0.50	0.48	0.49
query6	1.13	0.66	0.66
query7	0.02	0.01	0.01
query8	0.05	0.04	0.05
query9	0.56	0.50	0.51
query10	0.57	0.57	0.56
query11	0.14	0.11	0.11
query12	0.14	0.11	0.12
query13	0.61	0.60	0.58
query14	0.78	0.77	0.78
query15	0.86	0.84	0.82
query16	0.36	0.37	0.35
query17	0.99	0.98	0.95
query18	0.25	0.25	0.24
query19	1.87	1.72	1.73
query20	0.02	0.01	0.01
query21	15.42	0.76	0.73
query22	3.00	5.04	1.76
query23	17.71	1.48	1.00
query24	1.39	0.22	0.28
query25	0.14	0.09	0.08
query26	0.28	0.18	0.19
query27	0.09	0.08	0.08
query28	13.74	0.97	0.94
query29	12.54	3.38	3.50
query30	0.26	0.06	0.06
query31	2.85	0.37	0.38
query32	3.30	0.46	0.47
query33	2.86	2.86	2.85
query34	15.49	4.33	4.33
query35	4.36	4.37	4.36
query36	0.67	0.47	0.47
query37	0.20	0.17	0.17
query38	0.18	0.15	0.16
query39	0.05	0.04	0.04
query40	0.17	0.14	0.15
query41	0.09	0.06	0.05
query42	0.07	0.06	0.06
query43	0.05	0.04	0.05
Total cold run time: 105.8 s
Total hot run time: 30 s

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit 992a4add26445e03cb3f49e7373ab75f1037e4a0 with default session variables
Stream load json:         18 seconds loaded 2358488459 Bytes, about 124 MB/s
Stream load orc:          60 seconds loaded 1101869774 Bytes, about 17 MB/s
Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select:       15.3 seconds inserted 10000000 Rows, about 653K ops/s

@zclllyybb
Copy link
Contributor Author

run buildall

@zclllyybb
Copy link
Contributor Author

run buildall

Copy link
Contributor

@HappenLee HappenLee left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Apr 1, 2024
@github-actions
Copy link
Contributor

github-actions bot commented Apr 1, 2024

PR approved by at least one committer and no changes requested.

@github-actions
Copy link
Contributor

github-actions bot commented Apr 1, 2024

PR approved by anyone and no changes requested.

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 35.58% (8853/24885)
Line Coverage: 27.31% (72628/265910)
Region Coverage: 26.50% (37580/141787)
Branch Coverage: 23.31% (19164/82206)
Coverage Report: http://coverage.selectdb-in.cc/coverage/9f47d514784b8bd68cd8096f143a301a2db72880_9f47d514784b8bd68cd8096f143a301a2db72880/report/index.html

@doris-robot
Copy link

TPC-H: Total hot run time: 38478 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 9f47d514784b8bd68cd8096f143a301a2db72880, data reload: false

------ Round 1 ----------------------------------
q1	17649	4113	4049	4049
q2	2018	181	177	177
q3	10497	1267	1408	1267
q4	10207	888	1013	888
q5	7461	2974	2894	2894
q6	218	132	132	132
q7	1094	637	597	597
q8	9382	2082	2022	2022
q9	6711	6159	6115	6115
q10	8456	3489	3481	3481
q11	431	239	231	231
q12	381	218	213	213
q13	17787	2873	2909	2873
q14	272	245	241	241
q15	533	496	476	476
q16	526	375	373	373
q17	943	897	908	897
q18	7128	6484	6355	6355
q19	1621	1509	1531	1509
q20	605	334	306	306
q21	3532	3091	3081	3081
q22	354	301	307	301
Total cold run time: 107806 ms
Total hot run time: 38478 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4055	4039	4030	4030
q2	327	219	223	219
q3	2985	2916	2912	2912
q4	1846	1830	1818	1818
q5	5250	5197	5204	5197
q6	207	125	126	125
q7	2222	1820	1785	1785
q8	3196	3276	3278	3276
q9	8423	8460	8513	8460
q10	3764	3912	3957	3912
q11	563	460	456	456
q12	768	572	577	572
q13	16894	3072	3141	3072
q14	316	275	271	271
q15	538	520	511	511
q16	511	471	447	447
q17	1757	1744	1706	1706
q18	8315	7918	7509	7509
q19	1683	1687	1672	1672
q20	2028	1815	1849	1815
q21	5091	4894	4868	4868
q22	488	421	441	421
Total cold run time: 71227 ms
Total hot run time: 55054 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 182147 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 9f47d514784b8bd68cd8096f143a301a2db72880, data reload: false

query1	1231	1125	1111	1111
query2	6360	1887	1914	1887
query3	6656	209	207	207
query4	24728	21490	21519	21490
query5	4176	400	405	400
query6	260	181	182	181
query7	4594	301	298	298
query8	228	173	176	173
query9	8470	2235	2216	2216
query10	468	258	276	258
query11	15022	14737	14403	14403
query12	134	92	99	92
query13	1624	380	379	379
query14	8586	7006	6868	6868
query15	203	168	171	168
query16	6499	264	266	264
query17	1002	598	590	590
query18	1768	288	298	288
query19	205	164	169	164
query20	99	92	92	92
query21	197	139	142	139
query22	4988	4805	4866	4805
query23	33344	32877	33348	32877
query24	13028	3211	3195	3195
query25	715	428	434	428
query26	1893	177	173	173
query27	3248	400	390	390
query28	7142	1907	1866	1866
query29	1154	632	620	620
query30	319	157	153	153
query31	1039	771	816	771
query32	104	67	63	63
query33	719	254	236	236
query34	1172	532	541	532
query35	881	735	730	730
query36	1034	867	877	867
query37	223	81	81	81
query38	3735	3544	3572	3544
query39	1643	1612	1611	1611
query40	247	153	156	153
query41	52	52	47	47
query42	113	109	106	106
query43	477	419	416	416
query44	1114	736	746	736
query45	291	259	268	259
query46	1094	846	830	830
query47	1975	1881	1900	1881
query48	406	323	305	305
query49	982	372	369	369
query50	826	432	419	419
query51	6923	6837	6787	6787
query52	109	105	101	101
query53	387	310	304	304
query54	315	248	244	244
query55	91	84	77	77
query56	257	244	251	244
query57	1265	1172	1164	1164
query58	240	237	234	234
query59	2721	2592	2365	2365
query60	263	227	228	227
query61	90	86	90	86
query62	669	465	447	447
query63	309	289	284	284
query64	6013	3078	3400	3078
query65	3039	3064	3005	3005
query66	1317	321	311	311
query67	15461	14873	14717	14717
query68	7505	561	575	561
query69	566	335	318	318
query70	1197	1117	1119	1117
query71	515	277	277	277
query72	6290	2598	2420	2420
query73	803	326	329	326
query74	6768	6221	6422	6221
query75	3462	2337	2254	2254
query76	4916	1154	1198	1154
query77	538	249	256	249
query78	10963	10122	10083	10083
query79	10710	533	528	528
query80	1946	447	435	435
query81	521	225	229	225
query82	730	102	100	100
query83	206	162	161	161
query84	266	92	98	92
query85	1360	307	290	290
query86	457	267	300	267
query87	3729	3525	3464	3464
query88	4350	2267	2285	2267
query89	565	369	386	369
query90	1903	177	183	177
query91	138	105	109	105
query92	62	54	53	53
query93	7217	531	537	531
query94	1062	196	199	196
query95	442	333	339	333
query96	609	271	266	266
query97	2716	2517	2470	2470
query98	234	222	211	211
query99	1343	821	836	821
Total cold run time: 300026 ms
Total hot run time: 182147 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.38 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 9f47d514784b8bd68cd8096f143a301a2db72880, data reload: false

query1	0.04	0.03	0.03
query2	0.08	0.04	0.03
query3	0.23	0.04	0.04
query4	1.70	0.07	0.07
query5	0.49	0.47	0.48
query6	1.16	0.65	0.65
query7	0.02	0.01	0.01
query8	0.05	0.04	0.05
query9	0.55	0.51	0.51
query10	0.57	0.59	0.56
query11	0.15	0.11	0.11
query12	0.14	0.12	0.11
query13	0.60	0.60	0.60
query14	0.76	0.79	0.78
query15	0.85	0.85	0.84
query16	0.36	0.34	0.35
query17	0.98	0.96	1.01
query18	0.24	0.25	0.24
query19	1.76	1.80	1.72
query20	0.01	0.00	0.00
query21	15.41	0.73	0.68
query22	3.12	6.11	2.13
query23	17.71	1.36	1.03
query24	1.33	0.21	0.24
query25	0.13	0.09	0.08
query26	0.29	0.17	0.19
query27	0.09	0.09	0.08
query28	13.87	0.94	0.92
query29	12.71	3.42	3.44
query30	0.26	0.07	0.05
query31	2.86	0.39	0.38
query32	3.30	0.46	0.46
query33	2.86	2.84	2.88
query34	15.50	4.37	4.35
query35	4.39	4.38	4.37
query36	0.66	0.47	0.47
query37	0.21	0.17	0.18
query38	0.16	0.16	0.15
query39	0.05	0.04	0.04
query40	0.18	0.14	0.14
query41	0.09	0.04	0.05
query42	0.05	0.06	0.05
query43	0.05	0.04	0.04
Total cold run time: 106.02 s
Total hot run time: 30.38 s

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit 9f47d514784b8bd68cd8096f143a301a2db72880 with default session variables
Stream load json:         19 seconds loaded 2358488459 Bytes, about 118 MB/s
Stream load orc:          59 seconds loaded 1101869774 Bytes, about 17 MB/s
Stream load parquet:      32 seconds loaded 861443392 Bytes, about 25 MB/s
Insert into select:       15.7 seconds inserted 10000000 Rows, about 636K ops/s

@zhangstar333 zhangstar333 merged commit e85df2c into apache:master Apr 2, 2024
@yiguolei yiguolei mentioned this pull request Apr 26, 2024
1 task
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

approved Indicates a PR has been approved by one committer. reviewed

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants