Skip to content

[Feature](function) support split_by_regexp function #38259

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
zhangstar333 merged 4 commits into from
Aug 1, 2024
Merged

[Feature](function) support split_by_regexp function #38259

zhangstar333 merged 4 commits into from
Aug 1, 2024

Conversation

@zhangstar333
Copy link
Contributor

@zhangstar333 zhangstar333 commented Jul 23, 2024

Proposed changes

docs link:
apache/doris-website#904

@doris-robot
Copy link

doris-robot commented Jul 23, 2024

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@zhangstar333
Copy link
Contributor Author

zhangstar333 commented Jul 23, 2024

run buildall

github-actions[bot]
github-actions bot reviewed Jul 23, 2024
View reviewed changes
Copy link
Contributor

@github-actions github-actions bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

clang-tidy made some suggestions

@doris-robot
Copy link

doris-robot commented Jul 23, 2024

TPC-H: Total hot run time: 40052 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 634392e804bcd0925f759a15d62a4eacf712ee20, data reload: false

------ Round 1 ----------------------------------
q1	17638	4481	4385	4385
q2	2025	190	186	186
q3	10451	1197	1157	1157
q4	10191	823	806	806
q5	7532	2704	2672	2672
q6	215	136	138	136
q7	946	595	593	593
q8	9223	2073	2053	2053
q9	8735	6561	6532	6532
q10	8926	3759	3790	3759
q11	467	241	240	240
q12	438	223	222	222
q13	17835	2979	2996	2979
q14	269	242	239	239
q15	525	468	489	468
q16	491	393	376	376
q17	958	683	779	683
q18	8161	7518	7448	7448
q19	5837	1432	1357	1357
q20	668	331	317	317
q21	4937	3291	3160	3160
q22	354	290	284	284
Total cold run time: 116822 ms
Total hot run time: 40052 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4376	4244	4232	4232
q2	365	275	273	273
q3	2992	2822	2944	2822
q4	2042	1724	1717	1717
q5	5698	5512	5538	5512
q6	224	145	130	130
q7	2218	1900	1828	1828
q8	3249	3431	3412	3412
q9	8773	8890	8853	8853
q10	4114	3779	3821	3779
q11	590	513	499	499
q12	825	638	647	638
q13	17198	3211	3197	3197
q14	328	295	312	295
q15	527	479	493	479
q16	493	435	443	435
q17	1802	1522	1485	1485
q18	8147	8118	7941	7941
q19	2270	1659	1666	1659
q20	2231	1862	1876	1862
q21	5088	4697	4856	4697
q22	609	498	520	498
Total cold run time: 74159 ms
Total hot run time: 56243 ms

@doris-robot
Copy link

doris-robot commented Jul 23, 2024

TPC-DS: Total hot run time: 174901 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 634392e804bcd0925f759a15d62a4eacf712ee20, data reload: false

query1	919	375	363	363
query2	6426	1888	1759	1759
query3	6649	208	213	208
query4	28445	17410	17350	17350
query5	3651	494	503	494
query6	269	166	157	157
query7	4580	298	289	289
query8	237	193	188	188
query9	8515	2435	2434	2434
query10	439	280	274	274
query11	10704	10124	10114	10114
query12	116	83	84	83
query13	1631	367	360	360
query14	9988	7786	7650	7650
query15	217	170	170	170
query16	7794	478	492	478
query17	1514	568	527	527
query18	1975	287	270	270
query19	200	148	145	145
query20	89	82	79	79
query21	205	127	123	123
query22	4392	4016	4015	4015
query23	34124	33953	33956	33953
query24	10682	2997	2892	2892
query25	583	386	394	386
query26	698	153	150	150
query27	2283	287	287	287
query28	5927	2112	2091	2091
query29	899	638	643	638
query30	249	153	150	150
query31	970	775	778	775
query32	88	53	51	51
query33	673	336	319	319
query34	915	485	514	485
query35	852	755	772	755
query36	1144	910	977	910
query37	142	83	87	83
query38	2897	2875	2811	2811
query39	906	816	819	816
query40	213	119	122	119
query41	45	47	46	46
query42	120	98	97	97
query43	506	454	447	447
query44	1079	727	724	724
query45	193	168	165	165
query46	1103	743	725	725
query47	1881	1820	1765	1765
query48	377	307	306	306
query49	821	398	411	398
query50	780	386	394	386
query51	6802	6743	6712	6712
query52	100	94	91	91
query53	362	288	294	288
query54	861	449	451	449
query55	82	73	75	73
query56	284	264	273	264
query57	1173	1044	1054	1044
query58	255	271	247	247
query59	2824	2713	2742	2713
query60	332	288	304	288
query61	114	114	111	111
query62	792	644	667	644
query63	329	291	294	291
query64	9270	2322	1748	1748
query65	3177	3135	3135	3135
query66	754	332	337	332
query67	15497	14996	15121	14996
query68	4602	558	556	556
query69	642	401	364	364
query70	1220	1123	1179	1123
query71	409	276	285	276
query72	8982	5888	5598	5598
query73	768	329	333	329
query74	6133	5726	5693	5693
query75	3832	2700	2687	2687
query76	2783	949	976	949
query77	696	328	321	321
query78	9694	9031	8974	8974
query79	8396	529	529	529
query80	1333	517	484	484
query81	592	223	230	223
query82	1347	137	139	137
query83	384	173	170	170
query84	277	84	84	84
query85	1449	304	306	304
query86	442	316	302	302
query87	3366	3128	3152	3128
query88	5041	2421	2418	2418
query89	538	398	376	376
query90	1958	192	191	191
query91	128	132	99	99
query92	65	51	51	51
query93	6570	515	515	515
query94	1321	287	290	287
query95	411	317	325	317
query96	625	276	272	272
query97	3152	3039	3004	3004
query98	219	207	208	207
query99	1627	1283	1247	1247
Total cold run time: 292115 ms
Total hot run time: 174901 ms

@doris-robot
Copy link

doris-robot commented Jul 23, 2024

ClickBench: Total hot run time: 30.8 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 634392e804bcd0925f759a15d62a4eacf712ee20, data reload: false

query1	0.04	0.03	0.03
query2	0.07	0.04	0.04
query3	0.22	0.05	0.05
query4	1.66	0.07	0.07
query5	0.50	0.50	0.49
query6	1.14	0.72	0.73
query7	0.02	0.01	0.02
query8	0.05	0.04	0.04
query9	0.53	0.49	0.49
query10	0.54	0.55	0.53
query11	0.16	0.11	0.12
query12	0.15	0.13	0.12
query13	0.60	0.59	0.59
query14	0.75	0.79	0.79
query15	0.87	0.83	0.83
query16	0.37	0.35	0.37
query17	1.01	0.95	0.97
query18	0.22	0.21	0.22
query19	1.79	1.75	1.71
query20	0.01	0.00	0.01
query21	15.38	0.76	0.64
query22	4.24	7.47	1.96
query23	18.32	1.41	1.32
query24	2.17	0.23	0.22
query25	0.16	0.08	0.09
query26	0.30	0.21	0.20
query27	0.45	0.23	0.23
query28	13.26	1.02	1.01
query29	12.62	3.34	3.31
query30	0.24	0.06	0.05
query31	2.88	0.40	0.38
query32	3.28	0.47	0.47
query33	2.95	2.96	2.86
query34	17.12	4.41	4.40
query35	4.48	4.48	4.50
query36	0.66	0.48	0.48
query37	0.18	0.15	0.16
query38	0.15	0.15	0.16
query39	0.05	0.04	0.04
query40	0.15	0.12	0.12
query41	0.09	0.04	0.05
query42	0.05	0.05	0.05
query43	0.04	0.03	0.04
Total cold run time: 109.92 s
Total hot run time: 30.8 s

@zhangstar333
Copy link
Contributor Author

zhangstar333 commented Jul 24, 2024

run buildall

@doris-robot
Copy link

doris-robot commented Jul 24, 2024

TPC-H: Total hot run time: 40207 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 20932e72eb66c7a62369b5fa64f33b0a0f2a91f1, data reload: false

------ Round 1 ----------------------------------
q1	18366	4519	4361	4361
q2	2702	200	190	190
q3	12276	1203	1215	1203
q4	10984	782	797	782
q5	7885	2697	2691	2691
q6	221	136	137	136
q7	952	605	613	605
q8	9219	2074	2114	2074
q9	8770	6591	6549	6549
q10	8742	3836	3783	3783
q11	463	238	241	238
q12	398	230	231	230
q13	17758	3015	3037	3015
q14	277	242	250	242
q15	516	510	504	504
q16	488	398	389	389
q17	972	743	692	692
q18	8127	7490	7420	7420
q19	6947	1336	1393	1336
q20	693	322	335	322
q21	5205	3160	3257	3160
q22	359	319	285	285
Total cold run time: 122320 ms
Total hot run time: 40207 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4377	4262	4271	4262
q2	381	272	260	260
q3	3042	2713	2741	2713
q4	1907	1692	1612	1612
q5	5338	5331	5338	5331
q6	223	130	132	130
q7	2151	1696	1743	1696
q8	3198	3381	3321	3321
q9	8470	8346	8406	8346
q10	3956	3735	3746	3735
q11	581	499	482	482
q12	796	568	617	568
q13	17365	2993	3011	2993
q14	302	267	270	267
q15	513	477	481	477
q16	472	438	423	423
q17	1756	1496	1453	1453
q18	7605	7456	7406	7406
q19	4314	1465	1520	1465
q20	2040	1811	1784	1784
q21	5014	4738	4691	4691
q22	578	473	518	473
Total cold run time: 74379 ms
Total hot run time: 53888 ms

@doris-robot
Copy link

doris-robot commented Jul 24, 2024

TPC-DS: Total hot run time: 173753 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 20932e72eb66c7a62369b5fa64f33b0a0f2a91f1, data reload: false

query1	918	385	370	370
query2	6452	1960	1908	1908
query3	6644	205	222	205
query4	28327	17482	17488	17482
query5	4177	513	479	479
query6	274	161	175	161
query7	4593	297	290	290
query8	245	190	187	187
query9	8434	2419	2403	2403
query10	455	287	289	287
query11	10802	9998	10045	9998
query12	143	85	83	83
query13	1649	384	384	384
query14	10195	7380	7709	7380
query15	227	170	168	168
query16	7749	478	514	478
query17	1133	577	528	528
query18	1869	281	281	281
query19	202	152	157	152
query20	92	82	81	81
query21	206	128	126	126
query22	4337	4053	3871	3871
query23	33905	33351	33219	33219
query24	12334	2975	2879	2879
query25	678	364	391	364
query26	1818	153	153	153
query27	2974	272	279	272
query28	7704	2020	2007	2007
query29	1147	629	623	623
query30	287	153	149	149
query31	977	717	749	717
query32	98	53	61	53
query33	775	344	324	324
query34	954	497	496	496
query35	858	732	744	732
query36	1100	957	939	939
query37	282	79	80	79
query38	2870	2727	2765	2727
query39	889	822	827	822
query40	277	126	122	122
query41	52	45	45	45
query42	127	99	108	99
query43	539	490	469	469
query44	1179	731	736	731
query45	193	161	160	160
query46	1125	788	773	773
query47	1867	1772	1759	1759
query48	365	292	285	285
query49	1193	421	423	421
query50	792	410	409	409
query51	6781	6754	6699	6699
query52	108	99	91	91
query53	364	309	295	295
query54	1047	452	460	452
query55	83	77	75	75
query56	299	279	275	275
query57	1226	1052	1069	1052
query58	266	264	282	264
query59	2877	2677	2675	2675
query60	313	284	290	284
query61	132	98	98	98
query62	851	670	676	670
query63	335	298	304	298
query64	10505	2237	1680	1680
query65	3246	3124	3103	3103
query66	1350	334	324	324
query67	15509	14864	15177	14864
query68	4523	560	561	560
query69	565	408	373	373
query70	1177	1081	1141	1081
query71	400	286	283	283
query72	7046	5653	5777	5653
query73	750	337	335	335
query74	6334	5684	5672	5672
query75	3484	2750	2703	2703
query76	2505	930	930	930
query77	505	313	314	313
query78	9482	9625	9104	9104
query79	2715	541	543	541
query80	1928	489	491	489
query81	580	220	224	220
query82	736	140	141	140
query83	323	167	175	167
query84	276	96	86	86
query85	1785	371	367	367
query86	411	319	296	296
query87	3284	3084	3102	3084
query88	4031	2404	2405	2404
query89	488	389	416	389
query90	1814	203	205	203
query91	143	119	116	116
query92	68	54	54	54
query93	3602	526	523	523
query94	994	315	296	296
query95	499	331	326	326
query96	611	275	269	269
query97	3188	3048	2985	2985
query98	222	203	200	200
query99	1677	1262	1290	1262
Total cold run time: 287920 ms
Total hot run time: 173753 ms

@doris-robot
Copy link

doris-robot commented Jul 24, 2024

ClickBench: Total hot run time: 30.19 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 20932e72eb66c7a62369b5fa64f33b0a0f2a91f1, data reload: false

query1	0.04	0.04	0.03
query2	0.08	0.04	0.04
query3	0.22	0.05	0.06
query4	1.68	0.11	0.10
query5	0.50	0.49	0.50
query6	1.13	0.73	0.73
query7	0.02	0.02	0.01
query8	0.06	0.04	0.04
query9	0.55	0.49	0.49
query10	0.55	0.55	0.54
query11	0.16	0.12	0.11
query12	0.14	0.13	0.12
query13	0.61	0.59	0.59
query14	0.78	0.78	0.77
query15	0.86	0.81	0.82
query16	0.35	0.36	0.36
query17	1.06	0.96	0.97
query18	0.23	0.22	0.22
query19	1.88	1.71	1.71
query20	0.02	0.01	0.01
query21	15.39	0.83	0.66
query22	4.67	7.79	1.36
query23	18.27	1.39	1.29
query24	2.13	0.23	0.23
query25	0.16	0.09	0.09
query26	0.30	0.21	0.22
query27	0.46	0.23	0.23
query28	13.21	1.05	1.03
query29	12.62	3.29	3.31
query30	0.25	0.06	0.05
query31	2.85	0.39	0.40
query32	3.26	0.48	0.47
query33	2.91	2.88	2.97
query34	16.94	4.32	4.41
query35	4.37	4.45	4.47
query36	0.65	0.48	0.47
query37	0.19	0.17	0.16
query38	0.15	0.14	0.15
query39	0.04	0.03	0.03
query40	0.15	0.12	0.13
query41	0.10	0.05	0.04
query42	0.05	0.06	0.05
query43	0.05	0.05	0.05
Total cold run time: 110.09 s
Total hot run time: 30.19 s

@zhangstar333
Copy link
Contributor Author

zhangstar333 commented Jul 24, 2024

run buildall

@doris-robot
Copy link

doris-robot commented Jul 24, 2024

TPC-H: Total hot run time: 39859 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit c8c9740ee8e063ddd2f2812b4c7dc676eb871f82, data reload: false

------ Round 1 ----------------------------------
q1	18026	4429	4406	4406
q2	2569	196	216	196
q3	10993	1176	1140	1140
q4	10718	908	770	770
q5	7787	2738	2705	2705
q6	228	142	141	141
q7	988	609	610	609
q8	9618	2076	2102	2076
q9	8684	6581	6579	6579
q10	8648	3712	3726	3712
q11	449	239	243	239
q12	396	226	225	225
q13	17782	2962	2983	2962
q14	282	241	232	232
q15	527	485	494	485
q16	497	376	381	376
q17	966	640	685	640
q18	7982	7480	7404	7404
q19	6207	1382	1253	1253
q20	661	311	317	311
q21	4868	3110	3159	3110
q22	350	288	292	288
Total cold run time: 119226 ms
Total hot run time: 39859 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4375	4256	4220	4220
q2	374	276	273	273
q3	2994	2757	2744	2744
q4	1835	1568	1587	1568
q5	5297	5315	5306	5306
q6	217	130	128	128
q7	2109	1681	1707	1681
q8	3173	3380	3312	3312
q9	8378	8412	8372	8372
q10	3908	3709	3698	3698
q11	574	483	479	479
q12	788	639	636	636
q13	17530	2957	2950	2950
q14	293	263	282	263
q15	517	479	484	479
q16	475	414	425	414
q17	1764	1465	1437	1437
q18	7752	7551	7385	7385
q19	1681	1518	1539	1518
q20	2024	1807	1816	1807
q21	4941	4585	4692	4585
q22	583	503	497	497
Total cold run time: 71582 ms
Total hot run time: 53752 ms

@doris-robot
Copy link

doris-robot commented Jul 24, 2024

TPC-DS: Total hot run time: 173577 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit c8c9740ee8e063ddd2f2812b4c7dc676eb871f82, data reload: false

query1	912	368	371	368
query2	6471	1843	1822	1822
query3	6652	207	217	207
query4	28510	17428	17289	17289
query5	4200	481	470	470
query6	273	165	156	156
query7	4599	284	282	282
query8	239	196	186	186
query9	8480	2395	2394	2394
query10	449	289	288	288
query11	11233	10168	10127	10127
query12	138	91	87	87
query13	1642	377	366	366
query14	10242	7544	7045	7045
query15	230	182	169	169
query16	7656	444	468	444
query17	1583	558	524	524
query18	1909	271	271	271
query19	198	146	151	146
query20	93	82	85	82
query21	208	157	130	130
query22	4280	4076	4043	4043
query23	33676	33316	33329	33316
query24	12053	2855	2846	2846
query25	653	362	397	362
query26	1806	147	147	147
query27	2889	271	274	271
query28	7531	2006	1981	1981
query29	1101	600	606	600
query30	291	153	148	148
query31	952	752	751	751
query32	93	52	53	52
query33	775	323	329	323
query34	916	475	485	475
query35	899	760	719	719
query36	1126	966	945	945
query37	270	80	77	77
query38	2848	2750	2761	2750
query39	892	849	811	811
query40	273	121	146	121
query41	48	44	47	44
query42	121	101	106	101
query43	500	470	464	464
query44	1215	742	716	716
query45	210	176	176	176
query46	1081	713	718	713
query47	1845	1743	1741	1741
query48	368	291	290	290
query49	1203	428	423	423
query50	786	383	382	382
query51	6759	6757	6650	6650
query52	103	94	90	90
query53	352	291	284	284
query54	949	448	449	448
query55	76	71	74	71
query56	290	280	264	264
query57	1146	1062	1048	1048
query58	278	249	254	249
query59	2780	2763	2590	2590
query60	318	275	274	274
query61	100	98	96	96
query62	848	643	657	643
query63	336	287	289	287
query64	10486	2232	7514	2232
query65	3169	3158	3152	3152
query66	1395	342	341	341
query67	15650	14874	14895	14874
query68	4611	549	554	549
query69	554	473	347	347
query70	1182	1118	1047	1047
query71	405	285	278	278
query72	7405	5875	5716	5716
query73	751	328	325	325
query74	6064	5661	5660	5660
query75	3446	2691	2704	2691
query76	2828	884	934	884
query77	493	333	319	319
query78	9730	9268	9654	9268
query79	2910	516	517	516
query80	1802	475	478	475
query81	584	224	221	221
query82	856	132	138	132
query83	330	170	165	165
query84	279	83	88	83
query85	1944	326	303	303
query86	483	336	307	307
query87	3339	3102	3084	3084
query88	3597	2392	2432	2392
query89	473	387	388	387
query90	1868	194	195	194
query91	129	102	102	102
query92	71	51	49	49
query93	2483	520	513	513
query94	1282	299	295	295
query95	412	318	327	318
query96	617	274	270	270
query97	3168	3009	3034	3009
query98	219	202	186	186
query99	1806	1258	1271	1258
Total cold run time: 287774 ms
Total hot run time: 173577 ms

@doris-robot
Copy link

doris-robot commented Jul 24, 2024

ClickBench: Total hot run time: 31.25 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit c8c9740ee8e063ddd2f2812b4c7dc676eb871f82, data reload: false

query1	0.05	0.03	0.04
query2	0.08	0.04	0.04
query3	0.22	0.05	0.05
query4	1.68	0.07	0.07
query5	0.50	0.47	0.49
query6	1.14	0.72	0.72
query7	0.02	0.02	0.01
query8	0.05	0.04	0.05
query9	0.54	0.48	0.48
query10	0.54	0.54	0.55
query11	0.15	0.11	0.11
query12	0.15	0.13	0.13
query13	0.61	0.58	0.59
query14	0.77	0.78	0.77
query15	0.88	0.81	0.81
query16	0.35	0.38	0.37
query17	0.98	0.97	1.04
query18	0.23	0.22	0.22
query19	1.78	1.83	1.84
query20	0.01	0.00	0.01
query21	15.39	0.75	0.66
query22	4.15	6.52	2.51
query23	18.30	1.32	1.23
query24	2.17	0.22	0.22
query25	0.16	0.08	0.09
query26	0.30	0.20	0.20
query27	0.44	0.24	0.23
query28	13.22	1.03	0.99
query29	12.61	3.31	3.31
query30	0.25	0.06	0.06
query31	2.86	0.39	0.39
query32	3.26	0.47	0.47
query33	2.87	2.88	2.94
query34	16.90	4.32	4.32
query35	4.40	4.41	4.40
query36	0.65	0.49	0.50
query37	0.20	0.15	0.16
query38	0.16	0.16	0.15
query39	0.04	0.03	0.04
query40	0.14	0.12	0.13
query41	0.09	0.04	0.05
query42	0.05	0.05	0.04
query43	0.04	0.04	0.04
Total cold run time: 109.38 s
Total hot run time: 31.25 s

@zhangstar333
Copy link
Contributor Author

zhangstar333 commented Jul 25, 2024

run buildall

@doris-robot
Copy link

doris-robot commented Jul 25, 2024

TPC-H: Total hot run time: 40176 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit c8c9740ee8e063ddd2f2812b4c7dc676eb871f82, data reload: false

------ Round 1 ----------------------------------
q1	18095	4344	4340	4340
q2	2015	191	184	184
q3	10468	1168	1119	1119
q4	10220	744	823	744
q5	7942	2762	2695	2695
q6	222	140	137	137
q7	954	596	594	594
q8	9224	2095	2056	2056
q9	8923	6616	6656	6616
q10	9183	3945	4021	3945
q11	1220	275	249	249
q12	1463	241	249	241
q13	19593	2983	2982	2982
q14	272	242	230	230
q15	523	490	489	489
q16	507	406	515	406
q17	1129	696	710	696
q18	8520	7585	7391	7391
q19	6742	1385	1359	1359
q20	680	325	316	316
q21	4924	3110	3304	3110
q22	336	287	277	277
Total cold run time: 123155 ms
Total hot run time: 40176 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4406	4289	4290	4289
q2	378	273	272	272
q3	3169	2901	2979	2901
q4	2000	1708	1743	1708
q5	5501	5512	5603	5512
q6	222	133	129	129
q7	2263	1922	1823	1823
q8	3289	3431	3411	3411
q9	8809	8756	8685	8685
q10	4004	3876	3906	3876
q11	599	499	499	499
q12	805	629	656	629
q13	16145	3140	3164	3140
q14	305	277	288	277
q15	534	491	484	484
q16	478	429	437	429
q17	1807	1561	1521	1521
q18	8106	7939	7956	7939
q19	1743	1699	1501	1501
q20	2621	1889	1825	1825
q21	10391	4753	4931	4753
q22	603	494	510	494
Total cold run time: 78178 ms
Total hot run time: 56097 ms

@doris-robot
Copy link

doris-robot commented Jul 25, 2024

TPC-DS: Total hot run time: 174524 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit c8c9740ee8e063ddd2f2812b4c7dc676eb871f82, data reload: false

query1	915	375	375	375
query2	6338	1812	1788	1788
query3	6642	205	216	205
query4	27526	17553	17409	17409
query5	3598	493	490	490
query6	274	168	176	168
query7	4589	292	287	287
query8	271	200	190	190
query9	8550	2409	2400	2400
query10	427	315	269	269
query11	11788	10081	10072	10072
query12	114	85	83	83
query13	1639	384	358	358
query14	10233	7680	7522	7522
query15	223	163	165	163
query16	7090	476	534	476
query17	1242	573	536	536
query18	1091	273	272	272
query19	189	151	145	145
query20	93	82	82	82
query21	211	135	132	132
query22	4277	4076	4086	4076
query23	34123	33749	33701	33701
query24	11246	2991	2908	2908
query25	634	385	378	378
query26	702	155	144	144
query27	2252	280	274	274
query28	6016	2075	2089	2075
query29	872	659	625	625
query30	262	161	160	160
query31	992	818	754	754
query32	91	54	56	54
query33	746	333	333	333
query34	961	491	512	491
query35	885	775	789	775
query36	1143	989	1024	989
query37	141	85	82	82
query38	3075	2996	2785	2785
query39	899	835	826	826
query40	207	117	119	117
query41	47	43	45	43
query42	118	97	97	97
query43	507	458	468	458
query44	1198	723	724	723
query45	207	173	174	173
query46	1095	741	707	707
query47	1882	1797	1814	1797
query48	385	290	284	284
query49	810	410	408	408
query50	777	390	394	390
query51	6830	6679	6653	6653
query52	107	89	93	89
query53	360	290	279	279
query54	933	448	457	448
query55	82	75	75	75
query56	318	261	278	261
query57	1111	1035	1051	1035
query58	254	246	275	246
query59	2850	2683	2593	2593
query60	308	273	282	273
query61	95	98	97	97
query62	807	626	646	626
query63	314	285	285	285
query64	9264	2213	1709	1709
query65	3210	3089	3098	3089
query66	763	325	332	325
query67	15345	15128	15161	15128
query68	4498	550	547	547
query69	474	343	345	343
query70	1141	1168	1055	1055
query71	407	284	279	279
query72	6897	5767	5451	5451
query73	744	326	325	325
query74	6161	5763	5676	5676
query75	3377	2679	2671	2671
query76	2238	933	933	933
query77	434	303	302	302
query78	9572	9402	10646	9402
query79	3251	523	532	523
query80	1678	499	480	480
query81	598	219	219	219
query82	748	137	134	134
query83	329	192	170	170
query84	276	88	92	88
query85	1666	312	358	312
query86	480	298	307	298
query87	3264	3123	3193	3123
query88	3464	2361	2362	2361
query89	494	383	380	380
query90	1759	191	210	191
query91	130	101	107	101
query92	62	49	51	49
query93	2990	535	519	519
query94	1124	292	285	285
query95	428	321	318	318
query96	609	287	273	273
query97	3204	3001	3054	3001
query98	212	200	195	195
query99	1483	1260	1264	1260
Total cold run time: 276736 ms
Total hot run time: 174524 ms

@doris-robot
Copy link

doris-robot commented Jul 25, 2024

ClickBench: Total hot run time: 30.83 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit c8c9740ee8e063ddd2f2812b4c7dc676eb871f82, data reload: false

query1	0.05	0.04	0.03
query2	0.08	0.04	0.04
query3	0.22	0.05	0.05
query4	1.68	0.06	0.07
query5	0.50	0.48	0.49
query6	1.13	0.74	0.73
query7	0.02	0.01	0.02
query8	0.05	0.04	0.04
query9	0.55	0.48	0.49
query10	0.53	0.55	0.54
query11	0.15	0.11	0.12
query12	0.14	0.12	0.13
query13	0.60	0.58	0.58
query14	0.78	0.78	0.78
query15	0.84	0.81	0.82
query16	0.37	0.36	0.36
query17	1.04	0.96	1.03
query18	0.22	0.21	0.22
query19	1.79	1.72	1.68
query20	0.02	0.01	0.01
query21	15.42	0.76	0.66
query22	3.63	7.47	2.31
query23	18.34	1.38	1.26
query24	2.11	0.22	0.21
query25	0.16	0.10	0.09
query26	0.29	0.21	0.22
query27	0.46	0.23	0.22
query28	13.36	1.02	1.00
query29	12.58	3.30	3.25
query30	0.26	0.06	0.05
query31	2.93	0.39	0.39
query32	3.22	0.47	0.46
query33	2.86	2.91	2.96
query34	17.01	4.34	4.31
query35	4.35	4.37	4.44
query36	0.65	0.46	0.47
query37	0.19	0.16	0.16
query38	0.16	0.15	0.15
query39	0.05	0.03	0.03
query40	0.17	0.12	0.13
query41	0.10	0.05	0.05
query42	0.06	0.04	0.05
query43	0.04	0.04	0.04
Total cold run time: 109.16 s
Total hot run time: 30.83 s

@zhangstar333
Copy link
Contributor Author

zhangstar333 commented Jul 25, 2024

run buildall

@doris-robot
Copy link

doris-robot commented Jul 25, 2024

TPC-H: Total hot run time: 39752 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit daafe3c0b29f3119dd33734cf1b2b9efb44ded91, data reload: false

------ Round 1 ----------------------------------
q1	18187	4694	4251	4251
q2	2028	193	194	193
q3	10534	1216	1103	1103
q4	10222	830	839	830
q5	7519	2658	2665	2658
q6	220	139	141	139
q7	968	596	625	596
q8	9222	2100	2110	2100
q9	8744	6532	6531	6531
q10	8910	3808	3804	3804
q11	476	243	244	243
q12	404	238	234	234
q13	17770	2964	2980	2964
q14	271	239	233	233
q15	531	474	484	474
q16	488	406	390	390
q17	980	651	771	651
q18	7978	7616	7316	7316
q19	5715	1343	1393	1343
q20	698	316	331	316
q21	4925	3103	3235	3103
q22	355	281	280	280
Total cold run time: 117145 ms
Total hot run time: 39752 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4369	4236	4275	4236
q2	364	272	266	266
q3	3006	2886	2921	2886
q4	2016	1671	1657	1657
q5	5711	5555	5483	5483
q6	224	134	134	134
q7	2180	1862	1832	1832
q8	3293	3403	3455	3403
q9	8796	8774	8920	8774
q10	4055	3864	3767	3767
q11	620	498	493	493
q12	849	656	638	638
q13	15956	3256	3163	3163
q14	310	277	305	277
q15	550	505	521	505
q16	495	425	431	425
q17	1831	1543	1509	1509
q18	7991	7843	7951	7843
q19	1722	1524	1499	1499
q20	2101	1889	1878	1878
q21	5046	5098	4771	4771
q22	615	489	507	489
Total cold run time: 72100 ms
Total hot run time: 55928 ms

@doris-robot
Copy link

doris-robot commented Jul 25, 2024

TPC-DS: Total hot run time: 173451 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit daafe3c0b29f3119dd33734cf1b2b9efb44ded91, data reload: false

query1	908	371	360	360
query2	6443	2016	1907	1907
query3	6654	205	217	205
query4	28082	17471	17639	17471
query5	3685	477	478	477
query6	264	157	155	155
query7	4594	290	285	285
query8	233	192	198	192
query9	8599	2409	2378	2378
query10	458	294	284	284
query11	11472	10025	9994	9994
query12	117	81	83	81
query13	1635	403	371	371
query14	10444	7681	7541	7541
query15	225	168	168	168
query16	7789	474	469	469
query17	1600	546	514	514
query18	1968	275	267	267
query19	188	146	146	146
query20	85	98	78	78
query21	204	133	129	129
query22	4330	4193	4058	4058
query23	34378	33802	33534	33534
query24	11026	2897	2855	2855
query25	605	377	397	377
query26	1108	148	151	148
query27	2370	280	283	280
query28	6430	2086	2055	2055
query29	881	692	629	629
query30	259	159	158	158
query31	981	772	737	737
query32	96	52	57	52
query33	763	317	337	317
query34	947	482	486	482
query35	859	763	759	759
query36	1142	989	981	981
query37	140	84	105	84
query38	2951	2858	2829	2829
query39	933	858	821	821
query40	201	118	120	118
query41	44	45	44	44
query42	117	99	97	97
query43	537	490	496	490
query44	1271	727	725	725
query45	205	171	174	171
query46	1080	715	701	701
query47	1839	1748	1774	1748
query48	369	289	289	289
query49	830	402	415	402
query50	773	397	392	392
query51	6787	6765	6543	6543
query52	101	95	95	95
query53	354	296	294	294
query54	923	453	445	445
query55	74	73	75	73
query56	313	269	263	263
query57	1128	1040	1054	1040
query58	262	247	297	247
query59	2990	2667	2579	2579
query60	297	278	272	272
query61	96	93	96	93
query62	804	654	640	640
query63	317	303	292	292
query64	9219	2221	1676	1676
query65	3168	3123	3164	3123
query66	745	333	334	333
query67	15385	15051	14763	14763
query68	4547	539	536	536
query69	488	334	334	334
query70	1203	1156	1160	1156
query71	427	287	271	271
query72	7401	5721	5571	5571
query73	766	326	321	321
query74	6318	5646	5724	5646
query75	3629	2674	2675	2674
query76	2730	971	895	895
query77	613	310	316	310
query78	9603	9015	8944	8944
query79	2799	516	521	516
query80	1651	483	473	473
query81	582	217	226	217
query82	907	142	139	139
query83	325	169	175	169
query84	277	89	89	89
query85	1794	383	307	307
query86	484	325	303	303
query87	3276	3070	3108	3070
query88	3812	2353	2367	2353
query89	485	393	392	392
query90	1787	195	195	195
query91	129	102	100	100
query92	61	52	51	51
query93	3073	516	501	501
query94	1146	283	290	283
query95	409	315	327	315
query96	597	270	274	270
query97	3264	3026	3091	3026
query98	222	190	196	190
query99	1744	1258	1279	1258
Total cold run time: 282624 ms
Total hot run time: 173451 ms

@doris-robot
Copy link

doris-robot commented Jul 25, 2024

ClickBench: Total hot run time: 30.96 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit daafe3c0b29f3119dd33734cf1b2b9efb44ded91, data reload: false

query1	0.05	0.04	0.04
query2	0.09	0.04	0.04
query3	0.22	0.06	0.05
query4	1.68	0.08	0.07
query5	0.50	0.48	0.48
query6	1.12	0.73	0.73
query7	0.02	0.01	0.02
query8	0.05	0.04	0.04
query9	0.55	0.49	0.50
query10	0.55	0.54	0.54
query11	0.15	0.12	0.12
query12	0.16	0.13	0.12
query13	0.61	0.59	0.59
query14	0.77	0.77	0.81
query15	0.85	0.83	0.80
query16	0.35	0.36	0.34
query17	0.97	0.97	0.97
query18	0.23	0.22	0.21
query19	1.81	1.68	1.74
query20	0.01	0.01	0.01
query21	15.41	0.78	0.66
query22	4.20	7.26	2.12
query23	18.26	1.37	1.31
query24	2.11	0.24	0.21
query25	0.16	0.09	0.08
query26	0.28	0.20	0.21
query27	0.46	0.23	0.23
query28	13.35	1.01	1.00
query29	12.63	3.55	3.48
query30	0.26	0.07	0.06
query31	2.85	0.39	0.39
query32	3.28	0.47	0.46
query33	2.94	2.88	2.94
query34	17.09	4.34	4.33
query35	4.40	4.40	4.40
query36	0.65	0.46	0.50
query37	0.18	0.15	0.16
query38	0.16	0.15	0.15
query39	0.04	0.04	0.04
query40	0.14	0.11	0.13
query41	0.10	0.05	0.05
query42	0.06	0.05	0.06
query43	0.05	0.04	0.04
Total cold run time: 109.8 s
Total hot run time: 30.96 s

@doris-robot
Copy link

doris-robot commented Jul 30, 2024

TPC-H: Total hot run time: 41688 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 53dd9d13be3873af8b8d8c24f8cf26635223627b, data reload: false

------ Round 1 ----------------------------------
q1	17627	4170	4067	4067
q2	2022	204	206	204
q3	10427	1350	1300	1300
q4	10163	864	921	864
q5	7658	3029	3003	3003
q6	218	136	138	136
q7	1034	614	617	614
q8	9443	1924	1918	1918
q9	8563	6637	6639	6637
q10	8758	3844	3846	3844
q11	439	250	259	250
q12	433	231	227	227
q13	17751	2960	2942	2942
q14	267	245	244	244
q15	525	484	496	484
q16	538	417	387	387
q17	974	941	930	930
q18	8053	7285	7201	7201
q19	2631	1151	1214	1151
q20	573	323	324	323
q21	5290	4675	4763	4675
q22	363	288	287	287
Total cold run time: 113750 ms
Total hot run time: 41688 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4081	3986	3996	3986
q2	325	222	219	219
q3	2972	3033	3155	3033
q4	2025	2024	1947	1947
q5	5620	5485	5452	5452
q6	219	131	130	130
q7	2156	1811	1843	1811
q8	3327	3400	3391	3391
q9	8708	8666	8746	8666
q10	3990	4058	4036	4036
q11	543	437	457	437
q12	759	567	583	567
q13	16264	3127	3144	3127
q14	302	288	265	265
q15	521	510	479	479
q16	465	414	432	414
q17	1759	1743	1751	1743
q18	8227	7859	7779	7779
q19	1750	1708	1704	1704
q20	2058	1898	1808	1808
q21	5758	5456	5338	5338
q22	527	456	490	456
Total cold run time: 72356 ms
Total hot run time: 56788 ms

@doris-robot
Copy link

doris-robot commented Jul 30, 2024

TPC-DS: Total hot run time: 171090 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 53dd9d13be3873af8b8d8c24f8cf26635223627b, data reload: false

query1	916	372	376	372
query2	6470	1779	1733	1733
query3	6675	213	214	213
query4	20176	17681	17406	17406
query5	3671	517	521	517
query6	289	164	185	164
query7	4599	306	295	295
query8	233	197	202	197
query9	8526	2420	2402	2402
query10	432	317	274	274
query11	10464	10167	10025	10025
query12	123	92	87	87
query13	1646	387	379	379
query14	8751	7900	7986	7900
query15	200	165	169	165
query16	6778	480	455	455
query17	956	594	557	557
query18	1901	294	295	294
query19	204	153	150	150
query20	98	86	89	86
query21	207	99	104	99
query22	4162	3970	3940	3940
query23	34136	33778	33378	33378
query24	10190	3127	3069	3069
query25	686	422	411	411
query26	1748	157	154	154
query27	2980	290	303	290
query28	7346	2073	2039	2039
query29	1258	444	441	441
query30	238	155	154	154
query31	939	778	763	763
query32	102	56	60	56
query33	682	321	316	316
query34	914	507	496	496
query35	862	765	768	765
query36	1087	897	888	888
query37	285	86	91	86
query38	3025	2866	2856	2856
query39	850	824	816	816
query40	256	120	114	114
query41	47	43	44	43
query42	120	97	99	97
query43	479	434	411	411
query44	1183	732	734	732
query45	220	181	173	173
query46	1090	800	781	781
query47	1796	1688	1687	1687
query48	364	297	296	296
query49	934	443	421	421
query50	917	443	442	442
query51	6950	6761	6616	6616
query52	100	94	89	89
query53	255	180	188	180
query54	635	467	474	467
query55	80	73	76	73
query56	281	256	250	250
query57	1146	1031	1042	1031
query58	265	265	291	265
query59	2598	2401	2550	2401
query60	291	269	279	269
query61	103	98	97	97
query62	889	654	660	654
query63	209	179	180	179
query64	5696	1907	1893	1893
query65	3165	3084	3118	3084
query66	1311	336	340	336
query67	15231	15255	14855	14855
query68	4355	575	572	572
query69	453	304	296	296
query70	1125	1060	1087	1060
query71	414	277	276	276
query72	7198	2682	2565	2565
query73	755	333	330	330
query74	6014	5713	5664	5664
query75	3395	2749	2747	2747
query76	2422	1329	1399	1329
query77	413	314	306	306
query78	9521	8893	8975	8893
query79	2718	546	535	535
query80	1121	521	502	502
query81	566	230	225	225
query82	954	131	126	126
query83	233	167	174	167
query84	276	85	84	84
query85	1311	318	312	312
query86	490	289	307	289
query87	3259	3091	3085	3085
query88	4010	2488	2491	2488
query89	400	300	285	285
query90	1760	196	195	195
query91	131	103	107	103
query92	60	50	52	50
query93	2115	631	615	615
query94	823	307	305	305
query95	388	275	283	275
query96	600	286	282	282
query97	3212	3036	3022	3022
query98	211	208	198	198
query99	1599	1285	1297	1285
Total cold run time: 263718 ms
Total hot run time: 171090 ms

@doris-robot
Copy link

doris-robot commented Jul 30, 2024

ClickBench: Total hot run time: 29.98 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 53dd9d13be3873af8b8d8c24f8cf26635223627b, data reload: false

query1	0.04	0.03	0.04
query2	0.07	0.03	0.04
query3	0.22	0.05	0.05
query4	1.69	0.07	0.06
query5	0.50	0.49	0.48
query6	1.14	0.72	0.72
query7	0.02	0.01	0.02
query8	0.04	0.04	0.04
query9	0.58	0.51	0.55
query10	0.56	0.57	0.58
query11	0.15	0.11	0.12
query12	0.15	0.12	0.12
query13	0.62	0.61	0.60
query14	0.78	0.79	0.79
query15	0.91	0.86	0.86
query16	0.36	0.35	0.35
query17	0.99	1.04	1.04
query18	0.22	0.25	0.25
query19	1.85	1.75	1.71
query20	0.02	0.01	0.01
query21	15.39	0.76	0.66
query22	4.43	8.01	1.17
query23	18.04	1.34	1.37
query24	2.26	0.21	0.22
query25	0.19	0.08	0.08
query26	0.32	0.22	0.21
query27	0.46	0.23	0.24
query28	13.16	1.00	0.97
query29	12.56	3.38	3.32
query30	0.25	0.06	0.05
query31	2.87	0.40	0.40
query32	3.25	0.51	0.49
query33	2.96	3.00	2.91
query34	15.44	4.24	4.27
query35	4.30	4.27	4.28
query36	0.69	0.49	0.49
query37	0.19	0.17	0.17
query38	0.17	0.15	0.15
query39	0.04	0.04	0.03
query40	0.16	0.13	0.12
query41	0.10	0.05	0.05
query42	0.05	0.04	0.04
query43	0.05	0.04	0.04
Total cold run time: 108.24 s
Total hot run time: 29.98 s

@zhangstar333 zhangstar333 merged commit 89ca022 into apache:master Aug 1, 2024
feiniaofeiafei pushed a commit to feiniaofeiafei/doris that referenced this pull request Aug 9, 2024
@zhangstar333 @feiniaofeiafei
[Feature](function) support split_by_regexp function (apache#38259)
a03a728 
## Proposed changes
docs link:
apache/doris-website#904

<!--Describe your changes.-->
@Jibing-Li Jibing-Li mentioned this pull request Feb 10, 2025
Merged
16 tasks
zhangstar333 added a commit to zhangstar333/incubator-doris that referenced this pull request Apr 22, 2025
@zhangstar333
[Feature](function) support split_by_regexp function (apache#38259)
6828d3e 
docs link:
apache/doris-website#904

<!--Describe your changes.-->
@morningman morningman mentioned this pull request Apr 22, 2025
Merged
dataroaring pushed a commit that referenced this pull request Jun 18, 2025
@zhangstar333 @Jibing-Li
[cherry-pick](branch-30) support split_by_regexp (#38259) (#47676) (#…
d499904 
…50272)

bp (#38259) (#47676)
also need pick #51293

---------

Co-authored-by: James <lijibing@selectdb.com>
zhangstar333 added a commit to zhangstar333/incubator-doris that referenced this pull request Jun 20, 2025
@zhangstar333
[Feature](function) support split_by_regexp function (apache#38259)
fb75012 
docs link:
apache/doris-website#904

<!--Describe your changes.-->
@zhangstar333 zhangstar333 mentioned this pull request Jun 20, 2025
Merged
16 tasks
morrySnow pushed a commit that referenced this pull request Jun 20, 2025
@zhangstar333 @Jibing-Li
[cherry-pick](branch-31) pick 4 prs #38259 #47676 #51293 #49381 (#52005)
d538b6f 
pick from master #38259 #47676 #51293 #49381 


Co-authored-by: James <lijibing@selectdb.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@github-actions github-actions[bot] github-actions[bot] left review comments

@morrySnow morrySnow morrySnow left review comments

@HappenLee HappenLee HappenLee approved these changes

+1 more reviewer

@LiBinfeng-01 LiBinfeng-01 LiBinfeng-01 approved these changes

Reviewers whose approvals may not affect merge requirements

Assignees

No one assigned

Labels

approved Indicates a PR has been approved by one committer. dev/3.0.7-merged dev/3.1.0-merged reviewed

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

7 participants

@zhangstar333 @doris-robot @HappenLee @LiBinfeng-01 @morrySnow @morningman @dataroaring