Skip to content

Conversation

@eldenmoon
Copy link
Member

@eldenmoon eldenmoon commented Feb 10, 2025

What problem does this PR solve?

This pull request includes several changes to support inverted indexes for arrays and improve the handling of complex data types in the codebase. The most important changes include modifications to the inverted index writer, updates to expression evaluation, and the addition of new regression tests.

Improvements to inverted index support:

Addition of regression tests:

Related PR: #xxx

Problem Summary:

Release note

None

Check List (For Author)

  • Test

    • Regression test
    • Unit Test
    • Manual test (add detailed scripts or steps below)
    • No need to test or manual test. Explain why:
      • This is a refactor/code format and no logic has been changed.
      • Previous test can cover this change.
      • No code files have been changed.
      • Other reason
  • Behavior changed:

    • No.
    • Yes.
  • Does this need documentation?

    • No.
    • Yes.

Check List (For Reviewer who merge this PR)

  • Confirm the release note
  • Confirm test cases
  • Confirm document
  • Add branch pick label

@hello-stephen
Copy link
Contributor

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@eldenmoon
Copy link
Member Author

run buildall

@eldenmoon
Copy link
Member Author

This pull request includes several changes to support inverted indexes for arrays and improve the handling of complex data types in the codebase. The most important changes include modifications to the inverted index writer, updates to expression evaluation, and the addition of new regression tests.

Improvements to inverted index support:

Addition of regression tests:

@doris-robot
Copy link

TPC-H: Total hot run time: 31645 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit b48b36e006ee9a3f9c77cb37907c2660c5f82c37, data reload: false

------ Round 1 ----------------------------------
q1	17586	5224	5108	5108
q2	2048	296	168	168
q3	10418	1220	732	732
q4	10241	1051	530	530
q5	7635	2364	2311	2311
q6	185	166	131	131
q7	888	741	596	596
q8	9300	1284	1057	1057
q9	4844	4794	4846	4794
q10	6823	2273	1891	1891
q11	487	280	251	251
q12	338	349	227	227
q13	17771	3725	3081	3081
q14	233	226	214	214
q15	535	464	446	446
q16	639	624	598	598
q17	547	870	333	333
q18	6647	6375	6189	6189
q19	1224	953	537	537
q20	312	327	191	191
q21	2760	2176	1953	1953
q22	370	333	307	307
Total cold run time: 101831 ms
Total hot run time: 31645 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5164	5121	5142	5121
q2	240	325	232	232
q3	2170	2716	2325	2325
q4	1471	1860	1322	1322
q5	4248	4191	4199	4191
q6	206	163	123	123
q7	1879	1870	1684	1684
q8	2632	2635	2554	2554
q9	7266	7211	7200	7200
q10	3034	3218	2839	2839
q11	601	552	515	515
q12	747	786	665	665
q13	3848	4165	3615	3615
q14	294	336	303	303
q15	500	475	486	475
q16	664	702	674	674
q17	1186	1660	1366	1366
q18	7949	7380	7371	7371
q19	811	816	873	816
q20	2044	2100	1931	1931
q21	5375	4947	4788	4788
q22	643	589	547	547
Total cold run time: 52972 ms
Total hot run time: 50657 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 189993 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit b48b36e006ee9a3f9c77cb37907c2660c5f82c37, data reload: false

query1	1322	992	934	934
query2	6441	1908	1862	1862
query3	10999	4433	4476	4433
query4	56451	25863	22952	22952
query5	5332	508	468	468
query6	385	191	182	182
query7	5211	501	287	287
query8	323	241	232	232
query9	7004	2492	2516	2492
query10	416	335	262	262
query11	15160	15001	14802	14802
query12	154	108	106	106
query13	1230	518	396	396
query14	10493	6723	6386	6386
query15	198	192	173	173
query16	6997	674	506	506
query17	1087	738	587	587
query18	1506	406	323	323
query19	201	193	168	168
query20	135	142	131	131
query21	209	128	109	109
query22	4473	4531	4443	4443
query23	34008	33557	33561	33557
query24	5706	2393	2409	2393
query25	458	463	392	392
query26	653	271	160	160
query27	1643	493	326	326
query28	2892	2400	2400	2400
query29	584	587	444	444
query30	211	190	154	154
query31	906	879	791	791
query32	75	63	63	63
query33	462	354	307	307
query34	764	869	501	501
query35	795	845	748	748
query36	972	1007	918	918
query37	123	110	79	79
query38	4292	4222	4242	4222
query39	1572	1425	1616	1425
query40	202	116	115	115
query41	52	51	51	51
query42	123	112	109	109
query43	507	509	499	499
query44	1270	791	779	779
query45	179	174	168	168
query46	884	1051	659	659
query47	1873	1894	1817	1817
query48	398	411	323	323
query49	723	526	418	418
query50	735	763	430	430
query51	4249	4319	4239	4239
query52	110	109	98	98
query53	242	269	196	196
query54	496	494	419	419
query55	79	78	88	78
query56	281	276	252	252
query57	1170	1200	1098	1098
query58	248	250	261	250
query59	2727	2955	2772	2772
query60	302	285	282	282
query61	120	124	128	124
query62	737	748	704	704
query63	226	192	191	191
query64	1444	1016	666	666
query65	3283	3126	3138	3126
query66	718	385	303	303
query67	15877	15590	15538	15538
query68	5511	753	495	495
query69	559	296	264	264
query70	1234	1117	1118	1117
query71	463	307	273	273
query72	6414	3702	3878	3702
query73	1075	745	332	332
query74	8966	9339	8866	8866
query75	3490	3126	2661	2661
query76	3828	1164	738	738
query77	549	360	283	283
query78	9967	10037	9374	9374
query79	2413	791	585	585
query80	612	517	448	448
query81	484	271	245	245
query82	663	146	117	117
query83	181	165	150	150
query84	284	96	73	73
query85	789	369	306	306
query86	446	311	289	289
query87	4440	4481	4452	4452
query88	3574	2177	2165	2165
query89	414	328	276	276
query90	1889	192	190	190
query91	135	137	111	111
query92	73	59	54	54
query93	1981	980	567	567
query94	677	384	299	299
query95	355	264	250	250
query96	475	563	269	269
query97	2829	2891	2730	2730
query98	243	205	205	205
query99	1406	1409	1289	1289
Total cold run time: 297517 ms
Total hot run time: 189993 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.53 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit b48b36e006ee9a3f9c77cb37907c2660c5f82c37, data reload: false

query1	0.03	0.03	0.03
query2	0.07	0.04	0.04
query3	0.23	0.08	0.06
query4	1.61	0.11	0.10
query5	0.41	0.42	0.39
query6	1.16	0.68	0.65
query7	0.03	0.02	0.01
query8	0.04	0.02	0.03
query9	0.60	0.52	0.53
query10	0.57	0.58	0.57
query11	0.15	0.10	0.10
query12	0.14	0.12	0.11
query13	0.62	0.60	0.61
query14	2.80	2.82	2.80
query15	0.93	0.85	0.86
query16	0.38	0.38	0.38
query17	1.02	1.07	1.00
query18	0.21	0.20	0.20
query19	1.93	1.76	2.00
query20	0.01	0.01	0.01
query21	15.36	0.88	0.53
query22	0.76	1.11	0.75
query23	14.90	1.38	0.62
query24	6.99	2.06	0.62
query25	0.52	0.16	0.23
query26	0.71	0.17	0.15
query27	0.06	0.05	0.05
query28	9.63	0.86	0.43
query29	12.53	3.97	3.29
query30	0.27	0.10	0.07
query31	2.81	0.58	0.39
query32	3.23	0.55	0.46
query33	2.97	3.03	3.11
query34	15.69	5.12	4.47
query35	4.49	4.51	4.55
query36	0.66	0.50	0.48
query37	0.10	0.07	0.06
query38	0.05	0.04	0.04
query39	0.03	0.02	0.03
query40	0.17	0.14	0.13
query41	0.09	0.02	0.02
query42	0.04	0.02	0.02
query43	0.03	0.03	0.03
Total cold run time: 105.03 s
Total hot run time: 30.53 s

@eldenmoon
Copy link
Member Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 31490 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 291c3590632c7f2ab7753eddde0480c1f42f8910, data reload: false

------ Round 1 ----------------------------------
q1	17616	5184	5073	5073
q2	2046	309	174	174
q3	10396	1356	721	721
q4	10218	991	527	527
q5	7693	2387	2347	2347
q6	191	168	133	133
q7	888	739	590	590
q8	9321	1270	1080	1080
q9	4787	4786	4660	4660
q10	6813	2298	1889	1889
q11	493	271	262	262
q12	352	355	219	219
q13	17758	3701	3079	3079
q14	222	218	203	203
q15	516	478	467	467
q16	635	632	589	589
q17	560	881	332	332
q18	6681	6185	6297	6185
q19	1198	946	542	542
q20	316	326	189	189
q21	2804	2239	1927	1927
q22	357	330	302	302
Total cold run time: 101861 ms
Total hot run time: 31490 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5142	5133	5165	5133
q2	238	332	224	224
q3	2153	2667	2295	2295
q4	1448	1823	1388	1388
q5	4229	4133	4156	4133
q6	206	165	124	124
q7	1859	1836	1632	1632
q8	2605	2581	2653	2581
q9	7366	7043	7053	7043
q10	2983	3159	2741	2741
q11	569	515	495	495
q12	681	730	603	603
q13	3492	4005	3264	3264
q14	276	317	285	285
q15	524	473	461	461
q16	647	678	624	624
q17	1164	1548	1375	1375
q18	7626	7258	7337	7258
q19	778	821	979	821
q20	1987	2003	1866	1866
q21	5417	4928	4879	4879
q22	640	590	530	530
Total cold run time: 52030 ms
Total hot run time: 49755 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 183100 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 291c3590632c7f2ab7753eddde0480c1f42f8910, data reload: false

query1	988	382	368	368
query2	6535	1823	1807	1807
query3	6797	209	210	209
query4	26580	24076	23506	23506
query5	4367	682	521	521
query6	311	216	184	184
query7	4618	515	308	308
query8	298	252	250	250
query9	8606	2486	2500	2486
query10	455	318	268	268
query11	15389	15258	14996	14996
query12	157	112	106	106
query13	1659	534	388	388
query14	8732	6096	6231	6096
query15	223	189	174	174
query16	7210	621	457	457
query17	1213	720	557	557
query18	1962	400	309	309
query19	197	193	155	155
query20	129	117	119	117
query21	210	127	104	104
query22	4031	4075	4046	4046
query23	33878	32772	33125	32772
query24	8203	2374	2392	2374
query25	540	446	385	385
query26	1235	267	154	154
query27	2714	484	332	332
query28	4349	2411	2350	2350
query29	776	544	420	420
query30	233	187	155	155
query31	936	848	800	800
query32	76	65	61	61
query33	555	363	300	300
query34	784	861	504	504
query35	797	835	727	727
query36	947	975	882	882
query37	130	98	87	87
query38	4316	4144	4017	4017
query39	1476	1436	1378	1378
query40	212	123	102	102
query41	54	54	56	54
query42	117	105	103	103
query43	503	501	468	468
query44	1322	797	792	792
query45	175	170	166	166
query46	857	1046	648	648
query47	1750	1803	1708	1708
query48	387	418	298	298
query49	778	503	387	387
query50	702	751	410	410
query51	4213	4161	4116	4116
query52	106	117	99	99
query53	228	258	184	184
query54	490	507	430	430
query55	82	83	80	80
query56	268	266	254	254
query57	1152	1119	1067	1067
query58	244	235	234	234
query59	2466	2567	2628	2567
query60	296	275	276	275
query61	120	116	139	116
query62	810	715	676	676
query63	231	187	188	187
query64	4388	1000	662	662
query65	3243	3125	3146	3125
query66	1163	423	308	308
query67	15819	15418	15448	15418
query68	7916	821	519	519
query69	475	293	266	266
query70	1194	1141	1099	1099
query71	387	290	275	275
query72	6060	3594	3958	3594
query73	753	756	362	362
query74	9179	9177	8665	8665
query75	3166	3134	2709	2709
query76	3185	1164	740	740
query77	468	386	308	308
query78	9925	10048	9306	9306
query79	2493	808	607	607
query80	594	590	462	462
query81	518	278	245	245
query82	541	151	120	120
query83	174	179	153	153
query84	237	96	71	71
query85	799	338	301	301
query86	380	296	288	288
query87	4430	4566	4450	4450
query88	3926	2215	2205	2205
query89	390	313	278	278
query90	1875	200	200	200
query91	139	141	114	114
query92	76	61	62	61
query93	1866	1028	587	587
query94	718	413	304	304
query95	357	274	265	265
query96	484	555	266	266
query97	2795	2858	2773	2773
query98	239	207	211	207
query99	1357	1414	1256	1256
Total cold run time: 271884 ms
Total hot run time: 183100 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.67 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 291c3590632c7f2ab7753eddde0480c1f42f8910, data reload: false

query1	0.04	0.03	0.03
query2	0.09	0.03	0.03
query3	0.23	0.07	0.07
query4	1.61	0.10	0.10
query5	0.42	0.41	0.41
query6	1.17	0.67	0.65
query7	0.02	0.02	0.02
query8	0.05	0.04	0.03
query9	0.60	0.50	0.53
query10	0.57	0.58	0.56
query11	0.14	0.11	0.11
query12	0.14	0.10	0.11
query13	0.61	0.61	0.61
query14	2.69	2.72	2.86
query15	0.90	0.84	0.85
query16	0.37	0.37	0.36
query17	1.03	1.07	1.02
query18	0.21	0.20	0.19
query19	1.90	1.83	2.04
query20	0.02	0.02	0.01
query21	15.35	0.90	0.53
query22	0.77	1.29	0.74
query23	14.73	1.35	0.61
query24	7.73	1.54	0.70
query25	0.49	0.27	0.06
query26	0.59	0.16	0.14
query27	0.05	0.05	0.05
query28	8.91	0.84	0.43
query29	12.54	4.13	3.45
query30	0.26	0.08	0.06
query31	2.81	0.60	0.38
query32	3.22	0.55	0.46
query33	2.97	3.08	3.04
query34	15.79	5.14	4.48
query35	4.46	4.53	4.52
query36	0.65	0.50	0.49
query37	0.09	0.07	0.06
query38	0.05	0.04	0.04
query39	0.03	0.03	0.03
query40	0.18	0.14	0.14
query41	0.09	0.03	0.02
query42	0.04	0.03	0.02
query43	0.04	0.04	0.03
Total cold run time: 104.65 s
Total hot run time: 30.67 s

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 42.81% (11264/26309)
Line Coverage: 32.78% (94598/288571)
Region Coverage: 31.94% (48505/151843)
Branch Coverage: 27.81% (24457/87946)
Coverage Report: http://coverage.selectdb-in.cc/coverage/291c3590632c7f2ab7753eddde0480c1f42f8910_291c3590632c7f2ab7753eddde0480c1f42f8910/report/index.html

@eldenmoon
Copy link
Member Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 31734 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit a51cba992c463e5ea1669265427843cefb129f6d, data reload: false

------ Round 1 ----------------------------------
q1	17629	5442	5142	5142
q2	2057	323	173	173
q3	10391	1310	720	720
q4	10202	999	518	518
q5	8136	2522	2345	2345
q6	188	168	139	139
q7	896	775	604	604
q8	9307	1397	1200	1200
q9	4906	4655	4711	4655
q10	6841	2303	1914	1914
q11	491	277	270	270
q12	360	369	220	220
q13	17758	3703	3090	3090
q14	235	231	203	203
q15	515	465	447	447
q16	626	624	581	581
q17	601	897	353	353
q18	6625	6303	6191	6191
q19	1086	943	550	550
q20	322	330	195	195
q21	2908	2152	1915	1915
q22	370	326	309	309
Total cold run time: 102450 ms
Total hot run time: 31734 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5216	5188	5233	5188
q2	236	327	235	235
q3	2204	2704	2346	2346
q4	1389	1830	1382	1382
q5	4256	4116	4165	4116
q6	206	166	126	126
q7	1865	1851	1761	1761
q8	2587	2620	2522	2522
q9	7212	7088	7106	7088
q10	3070	3169	2766	2766
q11	583	528	487	487
q12	688	802	602	602
q13	3583	3961	3183	3183
q14	273	299	284	284
q15	501	465	472	465
q16	653	669	625	625
q17	1136	1596	1344	1344
q18	7642	7334	7313	7313
q19	858	905	1002	905
q20	1997	1995	1877	1877
q21	5357	4928	4782	4782
q22	631	570	532	532
Total cold run time: 52143 ms
Total hot run time: 49929 ms

@eldenmoon
Copy link
Member Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 31685 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit a51cba992c463e5ea1669265427843cefb129f6d, data reload: false

------ Round 1 ----------------------------------
q1	17618	5338	5090	5090
q2	2053	302	166	166
q3	10420	1319	768	768
q4	10209	1034	547	547
q5	7537	2483	2286	2286
q6	191	164	134	134
q7	920	815	620	620
q8	9313	1361	1174	1174
q9	5083	4747	4808	4747
q10	6875	2340	1881	1881
q11	498	287	273	273
q12	367	357	229	229
q13	17774	3740	3117	3117
q14	245	231	210	210
q15	529	461	452	452
q16	637	615	579	579
q17	608	879	347	347
q18	7207	6324	6082	6082
q19	1209	949	548	548
q20	336	340	199	199
q21	2873	2158	1938	1938
q22	368	336	298	298
Total cold run time: 102870 ms
Total hot run time: 31685 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5188	5154	5145	5145
q2	244	338	237	237
q3	2178	2683	2335	2335
q4	1490	1858	1377	1377
q5	4246	4169	4183	4169
q6	214	162	126	126
q7	1874	1886	1670	1670
q8	2528	2537	2496	2496
q9	6844	6824	6805	6805
q10	2886	3098	2646	2646
q11	573	497	478	478
q12	651	717	592	592
q13	3340	3746	3065	3065
q14	275	289	260	260
q15	513	447	453	447
q16	650	683	623	623
q17	1112	1638	1239	1239
q18	7096	6914	6897	6897
q19	799	837	1042	837
q20	1928	1919	1809	1809
q21	5275	4737	4764	4737
q22	641	565	546	546
Total cold run time: 50545 ms
Total hot run time: 48536 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 184758 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit a51cba992c463e5ea1669265427843cefb129f6d, data reload: false

query1	993	390	375	375
query2	6244	1913	1908	1908
query3	6487	219	217	217
query4	26118	23851	23389	23389
query5	4950	656	564	564
query6	303	215	191	191
query7	3170	506	313	313
query8	267	248	239	239
query9	3902	2613	2588	2588
query10	326	346	268	268
query11	15301	15015	15074	15015
query12	155	108	108	108
query13	1959	560	417	417
query14	9739	6221	7259	6221
query15	200	198	183	183
query16	7642	633	469	469
query17	1549	733	552	552
query18	1981	401	301	301
query19	199	181	154	154
query20	132	118	113	113
query21	207	128	117	117
query22	4080	4200	4185	4185
query23	33999	32945	33164	32945
query24	7902	2440	2460	2440
query25	493	463	390	390
query26	1281	276	158	158
query27	2070	500	346	346
query28	3887	2485	2451	2451
query29	673	544	431	431
query30	296	186	161	161
query31	949	861	769	769
query32	73	70	65	65
query33	622	369	309	309
query34	779	869	508	508
query35	862	836	740	740
query36	972	976	884	884
query37	119	101	73	73
query38	4227	4166	4102	4102
query39	1476	1406	1402	1402
query40	203	120	105	105
query41	53	54	52	52
query42	123	108	104	104
query43	505	542	489	489
query44	1341	828	825	825
query45	177	172	165	165
query46	898	1071	675	675
query47	1755	1807	1674	1674
query48	390	462	329	329
query49	786	502	401	401
query50	682	731	451	451
query51	4260	4186	4090	4090
query52	110	110	98	98
query53	242	273	194	194
query54	517	506	422	422
query55	86	87	83	83
query56	301	274	248	248
query57	1133	1124	1064	1064
query58	258	248	259	248
query59	2603	2849	2829	2829
query60	291	277	261	261
query61	120	140	158	140
query62	809	729	657	657
query63	251	198	203	198
query64	4220	1112	708	708
query65	3270	3179	3171	3171
query66	1059	411	308	308
query67	15947	15518	15326	15326
query68	7619	827	587	587
query69	472	300	281	281
query70	1242	1161	1109	1109
query71	415	304	266	266
query72	5709	3598	3709	3598
query73	718	748	367	367
query74	9240	9179	8897	8897
query75	3365	3209	2745	2745
query76	3330	1169	755	755
query77	603	390	306	306
query78	10113	10066	9351	9351
query79	2094	828	626	626
query80	688	535	447	447
query81	514	284	235	235
query82	241	130	93	93
query83	172	191	159	159
query84	250	100	79	79
query85	737	342	301	301
query86	344	298	286	286
query87	4687	4453	4362	4362
query88	3674	2230	2221	2221
query89	391	325	283	283
query90	1892	197	198	197
query91	138	140	109	109
query92	74	64	62	62
query93	2313	1019	601	601
query94	669	414	296	296
query95	361	273	260	260
query96	490	549	267	267
query97	2776	2835	2750	2750
query98	234	206	206	206
query99	1301	1437	1280	1280
Total cold run time: 265840 ms
Total hot run time: 184758 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.47 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit a51cba992c463e5ea1669265427843cefb129f6d, data reload: false

query1	0.03	0.02	0.03
query2	0.07	0.03	0.04
query3	0.23	0.07	0.07
query4	1.62	0.11	0.10
query5	0.42	0.41	0.42
query6	1.15	0.68	0.65
query7	0.02	0.02	0.02
query8	0.04	0.03	0.03
query9	0.58	0.51	0.53
query10	0.57	0.60	0.57
query11	0.15	0.11	0.10
query12	0.14	0.12	0.11
query13	0.62	0.60	0.61
query14	2.72	2.71	2.69
query15	0.91	0.87	0.85
query16	0.38	0.37	0.38
query17	1.04	1.01	1.07
query18	0.21	0.19	0.19
query19	1.97	1.87	1.98
query20	0.01	0.02	0.01
query21	15.37	0.90	0.55
query22	0.75	1.22	0.66
query23	14.90	1.37	0.65
query24	11.36	1.05	0.34
query25	0.43	0.23	0.22
query26	0.93	0.19	0.15
query27	0.05	0.05	0.06
query28	6.32	0.76	0.42
query29	12.60	3.96	3.35
query30	0.24	0.08	0.06
query31	2.83	0.59	0.38
query32	3.23	0.55	0.47
query33	2.97	3.05	3.03
query34	15.80	5.16	4.57
query35	4.55	4.54	4.57
query36	0.70	0.50	0.49
query37	0.09	0.07	0.06
query38	0.04	0.04	0.04
query39	0.03	0.03	0.02
query40	0.17	0.14	0.14
query41	0.08	0.02	0.02
query42	0.03	0.02	0.03
query43	0.03	0.03	0.03
Total cold run time: 106.38 s
Total hot run time: 30.47 s

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 43.84% (11637/26546)
Line Coverage: 33.75% (97564/289037)
Region Coverage: 32.85% (49944/152036)
Branch Coverage: 28.56% (25098/87888)
Coverage Report: http://coverage.selectdb-in.cc/coverage/a51cba992c463e5ea1669265427843cefb129f6d_a51cba992c463e5ea1669265427843cefb129f6d/report/index.html

Copy link
Member

@airborne12 airborne12 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Feb 20, 2025
@github-actions
Copy link
Contributor

PR approved by at least one committer and no changes requested.

@github-actions
Copy link
Contributor

PR approved by anyone and no changes requested.

Copy link
Contributor

@xiaokang xiaokang left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@eldenmoon eldenmoon changed the title [InvertedIndex](Variant) suport inverted index for array type in variant [InvertedIndex](Variant) support inverted index for array type in variant Feb 20, 2025
@eldenmoon eldenmoon deleted the var-arr-idx branch February 20, 2025 02:54
github-actions bot pushed a commit that referenced this pull request Feb 20, 2025
…iant (#47688)

This pull request includes several changes to support inverted indexes
for arrays and improve the handling of complex data types in the
codebase. The most important changes include modifications to the
inverted index writer, updates to expression evaluation, and the
addition of new regression tests
lzyy2024 pushed a commit to lzyy2024/doris that referenced this pull request Feb 21, 2025
…iant (apache#47688)

This pull request includes several changes to support inverted indexes
for arrays and improve the handling of complex data types in the
codebase. The most important changes include modifications to the
inverted index writer, updates to expression evaluation, and the
addition of new regression tests
eldenmoon added a commit to eldenmoon/incubator-doris that referenced this pull request Mar 4, 2025
…iant (apache#47688)

This pull request includes several changes to support inverted indexes
for arrays and improve the handling of complex data types in the
codebase. The most important changes include modifications to the
inverted index writer, updates to expression evaluation, and the
addition of new regression tests
@yiguolei yiguolei added the usercase Important user case type label label Mar 4, 2025
eldenmoon added a commit to eldenmoon/incubator-doris that referenced this pull request Mar 4, 2025
…iant (apache#47688)

This pull request includes several changes to support inverted indexes
for arrays and improve the handling of complex data types in the
codebase. The most important changes include modifications to the
inverted index writer, updates to expression evaluation, and the
addition of new regression tests
eldenmoon added a commit to eldenmoon/incubator-doris that referenced this pull request Mar 4, 2025
…iant (apache#47688)

This pull request includes several changes to support inverted indexes
for arrays and improve the handling of complex data types in the
codebase. The most important changes include modifications to the
inverted index writer, updates to expression evaluation, and the
addition of new regression tests
yiguolei pushed a commit that referenced this pull request Mar 5, 2025
@eldenmoon eldenmoon added the p0_b label Mar 6, 2025
dataroaring pushed a commit that referenced this pull request Mar 20, 2025
… type in variant #47688 (#48117)

Cherry-picked from #47688

Co-authored-by: lihangyu <lihangyu@selectdb.com>
@yiguolei yiguolei mentioned this pull request Mar 25, 2025
@gavinchou gavinchou mentioned this pull request Apr 23, 2025
koarz pushed a commit to koarz/doris that referenced this pull request Jun 4, 2025
…iant (apache#47688)

This pull request includes several changes to support inverted indexes
for arrays and improve the handling of complex data types in the
codebase. The most important changes include modifications to the
inverted index writer, updates to expression evaluation, and the
addition of new regression tests
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

approved Indicates a PR has been approved by one committer. dev/2.1.9-merged dev/3.0.5-merged p0_b reviewed usercase Important user case type label

Projects

None yet

Development

Successfully merging this pull request may close these issues.

7 participants