Skip to content

Conversation

@github-actions
Copy link
Contributor

@github-actions github-actions bot commented Apr 7, 2025

Cherry-picked from #49159

…9159)

Index files are not created for variant columns during the build index
process, causing link file operations to fail
@github-actions github-actions bot requested a review from dataroaring as a code owner April 7, 2025 09:45
@Thearas
Copy link
Contributor

Thearas commented Apr 7, 2025

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@dataroaring dataroaring closed this Apr 7, 2025
@dataroaring dataroaring reopened this Apr 7, 2025
@Thearas
Copy link
Contributor

Thearas commented Apr 7, 2025

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 40183 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 83cdcf9086320ef91a145c7b29906acab5a5af6c, data reload: false

------ Round 1 ----------------------------------
q1	17627	6733	6630	6630
q2	2058	178	177	177
q3	10708	1086	1126	1086
q4	10539	714	779	714
q5	7756	2804	2803	2803
q6	216	133	139	133
q7	992	612	605	605
q8	9354	1917	2026	1917
q9	6605	6414	6411	6411
q10	7032	2294	2305	2294
q11	466	270	265	265
q12	399	217	211	211
q13	17765	3002	3025	3002
q14	239	218	204	204
q15	506	484	465	465
q16	693	597	589	589
q17	976	564	571	564
q18	7189	6576	6634	6576
q19	1388	1092	1068	1068
q20	482	201	208	201
q21	4043	3242	3378	3242
q22	1091	1026	1060	1026
Total cold run time: 108124 ms
Total hot run time: 40183 ms

----- Round 2, with runtime_filter_mode=off -----
q1	6673	6537	6666	6537
q2	332	237	242	237
q3	2957	2828	3008	2828
q4	2084	1842	1849	1842
q5	5768	5755	5677	5677
q6	221	138	131	131
q7	2204	1790	1839	1790
q8	3417	3542	3528	3528
q9	8706	8899	8818	8818
q10	3560	3518	3537	3518
q11	608	485	483	483
q12	816	626	629	626
q13	8173	3310	3202	3202
q14	301	280	275	275
q15	498	445	454	445
q16	704	657	651	651
q17	1817	1631	1619	1619
q18	8274	7619	7583	7583
q19	1654	1491	1432	1432
q20	2044	1888	1939	1888
q21	5454	5465	5396	5396
q22	1159	1024	1054	1024
Total cold run time: 67424 ms
Total hot run time: 59530 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 197894 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 83cdcf9086320ef91a145c7b29906acab5a5af6c, data reload: false

query1	1262	904	912	904
query2	6249	1990	2011	1990
query3	10921	4441	4512	4441
query4	61246	29722	23559	23559
query5	5159	459	453	453
query6	415	182	176	176
query7	5449	315	309	309
query8	317	226	224	224
query9	8278	2597	2595	2595
query10	450	270	271	270
query11	17624	15075	15589	15075
query12	157	106	100	100
query13	1429	418	425	418
query14	11069	7400	7810	7400
query15	211	185	185	185
query16	7024	482	498	482
query17	1144	581	607	581
query18	1561	318	339	318
query19	215	166	165	165
query20	118	112	109	109
query21	218	103	103	103
query22	4758	4358	4460	4358
query23	35369	34246	34627	34246
query24	6256	3015	2991	2991
query25	540	429	436	429
query26	649	173	179	173
query27	1919	370	360	360
query28	3997	2471	2433	2433
query29	709	518	464	464
query30	251	164	165	164
query31	1000	822	845	822
query32	74	58	57	57
query33	429	350	360	350
query34	938	513	523	513
query35	890	741	729	729
query36	1086	969	992	969
query37	114	70	65	65
query38	4106	4106	3956	3956
query39	1510	1480	1474	1474
query40	216	104	104	104
query41	49	49	47	47
query42	115	97	103	97
query43	531	493	497	493
query44	1231	807	822	807
query45	182	168	165	165
query46	1152	736	742	736
query47	1995	1901	1921	1901
query48	480	396	398	396
query49	761	410	413	410
query50	829	435	438	435
query51	7435	7183	7325	7183
query52	108	90	90	90
query53	271	195	190	190
query54	584	468	473	468
query55	80	76	84	76
query56	280	250	247	247
query57	1294	1137	1206	1137
query58	234	222	225	222
query59	3182	2924	2818	2818
query60	279	263	262	262
query61	150	109	104	104
query62	765	667	658	658
query63	220	190	186	186
query64	1422	683	636	636
query65	3284	3220	3255	3220
query66	708	292	300	292
query67	15845	15946	15499	15499
query68	3943	589	574	574
query69	432	282	276	276
query70	1163	1130	1133	1130
query71	366	262	260	260
query72	6187	3986	3965	3965
query73	770	350	359	350
query74	10214	9029	9035	9029
query75	3357	2609	2658	2609
query76	2004	1108	1092	1092
query77	488	275	272	272
query78	10596	9574	9559	9559
query79	1892	610	596	596
query80	1289	435	440	435
query81	545	244	236	236
query82	1247	90	89	89
query83	160	143	142	142
query84	285	80	82	80
query85	957	299	287	287
query86	405	302	311	302
query87	4533	4265	4323	4265
query88	3924	2382	2319	2319
query89	420	290	297	290
query90	1966	187	183	183
query91	183	149	146	146
query92	69	51	52	51
query93	2411	552	560	552
query94	761	298	290	290
query95	358	252	256	252
query96	637	292	281	281
query97	3344	3234	3219	3219
query98	215	198	191	191
query99	1620	1283	1313	1283
Total cold run time: 315534 ms
Total hot run time: 197894 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 32.69 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 83cdcf9086320ef91a145c7b29906acab5a5af6c, data reload: false

query1	0.04	0.04	0.03
query2	0.07	0.03	0.03
query3	0.23	0.07	0.06
query4	1.63	0.10	0.10
query5	0.52	0.51	0.51
query6	1.14	0.73	0.72
query7	0.02	0.02	0.01
query8	0.04	0.03	0.03
query9	0.57	0.50	0.50
query10	0.54	0.54	0.57
query11	0.14	0.10	0.10
query12	0.14	0.11	0.11
query13	0.61	0.60	0.60
query14	2.70	2.74	2.76
query15	0.90	0.83	0.84
query16	0.38	0.38	0.38
query17	1.05	1.06	1.02
query18	0.23	0.22	0.22
query19	1.95	1.85	1.99
query20	0.01	0.00	0.01
query21	15.38	0.60	0.59
query22	3.05	2.85	2.01
query23	17.04	0.82	0.78
query24	2.67	1.28	1.39
query25	0.18	0.16	0.05
query26	0.45	0.15	0.13
query27	0.05	0.05	0.04
query28	10.20	0.52	0.52
query29	12.60	3.22	3.27
query30	0.25	0.06	0.07
query31	2.84	0.39	0.39
query32	3.24	0.46	0.46
query33	2.99	3.04	3.01
query34	17.05	4.49	4.55
query35	4.63	4.49	4.56
query36	0.69	0.49	0.48
query37	0.10	0.06	0.07
query38	0.05	0.03	0.04
query39	0.04	0.02	0.03
query40	0.16	0.13	0.13
query41	0.08	0.02	0.03
query42	0.04	0.02	0.02
query43	0.04	0.03	0.03
Total cold run time: 106.73 s
Total hot run time: 32.69 s

Copy link
Contributor

@dataroaring dataroaring left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@dataroaring dataroaring merged commit 62bfeac into branch-3.0 Apr 9, 2025
23 of 24 checks passed
@github-actions github-actions bot deleted the auto-pick-49159-branch-3.0 branch April 9, 2025 02:26
@gavinchou gavinchou mentioned this pull request Apr 23, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants