Skip to content

Conversation

@wsjz
Copy link
Contributor

@wsjz wsjz commented Aug 21, 2024

Proposed changes

fix for #39259

@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@wsjz
Copy link
Contributor Author

wsjz commented Aug 21, 2024

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 38089 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 177cd5a7fd97429725e4ea5aca473fc6372a9953, data reload: false

------ Round 1 ----------------------------------
q1	17930	4358	4298	4298
q2	2055	212	251	212
q3	10386	1129	1086	1086
q4	10168	761	776	761
q5	7767	2820	2794	2794
q6	262	160	167	160
q7	1001	660	651	651
q8	9400	2083	2093	2083
q9	7169	6571	6519	6519
q10	7040	2237	2267	2237
q11	490	276	278	276
q12	435	262	264	262
q13	17779	2995	3025	2995
q14	296	258	251	251
q15	561	531	537	531
q16	517	412	416	412
q17	997	657	775	657
q18	7672	6813	6715	6715
q19	7687	1100	1029	1029
q20	736	362	363	362
q21	3882	3014	2767	2767
q22	1131	1038	1031	1031
Total cold run time: 115361 ms
Total hot run time: 38089 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4499	4305	4381	4305
q2	421	331	307	307
q3	2845	2611	2584	2584
q4	1976	1676	1684	1676
q5	5359	5422	5421	5421
q6	245	149	152	149
q7	2100	1708	1724	1708
q8	3197	3399	3350	3350
q9	8438	8379	8355	8355
q10	3401	3108	3160	3108
q11	620	552	548	548
q12	800	617	616	616
q13	16481	2989	2993	2989
q14	325	289	313	289
q15	555	513	521	513
q16	494	434	455	434
q17	1756	1512	1472	1472
q18	7861	7968	7747	7747
q19	2078	1703	1580	1580
q20	2110	1838	1863	1838
q21	11927	5085	4908	4908
q22	1122	1061	1073	1061
Total cold run time: 78610 ms
Total hot run time: 54958 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 190718 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 177cd5a7fd97429725e4ea5aca473fc6372a9953, data reload: false

query1	991	407	391	391
query2	6727	1990	1962	1962
query3	6667	233	245	233
query4	33750	23339	23387	23339
query5	4319	666	636	636
query6	287	193	192	192
query7	4601	338	322	322
query8	455	432	428	428
query9	8762	2518	2489	2489
query10	501	357	354	354
query11	16725	15080	15154	15080
query12	188	138	136	136
query13	1711	449	454	449
query14	10111	7310	6971	6971
query15	291	198	185	185
query16	7943	512	515	512
query17	1601	597	581	581
query18	2080	337	344	337
query19	221	171	167	167
query20	144	136	136	136
query21	243	147	142	142
query22	4278	4062	4076	4062
query23	34104	33426	33271	33271
query24	11183	2889	2850	2850
query25	644	428	419	419
query26	1183	182	182	182
query27	2165	308	308	308
query28	6902	2142	2112	2112
query29	837	452	462	452
query30	336	186	187	186
query31	1049	840	841	840
query32	121	81	79	79
query33	824	338	353	338
query34	927	529	526	526
query35	894	758	765	758
query36	1103	903	959	903
query37	158	107	103	103
query38	4044	3973	3865	3865
query39	1527	1481	1464	1464
query40	242	151	151	151
query41	145	158	140	140
query42	138	115	117	115
query43	551	508	516	508
query44	1301	787	803	787
query45	233	191	191	191
query46	1131	798	803	798
query47	1914	1827	1831	1827
query48	424	335	342	335
query49	1255	579	587	579
query50	849	461	479	461
query51	7234	7078	6993	6993
query52	123	111	111	111
query53	297	231	229	229
query54	990	508	511	508
query55	91	91	89	89
query56	330	328	329	328
query57	1203	1107	1101	1101
query58	314	299	307	299
query59	2984	2782	2971	2782
query60	369	324	325	324
query61	149	142	149	142
query62	879	703	683	683
query63	261	229	231	229
query64	5306	2325	1811	1811
query65	3245	3204	3182	3182
query66	1106	670	670	670
query67	15648	15026	14856	14856
query68	6467	642	616	616
query69	741	436	329	329
query70	1201	1132	1131	1131
query71	572	320	316	316
query72	7583	2320	2099	2099
query73	864	357	365	357
query74	9220	8869	8778	8778
query75	4807	2724	2759	2724
query76	4850	1012	997	997
query77	901	438	434	434
query78	10266	9220	8944	8944
query79	4732	549	618	549
query80	1214	602	602	602
query81	623	256	262	256
query82	815	161	164	161
query83	391	214	220	214
query84	299	102	101	101
query85	1435	360	348	348
query86	459	324	296	296
query87	4403	4314	4208	4208
query88	5168	2506	2529	2506
query89	475	334	325	325
query90	2088	234	233	233
query91	155	127	131	127
query92	92	75	74	74
query93	4709	562	550	550
query94	1012	322	316	316
query95	392	333	312	312
query96	620	285	283	283
query97	3222	3026	3013	3013
query98	237	237	228	228
query99	1591	1316	1302	1302
Total cold run time: 310913 ms
Total hot run time: 190718 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.29 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 177cd5a7fd97429725e4ea5aca473fc6372a9953, data reload: false

query1	0.05	0.04	0.04
query2	0.08	0.05	0.04
query3	0.23	0.05	0.05
query4	1.66	0.09	0.10
query5	0.52	0.49	0.50
query6	1.14	0.73	0.73
query7	0.02	0.01	0.02
query8	0.06	0.05	0.06
query9	0.55	0.48	0.48
query10	0.57	0.56	0.54
query11	0.16	0.13	0.13
query12	0.15	0.13	0.13
query13	0.62	0.59	0.60
query14	0.75	0.79	0.81
query15	0.84	0.80	0.83
query16	0.39	0.38	0.36
query17	1.01	0.95	1.04
query18	0.21	0.20	0.20
query19	1.86	1.74	1.68
query20	0.01	0.01	0.02
query21	15.40	0.66	0.66
query22	4.64	8.33	1.40
query23	18.29	1.50	1.25
query24	2.11	0.21	0.21
query25	0.16	0.09	0.08
query26	0.26	0.18	0.17
query27	0.10	0.08	0.08
query28	13.31	1.02	0.99
query29	13.02	3.38	3.36
query30	0.43	0.24	0.24
query31	2.81	0.40	0.40
query32	3.25	0.49	0.49
query33	2.96	2.94	2.92
query34	17.03	4.33	4.36
query35	4.45	4.36	4.41
query36	0.66	0.49	0.50
query37	0.21	0.18	0.17
query38	0.18	0.17	0.16
query39	0.07	0.06	0.05
query40	0.18	0.16	0.14
query41	0.12	0.07	0.07
query42	0.08	0.07	0.06
query43	0.08	0.07	0.05
Total cold run time: 110.68 s
Total hot run time: 30.29 s

@wsjz wsjz changed the title [fix](multi-catalog)fix array and map type read offset [fix](multi-catalog)fix max compute array and map type read offset Aug 21, 2024
@wsjz
Copy link
Contributor Author

wsjz commented Aug 21, 2024

run external

@wsjz
Copy link
Contributor Author

wsjz commented Aug 21, 2024

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 38791 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 622906895390beab8c989371fe25fff7913350e2, data reload: false

------ Round 1 ----------------------------------
q1	17972	4365	4286	4286
q2	2052	209	208	208
q3	12250	993	1056	993
q4	10541	742	800	742
q5	7789	2870	2847	2847
q6	267	161	160	160
q7	1027	697	692	692
q8	10009	2124	2122	2122
q9	7158	6626	6623	6623
q10	7090	2259	2212	2212
q11	508	288	260	260
q12	417	256	259	256
q13	18194	3057	2965	2965
q14	284	257	247	247
q15	548	532	518	518
q16	564	434	419	419
q17	992	815	751	751
q18	8330	7307	7191	7191
q19	7653	1139	1130	1130
q20	740	386	373	373
q21	3996	3144	2784	2784
q22	1120	1046	1012	1012
Total cold run time: 119501 ms
Total hot run time: 38791 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5100	4352	4313	4313
q2	415	295	309	295
q3	2871	2769	2722	2722
q4	1972	1704	1755	1704
q5	5651	5707	5631	5631
q6	241	147	156	147
q7	2161	1759	1863	1759
q8	3305	3510	3416	3416
q9	8791	8705	8795	8705
q10	3608	3269	3267	3267
q11	631	542	536	536
q12	816	649	639	639
q13	15873	3179	3045	3045
q14	337	306	307	306
q15	566	540	526	526
q16	494	469	494	469
q17	1865	1549	1520	1520
q18	8356	7777	7666	7666
q19	9603	1663	1497	1497
q20	2190	1902	1869	1869
q21	10654	5327	5242	5242
q22	1169	1103	1062	1062
Total cold run time: 86669 ms
Total hot run time: 56336 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 196900 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 622906895390beab8c989371fe25fff7913350e2, data reload: false

query1	1291	912	888	888
query2	6715	2035	1963	1963
query3	10594	3874	3946	3874
query4	58299	27616	23395	23395
query5	6122	721	700	700
query6	561	219	209	209
query7	6441	332	333	332
query8	545	442	434	434
query9	9326	2566	2542	2542
query10	566	345	346	345
query11	18455	15000	15431	15000
query12	200	139	143	139
query13	1703	445	437	437
query14	12084	7419	7040	7040
query15	261	194	196	194
query16	7685	512	552	512
query17	1204	612	635	612
query18	2009	350	345	345
query19	336	173	176	173
query20	149	135	138	135
query21	251	141	145	141
query22	4732	4494	4412	4412
query23	34090	33549	33889	33549
query24	5692	2994	3041	2994
query25	593	437	444	437
query26	731	184	205	184
query27	1813	307	308	307
query28	3726	2173	2109	2109
query29	744	446	450	446
query30	221	182	179	179
query31	1054	838	821	821
query32	102	76	77	76
query33	561	344	336	336
query34	898	519	540	519
query35	869	735	769	735
query36	1096	983	937	937
query37	156	100	100	100
query38	4008	3867	3880	3867
query39	1537	1514	1570	1514
query40	231	156	153	153
query41	139	137	138	137
query42	133	118	119	118
query43	571	526	536	526
query44	1103	782	808	782
query45	225	191	192	191
query46	1130	823	764	764
query47	1944	1865	1858	1858
query48	408	329	333	329
query49	916	582	578	578
query50	857	464	486	464
query51	7149	7127	7114	7114
query52	120	110	109	109
query53	305	229	230	229
query54	612	502	500	500
query55	95	93	91	91
query56	352	313	305	305
query57	1196	1180	1136	1136
query58	294	302	299	299
query59	2987	2796	2819	2796
query60	372	320	329	320
query61	151	146	145	145
query62	765	689	706	689
query63	262	236	224	224
query64	3417	1844	1857	1844
query65	3245	3194	3174	3174
query66	1012	676	704	676
query67	15408	15140	15181	15140
query68	7450	579	586	579
query69	693	414	341	341
query70	1277	1082	1149	1082
query71	547	312	307	307
query72	6709	2293	2083	2083
query73	829	351	355	351
query74	9132	8699	8757	8699
query75	3850	2725	2731	2725
query76	4410	1103	1101	1101
query77	866	457	452	452
query78	10876	9582	9972	9582
query79	12999	570	557	557
query80	971	664	608	608
query81	606	260	257	257
query82	696	154	158	154
query83	343	216	213	213
query84	296	97	98	97
query85	793	351	354	351
query86	387	321	317	317
query87	4416	4165	4321	4165
query88	4639	2456	2471	2456
query89	508	329	322	322
query90	2205	234	228	228
query91	153	128	126	126
query92	86	75	74	74
query93	4579	552	545	545
query94	958	323	321	321
query95	399	299	305	299
query96	621	295	283	283
query97	3210	3066	3096	3066
query98	287	226	222	222
query99	1613	1356	1314	1314
Total cold run time: 340223 ms
Total hot run time: 196900 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.61 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 622906895390beab8c989371fe25fff7913350e2, data reload: false

query1	0.05	0.04	0.04
query2	0.08	0.05	0.04
query3	0.23	0.06	0.06
query4	1.65	0.10	0.08
query5	0.52	0.50	0.48
query6	1.12	0.72	0.73
query7	0.02	0.02	0.01
query8	0.05	0.05	0.05
query9	0.56	0.50	0.47
query10	0.56	0.54	0.54
query11	0.16	0.13	0.12
query12	0.16	0.12	0.12
query13	0.61	0.59	0.59
query14	0.77	0.80	0.78
query15	0.85	0.83	0.82
query16	0.36	0.38	0.36
query17	1.05	1.04	1.06
query18	0.22	0.21	0.21
query19	1.83	1.80	1.76
query20	0.02	0.01	0.01
query21	15.40	0.66	0.66
query22	4.66	6.51	2.30
query23	18.28	1.52	1.36
query24	2.08	0.24	0.23
query25	0.16	0.09	0.08
query26	0.28	0.19	0.18
query27	0.09	0.08	0.08
query28	13.21	1.04	1.00
query29	12.71	3.46	3.43
query30	0.44	0.24	0.22
query31	2.80	0.39	0.39
query32	3.26	0.49	0.49
query33	2.98	2.98	2.96
query34	16.97	4.35	4.32
query35	4.45	4.42	4.45
query36	0.67	0.48	0.47
query37	0.20	0.17	0.18
query38	0.17	0.16	0.16
query39	0.06	0.05	0.06
query40	0.19	0.15	0.15
query41	0.11	0.06	0.06
query42	0.08	0.07	0.08
query43	0.06	0.06	0.06
Total cold run time: 110.18 s
Total hot run time: 31.61 s

hello-stephen pushed a commit that referenced this pull request Aug 22, 2024
This PR #39680 introduced a wrong test case, exclude it temporarily.
Copy link
Contributor

@hello-stephen hello-stephen left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@github-actions
Copy link
Contributor

PR approved by at least one committer and no changes requested.

@github-actions github-actions bot added approved Indicates a PR has been approved by one committer. reviewed labels Aug 22, 2024
@github-actions
Copy link
Contributor

PR approved by anyone and no changes requested.

Copy link
Contributor

@morningman morningman left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

dataroaring pushed a commit that referenced this pull request Oct 9, 2024
This PR #39680 introduced a wrong test case, exclude it temporarily.
@wsjz wsjz deleted the fix_mc_am branch November 18, 2024 01:18
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

approved Indicates a PR has been approved by one committer. dev/2.1.6-merged dev/3.0.2-merged reviewed

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants