Skip to content

Conversation

@zzzxl1993
Copy link
Contributor

@zzzxl1993 zzzxl1993 commented Apr 18, 2024

…dex is missing

Proposed changes

#33663

Further comments

If this is a relatively large or complex change, kick off the discussion at dev@doris.apache.org by explaining why you chose the solution you did and what alternatives you considered, etc...

@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@zzzxl1993
Copy link
Contributor Author

run buildall

@github-actions
Copy link
Contributor

clang-tidy review says "All clean, LGTM! 👍"

@doris-robot
Copy link

TPC-H: Total hot run time: 49756 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 4d54c6fb335655ea85c342c794fbbe173b66339d, data reload: false

------ Round 1 ----------------------------------
q1	17745	4456	4311	4311
q2	2040	147	141	141
q3	10450	1894	1895	1894
q4	10306	1230	1341	1230
q5	8467	3983	3935	3935
q6	229	123	122	122
q7	2024	1607	1575	1575
q8	9301	2706	2708	2706
q9	10762	10393	10358	10358
q10	8633	3529	3499	3499
q11	430	233	243	233
q12	456	300	310	300
q13	18339	3972	3986	3972
q14	351	331	326	326
q15	516	467	462	462
q16	693	584	572	572
q17	1137	948	957	948
q18	7376	6898	7021	6898
q19	1687	1572	1521	1521
q20	543	315	289	289
q21	4459	4085	4061	4061
q22	509	403	403	403
Total cold run time: 116453 ms
Total hot run time: 49756 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4301	4307	4299	4299
q2	316	222	215	215
q3	4149	4143	4100	4100
q4	2736	2719	2766	2719
q5	7230	7152	7117	7117
q6	236	118	120	118
q7	3189	2819	2806	2806
q8	4342	4431	4471	4431
q9	17120	16848	16980	16848
q10	4204	4211	4275	4211
q11	761	695	657	657
q12	1034	840	833	833
q13	6889	3700	3743	3700
q14	455	427	426	426
q15	488	454	462	454
q16	772	692	691	691
q17	3773	3842	3874	3842
q18	8727	8610	8775	8610
q19	1695	1706	1648	1648
q20	2383	2143	2089	2089
q21	8377	8489	8481	8481
q22	1074	983	944	944
Total cold run time: 84251 ms
Total hot run time: 79239 ms

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 37.83% (8065/21318)
Line Coverage: 29.50% (65881/223301)
Region Coverage: 28.95% (33907/117132)
Branch Coverage: 24.81% (17411/70170)
Coverage Report: http://coverage.selectdb-in.cc/coverage/4d54c6fb335655ea85c342c794fbbe173b66339d_4d54c6fb335655ea85c342c794fbbe173b66339d/report/index.html

@doris-robot
Copy link

TPC-DS: Total hot run time: 201030 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 4d54c6fb335655ea85c342c794fbbe173b66339d, data reload: false

query1	936	391	379	379
query2	6517	2279	2134	2134
query3	6912	206	204	204
query4	20111	17877	18009	17877
query5	19712	6518	6520	6518
query6	303	219	220	219
query7	4145	293	292	292
query8	244	229	272	229
query9	3158	2704	2618	2618
query10	450	311	290	290
query11	11321	10757	10838	10757
query12	126	74	71	71
query13	5574	652	622	622
query14	17897	13514	13107	13107
query15	362	230	244	230
query16	6446	274	257	257
query17	1755	1459	871	871
query18	2312	408	407	407
query19	205	143	147	143
query20	79	81	74	74
query21	190	90	92	90
query22	5334	4927	5101	4927
query23	32539	31945	31898	31898
query24	6894	6532	6540	6532
query25	521	423	425	423
query26	523	163	157	157
query27	1875	294	290	290
query28	6135	2198	2174	2174
query29	2852	2711	2667	2667
query30	238	161	159	159
query31	903	761	736	736
query32	70	59	58	58
query33	383	254	252	252
query34	859	459	468	459
query35	1108	909	882	882
query36	1209	1243	1360	1243
query37	92	65	62	62
query38	3087	2887	2921	2887
query39	1375	1303	1320	1303
query40	207	92	101	92
query41	35	32	32	32
query42	87	91	87	87
query43	659	697	647	647
query44	1154	731	725	725
query45	243	229	229	229
query46	1222	975	954	954
query47	1887	1740	1940	1740
query48	985	692	692	692
query49	637	364	365	364
query50	858	609	596	596
query51	4737	4655	4602	4602
query52	94	87	78	78
query53	439	320	313	313
query54	2624	2459	2458	2458
query55	87	86	87	86
query56	221	215	207	207
query57	1163	1342	1086	1086
query58	213	182	191	182
query59	3582	3309	3098	3098
query60	216	183	201	183
query61	87	83	85	83
query62	799	473	535	473
query63	471	343	337	337
query64	2326	1463	1425	1425
query65	3654	3556	3581	3556
query66	824	376	368	368
query67	15912	15615	15275	15275
query68	8760	658	678	658
query69	560	339	342	339
query70	1507	1593	1329	1329
query71	386	306	318	306
query72	6451	3480	3435	3435
query73	738	322	323	322
query74	6267	5902	5843	5843
query75	5229	3672	3699	3672
query76	5159	1178	1211	1178
query77	858	244	263	244
query78	12637	11424	11647	11424
query79	8344	638	640	638
query80	1583	402	392	392
query81	493	239	229	229
query82	1634	95	102	95
query83	169	134	134	134
query84	255	67	66	66
query85	850	286	282	282
query86	323	310	335	310
query87	3225	3041	2989	2989
query88	4907	2328	2338	2328
query89	389	297	312	297
query90	1966	210	211	210
query91	150	114	115	114
query92	55	51	51	51
query93	6656	578	589	578
query94	732	208	203	203
query95	1115	1088	1063	1063
query96	635	330	329	329
query97	6521	6421	6434	6421
query98	176	168	166	166
query99	2975	919	921	919
Total cold run time: 311880 ms
Total hot run time: 201030 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.26 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 4d54c6fb335655ea85c342c794fbbe173b66339d, data reload: false

query1	0.02	0.03	0.02
query2	0.06	0.02	0.02
query3	0.25	0.05	0.04
query4	1.81	0.07	0.08
query5	0.53	0.53	0.52
query6	1.23	0.61	0.61
query7	0.01	0.01	0.01
query8	0.03	0.02	0.03
query9	0.51	0.48	0.48
query10	0.54	0.54	0.53
query11	0.12	0.09	0.08
query12	0.11	0.09	0.09
query13	0.62	0.61	0.61
query14	0.76	0.80	0.78
query15	0.78	0.76	0.76
query16	0.36	0.38	0.37
query17	1.02	1.02	1.03
query18	0.23	0.26	0.26
query19	1.91	1.84	1.89
query20	0.02	0.00	0.01
query21	15.49	0.55	0.54
query22	1.92	2.48	1.53
query23	16.74	0.95	0.96
query24	5.25	0.65	0.82
query25	0.28	0.07	0.07
query26	0.66	0.16	0.16
query27	0.04	0.04	0.04
query28	8.38	0.73	0.69
query29	12.78	2.23	2.36
query30	0.55	0.53	0.53
query31	2.82	0.38	0.38
query32	3.39	0.49	0.50
query33	3.05	3.08	3.01
query34	15.25	4.79	4.76
query35	4.84	4.85	4.85
query36	1.06	0.99	1.00
query37	0.06	0.04	0.05
query38	0.04	0.02	0.02
query39	0.02	0.02	0.02
query40	0.17	0.13	0.14
query41	0.07	0.01	0.02
query42	0.02	0.02	0.02
query43	0.02	0.02	0.02
Total cold run time: 103.82 s
Total hot run time: 30.26 s

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit 4d54c6fb335655ea85c342c794fbbe173b66339d with default session variables
Stream load json:         20 seconds loaded 2358488459 Bytes, about 112 MB/s
Stream load orc:          58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet:      32 seconds loaded 861443392 Bytes, about 25 MB/s
Insert into select:       20.4 seconds inserted 10000000 Rows, about 490K ops/s

@xiaokang xiaokang changed the title [fix](inverted index) normal process query for null condition when in… [fix](inverted index) normal process query for null condition when index is missing Apr 18, 2024
@xiaokang xiaokang merged commit 67dfa39 into apache:branch-2.0 Apr 18, 2024
mongo360 pushed a commit to mongo360/doris that referenced this pull request Aug 16, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants