Skip to content

Conversation

@zzzxl1993
Copy link
Contributor

@zzzxl1993 zzzxl1993 commented Jun 18, 2024

pick from #36292

@zzzxl1993
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@github-actions
Copy link
Contributor

clang-tidy review says "All clean, LGTM! 👍"

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 37.78% (8092/21416)
Line Coverage: 29.43% (66115/224663)
Region Coverage: 28.90% (34073/117913)
Branch Coverage: 24.77% (17491/70624)
Coverage Report: http://coverage.selectdb-in.cc/coverage/7c70299653022f4d0292cc1d045b7da8cd41d692_7c70299653022f4d0292cc1d045b7da8cd41d692/report/index.html

@doris-robot
Copy link

TPC-H: Total hot run time: 49833 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 7c70299653022f4d0292cc1d045b7da8cd41d692, data reload: false

------ Round 1 ----------------------------------
q1	17628	4451	4374	4374
q2	2095	161	150	150
q3	10441	1923	1900	1900
q4	10402	1262	1286	1262
q5	8519	3891	3902	3891
q6	232	148	127	127
q7	2044	1603	1606	1603
q8	9493	2742	2716	2716
q9	13753	10179	10191	10179
q10	8622	3491	3500	3491
q11	412	249	251	249
q12	471	315	306	306
q13	18335	3944	4057	3944
q14	357	328	331	328
q15	521	467	460	460
q16	664	575	581	575
q17	1132	948	923	923
q18	7213	6985	6963	6963
q19	1778	1667	1595	1595
q20	564	322	294	294
q21	4419	4120	4061	4061
q22	538	442	446	442
Total cold run time: 119633 ms
Total hot run time: 49833 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4345	4295	4343	4295
q2	319	226	224	224
q3	4156	4138	4144	4138
q4	2759	2752	2755	2752
q5	7096	7076	7077	7076
q6	243	122	118	118
q7	3234	2884	2810	2810
q8	4402	4476	4489	4476
q9	16864	16759	16570	16570
q10	4264	4233	4268	4233
q11	767	708	719	708
q12	1036	854	837	837
q13	6984	3721	3773	3721
q14	450	426	414	414
q15	510	460	457	457
q16	744	681	691	681
q17	3800	3781	3847	3781
q18	8764	8755	8805	8755
q19	1755	1691	1672	1672
q20	2371	2119	2087	2087
q21	8404	8505	8457	8457
q22	1056	956	966	956
Total cold run time: 84323 ms
Total hot run time: 79218 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 204163 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 7c70299653022f4d0292cc1d045b7da8cd41d692, data reload: false

query1	943	425	382	382
query2	6536	2883	2569	2569
query3	6921	211	202	202
query4	20963	18015	18012	18012
query5	19742	6504	6580	6504
query6	312	218	232	218
query7	4155	301	302	301
query8	448	433	394	394
query9	3112	2673	2604	2604
query10	418	302	300	300
query11	11275	10619	10733	10619
query12	124	80	78	78
query13	5596	707	686	686
query14	18239	13797	13425	13425
query15	371	251	256	251
query16	6438	277	262	262
query17	1711	1448	873	873
query18	2312	431	435	431
query19	208	151	155	151
query20	74	78	80	78
query21	193	104	93	93
query22	4995	4989	4955	4955
query23	32609	32064	32048	32048
query24	6921	6519	6515	6515
query25	536	432	417	417
query26	530	161	163	161
query27	1867	295	296	295
query28	6158	2363	2322	2322
query29	2863	2808	2693	2693
query30	247	167	173	167
query31	913	766	756	756
query32	68	68	65	65
query33	400	248	264	248
query34	853	476	487	476
query35	1137	895	914	895
query36	1183	1224	1188	1188
query37	90	60	57	57
query38	3096	2936	2930	2930
query39	1390	1350	1319	1319
query40	211	95	90	90
query41	46	47	44	44
query42	81	78	88	78
query43	814	632	723	632
query44	1130	735	742	735
query45	248	237	243	237
query46	1253	971	957	957
query47	1812	1722	1740	1722
query48	1002	717	710	710
query49	620	373	375	373
query50	861	605	626	605
query51	4775	4643	4619	4619
query52	101	81	88	81
query53	456	325	330	325
query54	2835	2448	2486	2448
query55	96	87	83	83
query56	235	221	205	205
query57	1292	1255	1061	1061
query58	212	198	201	198
query59	4353	3579	4050	3579
query60	221	201	204	201
query61	98	95	99	95
query62	840	505	485	485
query63	495	345	358	345
query64	2359	1520	1508	1508
query65	3636	3556	3544	3544
query66	810	379	384	379
query67	16871	16874	15565	15565
query68	8439	664	649	649
query69	571	351	355	351
query70	1648	1458	1611	1458
query71	396	302	319	302
query72	6590	3498	3498	3498
query73	745	337	328	328
query74	6293	5858	5821	5821
query75	4784	3627	3664	3627
query76	4796	1182	1173	1173
query77	665	250	252	250
query78	12570	12651	12232	12232
query79	10957	654	638	638
query80	760	405	395	395
query81	473	231	247	231
query82	581	106	96	96
query83	190	136	138	136
query84	249	75	73	73
query85	776	320	322	320
query86	321	305	309	305
query87	3268	3018	3061	3018
query88	4713	2307	2280	2280
query89	433	284	317	284
query90	2667	207	216	207
query91	177	137	144	137
query92	59	45	53	45
query93	6450	549	579	549
query94	1368	212	217	212
query95	1077	1058	1070	1058
query96	660	328	324	324
query97	6415	6286	6384	6286
query98	185	178	175	175
query99	2814	907	861	861
Total cold run time: 315800 ms
Total hot run time: 204163 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.14 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 7c70299653022f4d0292cc1d045b7da8cd41d692, data reload: false

query1	0.03	0.02	0.02
query2	0.07	0.02	0.02
query3	0.24	0.04	0.05
query4	1.80	0.06	0.07
query5	0.53	0.53	0.52
query6	1.25	0.60	0.61
query7	0.01	0.01	0.01
query8	0.03	0.03	0.02
query9	0.52	0.48	0.48
query10	0.54	0.54	0.53
query11	0.12	0.08	0.08
query12	0.11	0.10	0.09
query13	0.61	0.60	0.60
query14	0.78	0.78	0.79
query15	0.77	0.76	0.75
query16	0.39	0.36	0.36
query17	1.00	1.03	1.02
query18	0.24	0.24	0.25
query19	1.91	1.83	1.86
query20	0.02	0.01	0.01
query21	15.47	0.57	0.55
query22	2.01	2.94	1.65
query23	17.42	1.00	1.20
query24	7.00	1.52	1.28
query25	0.40	0.11	0.06
query26	0.75	0.16	0.16
query27	0.04	0.04	0.04
query28	5.45	0.74	0.73
query29	12.78	2.38	2.31
query30	0.59	0.50	0.55
query31	2.82	0.39	0.38
query32	3.37	0.50	0.50
query33	3.08	3.08	3.07
query34	15.27	4.81	4.78
query35	4.87	4.86	4.82
query36	1.06	1.00	1.01
query37	0.06	0.04	0.05
query38	0.04	0.02	0.02
query39	0.02	0.02	0.02
query40	0.17	0.14	0.14
query41	0.08	0.01	0.02
query42	0.02	0.01	0.01
query43	0.02	0.01	0.02
Total cold run time: 103.76 s
Total hot run time: 31.14 s

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit 7c70299653022f4d0292cc1d045b7da8cd41d692 with default session variables
Stream load json:         20 seconds loaded 2358488459 Bytes, about 112 MB/s
Stream load orc:          58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select:       21.9 seconds inserted 10000000 Rows, about 456K ops/s

@xiaokang xiaokang changed the title [fix](inverted index) fix the issue where need_read_data does not han… [fix](inverted index) fix the issue where need_read_data does not handle non-pushdown conditions Jun 19, 2024
@xiaokang xiaokang merged commit e065f34 into apache:branch-2.0 Jun 19, 2024
mongo360 pushed a commit to mongo360/doris that referenced this pull request Aug 16, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants