Skip to content

Conversation

@morrySnow
Copy link
Contributor

pick from master #39850

because consumer could refer multi times for one producer' slot, so producer to consumer slot map should be multimap

…#39850)

pick from master apache#39850

because consumer could refer multi times for one producer' slot, so producer to consumer slot map should be multimap
@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@morrySnow
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 49195 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit eb9dfdd15d636af9f9cdb36600f39dea6946d899, data reload: false

------ Round 1 ----------------------------------
q1	17824	4407	4332	4332
q2	2099	155	145	145
q3	10318	1946	1950	1946
q4	10110	1306	1324	1306
q5	8415	3979	3920	3920
q6	225	124	118	118
q7	2109	1607	1608	1607
q8	9498	2763	2732	2732
q9	13732	9912	9725	9725
q10	8658	3552	3500	3500
q11	418	246	248	246
q12	472	305	305	305
q13	18350	3972	4039	3972
q14	357	328	326	326
q15	512	463	452	452
q16	548	448	456	448
q17	1140	965	970	965
q18	7170	6830	6990	6830
q19	1707	1546	1543	1543
q20	554	304	305	304
q21	4433	4106	4080	4080
q22	492	393	405	393
Total cold run time: 119141 ms
Total hot run time: 49195 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4297	4341	4301	4301
q2	319	225	222	222
q3	4205	4142	4139	4139
q4	2758	2755	2757	2755
q5	7179	7124	7087	7087
q6	241	122	123	122
q7	3182	2870	2873	2870
q8	4398	4477	4477	4477
q9	13727	13626	13641	13626
q10	4274	4299	4297	4297
q11	734	697	705	697
q12	1007	850	857	850
q13	7137	3717	3733	3717
q14	471	431	436	431
q15	504	462	453	453
q16	627	590	570	570
q17	3836	3834	3853	3834
q18	8877	8779	8774	8774
q19	1731	1702	1690	1690
q20	2372	2157	2097	2097
q21	8512	8525	8546	8525
q22	1065	946	943	943
Total cold run time: 81453 ms
Total hot run time: 76477 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 212278 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit eb9dfdd15d636af9f9cdb36600f39dea6946d899, data reload: false

query1	948	392	433	392
query2	6545	2390	2169	2169
query3	6919	218	213	213
query4	24013	21496	21354	21354
query5	19802	6549	6521	6521
query6	283	222	224	222
query7	4294	296	321	296
query8	266	285	272	272
query9	3062	2628	2553	2553
query10	454	321	307	307
query11	15797	14871	14928	14871
query12	128	85	75	75
query13	1038	438	433	433
query14	17152	13239	14151	13239
query15	372	223	233	223
query16	6479	294	266	266
query17	1887	940	920	920
query18	896	317	317	317
query19	218	150	169	150
query20	72	77	78	77
query21	190	102	102	102
query22	5328	5124	5120	5120
query23	34353	33687	33650	33650
query24	7777	6262	6281	6262
query25	527	437	425	425
query26	1269	166	167	166
query27	2366	295	294	294
query28	6076	2235	2217	2217
query29	2963	2765	2917	2765
query30	253	168	174	168
query31	961	710	738	710
query32	73	64	59	59
query33	457	275	261	261
query34	873	481	473	473
query35	1110	918	945	918
query36	1158	1094	991	991
query37	174	57	59	57
query38	3079	2946	2924	2924
query39	1377	1350	1321	1321
query40	315	95	97	95
query41	39	37	36	36
query42	81	87	77	77
query43	619	582	574	574
query44	1165	724	724	724
query45	245	235	229	229
query46	1233	979	929	929
query47	2057	1738	1783	1738
query48	506	420	410	410
query49	663	382	386	382
query50	849	595	619	595
query51	4738	4665	4600	4600
query52	88	85	84	84
query53	231	184	185	184
query54	2658	2469	2458	2458
query55	84	82	83	82
query56	225	221	208	208
query57	1283	1176	1250	1176
query58	213	212	202	202
query59	3573	3058	3397	3058
query60	223	208	199	199
query61	99	96	102	96
query62	818	439	448	439
query63	198	171	173	171
query64	3508	1676	1454	1454
query65	3610	3559	3553	3553
query66	772	400	421	400
query67	15771	17585	15341	15341
query68	9212	678	641	641
query69	485	250	262	250
query70	1712	1427	1646	1427
query71	394	306	315	306
query72	6728	4931	4787	4787
query73	770	327	337	327
query74	6333	5833	5824	5824
query75	4539	3752	3637	3637
query76	4680	1132	1157	1132
query77	630	258	265	258
query78	13646	11821	12271	11821
query79	11234	638	646	638
query80	801	388	375	375
query81	502	243	233	233
query82	697	95	97	95
query83	180	137	141	137
query84	257	73	69	69
query85	806	325	322	322
query86	326	285	301	285
query87	3286	3071	2975	2975
query88	5116	2389	2407	2389
query89	366	318	279	279
query90	2162	214	218	214
query91	157	133	137	133
query92	58	51	55	51
query93	4183	579	532	532
query94	951	216	215	215
query95	2011	2002	2047	2002
query96	662	339	336	336
query97	6499	6371	6258	6258
query98	219	219	211	211
query99	2992	872	893	872
Total cold run time: 319447 ms
Total hot run time: 212278 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.4 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit eb9dfdd15d636af9f9cdb36600f39dea6946d899, data reload: false

query1	0.02	0.03	0.02
query2	0.08	0.03	0.02
query3	0.25	0.05	0.06
query4	1.78	0.07	0.07
query5	0.54	0.53	0.58
query6	1.26	0.62	0.65
query7	0.01	0.02	0.02
query8	0.04	0.03	0.02
query9	0.53	0.50	0.48
query10	0.52	0.54	0.51
query11	0.13	0.08	0.08
query12	0.11	0.09	0.09
query13	0.63	0.62	0.61
query14	0.80	0.78	0.79
query15	0.78	0.77	0.75
query16	0.38	0.37	0.36
query17	0.98	1.00	1.01
query18	0.23	0.25	0.25
query19	1.90	1.88	1.78
query20	0.01	0.01	0.01
query21	15.45	0.57	0.55
query22	1.94	2.12	1.46
query23	16.68	0.99	0.95
query24	4.85	0.86	2.67
query25	0.45	0.12	0.05
query26	0.63	0.16	0.15
query27	0.05	0.04	0.04
query28	7.09	0.77	0.72
query29	12.59	2.30	2.29
query30	0.68	0.53	0.52
query31	2.82	0.39	0.37
query32	3.38	0.50	0.49
query33	3.12	3.05	3.06
query34	15.23	4.81	4.76
query35	4.85	4.87	4.83
query36	1.10	1.01	1.01
query37	0.06	0.05	0.04
query38	0.03	0.02	0.02
query39	0.02	0.02	0.01
query40	0.17	0.14	0.14
query41	0.06	0.01	0.01
query42	0.02	0.01	0.02
query43	0.02	0.02	0.02
Total cold run time: 102.27 s
Total hot run time: 30.4 s

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit eb9dfdd15d636af9f9cdb36600f39dea6946d899 with default session variables
Stream load json:         20 seconds loaded 2358488459 Bytes, about 112 MB/s
Stream load orc:          58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select:       21.2 seconds inserted 10000000 Rows, about 471K ops/s

@morrySnow morrySnow merged commit 770e1fd into apache:branch-2.0 Sep 9, 2024
@morrySnow morrySnow deleted the cte branch September 9, 2024 10:37
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants