Skip to content

Conversation

@morrySnow
Copy link
Contributor

pick from master #37889

…apache#37889)

pick from master apache#37889

we use unscaled value of BigDecimal in tablet prune. So we need to
ensure BigDecimal's precision and scale is same with the literal
contains it.
@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@morrySnow
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 49624 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 0e029074ea92680b816ebac9fd67d6d130f821e1, data reload: false

------ Round 1 ----------------------------------
q1	17766	4368	4347	4347
q2	2071	157	143	143
q3	10423	1881	1917	1881
q4	10327	1219	1328	1219
q5	9130	3848	3891	3848
q6	238	125	149	125
q7	2060	1597	1584	1584
q8	9291	2743	2720	2720
q9	10592	10312	10117	10117
q10	8615	3514	3525	3514
q11	421	250	239	239
q12	474	305	310	305
q13	18335	3980	3997	3980
q14	351	326	330	326
q15	508	462	456	456
q16	667	567	573	567
q17	1138	972	983	972
q18	7197	6991	6828	6828
q19	1839	1653	1625	1625
q20	529	314	299	299
q21	4398	4107	4092	4092
q22	518	444	437	437
Total cold run time: 116888 ms
Total hot run time: 49624 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4302	4322	4311	4311
q2	324	217	226	217
q3	4187	4116	4129	4116
q4	2747	2750	2748	2748
q5	7122	7076	7030	7030
q6	239	120	118	118
q7	3212	2829	2813	2813
q8	4318	4454	4489	4454
q9	16886	16708	16698	16698
q10	4195	4267	4245	4245
q11	736	671	666	666
q12	1035	868	830	830
q13	6645	3754	3785	3754
q14	455	432	419	419
q15	502	464	455	455
q16	730	679	676	676
q17	3732	3885	3803	3803
q18	8892	8645	8822	8645
q19	1696	1701	1683	1683
q20	2367	2124	2111	2111
q21	8381	8427	8358	8358
q22	1024	1002	987	987
Total cold run time: 83727 ms
Total hot run time: 79137 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 204100 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 0e029074ea92680b816ebac9fd67d6d130f821e1, data reload: false

query1	934	420	378	378
query2	6549	2911	2683	2683
query3	6931	209	207	207
query4	21528	17994	18047	17994
query5	19733	6529	6605	6529
query6	285	219	230	219
query7	4146	310	316	310
query8	438	438	412	412
query9	3172	2713	2639	2639
query10	422	299	295	295
query11	11302	10563	10691	10563
query12	132	74	74	74
query13	5611	705	722	705
query14	17628	13485	13505	13485
query15	357	249	235	235
query16	6470	281	262	262
query17	1703	1447	888	888
query18	2315	420	420	420
query19	219	150	148	148
query20	74	79	78	78
query21	188	100	95	95
query22	5218	5019	4853	4853
query23	32620	32097	32125	32097
query24	7008	6608	6467	6467
query25	523	419	445	419
query26	531	169	170	169
query27	1846	304	304	304
query28	6165	2404	2325	2325
query29	2962	2717	2764	2717
query30	246	168	173	168
query31	903	744	732	732
query32	71	65	62	62
query33	415	257	247	247
query34	848	483	490	483
query35	1139	940	917	917
query36	1328	1154	1121	1121
query37	93	61	62	61
query38	3096	2906	2907	2906
query39	1369	1333	1322	1322
query40	205	102	94	94
query41	47	44	44	44
query42	89	82	87	82
query43	770	716	703	703
query44	1130	715	714	714
query45	252	234	232	232
query46	1232	968	980	968
query47	1830	1738	1757	1738
query48	1014	728	726	726
query49	636	378	384	378
query50	860	652	657	652
query51	4740	4674	4655	4655
query52	98	84	80	80
query53	448	339	332	332
query54	2658	2455	2461	2455
query55	92	84	91	84
query56	224	209	216	209
query57	1238	1138	1111	1111
query58	227	218	198	198
query59	4302	4071	3926	3926
query60	212	200	234	200
query61	98	94	96	94
query62	840	575	504	504
query63	485	341	343	341
query64	2535	1534	1509	1509
query65	3665	3565	3553	3553
query66	769	384	386	384
query67	15966	15499	15636	15499
query68	10784	660	646	646
query69	573	367	355	355
query70	1972	1390	1351	1351
query71	391	316	317	316
query72	6691	3487	3471	3471
query73	743	325	319	319
query74	6267	5851	5831	5831
query75	5551	3696	3752	3696
query76	7045	1151	1216	1151
query77	1197	265	276	265
query78	12444	11444	11855	11444
query79	7379	647	653	647
query80	929	394	408	394
query81	463	254	239	239
query82	884	99	99	99
query83	181	135	132	132
query84	261	71	70	70
query85	884	337	341	337
query86	328	307	299	299
query87	3281	3065	3088	3065
query88	4598	2364	2359	2359
query89	384	297	292	292
query90	1940	212	217	212
query91	180	140	143	140
query92	59	56	54	54
query93	7032	577	585	577
query94	712	211	213	211
query95	1107	1077	1059	1059
query96	635	339	333	333
query97	6596	6284	6225	6225
query98	190	164	176	164
query99	2995	893	920	893
Total cold run time: 317856 ms
Total hot run time: 204100 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.68 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 0e029074ea92680b816ebac9fd67d6d130f821e1, data reload: false

query1	0.02	0.02	0.02
query2	0.07	0.02	0.02
query3	0.25	0.04	0.04
query4	1.80	0.07	0.07
query5	0.53	0.51	0.52
query6	1.23	0.62	0.62
query7	0.01	0.01	0.01
query8	0.03	0.02	0.02
query9	0.53	0.48	0.48
query10	0.53	0.54	0.53
query11	0.11	0.08	0.09
query12	0.11	0.09	0.09
query13	0.63	0.61	0.62
query14	0.79	0.80	0.78
query15	0.78	0.76	0.78
query16	0.36	0.39	0.39
query17	1.01	1.01	1.02
query18	0.23	0.26	0.21
query19	1.88	1.83	1.86
query20	0.02	0.01	0.01
query21	15.52	0.55	0.59
query22	2.00	2.61	1.65
query23	17.24	1.07	0.89
query24	5.55	1.11	0.91
query25	0.37	0.12	0.06
query26	0.60	0.15	0.14
query27	0.04	0.05	0.04
query28	7.60	0.73	0.77
query29	12.76	2.31	2.28
query30	0.55	0.58	0.54
query31	2.83	0.37	0.38
query32	3.38	0.51	0.50
query33	3.04	3.07	3.04
query34	15.25	4.81	4.80
query35	4.84	4.86	4.84
query36	1.05	1.02	1.01
query37	0.06	0.04	0.05
query38	0.03	0.02	0.02
query39	0.02	0.01	0.02
query40	0.16	0.14	0.15
query41	0.07	0.02	0.01
query42	0.02	0.01	0.01
query43	0.03	0.01	0.01
Total cold run time: 103.93 s
Total hot run time: 30.68 s

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit 0e029074ea92680b816ebac9fd67d6d130f821e1 with default session variables
Stream load json:         19 seconds loaded 2358488459 Bytes, about 118 MB/s
Stream load orc:          59 seconds loaded 1101869774 Bytes, about 17 MB/s
Stream load parquet:      32 seconds loaded 861443392 Bytes, about 25 MB/s
Insert into select:       21.3 seconds inserted 10000000 Rows, about 469K ops/s

@morrySnow morrySnow merged commit 97d2d82 into apache:branch-2.0 Jul 24, 2024
mongo360 pushed a commit to mongo360/doris that referenced this pull request Aug 16, 2024
@morrySnow morrySnow deleted the 2.0_37889 branch September 18, 2024 03:02
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants