Skip to content

Conversation

@jackwener
Copy link
Member

Proposed changes

Issue Number: close #xxx

Further comments

If this is a relatively large or complex change, kick off the discussion at dev@doris.apache.org by explaining why you chose the solution you did and what alternatives you considered, etc...

@jackwener
Copy link
Member Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 37000 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 406a454792a4e88bdad993c626e0f5879a23aa48, data reload: false

------ Round 1 ----------------------------------
q1	17712	4965	4391	4391
q2	2037	139	126	126
q3	10875	904	904	904
q4	4693	675	715	675
q5	7690	2709	2785	2709
q6	183	119	117	117
q7	1142	715	714	714
q8	9430	2033	2017	2017
q9	7276	6370	6365	6365
q10	8109	2412	2418	2412
q11	414	202	207	202
q12	732	293	285	285
q13	18220	3327	3330	3327
q14	277	244	256	244
q15	528	483	489	483
q16	467	434	413	413
q17	943	540	534	534
q18	6718	5990	6030	5990
q19	1567	1370	1380	1370
q20	583	327	340	327
q21	7163	3119	3074	3074
q22	824	321	325	321
Total cold run time: 107583 ms
Total hot run time: 37000 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4646	4667	4402	4402
q2	339	244	241	241
q3	3190	2961	3017	2961
q4	1959	1731	1738	1731
q5	5315	5338	5340	5338
q6	199	125	119	119
q7	2178	1724	1790	1724
q8	3120	3243	3289	3243
q9	8320	8278	8305	8278
q10	5891	3534	3566	3534
q11	543	464	459	459
q12	759	592	586	586
q13	16901	3063	3033	3033
q14	274	253	261	253
q15	532	484	479	479
q16	528	470	453	453
q17	1837	1670	1697	1670
q18	7914	7758	7572	7572
q19	9967	1546	1474	1474
q20	2094	1901	1882	1882
q21	4722	4504	4567	4504
q22	532	455	463	455
Total cold run time: 81760 ms
Total hot run time: 54391 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 172531 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 406a454792a4e88bdad993c626e0f5879a23aa48, data reload: false

query1	941	334	335	334
query2	6549	2040	1942	1942
query3	6703	209	205	205
query4	27161	22021	22073	22021
query5	4458	362	419	362
query6	249	154	159	154
query7	4640	264	259	259
query8	247	181	167	167
query9	9083	2222	2215	2215
query10	408	216	194	194
query11	16853	15320	15334	15320
query12	116	67	63	63
query13	1676	364	365	364
query14	9318	6648	6539	6539
query15	227	180	182	180
query16	6508	253	256	253
query17	1908	476	461	461
query18	1934	254	247	247
query19	198	134	133	133
query20	68	63	69	63
query21	195	125	123	123
query22	4957	4592	4387	4387
query23	31177	30310	30270	30270
query24	11083	2755	2755	2755
query25	533	311	303	303
query26	827	133	131	131
query27	2841	279	282	279
query28	6084	1837	1813	1813
query29	916	620	614	614
query30	276	134	136	134
query31	898	706	727	706
query32	90	49	48	48
query33	597	207	204	204
query34	810	461	448	448
query35	851	765	738	738
query36	1333	1193	1167	1167
query37	90	58	59	58
query38	3283	3160	3158	3158
query39	1301	1245	1244	1244
query40	194	93	80	80
query41	36	36	33	33
query42	84	85	83	83
query43	519	481	487	481
query44	1021	676	679	676
query45	190	177	170	170
query46	1045	642	637	637
query47	1515	1533	1501	1501
query48	372	306	313	306
query49	1114	275	283	275
query50	678	308	308	308
query51	5241	5180	5175	5175
query52	103	77	79	77
query53	326	265	249	249
query54	242	181	194	181
query55	74	71	73	71
query56	180	161	167	161
query57	962	890	891	890
query58	173	151	152	151
query59	2451	2458	2432	2432
query60	195	168	174	168
query61	82	82	79	79
query62	648	370	357	357
query63	283	259	275	259
query64	4301	1736	1705	1705
query65	3298	3198	3200	3198
query66	1138	320	315	315
query67	14510	14318	14138	14138
query68	4289	492	496	492
query69	436	305	313	305
query70	1582	1554	1503	1503
query71	294	216	215	215
query72	3799	2844	2850	2844
query73	691	320	308	308
query74	6662	6197	6226	6197
query75	2806	2286	2318	2286
query76	2914	950	988	950
query77	381	227	230	227
query78	9081	8728	8534	8534
query79	2035	504	493	493
query80	1321	321	315	315
query81	540	209	196	196
query82	660	85	78	78
query83	218	113	118	113
query84	228	73	75	73
query85	2064	315	334	315
query86	510	348	388	348
query87	3492	3264	3304	3264
query88	3844	2282	2264	2264
query89	420	362	362	362
query90	1907	188	191	188
query91	146	116	117	116
query92	57	41	45	41
query93	2015	414	402	402
query94	1386	153	154	153
query95	475	446	436	436
query96	628	328	324	324
query97	4302	4105	4143	4105
query98	203	203	213	203
query99	1051	670	669	669
Total cold run time: 268799 ms
Total hot run time: 172531 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.19 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 406a454792a4e88bdad993c626e0f5879a23aa48, data reload: false

query1	0.04	0.03	0.03
query2	0.06	0.02	0.02
query3	0.23	0.06	0.06
query4	1.70	0.10	0.10
query5	0.53	0.51	0.52
query6	1.19	0.63	0.64
query7	0.01	0.01	0.01
query8	0.04	0.02	0.02
query9	0.54	0.49	0.50
query10	0.54	0.54	0.55
query11	0.13	0.08	0.08
query12	0.11	0.09	0.09
query13	0.61	0.60	0.61
query14	0.77	0.80	0.79
query15	0.79	0.77	0.78
query16	0.38	0.38	0.38
query17	1.00	0.98	1.03
query18	0.22	0.28	0.23
query19	1.86	1.78	1.70
query20	0.01	0.01	0.02
query21	15.43	0.56	0.58
query22	2.76	2.65	2.10
query23	17.12	0.79	0.87
query24	2.46	1.20	1.37
query25	0.47	0.09	0.19
query26	0.51	0.13	0.13
query27	0.05	0.05	0.05
query28	11.00	0.85	0.84
query29	12.55	3.04	3.05
query30	0.61	0.54	0.58
query31	2.79	0.34	0.34
query32	3.37	0.48	0.49
query33	3.22	3.23	3.19
query34	15.81	4.28	4.26
query35	4.23	4.25	4.24
query36	1.11	1.07	1.05
query37	0.06	0.05	0.05
query38	0.03	0.02	0.03
query39	0.01	0.02	0.01
query40	0.16	0.13	0.13
query41	0.06	0.01	0.02
query42	0.02	0.02	0.01
query43	0.03	0.02	0.02
Total cold run time: 104.62 s
Total hot run time: 31.19 s

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit 406a454792a4e88bdad993c626e0f5879a23aa48 with default session variables
Stream load json:         19 seconds loaded 2358488459 Bytes, about 118 MB/s
Stream load orc:          58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet:      32 seconds loaded 861443392 Bytes, about 25 MB/s
Insert into select:       13.5 seconds inserted 10000000 Rows, about 740K ops/s

@github-actions
Copy link
Contributor

PR approved by anyone and no changes requested.

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Jan 30, 2024
@github-actions
Copy link
Contributor

PR approved by at least one committer and no changes requested.

@yiguolei yiguolei merged commit ab5bddb into apache:master Jan 30, 2024
jackwener added a commit to jackwener/doris that referenced this pull request Feb 5, 2024
jackwener added a commit that referenced this pull request Feb 5, 2024
* [enhance](Nereids): support DateLiteral with suffix space (#30583)

(cherry picked from commit ab5bddb)

* [enhancement](Nereids): datetime support microsecond overflow (#30744)

(cherry picked from commit 3c62063)
jackwener added a commit to jackwener/doris that referenced this pull request Feb 6, 2024
mongo360 pushed a commit to mongo360/doris that referenced this pull request Aug 16, 2024
* [enhance](Nereids): support DateLiteral with suffix space (apache#30583)

(cherry picked from commit ab5bddb)

* [enhancement](Nereids): datetime support microsecond overflow (apache#30744)

(cherry picked from commit 3c62063)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

approved Indicates a PR has been approved by one committer. dev/2.0.5-merged reviewed

Projects

None yet

Development

Successfully merging this pull request may close these issues.

7 participants