Skip to content

Conversation

@jackwener
Copy link
Member

Proposed changes

Issue Number: close #xxx

Further comments

If this is a relatively large or complex change, kick off the discussion at dev@doris.apache.org by explaining why you chose the solution you did and what alternatives you considered, etc...

@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

@jackwener
Copy link
Member Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 36851 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 5d1d70dd8de7549ae13162ef45a9f8f065531820, data reload: false

------ Round 1 ----------------------------------
q1	17591	4424	4158	4158
q2	2024	154	139	139
q3	10591	948	953	948
q4	5023	753	725	725
q5	7603	2667	2819	2667
q6	193	123	125	123
q7	1220	832	804	804
q8	9482	2054	2089	2054
q9	7240	6475	6461	6461
q10	8160	2471	2483	2471
q11	423	235	216	216
q12	793	296	296	296
q13	17917	3035	3000	3000
q14	273	259	248	248
q15	508	466	453	453
q16	484	398	399	398
q17	946	541	641	541
q18	6812	5864	5859	5859
q19	1585	1390	1419	1390
q20	555	297	285	285
q21	7378	3362	3293	3293
q22	794	322	337	322
Total cold run time: 107595 ms
Total hot run time: 36851 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4097	4087	4119	4087
q2	319	231	236	231
q3	2972	2859	2810	2810
q4	1836	1550	1527	1527
q5	5203	5293	5236	5236
q6	195	118	119	118
q7	2217	1838	1867	1838
q8	3192	3300	3323	3300
q9	8541	8513	8542	8513
q10	6144	3688	3662	3662
q11	537	453	442	442
q12	715	549	565	549
q13	12063	2880	2850	2850
q14	281	257	251	251
q15	504	447	442	442
q16	448	397	403	397
q17	1753	1502	1458	1458
q18	7719	7196	7075	7075
q19	6883	1493	1552	1493
q20	1954	1667	1707	1667
q21	4775	4511	4636	4511
q22	539	442	455	442
Total cold run time: 72887 ms
Total hot run time: 52899 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 186298 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 5d1d70dd8de7549ae13162ef45a9f8f065531820, data reload: false

query1	931	359	350	350
query2	7395	2037	1999	1999
query3	6697	220	211	211
query4	31313	20678	20420	20420
query5	4431	401	413	401
query6	271	202	176	176
query7	4627	287	299	287
query8	223	164	166	164
query9	9916	2264	2219	2219
query10	441	225	239	225
query11	17041	14074	14070	14070
query12	133	88	79	79
query13	1626	427	437	427
query14	11521	10274	11267	10274
query15	247	204	194	194
query16	8101	261	259	259
query17	1943	573	543	543
query18	2103	284	283	283
query19	300	152	153	152
query20	101	86	79	79
query21	201	132	131	131
query22	4622	4416	4423	4416
query23	31818	31195	31072	31072
query24	10740	2884	2827	2827
query25	613	377	377	377
query26	1263	160	155	155
query27	3051	363	353	353
query28	7959	1908	1835	1835
query29	879	622	634	622
query30	305	150	144	144
query31	947	726	717	717
query32	95	57	56	56
query33	781	283	248	248
query34	1034	477	470	470
query35	843	615	594	594
query36	990	888	884	884
query37	131	75	76	75
query38	3297	3161	3107	3107
query39	1422	1368	1376	1368
query40	203	116	110	110
query41	51	47	46	46
query42	103	97	96	96
query43	482	444	440	440
query44	1327	728	698	698
query45	268	258	255	255
query46	1088	687	683	683
query47	1666	1597	1605	1597
query48	456	369	363	363
query49	1144	354	342	342
query50	761	367	370	367
query51	6853	6758	6615	6615
query52	98	89	89	89
query53	341	281	270	270
query54	293	253	231	231
query55	85	89	94	89
query56	254	225	242	225
query57	1064	1000	1023	1000
query58	239	203	210	203
query59	2871	2562	2558	2558
query60	270	253	260	253
query61	113	111	113	111
query62	617	405	414	405
query63	297	274	273	273
query64	5708	3940	3801	3801
query65	3092	3043	2991	2991
query66	1451	320	327	320
query67	14878	14424	14519	14424
query68	8937	529	533	529
query69	624	388	371	371
query70	1269	1178	1187	1178
query71	536	270	272	270
query72	6605	2653	2512	2512
query73	950	317	327	317
query74	8045	6542	6536	6536
query75	9912	8118	7904	7904
query76	5219	936	899	899
query77	644	262	249	249
query78	10389	9574	9622	9574
query79	12255	524	545	524
query80	1658	380	376	376
query81	533	209	207	207
query82	331	199	198	198
query83	218	147	143	143
query84	281	77	78	77
query85	1111	320	319	319
query86	356	285	297	285
query87	3435	3218	3230	3218
query88	5316	2303	2298	2298
query89	484	366	380	366
query90	2053	178	174	174
query91	157	127	146	127
query92	61	55	47	47
query93	6700	505	485	485
query94	1325	175	176	175
query95	424	324	331	324
query96	597	271	276	271
query97	4369	4250	4281	4250
query98	225	207	201	201
query99	1025	804	776	776
Total cold run time: 322469 ms
Total hot run time: 186298 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.28 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 5d1d70dd8de7549ae13162ef45a9f8f065531820, data reload: false

query1	0.04	0.04	0.03
query2	0.06	0.02	0.02
query3	0.23	0.06	0.06
query4	1.67	0.10	0.10
query5	0.52	0.49	0.53
query6	1.19	0.63	0.63
query7	0.01	0.01	0.01
query8	0.03	0.03	0.03
query9	0.56	0.49	0.50
query10	0.55	0.54	0.55
query11	0.12	0.09	0.10
query12	0.11	0.09	0.10
query13	0.57	0.56	0.58
query14	0.72	0.75	0.78
query15	0.81	0.78	0.79
query16	0.38	0.39	0.40
query17	0.95	1.00	0.94
query18	0.18	0.26	0.22
query19	1.80	1.67	1.74
query20	0.02	0.01	0.01
query21	15.43	0.58	0.57
query22	2.50	1.69	1.62
query23	17.24	0.84	0.64
query24	3.25	2.30	2.47
query25	0.27	0.06	0.05
query26	0.82	0.12	0.12
query27	0.03	0.04	0.03
query28	8.85	0.86	0.86
query29	12.52	3.13	3.18
query30	0.68	0.61	0.58
query31	2.80	0.34	0.33
query32	3.40	0.44	0.43
query33	2.77	2.87	2.78
query34	16.09	4.32	4.31
query35	4.32	4.34	4.34
query36	1.07	1.00	1.01
query37	0.08	0.05	0.05
query38	0.04	0.04	0.03
query39	0.02	0.01	0.01
query40	0.16	0.14	0.14
query41	0.07	0.02	0.02
query42	0.03	0.02	0.02
query43	0.03	0.02	0.02
Total cold run time: 102.99 s
Total hot run time: 31.28 s

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit 5d1d70dd8de7549ae13162ef45a9f8f065531820 with default session variables
Stream load json:         19 seconds loaded 2358488459 Bytes, about 118 MB/s
Stream load orc:          59 seconds loaded 1101869774 Bytes, about 17 MB/s
Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select:       13.8 seconds inserted 10000000 Rows, about 724K ops/s

Copy link
Contributor

@morrySnow morrySnow left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

add test case please

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Mar 13, 2024
@github-actions
Copy link
Contributor

PR approved by at least one committer and no changes requested.

@github-actions
Copy link
Contributor

PR approved by anyone and no changes requested.

@jackwener jackwener merged commit ca09213 into apache:master Mar 13, 2024
@jackwener jackwener deleted the time branch March 13, 2024 07:33
jackwener added a commit to jackwener/doris that referenced this pull request Mar 13, 2024
jackwener added a commit to jackwener/doris that referenced this pull request Mar 13, 2024
jackwener added a commit to jackwener/doris that referenced this pull request Mar 19, 2024
jackwener added a commit to jackwener/doris that referenced this pull request Mar 21, 2024
jackwener added a commit to jackwener/doris that referenced this pull request Mar 21, 2024
jackwener added a commit to jackwener/doris that referenced this pull request Mar 21, 2024
jackwener added a commit to jackwener/doris that referenced this pull request Mar 21, 2024
jackwener added a commit that referenced this pull request Mar 21, 2024
jackwener added a commit to jackwener/doris that referenced this pull request Mar 21, 2024
jackwener added a commit that referenced this pull request Mar 22, 2024
* [enhancement](Nereids): support more condition Date/DateTime Literal (#31858)

(cherry picked from commit dbb7573)

* [fix](Nereids): slot set in condition can be empty (#32169)

(cherry picked from commit ca09213)
mongo360 pushed a commit to mongo360/doris that referenced this pull request Aug 16, 2024
* [enhancement](Nereids): support more condition Date/DateTime Literal (apache#31858)

(cherry picked from commit dbb7573)

* [fix](Nereids): slot set in condition can be empty (apache#32169)

(cherry picked from commit ca09213)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

approved Indicates a PR has been approved by one committer. dev/2.0.7-merged reviewed

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants