Skip to content

Conversation

@zddr
Copy link
Contributor

@zddr zddr commented Aug 13, 2024

if base table have 3 partitions:

 PARTITION p_20200101 VALUES [("2020-01-01"),("2020-01-02")),
  PARTITION p_20200102 VALUES [("2020-01-02"),("2020-01-03")),
  PARTITION p_20200108 VALUES [("2020-01-08"),("2020-01-09"))

mtmv partition date_trunc(week)

mtmv will have 2 partitions

[("2019-12-30"),("2020-01-06"))
[("2020-01-06"),("2020-01-13"))

@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@zddr
Copy link
Contributor Author

zddr commented Aug 13, 2024

run buildall

@github-actions github-actions bot added the doing label Aug 13, 2024
@doris-robot
Copy link

TPC-H: Total hot run time: 39866 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit a56e0d4c1c3a255266f0bc40ed5b5fe0a6e39ce1, data reload: false

------ Round 1 ----------------------------------
q1	17637	4390	4305	4305
q2	2016	179	194	179
q3	11732	1015	1086	1015
q4	10529	739	697	697
q5	7764	2800	2773	2773
q6	223	140	141	140
q7	969	589	587	587
q8	9312	2058	2027	2027
q9	8562	6539	6527	6527
q10	7002	2274	2184	2184
q11	453	246	254	246
q12	387	224	228	224
q13	18890	2994	2995	2994
q14	284	235	243	235
q15	527	479	485	479
q16	484	410	382	382
q17	962	652	728	652
q18	8161	7464	7400	7400
q19	4953	1061	1064	1061
q20	712	338	336	336
q21	5517	4999	4422	4422
q22	1124	1035	1001	1001
Total cold run time: 118200 ms
Total hot run time: 39866 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4400	4257	4259	4257
q2	371	268	263	263
q3	2853	2783	2799	2783
q4	2009	1670	1753	1670
q5	5669	5600	5547	5547
q6	216	131	134	131
q7	2149	1758	1771	1758
q8	3266	3434	3403	3403
q9	8734	8918	8811	8811
q10	3579	3174	3194	3174
q11	607	532	499	499
q12	810	646	677	646
q13	17085	3165	3202	3165
q14	318	288	289	288
q15	526	495	480	480
q16	497	473	440	440
q17	1827	1536	1518	1518
q18	8134	8021	7867	7867
q19	5021	1459	1719	1459
q20	2103	1885	1882	1882
q21	5542	5285	5301	5285
q22	1145	1063	1008	1008
Total cold run time: 76861 ms
Total hot run time: 56334 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 189468 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit a56e0d4c1c3a255266f0bc40ed5b5fe0a6e39ce1, data reload: false

query1	1242	888	860	860
query2	6352	1894	1787	1787
query3	10599	3963	3918	3918
query4	59265	23964	23080	23080
query5	5589	489	498	489
query6	495	161	166	161
query7	6438	300	292	292
query8	305	201	204	201
query9	8918	2409	2396	2396
query10	510	271	251	251
query11	17802	15020	14974	14974
query12	168	99	105	99
query13	1616	392	392	392
query14	11938	7621	7756	7621
query15	250	177	168	168
query16	7678	473	484	473
query17	1160	571	547	547
query18	2114	292	305	292
query19	289	155	156	155
query20	118	109	111	109
query21	239	111	104	104
query22	4466	4253	4181	4181
query23	34136	33187	33229	33187
query24	5534	2883	2828	2828
query25	530	374	378	374
query26	691	163	157	157
query27	1798	268	277	268
query28	3784	2040	2037	2037
query29	701	403	405	403
query30	232	152	144	144
query31	924	717	729	717
query32	79	52	55	52
query33	444	272	274	272
query34	856	471	467	467
query35	819	727	762	727
query36	1051	919	918	918
query37	139	80	80	80
query38	3905	3836	3860	3836
query39	1463	1362	1398	1362
query40	202	118	113	113
query41	47	44	42	42
query42	114	93	96	93
query43	497	472	475	472
query44	1097	735	739	735
query45	189	164	166	164
query46	1084	749	714	714
query47	1819	1757	1740	1740
query48	362	284	291	284
query49	747	446	415	415
query50	800	394	401	394
query51	6794	6757	6688	6688
query52	100	91	91	91
query53	259	181	178	178
query54	557	447	434	434
query55	76	73	76	73
query56	271	244	248	244
query57	1149	1041	1062	1041
query58	214	223	220	220
query59	2803	2710	2668	2668
query60	289	260	253	253
query61	122	91	93	91
query62	751	644	639	639
query63	212	181	179	179
query64	6853	2260	1736	1736
query65	3183	3142	3145	3142
query66	682	329	329	329
query67	15128	14592	14683	14592
query68	4865	544	564	544
query69	414	263	264	263
query70	1155	1070	1121	1070
query71	428	273	275	273
query72	7101	2257	2050	2050
query73	759	326	327	326
query74	9197	8784	8759	8759
query75	3361	2720	2721	2720
query76	2028	965	922	922
query77	530	322	326	322
query78	9516	8957	8888	8888
query79	2807	533	519	519
query80	2137	474	487	474
query81	560	218	221	218
query82	764	136	135	135
query83	265	143	149	143
query84	275	76	77	76
query85	1345	268	271	268
query86	443	282	286	282
query87	4367	4239	4300	4239
query88	4743	2401	2407	2401
query89	399	287	285	285
query90	2025	194	263	194
query91	120	97	92	92
query92	58	50	50	50
query93	4656	541	531	531
query94	887	286	286	286
query95	354	257	256	256
query96	622	269	271	269
query97	3223	3056	3070	3056
query98	228	199	197	197
query99	1748	1271	1217	1217
Total cold run time: 322418 ms
Total hot run time: 189468 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.77 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit a56e0d4c1c3a255266f0bc40ed5b5fe0a6e39ce1, data reload: false

query1	0.04	0.04	0.04
query2	0.08	0.04	0.04
query3	0.22	0.05	0.05
query4	1.68	0.08	0.09
query5	0.51	0.51	0.50
query6	1.14	0.73	0.73
query7	0.02	0.01	0.02
query8	0.05	0.04	0.04
query9	0.54	0.48	0.48
query10	0.53	0.55	0.53
query11	0.15	0.12	0.11
query12	0.14	0.12	0.12
query13	0.60	0.61	0.58
query14	0.76	0.78	0.78
query15	0.89	0.85	0.82
query16	0.37	0.35	0.36
query17	0.99	1.02	0.98
query18	0.23	0.21	0.21
query19	1.94	1.73	1.76
query20	0.03	0.01	0.01
query21	15.39	0.77	0.66
query22	4.09	7.76	1.99
query23	18.28	1.47	1.34
query24	2.05	0.22	0.21
query25	0.14	0.08	0.08
query26	0.31	0.21	0.21
query27	0.46	0.23	0.22
query28	13.41	1.02	1.01
query29	12.70	3.31	3.25
query30	0.24	0.05	0.04
query31	2.88	0.40	0.40
query32	3.27	0.48	0.48
query33	2.94	2.99	2.96
query34	17.02	4.34	4.30
query35	4.49	4.45	4.40
query36	0.65	0.46	0.47
query37	0.18	0.16	0.15
query38	0.15	0.15	0.14
query39	0.04	0.04	0.04
query40	0.15	0.12	0.13
query41	0.09	0.05	0.04
query42	0.06	0.05	0.04
query43	0.05	0.04	0.04
Total cold run time: 109.95 s
Total hot run time: 30.77 s

@zddr
Copy link
Contributor Author

zddr commented Aug 13, 2024

run cloud_p1

result = value.plusYears(1L);
break;
case "quarter":
result = value.plusMonths(3L);
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

why add 3 month, can add some comment to explain this

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

1 quarter = 3month

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

value not have plusQuarter method,so use plusMonths(3L);

@github-actions
Copy link
Contributor

PR approved by anyone and no changes requested.

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Aug 14, 2024
@github-actions
Copy link
Contributor

PR approved by at least one committer and no changes requested.

@morrySnow morrySnow merged commit 8844e03 into apache:master Aug 14, 2024
wyxxxcat pushed a commit to wyxxxcat/doris that referenced this pull request Aug 14, 2024
if base table have 3 partitions:

PARTITION p_20200101 VALUES [("2020-01-01"),("2020-01-02")),
PARTITION p_20200102 VALUES [("2020-01-02"),("2020-01-03")),
PARTITION p_20200108 VALUES [("2020-01-08"),("2020-01-09"))

mtmv partition date_trunc(week)

mtmv will have 2 partitions

[("2019-12-30"),("2020-01-06"))
[("2020-01-06"),("2020-01-13"))
zddr added a commit to zddr/incubator-doris that referenced this pull request Aug 16, 2024
if base table have 3 partitions:

PARTITION p_20200101 VALUES [("2020-01-01"),("2020-01-02")),
PARTITION p_20200102 VALUES [("2020-01-02"),("2020-01-03")),
PARTITION p_20200108 VALUES [("2020-01-08"),("2020-01-09"))

mtmv partition date_trunc(week)

mtmv will have 2 partitions

[("2019-12-30"),("2020-01-06"))
[("2020-01-06"),("2020-01-13"))
morrySnow pushed a commit that referenced this pull request Aug 16, 2024
dataroaring pushed a commit that referenced this pull request Aug 17, 2024
if base table have 3 partitions:

PARTITION p_20200101 VALUES [("2020-01-01"),("2020-01-02")),
PARTITION p_20200102 VALUES [("2020-01-02"),("2020-01-03")),
PARTITION p_20200108 VALUES [("2020-01-08"),("2020-01-09"))

mtmv partition date_trunc(week)

mtmv will have 2 partitions

[("2019-12-30"),("2020-01-06"))
[("2020-01-06"),("2020-01-13"))
@gavinchou gavinchou mentioned this pull request Oct 13, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

approved Indicates a PR has been approved by one committer. dev/2.1.6-merged dev/3.0.2-merged doing reviewed

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants