Skip to content

Conversation

@jackwener
Copy link
Member

Proposed changes

pick (#30583) (#30744)

Further comments

If this is a relatively large or complex change, kick off the discussion at dev@doris.apache.org by explaining why you chose the solution you did and what alternatives you considered, etc...

@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

@jackwener
Copy link
Member Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 49746 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit d33b6e75ed5139f059a3386728627dffe5d86a2f, data reload: false

------ Round 1 ----------------------------------
q1	17673	4392	4344	4344
q2	2033	149	140	140
q3	10414	1909	1948	1909
q4	10344	1246	1335	1246
q5	8373	4488	3924	3924
q6	228	121	122	121
q7	2031	1611	1584	1584
q8	9493	2711	2703	2703
q9	13394	10654	10329	10329
q10	8670	3544	3525	3525
q11	419	234	246	234
q12	457	306	306	306
q13	18365	3951	4067	3951
q14	344	323	323	323
q15	505	458	459	458
q16	690	595	587	587
q17	1114	991	943	943
q18	7290	6891	6879	6879
q19	1680	1555	1447	1447
q20	524	310	309	309
q21	4406	4136	4083	4083
q22	511	404	401	401
Total cold run time: 118958 ms
Total hot run time: 49746 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4315	4280	4303	4280
q2	319	230	224	224
q3	4194	4126	4181	4126
q4	2754	2770	2758	2758
q5	7257	7248	7171	7171
q6	238	118	118	118
q7	3241	2817	2882	2817
q8	4334	4445	4469	4445
q9	17026	16922	17098	16922
q10	4244	4298	4266	4266
q11	778	674	680	674
q12	1018	828	866	828
q13	6551	3787	3755	3755
q14	446	422	409	409
q15	503	465	446	446
q16	763	709	701	701
q17	3880	3822	3825	3822
q18	8769	8828	8779	8779
q19	1716	1679	1651	1651
q20	2455	2231	2166	2166
q21	8807	8451	8455	8451
q22	1038	935	962	935
Total cold run time: 84646 ms
Total hot run time: 79744 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 235963 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit d33b6e75ed5139f059a3386728627dffe5d86a2f, data reload: false

query1	919	390	378	378
query2	6512	2223	1948	1948
query3	6932	202	201	201
query4	20660	17932	17912	17912
query5	19711	6244	6240	6240
query6	274	211	217	211
query7	4145	300	293	293
query8	279	230	229	229
query9	3168	2756	2684	2684
query10	410	313	286	286
query11	11319	10722	10679	10679
query12	124	76	72	72
query13	5653	641	642	641
query14	17756	13362	13217	13217
query15	361	248	244	244
query16	6442	261	263	261
query17	3229	873	860	860
query18	2274	409	417	409
query19	545	150	160	150
query20	82	90	80	80
query21	493	102	101	101
query22	5306	5335	5189	5189
query23	32724	32372	32679	32372
query24	6976	6630	6512	6512
query25	526	441	404	404
query26	526	172	161	161
query27	2348	307	300	300
query28	6925	2447	2215	2215
query29	2850	2758	2808	2758
query30	239	157	160	157
query31	908	722	726	722
query32	64	54	56	54
query33	395	242	239	239
query34	890	458	474	458
query35	1114	886	921	886
query36	1675	1455	1446	1446
query37	89	59	62	59
query38	3117	2933	2884	2884
query39	1386	1318	1324	1318
query40	203	102	86	86
query41	33	32	35	32
query42	85	80	83	80
query43	588	584	574	574
query44	1124	728	724	724
query45	237	231	224	224
query46	1238	971	968	968
query47	1742	1813	1771	1771
query48	975	676	657	657
query49	605	367	352	352
query50	854	585	602	585
query51	5500	5443	5444	5443
query52	81	82	80	80
query53	443	324	312	312
query54	2422	2248	2257	2248
query55	81	81	84	81
query56	223	200	196	196
query57	1166	1140	1074	1074
query58	196	183	212	183
query59	3429	3329	3242	3242
query60	210	182	181	181
query61	84	83	77	77
query62	807	513	499	499
query63	477	335	334	334
query64	2012	1319	1259	1259
query65	3664	3624	3620	3620
query66	808	362	356	356
query67	17395	16087	16068	16068
query68	5784	633	661	633
query69	563	329	334	329
query70	1718	1801	1644	1644
query71	401	300	299	299
query72	4243	3302	3322	3302
query73	716	315	317	315
query74	6388	5906	5994	5906
query75	4117	3454	3440	3440
query76	3125	1175	1165	1165
query77	526	240	239	239
query78	32499	51804	44635	44635
query79	14602	634	631	631
query80	4691	376	383	376
query81	565	224	232	224
query82	526	94	94	94
query83	415	132	133	132
query84	259	67	67	67
query85	2577	280	268	268
query86	487	385	396	385
query87	3231	2990	2999	2990
query88	6016	2298	2272	2272
query89	366	289	280	280
query90	2494	181	209	181
query91	159	123	121	121
query92	66	55	52	52
query93	3329	558	532	532
query94	1842	197	202	197
query95	1111	1052	1070	1052
query96	644	323	323	323
query97	6499	6369	6297	6297
query98	197	171	172	171
query99	3874	875	950	875
Total cold run time: 340058 ms
Total hot run time: 235963 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.45 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit d33b6e75ed5139f059a3386728627dffe5d86a2f, data reload: false

query1	0.02	0.02	0.03
query2	0.06	0.02	0.02
query3	0.24	0.04	0.04
query4	1.83	0.06	0.06
query5	0.53	0.53	0.52
query6	1.24	0.62	0.61
query7	0.02	0.01	0.01
query8	0.04	0.02	0.02
query9	0.51	0.50	0.48
query10	0.53	0.53	0.54
query11	0.11	0.09	0.09
query12	0.12	0.10	0.10
query13	0.63	0.61	0.61
query14	0.78	0.78	0.80
query15	0.78	0.76	0.77
query16	0.37	0.39	0.36
query17	1.01	1.03	1.02
query18	0.22	0.25	0.25
query19	1.94	1.87	1.85
query20	0.02	0.01	0.01
query21	15.48	0.56	0.55
query22	2.14	2.13	1.76
query23	17.69	1.01	0.93
query24	7.35	3.72	1.39
query25	1.65	0.12	0.11
query26	0.52	0.15	0.15
query27	0.11	0.11	0.10
query28	3.82	0.75	0.72
query29	12.72	2.28	2.34
query30	0.60	0.53	0.51
query31	2.83	0.37	0.38
query32	3.40	0.51	0.49
query33	3.07	3.12	3.06
query34	15.26	4.80	4.79
query35	4.83	4.84	4.87
query36	1.07	1.01	1.01
query37	0.05	0.05	0.04
query38	0.03	0.02	0.02
query39	0.02	0.01	0.01
query40	0.16	0.13	0.13
query41	0.08	0.02	0.02
query42	0.02	0.01	0.01
query43	0.02	0.02	0.02
Total cold run time: 103.92 s
Total hot run time: 31.45 s

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit d33b6e75ed5139f059a3386728627dffe5d86a2f with default session variables
Stream load json:         21 seconds loaded 2358488459 Bytes, about 107 MB/s
Stream load orc:          59 seconds loaded 1101869774 Bytes, about 17 MB/s
Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select:       21.0 seconds inserted 10000000 Rows, about 476K ops/s

@jackwener jackwener merged commit 35289ee into apache:branch-2.0 Feb 5, 2024
@jackwener jackwener deleted the branch-2.0_test branch February 5, 2024 15:26
mongo360 pushed a commit to mongo360/doris that referenced this pull request Aug 16, 2024
* [enhance](Nereids): support DateLiteral with suffix space (apache#30583)

(cherry picked from commit ab5bddb)

* [enhancement](Nereids): datetime support microsecond overflow (apache#30744)

(cherry picked from commit 3c62063)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants