Skip to content

pick (#32305) (#31858) #32476

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
jackwener merged 2 commits into from
Mar 22, 2024
Merged

pick (#32305) (#31858) #32476

jackwener merged 2 commits into from
Mar 22, 2024

Conversation

@jackwener
Copy link
Member

@jackwener jackwener commented Mar 19, 2024 •
edited
Loading

Proposed changes

pick (#32305) (#31858)

Further comments

If this is a relatively large or complex change, kick off the discussion at dev@doris.apache.org by explaining why you chose the solution you did and what alternatives you considered, etc...

@doris-robot
Copy link

doris-robot commented Mar 19, 2024

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@jackwener
Copy link
Member Author

jackwener commented Mar 19, 2024

run buildall

@jackwener jackwener changed the title pick (#32169) (#31858) pick (#32305) (#31858) Mar 19, 2024
@jackwener
Copy link
Member Author

jackwener commented Mar 19, 2024

run p0

1 similar comment
@jackwener
Copy link
Member Author

jackwener commented Mar 19, 2024

run p0

@jackwener
Copy link
Member Author

jackwener commented Mar 20, 2024

run buildall

1 similar comment
@jackwener
Copy link
Member Author

jackwener commented Mar 21, 2024

run buildall

@jackwener jackwener force-pushed the branch-2.0_join branch 2 times, most recently from d0eff47 to 88959f6 Compare March 21, 2024 09:18
@jackwener
Copy link
Member Author

jackwener commented Mar 21, 2024

run p0

@jackwener
Copy link
Member Author

jackwener commented Mar 21, 2024

run p0

@jackwener
Copy link
Member Author

jackwener commented Mar 21, 2024

run buildall

@doris-robot
Copy link

doris-robot commented Mar 21, 2024

TPC-H: Total hot run time: 50006 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit a42ac69114ad33d92e8036ee2b8c73d8418a2eb9, data reload: false

------ Round 1 ----------------------------------
q1	17701	4371	4392	4371
q2	2042	145	137	137
q3	10362	1940	1941	1940
q4	10374	1233	1293	1233
q5	8424	3956	3971	3956
q6	235	121	121	121
q7	2040	1575	1611	1575
q8	9304	2708	2690	2690
q9	10679	10476	10508	10476
q10	8627	3503	3535	3503
q11	413	246	240	240
q12	459	292	294	292
q13	18335	3971	4007	3971
q14	338	319	317	317
q15	507	454	451	451
q16	699	596	600	596
q17	1105	962	979	962
q18	7228	6907	6930	6907
q19	1692	1542	1555	1542
q20	510	309	301	301
q21	4432	4127	4035	4035
q22	510	406	390	390
Total cold run time: 116016 ms
Total hot run time: 50006 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4298	4259	4350	4259
q2	320	222	217	217
q3	4161	4150	4145	4145
q4	2775	2739	2750	2739
q5	7239	7145	7209	7145
q6	242	119	116	116
q7	3331	2880	2959	2880
q8	4449	4552	4509	4509
q9	17038	17083	16899	16899
q10	4239	4244	4258	4244
q11	754	707	731	707
q12	1019	866	837	837
q13	6865	3773	3736	3736
q14	466	432	434	432
q15	494	452	451	451
q16	758	689	695	689
q17	3887	3795	3880	3795
q18	9016	8765	8633	8633
q19	1715	1675	1621	1621
q20	2322	2123	2116	2116
q21	8502	8467	8514	8467
q22	1011	966	912	912
Total cold run time: 84901 ms
Total hot run time: 79549 ms

@doris-robot
Copy link

doris-robot commented Mar 21, 2024

TPC-DS: Total hot run time: 202817 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit a42ac69114ad33d92e8036ee2b8c73d8418a2eb9, data reload: false

query1	912	389	380	380
query2	6538	2288	2105	2105
query3	6913	210	208	208
query4	19905	18029	18106	18029
query5	19978	6606	6565	6565
query6	285	220	229	220
query7	4367	304	317	304
query8	254	248	248	248
query9	3203	2771	2673	2673
query10	413	281	305	281
query11	11445	10844	10817	10817
query12	127	78	71	71
query13	5583	672	645	645
query14	18011	13598	13871	13598
query15	383	244	237	237
query16	6532	291	271	271
query17	2136	1446	916	916
query18	2276	442	437	437
query19	227	166	170	166
query20	92	86	89	86
query21	195	104	104	104
query22	5748	5420	5238	5238
query23	33233	31849	32195	31849
query24	6963	6575	6552	6552
query25	533	426	422	422
query26	522	166	160	160
query27	1835	298	301	298
query28	6166	2295	2273	2273
query29	2871	2745	2829	2745
query30	238	165	161	161
query31	888	744	732	732
query32	66	63	58	58
query33	400	242	260	242
query34	882	487	498	487
query35	1132	935	887	887
query36	1263	1252	1167	1167
query37	89	62	60	60
query38	3074	2933	2926	2926
query39	1380	1320	1329	1320
query40	207	99	105	99
query41	37	32	32	32
query42	89	84	80	80
query43	719	646	641	641
query44	1136	738	749	738
query45	243	236	235	235
query46	1235	977	988	977
query47	1750	1678	1651	1651
query48	978	690	659	659
query49	620	376	356	356
query50	889	616	609	609
query51	4771	4753	4683	4683
query52	90	80	84	80
query53	440	319	329	319
query54	2666	2459	2505	2459
query55	83	78	79	78
query56	228	205	212	205
query57	1212	1053	1116	1053
query58	215	207	193	193
query59	3513	3418	3312	3312
query60	198	192	191	191
query61	90	85	86	85
query62	795	465	559	465
query63	471	341	337	337
query64	2443	1461	1405	1405
query65	3674	3613	3543	3543
query66	762	366	359	359
query67	16031	15209	15608	15209
query68	8865	670	682	670
query69	581	336	346	336
query70	1826	1410	1621	1410
query71	424	305	305	305
query72	6530	3536	3440	3440
query73	742	332	333	332
query74	6374	5824	5802	5802
query75	5167	3654	3744	3654
query76	5115	1171	1227	1171
query77	884	250	255	250
query78	12433	11866	11629	11629
query79	6733	627	639	627
query80	1078	393	393	393
query81	488	232	234	232
query82	1275	101	94	94
query83	180	136	129	129
query84	255	74	69	69
query85	1009	294	284	284
query86	339	291	280	280
query87	3223	2996	3063	2996
query88	4935	2382	2412	2382
query89	344	294	281	281
query90	1991	216	198	198
query91	153	115	115	115
query92	55	56	51	51
query93	2829	573	579	573
query94	784	208	210	208
query95	1123	1080	1102	1080
query96	646	341	339	339
query97	6510	6431	6411	6411
query98	186	179	169	169
query99	2968	972	916	916
Total cold run time: 308688 ms
Total hot run time: 202817 ms

@doris-robot
Copy link

doris-robot commented Mar 21, 2024

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit a42ac69114ad33d92e8036ee2b8c73d8418a2eb9 with default session variables
Stream load json:         20 seconds loaded 2358488459 Bytes, about 112 MB/s
Stream load orc:          59 seconds loaded 1101869774 Bytes, about 17 MB/s
Stream load parquet:      32 seconds loaded 861443392 Bytes, about 25 MB/s
Insert into select:       22.2 seconds inserted 10000000 Rows, about 450K ops/s

@jackwener jackwener merged commit 409a44b into apache:branch-2.0 Mar 22, 2024
@jackwener jackwener deleted the branch-2.0_join branch March 22, 2024 10:11
mongo360 pushed a commit to mongo360/doris that referenced this pull request Aug 16, 2024
@jackwener
pick (apache#32305) (apache#31858) (apache#32476)
e1bedaf 
* [enhancement](Nereids): support more condition Date/DateTime Literal (apache#31858)

(cherry picked from commit dbb7573)

* [fix](Nereids): slot set in condition can be empty (apache#32169)

(cherry picked from commit ca09213)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

area/nereids

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@jackwener @doris-robot