Skip to content

Conversation

@github-actions
Copy link
Contributor

@github-actions github-actions bot commented Dec 3, 2024

Cherry-picked from #44568

…44568)

Problem Summary:
When using tables in connect context, it would keep on memory in next
run in the same session, but it should not be in memory when running
next sql statement
@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@dataroaring dataroaring closed this Dec 3, 2024
@dataroaring dataroaring reopened this Dec 3, 2024
@doris-robot
Copy link

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 40202 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 9cab960d1fd16a90120b82dfc295df4307499085, data reload: false

------ Round 1 ----------------------------------
q1	17612	7392	7283	7283
q2	2053	180	174	174
q3	10648	1068	1185	1068
q4	10546	704	760	704
q5	7737	2763	2764	2763
q6	232	146	146	146
q7	976	621	600	600
q8	9576	1942	2039	1942
q9	8025	6357	6442	6357
q10	6954	2259	2314	2259
q11	446	265	251	251
q12	396	214	212	212
q13	17788	2998	2939	2939
q14	238	205	207	205
q15	558	506	515	506
q16	674	613	589	589
q17	969	534	576	534
q18	7170	6557	6450	6450
q19	3429	986	1040	986
q20	470	207	193	193
q21	3879	3080	3216	3080
q22	1074	963	961	961
Total cold run time: 111450 ms
Total hot run time: 40202 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7356	7238	7259	7238
q2	326	227	224	224
q3	3024	2888	2886	2886
q4	2077	1715	1715	1715
q5	5631	5692	5729	5692
q6	229	146	144	144
q7	2206	1769	1790	1769
q8	3316	3384	3476	3384
q9	8904	8811	8762	8762
q10	3521	3513	3507	3507
q11	614	488	534	488
q12	799	581	620	581
q13	16631	3152	3155	3152
q14	316	267	285	267
q15	578	529	511	511
q16	722	671	650	650
q17	1822	1624	1630	1624
q18	8109	7656	7536	7536
q19	1675	1520	1591	1520
q20	2041	1857	1843	1843
q21	5503	5367	5355	5355
q22	1083	1014	995	995
Total cold run time: 76483 ms
Total hot run time: 59843 ms

@LiBinfeng-01
Copy link
Contributor

run buildall

@LiBinfeng-01 LiBinfeng-01 self-assigned this Dec 10, 2024
@doris-robot
Copy link

TPC-H: Total hot run time: 40602 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 9cab960d1fd16a90120b82dfc295df4307499085, data reload: false

------ Round 1 ----------------------------------
q1	17576	7427	7337	7337
q2	2074	169	196	169
q3	10675	1060	1141	1060
q4	10546	758	740	740
q5	7772	2886	2857	2857
q6	237	149	144	144
q7	985	618	608	608
q8	9575	1933	2017	1933
q9	7073	6394	6404	6394
q10	7027	2337	2278	2278
q11	469	263	259	259
q12	406	217	209	209
q13	17785	3001	3011	3001
q14	238	209	213	209
q15	561	517	517	517
q16	676	623	606	606
q17	989	546	521	521
q18	7310	6469	6628	6469
q19	2068	1000	1131	1000
q20	468	203	188	188
q21	3924	3261	3141	3141
q22	1098	979	962	962
Total cold run time: 109532 ms
Total hot run time: 40602 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7353	7262	7206	7206
q2	321	231	223	223
q3	2973	2869	2861	2861
q4	2070	1829	1782	1782
q5	5672	5711	5725	5711
q6	228	140	144	140
q7	2155	1782	1778	1778
q8	3322	3568	3426	3426
q9	8891	8833	8807	8807
q10	3541	3571	3492	3492
q11	609	498	494	494
q12	799	616	645	616
q13	16658	3162	3186	3162
q14	300	280	276	276
q15	557	520	507	507
q16	728	702	673	673
q17	1847	1634	1619	1619
q18	8157	7703	7433	7433
q19	3484	1576	1665	1576
q20	2091	1853	1801	1801
q21	5392	5266	5230	5230
q22	1143	1026	983	983
Total cold run time: 78291 ms
Total hot run time: 59796 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 195306 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 9cab960d1fd16a90120b82dfc295df4307499085, data reload: false

query1	1225	936	900	900
query2	6257	2090	2046	2046
query3	10809	4199	4050	4050
query4	66698	29125	23283	23283
query5	5372	443	431	431
query6	448	180	176	176
query7	5671	311	319	311
query8	327	225	225	225
query9	9367	2677	2678	2677
query10	522	268	268	268
query11	18061	15245	15714	15245
query12	155	98	99	98
query13	1552	415	406	406
query14	10789	6951	7323	6951
query15	227	180	170	170
query16	7367	475	442	442
query17	1408	556	569	556
query18	1904	313	308	308
query19	198	165	148	148
query20	119	108	108	108
query21	61	46	46	46
query22	4687	4335	4333	4333
query23	34505	34034	34017	34017
query24	6299	2951	2946	2946
query25	556	447	413	413
query26	688	171	169	169
query27	1812	302	308	302
query28	4625	2535	2489	2489
query29	723	462	463	462
query30	265	167	168	167
query31	1022	812	834	812
query32	72	56	58	56
query33	491	300	291	291
query34	913	518	512	512
query35	862	759	749	749
query36	1104	961	938	938
query37	122	74	84	74
query38	4028	4013	4081	4013
query39	1505	1487	1454	1454
query40	147	84	88	84
query41	51	48	46	46
query42	113	96	99	96
query43	536	493	502	493
query44	1178	824	852	824
query45	185	169	168	168
query46	1159	729	728	728
query47	1968	1885	1869	1869
query48	468	374	381	374
query49	754	374	379	374
query50	847	418	416	416
query51	7296	7123	6982	6982
query52	101	89	91	89
query53	255	183	179	179
query54	556	441	439	439
query55	80	78	76	76
query56	252	231	237	231
query57	1181	1091	1123	1091
query58	202	200	200	200
query59	3212	2976	2938	2938
query60	271	254	253	253
query61	116	109	109	109
query62	771	660	673	660
query63	219	190	195	190
query64	1816	661	642	642
query65	3220	3173	3167	3167
query66	716	300	297	297
query67	15650	15344	15292	15292
query68	5061	582	548	548
query69	409	250	253	250
query70	1115	1121	1110	1110
query71	415	273	252	252
query72	6547	3901	3912	3901
query73	777	342	340	340
query74	10227	8820	8997	8820
query75	3357	2612	2609	2609
query76	2188	1116	1023	1023
query77	502	262	267	262
query78	10777	9583	9513	9513
query79	8148	596	593	593
query80	2137	429	411	411
query81	539	243	232	232
query82	1128	116	109	109
query83	269	141	140	140
query84	284	85	72	72
query85	1773	303	286	286
query86	493	296	288	288
query87	4482	4234	4220	4220
query88	5569	2367	2405	2367
query89	543	288	295	288
query90	2062	187	184	184
query91	181	144	144	144
query92	75	48	48	48
query93	6654	544	534	534
query94	910	296	286	286
query95	340	249	252	249
query96	628	292	281	281
query97	3403	3103	3185	3103
query98	230	195	202	195
query99	1966	1304	1299	1299
Total cold run time: 339325 ms
Total hot run time: 195306 ms

@LiBinfeng-01
Copy link
Contributor

run feut

@morrySnow morrySnow merged commit 12982ab into branch-3.0 Dec 19, 2024
27 checks passed
@morrySnow morrySnow deleted the auto-pick-44568-branch-3.0 branch December 19, 2024 07:49
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants