Skip to content

Conversation

@github-actions
Copy link
Contributor

Cherry-picked from #51367

It was not easy to use for observability use case.

Co-authored-by: Yongqiang YANG <yangyogqiang@selectdb.com>
@github-actions github-actions bot requested a review from dataroaring as a code owner June 26, 2025 11:27
@hello-stephen
Copy link
Contributor

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@dataroaring dataroaring reopened this Jun 26, 2025
@hello-stephen
Copy link
Contributor

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 39713 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 998cefc9cef2c5e1a8801ffdb32ef041809af6b2, data reload: false

------ Round 1 ----------------------------------
q1	17735	6790	6615	6615
q2	2086	166	162	162
q3	10732	1087	1144	1087
q4	10546	736	715	715
q5	7748	2899	2843	2843
q6	218	136	134	134
q7	974	609	621	609
q8	9353	1933	2007	1933
q9	6630	6394	6389	6389
q10	6949	2306	2292	2292
q11	458	266	266	266
q12	397	218	210	210
q13	17780	2952	3037	2952
q14	228	199	211	199
q15	515	459	476	459
q16	467	398	380	380
q17	966	496	500	496
q18	7251	6680	6612	6612
q19	1391	1000	1125	1000
q20	493	214	203	203
q21	3938	3244	3188	3188
q22	1090	969	1003	969
Total cold run time: 107945 ms
Total hot run time: 39713 ms

----- Round 2, with runtime_filter_mode=off -----
q1	6600	6592	6542	6542
q2	329	241	237	237
q3	2872	2797	2814	2797
q4	2028	1786	1772	1772
q5	5822	5749	5694	5694
q6	216	129	129	129
q7	2191	1850	1773	1773
q8	3353	3528	3529	3528
q9	8871	8748	8937	8748
q10	3556	3550	3503	3503
q11	605	498	493	493
q12	773	594	568	568
q13	7337	3147	3136	3136
q14	305	264	263	263
q15	516	475	458	458
q16	501	458	455	455
q17	1829	1621	1598	1598
q18	8277	7772	7594	7594
q19	1709	1585	1483	1483
q20	2128	1890	1898	1890
q21	5124	4952	5078	4952
q22	1126	1038	1050	1038
Total cold run time: 66068 ms
Total hot run time: 58651 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 196704 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 998cefc9cef2c5e1a8801ffdb32ef041809af6b2, data reload: false

query1	1322	918	888	888
query2	6485	1931	1868	1868
query3	10835	4238	4265	4238
query4	61105	29728	23515	23515
query5	5205	455	451	451
query6	401	169	186	169
query7	5465	304	313	304
query8	323	231	220	220
query9	8548	2562	2564	2562
query10	476	261	279	261
query11	17658	15254	15740	15254
query12	168	100	105	100
query13	1439	458	428	428
query14	9820	7425	7106	7106
query15	210	176	177	176
query16	7101	492	522	492
query17	1146	609	590	590
query18	1859	342	318	318
query19	213	169	174	169
query20	125	111	122	111
query21	203	103	106	103
query22	4729	4435	4652	4435
query23	34506	33985	33830	33830
query24	6249	2902	2936	2902
query25	551	421	422	421
query26	657	165	169	165
query27	1904	352	356	352
query28	3792	2160	2147	2147
query29	719	473	435	435
query30	227	162	150	150
query31	977	788	812	788
query32	68	56	58	56
query33	458	299	298	298
query34	934	500	507	500
query35	849	732	713	713
query36	1061	961	959	959
query37	109	67	75	67
query38	4078	3990	3963	3963
query39	1548	1474	1465	1465
query40	200	109	106	106
query41	51	49	52	49
query42	118	103	101	101
query43	509	495	494	494
query44	1215	813	810	810
query45	186	173	165	165
query46	1149	740	735	735
query47	2009	1898	1932	1898
query48	485	375	380	375
query49	757	399	392	392
query50	838	437	422	422
query51	7418	7384	7208	7208
query52	105	93	93	93
query53	265	191	186	186
query54	587	469	460	460
query55	78	76	79	76
query56	269	257	262	257
query57	1320	1218	1233	1218
query58	217	239	245	239
query59	3294	3110	3145	3110
query60	291	269	260	260
query61	113	123	129	123
query62	794	692	703	692
query63	227	196	204	196
query64	1411	684	687	684
query65	3280	3198	3194	3194
query66	709	294	291	291
query67	15884	15443	15540	15443
query68	4257	601	561	561
query69	426	263	267	263
query70	1175	1049	1112	1049
query71	355	257	256	256
query72	6324	4131	3999	3999
query73	748	343	357	343
query74	10419	9202	8963	8963
query75	3374	2662	2680	2662
query76	2032	1090	1129	1090
query77	480	267	266	266
query78	10551	9838	9538	9538
query79	1668	610	612	610
query80	1312	437	438	437
query81	519	229	221	221
query82	1041	94	92	92
query83	262	141	140	140
query84	283	75	73	73
query85	1024	318	290	290
query86	386	297	286	286
query87	4441	4277	4324	4277
query88	3681	2380	2359	2359
query89	411	297	298	297
query90	1947	188	187	187
query91	186	150	148	148
query92	65	52	54	52
query93	2122	564	565	564
query94	780	295	291	291
query95	365	254	262	254
query96	626	287	280	280
query97	3316	3139	3192	3139
query98	224	202	192	192
query99	1628	1296	1279	1279
Total cold run time: 313730 ms
Total hot run time: 196704 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 29.86 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 998cefc9cef2c5e1a8801ffdb32ef041809af6b2, data reload: false

query1	0.03	0.03	0.02
query2	0.08	0.03	0.03
query3	0.24	0.07	0.06
query4	1.62	0.11	0.11
query5	0.52	0.50	0.52
query6	1.14	0.73	0.72
query7	0.02	0.01	0.01
query8	0.04	0.04	0.03
query9	0.56	0.51	0.50
query10	0.55	0.55	0.56
query11	0.14	0.10	0.10
query12	0.13	0.11	0.12
query13	0.60	0.60	0.59
query14	0.79	0.79	0.81
query15	0.84	0.83	0.82
query16	0.38	0.38	0.39
query17	1.04	1.04	1.08
query18	0.23	0.21	0.22
query19	1.88	1.77	1.78
query20	0.02	0.01	0.02
query21	15.39	0.60	0.59
query22	2.61	2.07	1.45
query23	16.94	0.94	0.95
query24	2.84	1.51	0.99
query25	0.21	0.06	0.08
query26	0.41	0.14	0.13
query27	0.05	0.04	0.04
query28	10.26	0.50	0.50
query29	12.60	3.25	3.18
query30	0.24	0.05	0.06
query31	2.86	0.39	0.37
query32	3.26	0.47	0.46
query33	2.98	3.02	3.04
query34	17.06	4.44	4.50
query35	4.51	4.51	4.54
query36	0.68	0.48	0.48
query37	0.09	0.06	0.06
query38	0.05	0.03	0.03
query39	0.03	0.02	0.02
query40	0.16	0.12	0.12
query41	0.08	0.03	0.02
query42	0.03	0.02	0.02
query43	0.03	0.03	0.03
Total cold run time: 104.22 s
Total hot run time: 29.86 s

Copy link
Contributor

@dataroaring dataroaring left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@dataroaring dataroaring merged commit eaa74b3 into branch-3.0 Jun 26, 2025
24 of 26 checks passed
@github-actions github-actions bot deleted the auto-pick-51367-branch-3.0 branch June 26, 2025 14:05
koarz pushed a commit to koarz/doris that referenced this pull request Jul 3, 2025
…pache#51367 (apache#52380)

Cherry-picked from apache#51367

Co-authored-by: Yongqiang YANG <yangyongqiang@selectdb.com>
Co-authored-by: Yongqiang YANG <yangyogqiang@selectdb.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants