Skip to content

[feat](FE) add rest api to get last profile #38268 #38450

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
morrySnow merged 1 commit into from
Jul 31, 2024
Merged

[feat](FE) add rest api to get last profile #38268 #38450

morrySnow merged 1 commit into from
Jul 31, 2024

Conversation

@englefly
Copy link
Contributor

@englefly englefly commented Jul 29, 2024 •
edited by morrySnow
Loading

pick from master #38268

@doris-robot
Copy link

doris-robot commented Jul 29, 2024

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@englefly
Copy link
Contributor Author

englefly commented Jul 29, 2024

run buildall

@doris-robot
Copy link

doris-robot commented Jul 29, 2024

TPC-H: Total hot run time: 49602 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 8853aeae3a2f4c323ee33608f9cbff42b0e99629, data reload: false

------ Round 1 ----------------------------------
q1	17718	4381	4284	4284
q2	2063	161	143	143
q3	10288	1899	1954	1899
q4	10365	1264	1296	1264
q5	8537	3854	3895	3854
q6	233	126	124	124
q7	2050	1637	1578	1578
q8	9278	2724	2699	2699
q9	10671	10395	10275	10275
q10	8627	3551	3505	3505
q11	419	239	261	239
q12	463	294	294	294
q13	18358	3966	4048	3966
q14	349	335	320	320
q15	517	477	453	453
q16	688	581	576	576
q17	1122	958	970	958
q18	7261	6775	7013	6775
q19	1763	1640	1563	1563
q20	509	326	303	303
q21	4456	4105	4067	4067
q22	527	467	463	463
Total cold run time: 116262 ms
Total hot run time: 49602 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4310	4312	4317	4312
q2	329	228	222	222
q3	4192	4125	4131	4125
q4	2769	2736	2758	2736
q5	7206	7126	7157	7126
q6	237	121	117	117
q7	3269	2841	2870	2841
q8	4350	4472	4481	4472
q9	16910	16827	16785	16785
q10	4248	4316	4293	4293
q11	747	684	687	684
q12	1037	868	878	868
q13	7186	3740	3756	3740
q14	454	426	427	426
q15	499	461	461	461
q16	736	691	690	690
q17	3816	3846	3903	3846
q18	8851	8766	8840	8766
q19	1748	1706	1674	1674
q20	2386	2138	2098	2098
q21	8559	8414	8507	8414
q22	1085	993	979	979
Total cold run time: 84924 ms
Total hot run time: 79675 ms

@doris-robot
Copy link

doris-robot commented Jul 29, 2024

TPC-DS: Total hot run time: 203659 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 8853aeae3a2f4c323ee33608f9cbff42b0e99629, data reload: false

query1	934	413	379	379
query2	6536	2899	2685	2685
query3	6921	207	197	197
query4	20322	18094	18022	18022
query5	19724	6508	6489	6489
query6	330	215	225	215
query7	4347	304	323	304
query8	471	403	400	400
query9	3163	2718	2670	2670
query10	427	318	296	296
query11	11350	10691	10716	10691
query12	126	76	77	76
query13	5604	721	705	705
query14	18722	13724	13513	13513
query15	371	269	256	256
query16	6448	297	262	262
query17	1463	1500	873	873
query18	2271	410	405	405
query19	205	150	174	150
query20	75	77	83	77
query21	189	98	89	89
query22	5158	5131	5040	5040
query23	32570	31925	31962	31925
query24	6757	6522	6474	6474
query25	521	427	436	427
query26	513	172	161	161
query27	1736	299	296	296
query28	6190	2424	2363	2363
query29	2943	2834	2829	2829
query30	240	167	172	167
query31	935	739	757	739
query32	70	64	59	59
query33	394	243	255	243
query34	832	492	469	469
query35	1124	910	885	885
query36	1346	1270	1068	1068
query37	91	62	62	62
query38	3100	2917	2902	2902
query39	1393	1335	1304	1304
query40	207	97	99	97
query41	47	44	43	43
query42	82	85	81	81
query43	725	721	751	721
query44	1109	721	719	719
query45	246	239	236	236
query46	1229	986	966	966
query47	1703	1958	1682	1682
query48	1009	710	734	710
query49	623	382	371	371
query50	857	628	597	597
query51	4733	4707	4632	4632
query52	94	85	86	85
query53	454	322	329	322
query54	2625	2471	2433	2433
query55	87	81	87	81
query56	251	212	199	199
query57	1185	1074	1066	1066
query58	218	213	215	213
query59	4407	3983	3966	3966
query60	219	194	206	194
query61	100	93	97	93
query62	762	489	449	449
query63	492	347	345	345
query64	2519	1533	1410	1410
query65	3609	3565	3584	3565
query66	769	390	376	376
query67	17441	15449	15072	15072
query68	9272	669	644	644
query69	587	340	336	336
query70	1664	1403	1365	1365
query71	425	312	322	312
query72	6588	3481	3467	3467
query73	731	320	326	320
query74	6228	5876	5835	5835
query75	5463	3763	3704	3704
query76	5705	1150	1231	1150
query77	991	272	258	258
query78	12585	11879	11626	11626
query79	7930	638	637	637
query80	1427	390	399	390
query81	485	241	234	234
query82	1688	101	101	101
query83	169	133	133	133
query84	263	71	68	68
query85	873	332	332	332
query86	346	290	281	281
query87	3182	3076	3049	3049
query88	4920	2297	2291	2291
query89	382	294	288	288
query90	1956	216	220	216
query91	177	139	159	139
query92	58	52	52	52
query93	5653	559	581	559
query94	689	203	212	203
query95	1131	1056	1088	1056
query96	644	326	322	322
query97	6460	6428	6369	6369
query98	195	177	184	177
query99	2925	961	854	854
Total cold run time: 315506 ms
Total hot run time: 203659 ms

@doris-robot
Copy link

doris-robot commented Jul 29, 2024

ClickBench: Total hot run time: 31.17 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 8853aeae3a2f4c323ee33608f9cbff42b0e99629, data reload: false

query1	0.02	0.03	0.02
query2	0.07	0.02	0.02
query3	0.25	0.04	0.05
query4	1.79	0.05	0.08
query5	0.54	0.53	0.52
query6	1.27	0.61	0.61
query7	0.02	0.01	0.01
query8	0.03	0.02	0.02
query9	0.52	0.47	0.49
query10	0.54	0.54	0.54
query11	0.12	0.09	0.08
query12	0.12	0.09	0.09
query13	0.62	0.60	0.61
query14	0.77	0.79	0.78
query15	0.77	0.77	0.77
query16	0.36	0.38	0.38
query17	1.02	1.01	1.02
query18	0.21	0.28	0.26
query19	1.94	1.83	1.78
query20	0.01	0.00	0.01
query21	15.49	0.58	0.55
query22	2.39	1.83	1.53
query23	17.14	1.03	0.98
query24	5.29	1.30	1.73
query25	0.41	0.08	0.04
query26	0.61	0.16	0.16
query27	0.04	0.05	0.04
query28	6.85	0.73	0.72
query29	12.70	2.41	2.52
query30	0.67	0.62	0.59
query31	2.82	0.38	0.36
query32	3.41	0.50	0.49
query33	3.09	3.11	3.06
query34	15.28	4.79	4.82
query35	4.88	4.86	4.85
query36	1.05	1.02	1.01
query37	0.06	0.04	0.04
query38	0.04	0.02	0.02
query39	0.02	0.01	0.02
query40	0.16	0.14	0.15
query41	0.07	0.01	0.02
query42	0.03	0.01	0.02
query43	0.02	0.01	0.01
Total cold run time: 103.51 s
Total hot run time: 31.17 s

@doris-robot
Copy link

doris-robot commented Jul 29, 2024

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit 8853aeae3a2f4c323ee33608f9cbff42b0e99629 with default session variables
Stream load json:         19 seconds loaded 2358488459 Bytes, about 118 MB/s
Stream load orc:          59 seconds loaded 1101869774 Bytes, about 17 MB/s
Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select:       21.6 seconds inserted 10000000 Rows, about 462K ops/s

@englefly
Copy link
Contributor Author

englefly commented Jul 29, 2024

run external

1 similar comment
@englefly
Copy link
Contributor Author

englefly commented Jul 29, 2024

run external

@englefly
Copy link
Contributor Author

englefly commented Jul 29, 2024

run buildall

@doris-robot
Copy link

doris-robot commented Jul 29, 2024

TPC-H: Total hot run time: 49746 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 8853aeae3a2f4c323ee33608f9cbff42b0e99629, data reload: false

------ Round 1 ----------------------------------
q1	17609	4424	4342	4342
q2	2057	163	149	149
q3	10296	1879	1932	1879
q4	10397	1243	1322	1243
q5	8881	3871	3922	3871
q6	237	124	123	123
q7	2050	1600	1623	1600
q8	9293	2705	2695	2695
q9	10621	10345	10232	10232
q10	8612	3533	3495	3495
q11	424	241	249	241
q12	474	306	299	299
q13	18354	3972	4016	3972
q14	347	326	333	326
q15	507	458	457	457
q16	675	579	568	568
q17	1119	953	953	953
q18	7357	6870	6929	6870
q19	1768	1687	1630	1630
q20	514	303	304	303
q21	4436	4076	4066	4066
q22	537	444	432	432
Total cold run time: 116565 ms
Total hot run time: 49746 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4473	4292	4267	4267
q2	324	225	224	224
q3	4154	4161	4170	4161
q4	2765	2770	2753	2753
q5	7185	7176	7123	7123
q6	242	121	121	121
q7	3206	2800	2769	2769
q8	4372	4462	4470	4462
q9	16858	16990	16687	16687
q10	4212	4255	4270	4255
q11	766	708	673	673
q12	1036	877	849	849
q13	7158	3722	3721	3721
q14	446	428	428	428
q15	502	469	469	469
q16	740	667	673	667
q17	3887	3860	3765	3765
q18	8936	8748	8731	8731
q19	1715	1729	1683	1683
q20	2396	2123	2141	2123
q21	8444	8535	8467	8467
q22	1036	1001	997	997
Total cold run time: 84853 ms
Total hot run time: 79395 ms

@doris-robot
Copy link

doris-robot commented Jul 30, 2024

TPC-DS: Total hot run time: 204235 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 8853aeae3a2f4c323ee33608f9cbff42b0e99629, data reload: false

query1	941	417	382	382
query2	6578	2854	2682	2682
query3	6929	213	201	201
query4	20034	18109	18026	18026
query5	19757	6496	6462	6462
query6	283	218	230	218
query7	4159	303	316	303
query8	447	415	458	415
query9	3179	2750	2666	2666
query10	410	312	291	291
query11	11367	10830	10696	10696
query12	119	72	77	72
query13	5611	702	712	702
query14	17282	13302	13330	13302
query15	368	249	246	246
query16	6475	289	266	266
query17	1695	1465	883	883
query18	2321	427	410	410
query19	208	149	151	149
query20	84	77	82	77
query21	194	101	92	92
query22	5374	5086	5059	5059
query23	32622	31840	31748	31748
query24	7011	6543	6499	6499
query25	532	443	433	433
query26	526	162	160	160
query27	1880	299	297	297
query28	6115	2398	2374	2374
query29	2848	2774	2699	2699
query30	243	167	170	167
query31	924	729	733	729
query32	66	58	47	47
query33	389	264	261	261
query34	870	482	480	480
query35	1117	946	951	946
query36	1428	1400	1239	1239
query37	92	59	60	59
query38	3101	2939	2917	2917
query39	1371	1323	1300	1300
query40	208	98	99	98
query41	46	45	44	44
query42	80	86	81	81
query43	717	805	677	677
query44	1126	718	722	718
query45	253	245	242	242
query46	1230	955	977	955
query47	1902	1632	1770	1632
query48	1016	711	712	711
query49	627	377	360	360
query50	873	613	609	609
query51	4719	4717	4741	4717
query52	104	83	86	83
query53	448	333	323	323
query54	2659	2456	2496	2456
query55	91	85	90	85
query56	232	226	221	221
query57	1188	1128	1140	1128
query58	221	207	194	194
query59	4106	3944	4137	3944
query60	209	216	206	206
query61	96	94	92	92
query62	797	515	499	499
query63	495	343	350	343
query64	2444	1518	1515	1515
query65	3626	3556	3559	3556
query66	777	388	393	388
query67	15430	15703	17447	15703
query68	8408	689	678	678
query69	594	370	351	351
query70	1690	1569	1447	1447
query71	404	308	312	308
query72	6512	3468	3526	3468
query73	747	326	329	326
query74	6299	5871	5835	5835
query75	4578	3721	3717	3717
query76	4625	1164	1214	1164
query77	576	260	253	253
query78	12461	11460	11442	11442
query79	7497	637	645	637
query80	1054	404	406	404
query81	505	239	235	235
query82	1499	101	98	98
query83	169	131	129	129
query84	254	70	72	70
query85	880	341	335	335
query86	338	287	335	287
query87	3259	2987	3055	2987
query88	4994	2303	2319	2303
query89	354	276	287	276
query90	1933	209	213	209
query91	175	149	143	143
query92	64	55	59	55
query93	4299	579	551	551
query94	759	211	215	211
query95	1105	1091	1058	1058
query96	627	326	328	326
query97	6501	6378	6379	6378
query98	191	171	172	171
query99	2984	935	848	848
Total cold run time: 307005 ms
Total hot run time: 204235 ms

@doris-robot
Copy link

doris-robot commented Jul 30, 2024

ClickBench: Total hot run time: 30.34 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 8853aeae3a2f4c323ee33608f9cbff42b0e99629, data reload: false

query1	0.02	0.02	0.02
query2	0.07	0.02	0.02
query3	0.25	0.04	0.04
query4	1.80	0.05	0.06
query5	0.54	0.52	0.52
query6	1.25	0.61	0.64
query7	0.02	0.01	0.00
query8	0.04	0.03	0.02
query9	0.53	0.49	0.48
query10	0.54	0.54	0.54
query11	0.12	0.08	0.09
query12	0.11	0.09	0.09
query13	0.62	0.61	0.62
query14	0.79	0.79	0.78
query15	0.78	0.76	0.76
query16	0.37	0.39	0.36
query17	1.01	1.01	1.02
query18	0.22	0.24	0.26
query19	1.90	1.79	1.85
query20	0.02	0.01	0.01
query21	15.48	0.57	0.53
query22	2.04	2.18	1.64
query23	17.37	0.99	0.84
query24	6.47	0.73	1.40
query25	0.40	0.07	0.07
query26	0.67	0.19	0.16
query27	0.05	0.03	0.03
query28	6.60	0.73	0.74
query29	12.64	2.34	2.28
query30	0.60	0.52	0.51
query31	2.79	0.38	0.38
query32	3.38	0.49	0.50
query33	3.09	3.08	3.09
query34	15.26	4.79	4.77
query35	4.88	4.84	4.82
query36	1.05	1.01	1.01
query37	0.06	0.04	0.04
query38	0.04	0.02	0.02
query39	0.02	0.01	0.02
query40	0.16	0.14	0.15
query41	0.07	0.01	0.01
query42	0.02	0.02	0.01
query43	0.02	0.01	0.02
Total cold run time: 104.16 s
Total hot run time: 30.34 s

@doris-robot
Copy link

doris-robot commented Jul 30, 2024

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit 8853aeae3a2f4c323ee33608f9cbff42b0e99629 with default session variables
Stream load json:         19 seconds loaded 2358488459 Bytes, about 118 MB/s
Stream load orc:          59 seconds loaded 1101869774 Bytes, about 17 MB/s
Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select:       21.3 seconds inserted 10000000 Rows, about 469K ops/s

@englefly
Copy link
Contributor Author

englefly commented Jul 30, 2024

run p0

@englefly
Copy link
Contributor Author

englefly commented Jul 30, 2024

run external

@englefly
Copy link
Contributor Author

englefly commented Jul 30, 2024

run p0

1 similar comment
@englefly
Copy link
Contributor Author

englefly commented Jul 30, 2024

run p0

@morrySnow morrySnow merged commit a6fc082 into apache:branch-2.0 Jul 31, 2024
@englefly englefly deleted the pick38268 branch November 30, 2024 03:34
mongo360 pushed a commit to mongo360/doris that referenced this pull request Dec 11, 2024
@englefly
[feat](FE) add rest api to get last profile apache#38268 (apache#38450)
0e72eb5 
pick from master apache#38268
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@englefly @doris-robot @morrySnow