Skip to content

Conversation

@zy-kkk
Copy link
Member

@zy-kkk zy-kkk commented Mar 21, 2024

Proposed changes

Issue Number: close #xxx

pick #32511

Further comments

If this is a relatively large or complex change, kick off the discussion at dev@doris.apache.org by explaining why you chose the solution you did and what alternatives you considered, etc...

@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@zy-kkk
Copy link
Member Author

zy-kkk commented Mar 21, 2024

run buildall

@zy-kkk zy-kkk changed the title [Feature](information_schema) add processlist table for information_schema db [branch-2.0][Feature](information_schema) add processlist table for information_schema db Mar 21, 2024
Copy link
Contributor

@github-actions github-actions bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

clang-tidy made some suggestions

{"STATE", TYPE_VARCHAR, sizeof(StringRef), false},
{"INFO", TYPE_VARCHAR, sizeof(StringRef), false}};

SchemaProcessListScanner::SchemaProcessListScanner()
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

warning: use '= default' to define a trivial default constructor [modernize-use-equals-default]

be/src/exec/schema_scanner/schema_processlist_scanner.cpp:43:

-         : SchemaScanner(_s_processlist_columns, TSchemaTableType::SCH_PROCESSLIST) {}
+         : SchemaScanner(_s_processlist_columns, TSchemaTableType::SCH_PROCESSLIST) = default;

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 37.79% (8041/21280)
Line Coverage: 29.44% (65627/222904)
Region Coverage: 28.92% (33779/116812)
Branch Coverage: 24.76% (17338/70024)
Coverage Report: http://coverage.selectdb-in.cc/coverage/01af6bcc851e3c84dac70223a5be56d1f4bd9adc_01af6bcc851e3c84dac70223a5be56d1f4bd9adc/report/index.html

@doris-robot
Copy link

TPC-H: Total hot run time: 50380 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 01af6bcc851e3c84dac70223a5be56d1f4bd9adc, data reload: false

------ Round 1 ----------------------------------
q1	17606	4462	4428	4428
q2	2028	149	140	140
q3	10286	1936	1998	1936
q4	10108	1291	1345	1291
q5	8488	4152	3963	3963
q6	228	128	124	124
q7	2050	1605	1590	1590
q8	9356	2760	2765	2760
q9	11015	10549	10453	10453
q10	8654	3547	3559	3547
q11	421	245	248	245
q12	461	300	298	298
q13	18321	3975	4016	3975
q14	359	317	330	317
q15	505	450	465	450
q16	697	591	588	588
q17	1144	979	978	978
q18	7365	6919	6949	6919
q19	1733	1552	1540	1540
q20	532	323	324	323
q21	4530	4149	4117	4117
q22	494	398	399	398
Total cold run time: 116381 ms
Total hot run time: 50380 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4328	4322	4306	4306
q2	324	224	224	224
q3	4227	4220	4155	4155
q4	2782	2767	2775	2767
q5	7334	7215	7179	7179
q6	240	120	119	119
q7	3262	2903	2806	2806
q8	4385	4467	4510	4467
q9	17219	17000	17059	17000
q10	4248	4276	4303	4276
q11	767	682	692	682
q12	1028	851	856	851
q13	7262	3733	3732	3732
q14	445	423	423	423
q15	501	463	455	455
q16	770	703	725	703
q17	3825	3843	3842	3842
q18	8879	8668	8899	8668
q19	1734	1719	1698	1698
q20	2371	2138	2092	2092
q21	8584	8533	8614	8533
q22	1035	975	933	933
Total cold run time: 85550 ms
Total hot run time: 79911 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 201552 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 01af6bcc851e3c84dac70223a5be56d1f4bd9adc, data reload: false

query1	933	396	386	386
query2	5875	2273	2077	2077
query3	6899	207	209	207
query4	20860	18066	18117	18066
query5	19335	6551	6515	6515
query6	284	224	224	224
query7	4148	315	313	313
query8	266	262	241	241
query9	3189	2728	2648	2648
query10	409	278	283	278
query11	11339	10676	10688	10676
query12	120	82	70	70
query13	5565	658	659	658
query14	18014	13947	13638	13638
query15	356	232	246	232
query16	6165	276	269	269
query17	1726	1335	880	880
query18	2283	420	411	411
query19	214	148	151	148
query20	77	77	76	76
query21	176	96	92	92
query22	5197	4886	4948	4886
query23	32659	32073	32318	32073
query24	6965	6526	6495	6495
query25	543	425	418	418
query26	538	172	161	161
query27	1889	302	304	302
query28	6108	2267	2237	2237
query29	2820	2616	2656	2616
query30	242	164	161	161
query31	911	737	735	735
query32	65	61	60	60
query33	406	266	265	265
query34	855	477	483	477
query35	1084	952	899	899
query36	1311	1234	1140	1140
query37	89	62	60	60
query38	3171	2948	2895	2895
query39	1379	1332	1332	1332
query40	210	91	95	91
query41	34	32	32	32
query42	80	92	82	82
query43	688	650	576	576
query44	1155	731	729	729
query45	243	228	228	228
query46	1246	986	971	971
query47	1853	1741	1931	1741
query48	985	672	669	669
query49	628	367	372	367
query50	870	608	604	604
query51	4824	4706	4644	4644
query52	90	83	79	79
query53	458	324	313	313
query54	2671	2465	2468	2465
query55	97	80	83	80
query56	211	206	223	206
query57	1237	1131	1111	1111
query58	217	209	202	202
query59	3558	3337	3120	3120
query60	215	199	198	198
query61	88	86	84	84
query62	872	468	497	468
query63	480	339	338	338
query64	2444	1489	1302	1302
query65	3697	3630	3607	3607
query66	812	372	363	363
query67	15901	15317	16146	15317
query68	7256	669	673	669
query69	552	363	374	363
query70	1607	1386	1284	1284
query71	381	308	304	304
query72	6299	3540	3418	3418
query73	745	315	322	315
query74	6239	5869	5825	5825
query75	4580	3615	3796	3615
query76	4318	1166	1240	1166
query77	521	242	253	242
query78	12930	11856	11480	11480
query79	8353	651	666	651
query80	1974	396	393	393
query81	512	239	227	227
query82	1252	96	94	94
query83	179	135	130	130
query84	256	74	69	69
query85	764	292	278	278
query86	350	283	294	283
query87	3254	2992	2973	2973
query88	5176	2333	2342	2333
query89	365	322	316	316
query90	1798	213	207	207
query91	165	124	115	115
query92	57	53	54	53
query93	4971	606	551	551
query94	773	210	204	204
query95	1107	1039	1065	1039
query96	646	326	337	326
query97	6434	6380	6304	6304
query98	193	176	179	176
query99	2969	884	845	845
Total cold run time: 307305 ms
Total hot run time: 201552 ms

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit 01af6bcc851e3c84dac70223a5be56d1f4bd9adc with default session variables
Stream load json:         20 seconds loaded 2358488459 Bytes, about 112 MB/s
Stream load orc:          59 seconds loaded 1101869774 Bytes, about 17 MB/s
Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select:       22.5 seconds inserted 10000000 Rows, about 444K ops/s

@xiaokang xiaokang merged commit a715ddc into apache:branch-2.0 Mar 21, 2024
@zy-kkk zy-kkk deleted the bi2 branch March 22, 2024 03:15
mongo360 pushed a commit to mongo360/doris that referenced this pull request Aug 16, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants