Skip to content

Conversation

@morningman
Copy link
Contributor

@morningman morningman commented Mar 28, 2024

bp #32977

Also fix some gson serde issue like:

XXX declares multiple JSON fields named runnable.

@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@morningman
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 49846 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit d1e418024a04d81fcabdea0c2e6e7aa168594fca, data reload: false

------ Round 1 ----------------------------------
q1	17784	4410	4316	4316
q2	2050	146	139	139
q3	10440	1911	1914	1911
q4	10351	1225	1318	1225
q5	8500	3961	3968	3961
q6	228	122	122	122
q7	2062	1608	1593	1593
q8	9323	2700	2714	2700
q9	10824	10515	10420	10420
q10	8651	3484	3510	3484
q11	415	244	237	237
q12	468	302	306	302
q13	18341	3949	3991	3949
q14	356	329	327	327
q15	511	463	446	446
q16	726	587	596	587
q17	1133	951	964	951
q18	7213	6800	6990	6800
q19	1657	1604	1545	1545
q20	519	307	324	307
q21	4428	4127	4122	4122
q22	495	402	404	402
Total cold run time: 116475 ms
Total hot run time: 49846 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4383	4321	4301	4301
q2	319	222	225	222
q3	4164	4131	4108	4108
q4	2750	2765	2735	2735
q5	7255	7146	7185	7146
q6	237	120	121	120
q7	3232	2863	2792	2792
q8	4344	4482	4499	4482
q9	17056	17107	17051	17051
q10	4273	4292	4322	4292
q11	755	662	677	662
q12	1028	870	881	870
q13	7369	3844	3794	3794
q14	456	422	431	422
q15	500	455	471	455
q16	765	710	710	710
q17	3830	3876	3954	3876
q18	8823	8752	8907	8752
q19	1720	1716	1682	1682
q20	2499	2252	2194	2194
q21	8943	8911	8926	8911
q22	1120	1064	1020	1020
Total cold run time: 85821 ms
Total hot run time: 80597 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 200982 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit d1e418024a04d81fcabdea0c2e6e7aa168594fca, data reload: false

query1	925	388	380	380
query2	6576	2338	2061	2061
query3	6918	201	196	196
query4	20038	17924	18060	17924
query5	19710	6515	6510	6510
query6	407	222	216	216
query7	5136	302	299	299
query8	272	244	236	236
query9	3147	2720	2661	2661
query10	412	289	312	289
query11	11308	10818	10728	10728
query12	119	76	66	66
query13	5579	647	642	642
query14	19016	13147	13430	13147
query15	360	230	229	229
query16	6418	266	255	255
query17	1328	1536	843	843
query18	2313	392	404	392
query19	197	150	149	149
query20	79	73	73	73
query21	181	94	93	93
query22	5214	5028	5061	5028
query23	32415	31900	32111	31900
query24	6735	6510	6565	6510
query25	519	423	417	417
query26	507	159	158	158
query27	1712	293	294	293
query28	6109	2297	2254	2254
query29	2933	2763	2739	2739
query30	235	161	161	161
query31	924	741	720	720
query32	62	56	58	56
query33	393	246	237	237
query34	844	470	482	470
query35	1094	923	876	876
query36	1207	1119	1113	1113
query37	89	64	63	63
query38	3046	2933	2934	2933
query39	1368	1325	1319	1319
query40	204	90	93	90
query41	35	37	31	31
query42	79	85	83	83
query43	658	615	573	573
query44	1128	722	727	722
query45	250	230	229	229
query46	1232	978	1000	978
query47	1940	1706	1705	1705
query48	1000	665	672	665
query49	618	361	362	361
query50	859	628	591	591
query51	4765	4664	4680	4664
query52	81	73	74	73
query53	437	319	321	319
query54	2657	2485	2468	2468
query55	79	84	82	82
query56	190	203	198	198
query57	1244	1036	1039	1036
query58	201	202	197	197
query59	3399	3395	3320	3320
query60	203	185	188	185
query61	83	79	83	79
query62	830	460	479	460
query63	468	333	332	332
query64	2452	1472	1458	1458
query65	3651	3544	3535	3535
query66	753	364	365	364
query67	15503	14886	15414	14886
query68	6879	670	665	665
query69	563	343	345	343
query70	1459	1463	1437	1437
query71	417	295	311	295
query72	6514	3432	3419	3419
query73	725	318	319	318
query74	6260	5925	5786	5786
query75	4576	3670	3788	3670
query76	4413	1124	1167	1124
query77	533	252	248	248
query78	12650	11588	11587	11587
query79	8231	643	660	643
query80	2238	396	384	384
query81	521	230	230	230
query82	1657	97	95	95
query83	178	143	126	126
query84	256	67	69	67
query85	1346	282	285	282
query86	360	307	301	301
query87	3260	3017	2996	2996
query88	5199	2309	2327	2309
query89	351	292	311	292
query90	1880	208	194	194
query91	157	119	113	113
query92	54	50	50	50
query93	4419	594	595	594
query94	987	201	205	201
query95	1138	1059	1051	1051
query96	628	338	331	331
query97	6423	6424	6367	6367
query98	192	175	174	174
query99	2982	981	970	970
Total cold run time: 308290 ms
Total hot run time: 200982 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.25 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit d1e418024a04d81fcabdea0c2e6e7aa168594fca, data reload: false

query1	0.02	0.02	0.03
query2	0.06	0.02	0.02
query3	0.24	0.04	0.05
query4	1.80	0.07	0.07
query5	0.53	0.52	0.52
query6	1.24	0.60	0.63
query7	0.01	0.01	0.00
query8	0.03	0.02	0.02
query9	0.51	0.46	0.49
query10	0.53	0.52	0.54
query11	0.12	0.09	0.08
query12	0.12	0.09	0.09
query13	0.62	0.61	0.61
query14	0.78	0.80	0.78
query15	0.77	0.76	0.75
query16	0.38	0.41	0.36
query17	1.01	1.01	1.02
query18	0.23	0.26	0.26
query19	1.92	1.82	1.85
query20	0.02	0.01	0.01
query21	15.92	0.56	0.55
query22	2.06	2.42	1.71
query23	17.17	1.01	0.81
query24	6.18	1.67	1.51
query25	0.36	0.12	0.05
query26	0.79	0.18	0.15
query27	0.04	0.04	0.04
query28	6.29	0.72	0.77
query29	12.66	2.31	2.44
query30	0.61	0.53	0.57
query31	2.82	0.39	0.38
query32	3.37	0.50	0.49
query33	3.11	3.10	3.07
query34	15.30	4.81	4.81
query35	4.84	4.86	4.82
query36	1.06	1.02	1.02
query37	0.06	0.05	0.04
query38	0.03	0.02	0.02
query39	0.02	0.01	0.01
query40	0.16	0.13	0.14
query41	0.07	0.01	0.01
query42	0.02	0.01	0.01
query43	0.02	0.02	0.02
Total cold run time: 103.9 s
Total hot run time: 31.25 s

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit d1e418024a04d81fcabdea0c2e6e7aa168594fca with default session variables
Stream load json:         20 seconds loaded 2358488459 Bytes, about 112 MB/s
Stream load orc:          59 seconds loaded 1101869774 Bytes, about 17 MB/s
Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select:       20.6 seconds inserted 10000000 Rows, about 485K ops/s

@morningman morningman merged commit 59fb37e into apache:branch-2.0 Mar 29, 2024
mongo360 pushed a commit to mongo360/doris that referenced this pull request Aug 16, 2024
…pache#32977 (apache#32979)

bp apache#32977

Also fix some gson serde issue like:
```
XXX declares multiple JSON fields named runnable.
```
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants