Skip to content

Conversation

@yagagagaga
Copy link
Contributor

Proposed changes

pick from #39521

According the [JEP 400](https://openjdk.org/jeps/400), UTF-8 was be used
as the default charset of the JavaSE 18. But when you use the version
below 18, the default charset depends on your locale. Usually, it can
work well in many sence, but Apache Doris only supports UTF-8 as its
charset, which may occur some decoding incorrectly.

So it is necessary to set UTF8 as the default JDK charset.

(cherry picked from commit 48991df)
@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@yagagagaga
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 49248 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit cdbc052b870c787a4a5e82f3b07798aa77995512, data reload: false

------ Round 1 ----------------------------------
q1	17803	4399	4316	4316
q2	2064	157	150	150
q3	10378	1870	1904	1870
q4	10374	1259	1296	1259
q5	8518	3897	3966	3897
q6	231	124	122	122
q7	2026	1620	1584	1584
q8	9297	2736	2696	2696
q9	10584	10165	9891	9891
q10	8606	3545	3474	3474
q11	413	249	252	249
q12	466	295	298	295
q13	18358	3989	4014	3989
q14	365	328	334	328
q15	511	462	461	461
q16	516	450	466	450
q17	1122	960	946	946
q18	7208	6948	6993	6948
q19	1669	1597	1528	1528
q20	525	326	322	322
q21	4369	4149	4092	4092
q22	494	381	398	381
Total cold run time: 115897 ms
Total hot run time: 49248 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4282	4281	4282	4281
q2	326	224	223	223
q3	4188	4138	4129	4129
q4	2755	2756	2745	2745
q5	7144	7050	7071	7050
q6	234	118	119	118
q7	3236	2917	2779	2779
q8	4342	4474	4503	4474
q9	14126	13953	14048	13953
q10	4228	4275	4259	4259
q11	744	669	679	669
q12	1035	864	858	858
q13	6927	3725	3689	3689
q14	456	424	421	421
q15	496	456	454	454
q16	633	602	608	602
q17	3827	3818	3817	3817
q18	8818	8717	8798	8717
q19	1721	1680	1652	1652
q20	2333	2114	2144	2114
q21	8536	8424	8434	8424
q22	1004	981	921	921
Total cold run time: 81391 ms
Total hot run time: 76349 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 213246 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit cdbc052b870c787a4a5e82f3b07798aa77995512, data reload: false

query1	938	392	435	392
query2	6551	2202	2029	2029
query3	6915	205	211	205
query4	23432	21592	21545	21545
query5	19741	6538	6645	6538
query6	309	219	232	219
query7	4273	305	302	302
query8	254	285	272	272
query9	3101	2657	2588	2588
query10	421	315	313	313
query11	15870	15166	15582	15166
query12	128	79	72	72
query13	1033	453	443	443
query14	17766	13431	13790	13431
query15	376	220	233	220
query16	6445	289	259	259
query17	1612	961	933	933
query18	893	325	316	316
query19	214	159	159	159
query20	82	78	78	78
query21	188	101	97	97
query22	5214	5067	5025	5025
query23	34203	33320	33644	33320
query24	6870	6347	6318	6318
query25	517	432	428	428
query26	794	168	170	168
query27	2372	305	298	298
query28	6130	2257	2229	2229
query29	2983	2698	2670	2670
query30	245	171	172	171
query31	961	727	754	727
query32	72	66	60	60
query33	441	256	274	256
query34	846	468	489	468
query35	1146	961	942	942
query36	1453	1294	1231	1231
query37	89	59	57	57
query38	3011	2951	2915	2915
query39	1396	1329	1321	1321
query40	213	96	99	96
query41	39	37	38	37
query42	85	89	89	89
query43	582	639	550	550
query44	1179	736	731	731
query45	250	233	228	228
query46	1254	988	983	983
query47	2037	2120	1866	1866
query48	532	440	410	410
query49	626	376	371	371
query50	868	601	604	601
query51	4820	4690	4648	4648
query52	98	92	86	86
query53	236	190	180	180
query54	2676	2470	2498	2470
query55	85	84	92	84
query56	229	206	217	206
query57	1210	1058	1095	1058
query58	228	221	213	213
query59	3546	3286	3335	3286
query60	229	207	205	205
query61	101	97	99	97
query62	834	458	600	458
query63	204	183	180	180
query64	3353	1569	1447	1447
query65	3623	3600	3557	3557
query66	794	401	423	401
query67	16572	15698	15513	15513
query68	9296	657	636	636
query69	499	286	273	273
query70	1545	1453	1414	1414
query71	409	303	320	303
query72	6822	4883	4903	4883
query73	761	338	318	318
query74	6299	5914	5796	5796
query75	4740	3613	3688	3613
query76	4933	1145	1211	1145
query77	732	258	257	257
query78	12839	11811	11605	11605
query79	8511	650	650	650
query80	2307	399	385	385
query81	487	237	234	234
query82	1649	99	97	97
query83	169	137	138	137
query84	258	74	70	70
query85	1088	330	321	321
query86	348	287	284	284
query87	3241	2998	2998	2998
query88	4838	2389	2393	2389
query89	527	318	273	273
query90	1927	211	218	211
query91	160	129	128	128
query92	57	51	56	51
query93	6470	563	529	529
query94	754	208	212	208
query95	2055	2061	2011	2011
query96	665	334	333	333
query97	6546	6363	6495	6363
query98	218	222	212	212
query99	2986	887	905	887
Total cold run time: 319924 ms
Total hot run time: 213246 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.05 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit cdbc052b870c787a4a5e82f3b07798aa77995512, data reload: false

query1	0.03	0.02	0.02
query2	0.07	0.03	0.03
query3	0.25	0.04	0.04
query4	1.79	0.08	0.07
query5	0.56	0.52	0.52
query6	1.29	0.63	0.62
query7	0.01	0.01	0.01
query8	0.04	0.03	0.02
query9	0.52	0.48	0.47
query10	0.55	0.53	0.53
query11	0.12	0.08	0.08
query12	0.12	0.09	0.09
query13	0.62	0.62	0.62
query14	0.77	0.79	0.79
query15	0.78	0.74	0.76
query16	0.36	0.37	0.38
query17	1.01	1.03	1.00
query18	0.22	0.26	0.24
query19	1.92	1.83	1.86
query20	0.02	0.01	0.01
query21	15.84	0.58	0.53
query22	2.16	2.51	1.77
query23	17.42	1.04	0.97
query24	7.06	1.50	1.06
query25	0.36	0.08	0.07
query26	0.82	0.16	0.15
query27	0.05	0.04	0.04
query28	5.63	0.74	0.71
query29	12.64	2.39	2.27
query30	0.59	0.52	0.50
query31	2.83	0.39	0.38
query32	3.39	0.50	0.50
query33	3.05	3.07	3.06
query34	15.24	4.83	4.81
query35	4.86	4.88	4.86
query36	1.08	1.01	1.03
query37	0.06	0.05	0.04
query38	0.04	0.02	0.02
query39	0.02	0.01	0.01
query40	0.16	0.15	0.15
query41	0.06	0.01	0.02
query42	0.02	0.01	0.02
query43	0.02	0.02	0.02
Total cold run time: 104.45 s
Total hot run time: 31.05 s

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit cdbc052b870c787a4a5e82f3b07798aa77995512 with default session variables
Stream load json:         20 seconds loaded 2358488459 Bytes, about 112 MB/s
Stream load orc:          58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select:       21.3 seconds inserted 10000000 Rows, about 469K ops/s

@yagagagaga yagagagaga closed this Feb 25, 2025
@yagagagaga yagagagaga deleted the cherry-pick-2.0-39521 branch February 25, 2025 02:38
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants