Skip to content

Conversation

@amorynan
Copy link
Contributor

@amorynan amorynan commented Nov 1, 2024

What problem does this PR solve?

Issue Number: close #xxx

Related PR: #xxx

Problem Summary:
before this pr:
if we has ipv6 column in table which is support store_row_column
we insert some data
and then make sql with update we will meet core

*** Aborted at 1730367188 (unix time) try "date -d @1730367188" if you are using GNU date ***
*** Current BE git commitID: face753ded ***
*** SIGSEGV invalid permissions for mapped object (@0x60c000a339ae) received by PID 4176451 (TID 4187168 OR 0x7ff774f5a700) from PID 10697134; stack trace: ***
 0# doris::signal::(anonymous namespace)::FailureSignalHandler(int, siginfo_t*, void*) at /mnt/disk1/wangqiannan/amory/doris/be/src/common/signal_handler.h:421
 1# PosixSignals::chained_handler(int, siginfo*, void*) [clone .part.0] in /mnt/disk1/wangqiannan/tool/jdk-17.0.10/lib/server/libjvm.so
 2# JVM_handle_linux_signal in /mnt/disk1/wangqiannan/tool/jdk-17.0.10/lib/server/libjvm.so
 3# 0x00007FFFF63AEB50 in /lib64/libc.so.6
 4# doris::IPv6Value::from_string(unsigned __int128&, char const*, unsigned long) at /mnt/disk1/wangqiannan/amory/doris/be/src/vec/runtime/ipv6_value.h:55
 5# bool doris::vectorized::read_ipv6_text_impl<unsigned __int128>(unsigned __int128&, doris::vectorized::ReadBuffer&) at /mnt/disk1/wangqiannan/amory/doris/be/src/vec/io/io_helper.h:316
 6# doris::vectorized::DataTypeIPv6SerDe::read_one_cell_from_jsonb(doris::vectorized::IColumn&, doris::JsonbValue const*) const at /mnt/disk1/wangqiannan/amory/doris/be/src/vec/data_types/serde/data_type_ipv6_serde.cpp:76
 7# doris::vectorized::JsonbSerializeUtil::jsonb_to_block(std::vector<std::shared_ptr<doris::vectorized::DataTypeSerDe>, std::allocator<std::shared_ptr<doris::vectorized::DataTypeSerDe> > > const&, char const*, unsigned long, std::unordered_map<unsigned int, unsigned int, std::hash<unsigned int>, std::equal_to<unsigned int>, std::allocator<std::pair<unsigned int const, unsigned int> > > const&, doris::vectorized::Block&, std::vector<std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >, std::allocator<std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > > > const&, std::unordered_set<int, std::hash<int>, std::equal_to<int>, std::allocator<int> > const&) at /mnt/disk1/wangqiannan/amory/doris/be/src/vec/jsonb/serialize.cpp:104
 8# doris::vectorized::JsonbSerializeUtil::jsonb_to_block(std::vector<std::shared_ptr<doris::vectorized::DataTypeSerDe>, std::allocator<std::shared_ptr<doris::vectorized::DataTypeSerDe> > > const&, doris::vectorized::ColumnStr<unsigned int> const&, std::unordered_map<unsigned int, unsigned int, std::hash<unsigned int>, std::equal_to<unsigned int>, std::allocator<std::pair<unsigned int const, unsigned int> > > const&, doris::vectorized::Block&, std::vector<std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >, std::allocator<std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > > > const&, std::unordered_set<int, std::hash<int>, std::equal_to<int>, std::allocator<int> > const&) at /mnt/disk1/wangqiannan/amory/doris/be/src/vec/jsonb/serialize.cpp:83
 9# doris::BaseTablet::fetch_value_through_row_column(std::shared_ptr<doris::Rowset>, doris::TabletSchema const&, unsigned int, std::vector<unsigned int, std::allocator<unsigned int> > const&, std::vector<unsigned int, std::allocator<unsigned int> > const&, doris::vectorized::Block&) at /mnt/disk1/wangqiannan/amory/doris/be/src/olap/base_tablet.cpp:885
10# doris::FixedReadPlan::read_columns_by_plan(doris::TabletSchema const&, std::vector<unsigned int, std::allocator<unsigned int> >, std::map<doris::RowsetId, std::shared_ptr<doris::Rowset>, std::less<doris::RowsetId>, std::allocator<std::pair<doris::RowsetId const, std::shared_ptr<doris::Rowset> > > > const&, doris::vectorized::Block&, std::map<unsigned int, unsigned int, std::less<unsigned int>, std::allocator<std::pair<unsigned int const, unsigned int> > >*, signed char const*) const at /mnt/disk1/wangqiannan/amory/doris/be/src/olap/partial_update_info.cpp:295
11# doris::FixedReadPlan::fill_missing_columns(doris::RowsetWriterContext*, std::map<doris::RowsetId, std::shared_ptr<doris::Rowset>, std::less<doris::RowsetId>, std::allocator<std::pair<doris::RowsetId const, std::shared_ptr<doris::Rowset> > > > const&, doris::TabletSchema const&, doris::vectorized::Block&, std::vector<bool, std::allocator<bool> > const&, bool, unsigned long const&, doris::vectorized::Block const*) const at /mnt/disk1/wangqiannan/amory/doris/be/src/olap/partial_update_info.cpp:332
12# doris::segment_v2::VerticalSegmentWriter::_append_block_with_partial_content(doris::segment_v2::RowsInBlock&, doris::vectorized::Block&) at /mnt/disk1/wangqiannan/amory/doris/be/src/olap/rowset/segment_v2/vertical_segment_writer.cpp:502

Check List (For Committer)

  • Test

    • Regression test
    • Unit Test
    • Manual test (add detailed scripts or steps below)
    • No need to test or manual test. Explain why:
      • This is a refactor/code format and no logic has been changed.
      • Previous test can cover this change.
      • No colde files have been changed.
      • Other reason
  • Behavior changed:

    • No.
    • Yes.
  • Does this need documentation?

    • No.
    • Yes.
  • Release note

    None

Check List (For Reviewer who merge this PR)

  • Confirm the release note
  • Confirm test cases
  • Confirm document
  • Add branch pick label

@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@amorynan
Copy link
Contributor Author

amorynan commented Nov 1, 2024

run buildall

Copy link
Contributor

@github-actions github-actions bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

clang-tidy made some suggestions

@amorynan
Copy link
Contributor Author

amorynan commented Nov 1, 2024

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 41763 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit cf0ea2d3eec077f2ea02807e880b5110b393a9e6, data reload: false

------ Round 1 ----------------------------------
q1	17573	7494	7300	7300
q2	2062	161	158	158
q3	10564	1139	1186	1139
q4	10224	897	848	848
q5	7738	3168	3086	3086
q6	237	143	144	143
q7	1008	608	596	596
q8	9509	1978	2041	1978
q9	6942	6507	6495	6495
q10	7152	2411	2447	2411
q11	467	265	264	264
q12	499	215	208	208
q13	17773	3030	3099	3030
q14	244	210	211	210
q15	578	522	512	512
q16	685	571	579	571
q17	981	560	586	560
q18	7404	6753	6730	6730
q19	1349	1025	1025	1025
q20	475	182	183	182
q21	4009	3296	3306	3296
q22	1131	1038	1021	1021
Total cold run time: 108604 ms
Total hot run time: 41763 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7298	7304	7224	7224
q2	326	227	222	222
q3	2972	2810	2802	2802
q4	1984	1742	1737	1737
q5	5501	5488	5546	5488
q6	222	137	137	137
q7	2124	1731	1710	1710
q8	3271	3390	3436	3390
q9	8628	8639	8665	8639
q10	3527	3454	3410	3410
q11	594	494	501	494
q12	799	607	569	569
q13	14258	3008	3022	3008
q14	308	256	275	256
q15	552	500	516	500
q16	664	631	630	630
q17	1855	1582	1568	1568
q18	7693	7413	7284	7284
q19	1685	1539	1596	1539
q20	2088	1828	1835	1828
q21	5436	5172	5230	5172
q22	1126	995	1032	995
Total cold run time: 72911 ms
Total hot run time: 58602 ms

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 37.83% (9825/25971)
Line Coverage: 28.99% (81618/281543)
Region Coverage: 28.28% (42169/149121)
Branch Coverage: 24.85% (21388/86074)
Coverage Report: http://coverage.selectdb-in.cc/coverage/cf0ea2d3eec077f2ea02807e880b5110b393a9e6_cf0ea2d3eec077f2ea02807e880b5110b393a9e6/report/index.html

@doris-robot
Copy link

TPC-DS: Total hot run time: 192044 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit cf0ea2d3eec077f2ea02807e880b5110b393a9e6, data reload: false

query1	856	373	365	365
query2	3249	2152	2152	2152
query3	4070	211	221	211
query4	33070	23690	23635	23635
query5	2661	460	445	445
query6	229	175	168	168
query7	3303	310	306	306
query8	258	227	220	220
query9	7972	2821	2810	2810
query10	404	249	257	249
query11	18039	15269	15206	15206
query12	139	99	100	99
query13	1232	457	434	434
query14	9133	6960	6862	6862
query15	239	180	177	177
query16	6935	427	458	427
query17	958	560	553	553
query18	1985	297	302	297
query19	363	150	154	150
query20	119	107	107	107
query21	210	103	100	100
query22	4378	4407	4238	4238
query23	35074	33962	34176	33962
query24	12563	2752	2787	2752
query25	697	395	396	395
query26	2073	168	166	166
query27	2793	299	294	294
query28	7897	2619	2632	2619
query29	959	418	425	418
query30	291	153	157	153
query31	1016	777	805	777
query32	89	58	62	58
query33	735	270	270	270
query34	1003	501	509	501
query35	899	722	719	719
query36	1084	940	974	940
query37	181	75	81	75
query38	4370	4351	4313	4313
query39	1484	1418	1420	1418
query40	238	104	105	104
query41	48	47	46	46
query42	112	104	102	102
query43	548	486	482	482
query44	1269	881	878	878
query45	182	165	165	165
query46	1126	712	692	692
query47	1966	1814	1842	1814
query48	410	322	327	322
query49	896	404	397	397
query50	818	397	393	393
query51	7431	7162	7139	7139
query52	103	92	90	90
query53	255	186	188	186
query54	986	423	447	423
query55	84	81	80	80
query56	262	251	247	247
query57	1275	1163	1189	1163
query58	216	191	200	191
query59	3180	3037	3023	3023
query60	272	243	249	243
query61	101	99	102	99
query62	873	678	672	672
query63	209	183	176	176
query64	4280	657	601	601
query65	3335	3215	3198	3198
query66	1158	308	307	307
query67	16114	15685	15818	15685
query68	4690	665	673	665
query69	400	249	249	249
query70	1172	1132	1030	1030
query71	385	261	244	244
query72	5926	4011	3944	3944
query73	767	361	374	361
query74	10055	9024	8945	8945
query75	3460	2664	2680	2664
query76	2526	1011	1102	1011
query77	419	284	275	275
query78	10540	9425	9439	9425
query79	1107	615	620	615
query80	689	462	424	424
query81	513	232	234	232
query82	288	111	118	111
query83	197	140	138	138
query84	257	70	74	70
query85	922	291	278	278
query86	327	300	289	289
query87	4778	4711	4800	4711
query88	3278	2213	2172	2172
query89	390	294	292	292
query90	1898	185	180	180
query91	138	98	96	96
query92	59	48	49	48
query93	1070	606	603	603
query94	786	273	268	268
query95	335	236	240	236
query96	618	278	279	278
query97	2841	2744	2754	2744
query98	206	200	196	196
query99	1511	1291	1313	1291
Total cold run time: 283305 ms
Total hot run time: 192044 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 32.66 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit cf0ea2d3eec077f2ea02807e880b5110b393a9e6, data reload: false

query1	0.03	0.03	0.04
query2	0.06	0.03	0.03
query3	0.23	0.06	0.07
query4	1.63	0.10	0.11
query5	0.41	0.40	0.40
query6	1.16	0.66	0.66
query7	0.02	0.01	0.01
query8	0.04	0.03	0.03
query9	0.56	0.48	0.50
query10	0.56	0.56	0.57
query11	0.15	0.11	0.12
query12	0.14	0.12	0.12
query13	0.61	0.61	0.60
query14	2.74	2.81	2.82
query15	0.90	0.82	0.82
query16	0.38	0.38	0.40
query17	1.04	1.04	1.05
query18	0.19	0.19	0.19
query19	1.99	1.83	1.96
query20	0.01	0.01	0.02
query21	15.36	0.60	0.61
query22	2.45	2.61	1.54
query23	17.00	0.90	0.82
query24	3.46	1.27	1.85
query25	0.25	0.14	0.14
query26	0.60	0.13	0.13
query27	0.05	0.04	0.04
query28	9.77	1.09	1.06
query29	12.56	3.26	3.24
query30	0.25	0.06	0.05
query31	2.87	0.38	0.36
query32	3.29	0.46	0.46
query33	3.00	3.03	3.02
query34	16.87	4.47	4.43
query35	4.52	4.45	4.53
query36	0.69	0.48	0.48
query37	0.09	0.06	0.06
query38	0.05	0.03	0.03
query39	0.04	0.03	0.02
query40	0.16	0.12	0.13
query41	0.08	0.03	0.02
query42	0.04	0.02	0.02
query43	0.03	0.03	0.03
Total cold run time: 106.33 s
Total hot run time: 32.66 s

@amorynan
Copy link
Contributor Author

amorynan commented Nov 4, 2024

run buildall

xiaokang
xiaokang previously approved these changes Nov 4, 2024
Copy link
Contributor

@xiaokang xiaokang left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@github-actions
Copy link
Contributor

github-actions bot commented Nov 4, 2024

PR approved by at least one committer and no changes requested.

@github-actions github-actions bot added approved Indicates a PR has been approved by one committer. reviewed labels Nov 4, 2024
@github-actions
Copy link
Contributor

github-actions bot commented Nov 4, 2024

PR approved by anyone and no changes requested.

@doris-robot
Copy link

TPC-H: Total hot run time: 41834 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit b40e54ad23ee7c69900cdc5dbd749ff157860ddb, data reload: false

------ Round 1 ----------------------------------
q1	17768	7558	7328	7328
q2	2048	159	178	159
q3	10674	1395	1194	1194
q4	10426	911	834	834
q5	7789	3347	3139	3139
q6	243	155	153	153
q7	1037	621	610	610
q8	9358	1968	1995	1968
q9	6747	6473	6487	6473
q10	7046	2436	2437	2436
q11	462	255	264	255
q12	408	220	219	219
q13	17775	3030	3010	3010
q14	236	222	197	197
q15	582	528	518	518
q16	639	593	580	580
q17	984	589	630	589
q18	7521	6737	6759	6737
q19	1339	1012	1051	1012
q20	499	192	177	177
q21	4011	3225	3299	3225
q22	1104	1021	1028	1021
Total cold run time: 108696 ms
Total hot run time: 41834 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7321	7284	7308	7284
q2	320	228	228	228
q3	2960	2789	2811	2789
q4	1993	1727	1748	1727
q5	5496	5541	5531	5531
q6	218	139	137	137
q7	2144	1745	1678	1678
q8	3257	3421	3449	3421
q9	8666	8630	8600	8600
q10	3530	3477	3442	3442
q11	602	526	495	495
q12	757	609	584	584
q13	8906	2998	3000	2998
q14	314	257	271	257
q15	576	516	515	515
q16	700	623	617	617
q17	1871	1590	1577	1577
q18	7869	7654	7561	7561
q19	1691	1566	1588	1566
q20	2084	1800	1845	1800
q21	5459	5227	5322	5227
q22	1106	1012	1004	1004
Total cold run time: 67840 ms
Total hot run time: 59038 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 191761 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit b40e54ad23ee7c69900cdc5dbd749ff157860ddb, data reload: false

query1	999	385	369	369
query2	6514	2018	2102	2018
query3	6790	219	214	214
query4	34234	23955	23533	23533
query5	4365	464	430	430
query6	261	170	159	159
query7	4595	302	302	302
query8	283	219	219	219
query9	9383	2727	2718	2718
query10	486	255	257	255
query11	18349	15410	15154	15154
query12	156	101	103	101
query13	1675	432	410	410
query14	9767	6615	7765	6615
query15	317	182	179	179
query16	8102	468	458	458
query17	1738	583	560	560
query18	2131	298	295	295
query19	366	149	148	148
query20	114	111	107	107
query21	205	100	101	100
query22	4517	4558	4470	4470
query23	34946	34211	34310	34211
query24	11069	2786	2817	2786
query25	675	406	407	406
query26	1279	168	156	156
query27	2451	278	280	278
query28	7819	2470	2435	2435
query29	865	435	432	432
query30	315	153	163	153
query31	1043	781	749	749
query32	100	55	61	55
query33	763	277	281	277
query34	981	517	520	517
query35	876	730	716	716
query36	1108	948	950	948
query37	150	78	79	78
query38	4450	4218	4265	4218
query39	1492	1419	1595	1419
query40	205	99	100	99
query41	49	46	47	46
query42	107	97	98	97
query43	528	484	472	472
query44	1222	837	822	822
query45	184	163	173	163
query46	1160	697	684	684
query47	1957	1845	1861	1845
query48	418	322	337	322
query49	1166	406	419	406
query50	802	400	398	398
query51	7299	7215	7204	7204
query52	102	90	88	88
query53	261	180	182	180
query54	1310	430	433	430
query55	81	78	76	76
query56	257	248	246	246
query57	1286	1197	1143	1143
query58	238	208	214	208
query59	3231	3085	2921	2921
query60	278	246	243	243
query61	102	108	107	107
query62	857	668	693	668
query63	212	189	189	189
query64	5300	645	663	645
query65	3346	3247	3245	3245
query66	1452	315	310	310
query67	16143	15783	16029	15783
query68	4812	576	571	571
query69	438	286	255	255
query70	1193	1088	1117	1088
query71	408	254	247	247
query72	6789	4053	3992	3992
query73	777	353	362	353
query74	10227	9021	9033	9021
query75	3436	2675	2699	2675
query76	2928	1140	1118	1118
query77	380	274	268	268
query78	10370	9541	9431	9431
query79	1131	578	579	578
query80	755	414	414	414
query81	517	241	232	232
query82	1277	119	124	119
query83	234	134	139	134
query84	228	68	66	66
query85	1107	302	297	297
query86	313	267	297	267
query87	4867	4746	4654	4654
query88	3265	2173	2116	2116
query89	385	291	293	291
query90	2084	185	182	182
query91	137	103	103	103
query92	57	46	48	46
query93	1058	545	553	545
query94	800	291	298	291
query95	345	246	242	242
query96	616	281	279	279
query97	2896	2718	2741	2718
query98	221	196	188	188
query99	1549	1319	1292	1292
Total cold run time: 300882 ms
Total hot run time: 191761 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 32.1 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit b40e54ad23ee7c69900cdc5dbd749ff157860ddb, data reload: false

query1	0.03	0.03	0.03
query2	0.08	0.03	0.03
query3	0.22	0.07	0.07
query4	1.69	0.10	0.10
query5	0.43	0.41	0.41
query6	1.16	0.66	0.65
query7	0.02	0.02	0.02
query8	0.03	0.04	0.03
query9	0.57	0.48	0.49
query10	0.55	0.54	0.56
query11	0.13	0.09	0.11
query12	0.14	0.11	0.11
query13	0.61	0.59	0.59
query14	2.83	2.87	2.81
query15	0.89	0.83	0.82
query16	0.38	0.37	0.42
query17	0.98	1.06	1.08
query18	0.21	0.20	0.19
query19	1.95	1.90	2.02
query20	0.01	0.01	0.02
query21	15.37	0.59	0.60
query22	2.84	1.96	1.66
query23	16.88	1.02	0.81
query24	2.98	0.55	0.54
query25	0.22	0.21	0.09
query26	0.35	0.14	0.14
query27	0.05	0.03	0.04
query28	11.67	1.10	1.07
query29	12.56	3.25	3.25
query30	0.25	0.06	0.06
query31	2.89	0.38	0.37
query32	3.25	0.47	0.46
query33	2.96	3.10	2.98
query34	17.16	4.49	4.50
query35	4.55	4.52	4.48
query36	0.68	0.49	0.48
query37	0.08	0.06	0.06
query38	0.04	0.03	0.04
query39	0.03	0.02	0.02
query40	0.16	0.13	0.12
query41	0.08	0.02	0.02
query42	0.03	0.02	0.02
query43	0.03	0.02	0.03
Total cold run time: 108.02 s
Total hot run time: 32.1 s

eldenmoon
eldenmoon previously approved these changes Nov 4, 2024
Copy link
Member

@eldenmoon eldenmoon left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 37.83% (9823/25968)
Line Coverage: 28.99% (81633/281570)
Region Coverage: 28.27% (42158/149146)
Branch Coverage: 24.84% (21388/86098)
Coverage Report: http://coverage.selectdb-in.cc/coverage/b40e54ad23ee7c69900cdc5dbd749ff157860ddb_b40e54ad23ee7c69900cdc5dbd749ff157860ddb/report/index.html

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 37.83% (9826/25977)
Line Coverage: 29.00% (81720/281826)
Region Coverage: 28.23% (42116/149200)
Branch Coverage: 24.81% (21370/86140)
Coverage Report: http://coverage.selectdb-in.cc/coverage/77e21a0e0d1aed1bd0a9a2e97f8824ee98ff5abf_77e21a0e0d1aed1bd0a9a2e97f8824ee98ff5abf/report/index.html

@doris-robot
Copy link

TPC-H: Total hot run time: 41612 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 77e21a0e0d1aed1bd0a9a2e97f8824ee98ff5abf, data reload: false

------ Round 1 ----------------------------------
q1	17595	7537	7348	7348
q2	2051	164	156	156
q3	10612	1118	1220	1118
q4	10574	870	771	771
q5	7740	3059	3063	3059
q6	235	146	145	145
q7	1018	607	598	598
q8	9357	2021	2028	2021
q9	6664	6455	6496	6455
q10	7072	2479	2459	2459
q11	468	253	254	253
q12	407	216	213	213
q13	17773	3036	2987	2987
q14	252	210	206	206
q15	573	517	505	505
q16	645	596	578	578
q17	988	568	571	568
q18	7324	6689	6798	6689
q19	1346	1052	1004	1004
q20	485	180	181	180
q21	4081	3300	3323	3300
q22	1119	1015	999	999
Total cold run time: 108379 ms
Total hot run time: 41612 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7333	7284	7271	7271
q2	322	224	226	224
q3	3098	2979	2994	2979
q4	2151	1888	1816	1816
q5	5750	5814	5817	5814
q6	225	137	136	136
q7	2272	1845	1792	1792
q8	3442	3463	3557	3463
q9	8947	8925	8940	8925
q10	3581	3618	3594	3594
q11	598	499	512	499
q12	843	640	658	640
q13	9998	3214	3227	3214
q14	323	282	284	282
q15	566	521	521	521
q16	701	643	635	635
q17	1870	1661	1657	1657
q18	8355	7831	7687	7687
q19	1709	1608	1667	1608
q20	2079	1908	1889	1889
q21	5653	5524	5467	5467
q22	1139	1073	1094	1073
Total cold run time: 70955 ms
Total hot run time: 61186 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 196919 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 77e21a0e0d1aed1bd0a9a2e97f8824ee98ff5abf, data reload: false

query1	1199	920	912	912
query2	6229	2086	2075	2075
query3	10797	4062	3999	3999
query4	67757	27887	23650	23650
query5	4945	471	451	451
query6	395	188	157	157
query7	5481	296	302	296
query8	300	217	215	215
query9	8324	2641	2620	2620
query10	419	251	239	239
query11	17328	15254	15893	15254
query12	155	102	101	101
query13	1430	450	438	438
query14	10048	7491	7768	7491
query15	209	196	202	196
query16	7169	490	456	456
query17	1042	553	562	553
query18	1798	307	293	293
query19	205	150	146	146
query20	117	111	110	110
query21	202	98	102	98
query22	4505	4401	4387	4387
query23	34767	34098	34143	34098
query24	6021	2812	2795	2795
query25	529	396	410	396
query26	649	162	159	159
query27	1652	287	303	287
query28	4257	2456	2451	2451
query29	685	425	434	425
query30	240	152	152	152
query31	967	785	838	785
query32	69	56	59	56
query33	463	276	282	276
query34	944	515	523	515
query35	866	742	734	734
query36	1090	971	981	971
query37	119	78	77	77
query38	4379	4357	4333	4333
query39	1491	1439	1417	1417
query40	200	99	99	99
query41	46	45	45	45
query42	109	103	98	98
query43	548	507	501	501
query44	1174	830	830	830
query45	186	168	165	165
query46	1114	707	725	707
query47	1948	1833	1847	1833
query48	430	326	331	326
query49	736	401	402	401
query50	819	416	431	416
query51	7248	7079	7073	7073
query52	98	84	86	84
query53	256	176	183	176
query54	537	414	407	407
query55	80	78	78	78
query56	259	263	230	230
query57	1315	1161	1129	1129
query58	214	218	214	214
query59	3289	2886	2992	2886
query60	259	251	247	247
query61	105	104	103	103
query62	792	650	693	650
query63	226	195	187	187
query64	1378	646	613	613
query65	3331	3247	3258	3247
query66	704	311	308	308
query67	16144	15771	15670	15670
query68	3728	592	618	592
query69	410	262	256	256
query70	1196	1129	1103	1103
query71	346	257	258	257
query72	6369	4114	4102	4102
query73	762	360	360	360
query74	10236	9069	9000	9000
query75	3447	2649	2684	2649
query76	1792	1160	1032	1032
query77	463	280	273	273
query78	10378	9449	9385	9385
query79	1816	587	605	587
query80	1416	425	431	425
query81	544	236	249	236
query82	1326	119	118	118
query83	185	135	142	135
query84	272	70	66	66
query85	1006	297	298	297
query86	424	303	312	303
query87	4884	4617	4764	4617
query88	3645	2207	2169	2169
query89	427	289	282	282
query90	1960	185	183	183
query91	137	103	102	102
query92	65	48	48	48
query93	2231	548	543	543
query94	888	300	286	286
query95	349	254	252	252
query96	636	277	282	277
query97	2920	2687	2688	2687
query98	212	202	194	194
query99	1674	1316	1320	1316
Total cold run time: 318931 ms
Total hot run time: 196919 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 32.51 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 77e21a0e0d1aed1bd0a9a2e97f8824ee98ff5abf, data reload: false

query1	0.04	0.03	0.02
query2	0.06	0.03	0.03
query3	0.23	0.06	0.06
query4	1.64	0.10	0.10
query5	0.39	0.41	0.43
query6	1.15	0.67	0.65
query7	0.02	0.01	0.01
query8	0.04	0.03	0.03
query9	0.57	0.49	0.49
query10	0.55	0.54	0.55
query11	0.14	0.10	0.10
query12	0.14	0.12	0.11
query13	0.61	0.60	0.59
query14	2.76	2.78	2.73
query15	0.91	0.83	0.82
query16	0.41	0.38	0.39
query17	1.08	1.06	0.98
query18	0.20	0.20	0.20
query19	1.87	1.79	1.93
query20	0.01	0.01	0.01
query21	15.36	0.61	0.61
query22	2.67	2.92	1.91
query23	17.04	0.88	0.84
query24	3.02	1.02	1.60
query25	0.24	0.10	0.16
query26	0.44	0.13	0.15
query27	0.04	0.04	0.04
query28	10.42	1.10	1.07
query29	12.56	3.20	3.16
query30	0.24	0.06	0.07
query31	2.86	0.40	0.39
query32	3.24	0.47	0.46
query33	2.98	3.04	3.03
query34	17.09	4.42	4.51
query35	4.50	4.49	4.45
query36	0.67	0.48	0.47
query37	0.10	0.06	0.06
query38	0.05	0.03	0.03
query39	0.03	0.03	0.02
query40	0.16	0.13	0.12
query41	0.07	0.03	0.02
query42	0.04	0.02	0.03
query43	0.04	0.03	0.03
Total cold run time: 106.68 s
Total hot run time: 32.51 s

@github-actions github-actions bot removed the approved Indicates a PR has been approved by one committer. label Nov 5, 2024
@amorynan
Copy link
Contributor Author

amorynan commented Nov 5, 2024

run buildall

Copy link
Member

@eldenmoon eldenmoon left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Nov 5, 2024
@github-actions
Copy link
Contributor

github-actions bot commented Nov 5, 2024

PR approved by at least one committer and no changes requested.

@doris-robot
Copy link

TPC-H: Total hot run time: 41409 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 48311fd4c772dbde480c3b921e8e198f7275a4fa, data reload: false

------ Round 1 ----------------------------------
q1	17552	7448	7339	7339
q2	2045	163	162	162
q3	10629	1133	1272	1133
q4	10592	863	879	863
q5	7771	3103	3132	3103
q6	239	154	152	152
q7	1033	618	607	607
q8	9350	1985	2059	1985
q9	6654	6410	6470	6410
q10	7034	2436	2433	2433
q11	466	269	255	255
q12	427	219	213	213
q13	17785	3044	3006	3006
q14	270	217	205	205
q15	580	508	511	508
q16	652	586	596	586
q17	1032	485	582	485
q18	7432	6557	6728	6557
q19	1336	980	974	974
q20	479	184	190	184
q21	4021	3354	3255	3255
q22	1125	1018	994	994
Total cold run time: 108504 ms
Total hot run time: 41409 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7290	7299	7249	7249
q2	323	238	234	234
q3	3051	2962	2936	2936
q4	2138	1917	1811	1811
q5	5748	5787	5878	5787
q6	230	147	143	143
q7	2261	1862	1787	1787
q8	3408	3552	3471	3471
q9	9087	9044	8967	8967
q10	3617	3558	3581	3558
q11	617	503	533	503
q12	850	648	599	599
q13	9400	3245	3199	3199
q14	301	291	270	270
q15	579	511	520	511
q16	703	652	641	641
q17	1885	1654	1635	1635
q18	8396	7788	7762	7762
q19	1727	1547	1554	1547
q20	2122	1873	1893	1873
q21	5594	5410	5476	5410
q22	1177	1048	1050	1048
Total cold run time: 70504 ms
Total hot run time: 60941 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 195896 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 48311fd4c772dbde480c3b921e8e198f7275a4fa, data reload: false

query1	1224	915	996	915
query2	6268	2140	2115	2115
query3	10795	3986	3972	3972
query4	67793	29487	23667	23667
query5	5124	445	443	443
query6	417	176	168	168
query7	5762	305	293	293
query8	324	252	218	218
query9	8893	2677	2695	2677
query10	480	257	253	253
query11	17599	15427	15964	15427
query12	152	102	101	101
query13	1554	412	394	394
query14	11087	6904	7350	6904
query15	203	185	193	185
query16	7042	412	462	412
query17	1029	552	535	535
query18	1782	284	280	280
query19	190	151	139	139
query20	112	106	111	106
query21	205	100	95	95
query22	4550	4291	4533	4291
query23	34452	33919	34190	33919
query24	5891	2715	2738	2715
query25	480	377	403	377
query26	645	156	154	154
query27	1685	281	285	281
query28	4294	2472	2455	2455
query29	698	427	440	427
query30	231	155	160	155
query31	1006	817	798	798
query32	66	56	59	56
query33	404	272	275	272
query34	928	514	511	511
query35	864	745	751	745
query36	1081	974	947	947
query37	120	76	73	73
query38	4336	4271	4225	4225
query39	1470	1466	1424	1424
query40	201	104	99	99
query41	47	48	46	46
query42	109	100	99	99
query43	542	506	504	504
query44	1196	826	833	826
query45	183	165	166	165
query46	1142	726	697	697
query47	1925	1848	1853	1848
query48	434	322	324	322
query49	742	399	400	399
query50	811	400	392	392
query51	7205	7028	7011	7011
query52	98	88	89	88
query53	260	179	179	179
query54	525	423	420	420
query55	81	77	79	77
query56	262	252	255	252
query57	1291	1180	1159	1159
query58	227	211	217	211
query59	3338	3147	3011	3011
query60	283	258	250	250
query61	129	121	125	121
query62	788	695	686	686
query63	215	196	189	189
query64	1441	750	613	613
query65	3259	3224	3206	3206
query66	724	306	297	297
query67	16000	15658	15588	15588
query68	3142	600	589	589
query69	401	257	253	253
query70	1149	1155	1116	1116
query71	324	256	249	249
query72	6227	4081	3917	3917
query73	756	352	362	352
query74	10117	9081	8997	8997
query75	3404	2687	2680	2680
query76	1588	1103	1066	1066
query77	479	289	268	268
query78	10331	9380	9451	9380
query79	1080	594	589	589
query80	687	422	444	422
query81	501	244	245	244
query82	339	120	112	112
query83	158	140	140	140
query84	265	69	69	69
query85	840	297	289	289
query86	316	287	275	275
query87	4951	4722	4656	4656
query88	3531	2194	2172	2172
query89	389	293	291	291
query90	2073	187	183	183
query91	133	102	101	101
query92	60	49	51	49
query93	1079	545	547	545
query94	780	292	288	288
query95	345	254	250	250
query96	612	280	287	280
query97	2886	2686	2705	2686
query98	208	205	194	194
query99	1910	1338	1315	1315
Total cold run time: 315755 ms
Total hot run time: 195896 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 32.41 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 48311fd4c772dbde480c3b921e8e198f7275a4fa, data reload: false

query1	0.04	0.04	0.03
query2	0.07	0.03	0.03
query3	0.23	0.06	0.06
query4	1.64	0.10	0.10
query5	0.39	0.40	0.40
query6	1.14	0.67	0.66
query7	0.02	0.01	0.01
query8	0.04	0.02	0.04
query9	0.56	0.50	0.50
query10	0.54	0.54	0.57
query11	0.14	0.11	0.10
query12	0.14	0.11	0.11
query13	0.62	0.59	0.59
query14	2.72	2.78	2.73
query15	0.91	0.82	0.83
query16	0.38	0.39	0.38
query17	1.10	1.07	1.03
query18	0.20	0.20	0.20
query19	1.84	1.92	1.99
query20	0.02	0.02	0.01
query21	15.35	0.57	0.59
query22	2.77	2.18	2.05
query23	16.95	0.96	0.75
query24	2.96	0.67	1.68
query25	0.25	0.08	0.10
query26	0.41	0.14	0.13
query27	0.05	0.05	0.04
query28	10.82	1.10	1.07
query29	12.84	3.23	3.21
query30	0.25	0.06	0.06
query31	2.88	0.38	0.39
query32	3.27	0.46	0.46
query33	3.01	2.98	3.04
query34	16.93	4.45	4.48
query35	4.54	4.48	4.48
query36	0.67	0.48	0.49
query37	0.09	0.06	0.05
query38	0.05	0.04	0.04
query39	0.03	0.02	0.02
query40	0.16	0.13	0.13
query41	0.08	0.03	0.02
query42	0.03	0.02	0.02
query43	0.03	0.03	0.03
Total cold run time: 107.16 s
Total hot run time: 32.41 s

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 37.80% (9822/25982)
Line Coverage: 28.97% (81685/281934)
Region Coverage: 28.21% (42096/149241)
Branch Coverage: 24.79% (21359/86164)
Coverage Report: http://coverage.selectdb-in.cc/coverage/48311fd4c772dbde480c3b921e8e198f7275a4fa_48311fd4c772dbde480c3b921e8e198f7275a4fa/report/index.html

@amorynan
Copy link
Contributor Author

amorynan commented Nov 5, 2024

run p0

Copy link
Contributor

@xiaokang xiaokang left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@xiaokang xiaokang merged commit 9e29566 into apache:master Nov 5, 2024
github-actions bot pushed a commit that referenced this pull request Nov 5, 2024
before this pr: 
if we has ipv6 column in table which is support store_row_column 
we insert some data
and then make sql with update we will meet core
```
*** Aborted at 1730367188 (unix time) try "date -d @1730367188" if you are using GNU date ***
*** Current BE git commitID: face753 ***
*** SIGSEGV invalid permissions for mapped object (@0x60c000a339ae) received by PID 4176451 (TID 4187168 OR 0x7ff774f5a700) from PID 10697134; stack trace: ***
 0# doris::signal::(anonymous namespace)::FailureSignalHandler(int, siginfo_t*, void*) at /mnt/disk1/wangqiannan/amory/doris/be/src/common/signal_handler.h:421
 1# PosixSignals::chained_handler(int, siginfo*, void*) [clone .part.0] in /mnt/disk1/wangqiannan/tool/jdk-17.0.10/lib/server/libjvm.so
 2# JVM_handle_linux_signal in /mnt/disk1/wangqiannan/tool/jdk-17.0.10/lib/server/libjvm.so
 3# 0x00007FFFF63AEB50 in /lib64/libc.so.6
 4# doris::IPv6Value::from_string(unsigned __int128&, char const*, unsigned long) at /mnt/disk1/wangqiannan/amory/doris/be/src/vec/runtime/ipv6_value.h:55
 5# bool doris::vectorized::read_ipv6_text_impl<unsigned __int128>(unsigned __int128&, doris::vectorized::ReadBuffer&) at /mnt/disk1/wangqiannan/amory/doris/be/src/vec/io/io_helper.h:316
 6# doris::vectorized::DataTypeIPv6SerDe::read_one_cell_from_jsonb(doris::vectorized::IColumn&, doris::JsonbValue const*) const at /mnt/disk1/wangqiannan/amory/doris/be/src/vec/data_types/serde/data_type_ipv6_serde.cpp:76
 7# doris::vectorized::JsonbSerializeUtil::jsonb_to_block(std::vector<std::shared_ptr<doris::vectorized::DataTypeSerDe>, std::allocator<std::shared_ptr<doris::vectorized::DataTypeSerDe> > > const&, char const*, unsigned long, std::unordered_map<unsigned int, unsigned int, std::hash<unsigned int>, std::equal_to<unsigned int>, std::allocator<std::pair<unsigned int const, unsigned int> > > const&, doris::vectorized::Block&, std::vector<std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >, std::allocator<std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > > > const&, std::unordered_set<int, std::hash<int>, std::equal_to<int>, std::allocator<int> > const&) at /mnt/disk1/wangqiannan/amory/doris/be/src/vec/jsonb/serialize.cpp:104
 8# doris::vectorized::JsonbSerializeUtil::jsonb_to_block(std::vector<std::shared_ptr<doris::vectorized::DataTypeSerDe>, std::allocator<std::shared_ptr<doris::vectorized::DataTypeSerDe> > > const&, doris::vectorized::ColumnStr<unsigned int> const&, std::unordered_map<unsigned int, unsigned int, std::hash<unsigned int>, std::equal_to<unsigned int>, std::allocator<std::pair<unsigned int const, unsigned int> > > const&, doris::vectorized::Block&, std::vector<std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >, std::allocator<std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > > > const&, std::unordered_set<int, std::hash<int>, std::equal_to<int>, std::allocator<int> > const&) at /mnt/disk1/wangqiannan/amory/doris/be/src/vec/jsonb/serialize.cpp:83
 9# doris::BaseTablet::fetch_value_through_row_column(std::shared_ptr<doris::Rowset>, doris::TabletSchema const&, unsigned int, std::vector<unsigned int, std::allocator<unsigned int> > const&, std::vector<unsigned int, std::allocator<unsigned int> > const&, doris::vectorized::Block&) at /mnt/disk1/wangqiannan/amory/doris/be/src/olap/base_tablet.cpp:885
10# doris::FixedReadPlan::read_columns_by_plan(doris::TabletSchema const&, std::vector<unsigned int, std::allocator<unsigned int> >, std::map<doris::RowsetId, std::shared_ptr<doris::Rowset>, std::less<doris::RowsetId>, std::allocator<std::pair<doris::RowsetId const, std::shared_ptr<doris::Rowset> > > > const&, doris::vectorized::Block&, std::map<unsigned int, unsigned int, std::less<unsigned int>, std::allocator<std::pair<unsigned int const, unsigned int> > >*, signed char const*) const at /mnt/disk1/wangqiannan/amory/doris/be/src/olap/partial_update_info.cpp:295
11# doris::FixedReadPlan::fill_missing_columns(doris::RowsetWriterContext*, std::map<doris::RowsetId, std::shared_ptr<doris::Rowset>, std::less<doris::RowsetId>, std::allocator<std::pair<doris::RowsetId const, std::shared_ptr<doris::Rowset> > > > const&, doris::TabletSchema const&, doris::vectorized::Block&, std::vector<bool, std::allocator<bool> > const&, bool, unsigned long const&, doris::vectorized::Block const*) const at /mnt/disk1/wangqiannan/amory/doris/be/src/olap/partial_update_info.cpp:332
12# doris::segment_v2::VerticalSegmentWriter::_append_block_with_partial_content(doris::segment_v2::RowsInBlock&, doris::vectorized::Block&) at /mnt/disk1/wangqiannan/amory/doris/be/src/olap/rowset/segment_v2/vertical_segment_writer.cpp:502
```
github-actions bot pushed a commit that referenced this pull request Nov 5, 2024
before this pr: 
if we has ipv6 column in table which is support store_row_column 
we insert some data
and then make sql with update we will meet core
```
*** Aborted at 1730367188 (unix time) try "date -d @1730367188" if you are using GNU date ***
*** Current BE git commitID: face753 ***
*** SIGSEGV invalid permissions for mapped object (@0x60c000a339ae) received by PID 4176451 (TID 4187168 OR 0x7ff774f5a700) from PID 10697134; stack trace: ***
 0# doris::signal::(anonymous namespace)::FailureSignalHandler(int, siginfo_t*, void*) at /mnt/disk1/wangqiannan/amory/doris/be/src/common/signal_handler.h:421
 1# PosixSignals::chained_handler(int, siginfo*, void*) [clone .part.0] in /mnt/disk1/wangqiannan/tool/jdk-17.0.10/lib/server/libjvm.so
 2# JVM_handle_linux_signal in /mnt/disk1/wangqiannan/tool/jdk-17.0.10/lib/server/libjvm.so
 3# 0x00007FFFF63AEB50 in /lib64/libc.so.6
 4# doris::IPv6Value::from_string(unsigned __int128&, char const*, unsigned long) at /mnt/disk1/wangqiannan/amory/doris/be/src/vec/runtime/ipv6_value.h:55
 5# bool doris::vectorized::read_ipv6_text_impl<unsigned __int128>(unsigned __int128&, doris::vectorized::ReadBuffer&) at /mnt/disk1/wangqiannan/amory/doris/be/src/vec/io/io_helper.h:316
 6# doris::vectorized::DataTypeIPv6SerDe::read_one_cell_from_jsonb(doris::vectorized::IColumn&, doris::JsonbValue const*) const at /mnt/disk1/wangqiannan/amory/doris/be/src/vec/data_types/serde/data_type_ipv6_serde.cpp:76
 7# doris::vectorized::JsonbSerializeUtil::jsonb_to_block(std::vector<std::shared_ptr<doris::vectorized::DataTypeSerDe>, std::allocator<std::shared_ptr<doris::vectorized::DataTypeSerDe> > > const&, char const*, unsigned long, std::unordered_map<unsigned int, unsigned int, std::hash<unsigned int>, std::equal_to<unsigned int>, std::allocator<std::pair<unsigned int const, unsigned int> > > const&, doris::vectorized::Block&, std::vector<std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >, std::allocator<std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > > > const&, std::unordered_set<int, std::hash<int>, std::equal_to<int>, std::allocator<int> > const&) at /mnt/disk1/wangqiannan/amory/doris/be/src/vec/jsonb/serialize.cpp:104
 8# doris::vectorized::JsonbSerializeUtil::jsonb_to_block(std::vector<std::shared_ptr<doris::vectorized::DataTypeSerDe>, std::allocator<std::shared_ptr<doris::vectorized::DataTypeSerDe> > > const&, doris::vectorized::ColumnStr<unsigned int> const&, std::unordered_map<unsigned int, unsigned int, std::hash<unsigned int>, std::equal_to<unsigned int>, std::allocator<std::pair<unsigned int const, unsigned int> > > const&, doris::vectorized::Block&, std::vector<std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >, std::allocator<std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > > > const&, std::unordered_set<int, std::hash<int>, std::equal_to<int>, std::allocator<int> > const&) at /mnt/disk1/wangqiannan/amory/doris/be/src/vec/jsonb/serialize.cpp:83
 9# doris::BaseTablet::fetch_value_through_row_column(std::shared_ptr<doris::Rowset>, doris::TabletSchema const&, unsigned int, std::vector<unsigned int, std::allocator<unsigned int> > const&, std::vector<unsigned int, std::allocator<unsigned int> > const&, doris::vectorized::Block&) at /mnt/disk1/wangqiannan/amory/doris/be/src/olap/base_tablet.cpp:885
10# doris::FixedReadPlan::read_columns_by_plan(doris::TabletSchema const&, std::vector<unsigned int, std::allocator<unsigned int> >, std::map<doris::RowsetId, std::shared_ptr<doris::Rowset>, std::less<doris::RowsetId>, std::allocator<std::pair<doris::RowsetId const, std::shared_ptr<doris::Rowset> > > > const&, doris::vectorized::Block&, std::map<unsigned int, unsigned int, std::less<unsigned int>, std::allocator<std::pair<unsigned int const, unsigned int> > >*, signed char const*) const at /mnt/disk1/wangqiannan/amory/doris/be/src/olap/partial_update_info.cpp:295
11# doris::FixedReadPlan::fill_missing_columns(doris::RowsetWriterContext*, std::map<doris::RowsetId, std::shared_ptr<doris::Rowset>, std::less<doris::RowsetId>, std::allocator<std::pair<doris::RowsetId const, std::shared_ptr<doris::Rowset> > > > const&, doris::TabletSchema const&, doris::vectorized::Block&, std::vector<bool, std::allocator<bool> > const&, bool, unsigned long const&, doris::vectorized::Block const*) const at /mnt/disk1/wangqiannan/amory/doris/be/src/olap/partial_update_info.cpp:332
12# doris::segment_v2::VerticalSegmentWriter::_append_block_with_partial_content(doris::segment_v2::RowsInBlock&, doris::vectorized::Block&) at /mnt/disk1/wangqiannan/amory/doris/be/src/olap/rowset/segment_v2/vertical_segment_writer.cpp:502
```
yiguolei pushed a commit that referenced this pull request Nov 5, 2024
before this pr: 
if we has ipv6 column in table which is support store_row_column 
we insert some data
and then make sql with update we will meet core
```
*** Aborted at 1730367188 (unix time) try "date -d @1730367188" if you are using GNU date ***
*** Current BE git commitID: face753 ***
*** SIGSEGV invalid permissions for mapped object (@0x60c000a339ae) received by PID 4176451 (TID 4187168 OR 0x7ff774f5a700) from PID 10697134; stack trace: ***
 0# doris::signal::(anonymous namespace)::FailureSignalHandler(int, siginfo_t*, void*) at /mnt/disk1/wangqiannan/amory/doris/be/src/common/signal_handler.h:421
 1# PosixSignals::chained_handler(int, siginfo*, void*) [clone .part.0] in /mnt/disk1/wangqiannan/tool/jdk-17.0.10/lib/server/libjvm.so
 2# JVM_handle_linux_signal in /mnt/disk1/wangqiannan/tool/jdk-17.0.10/lib/server/libjvm.so
 3# 0x00007FFFF63AEB50 in /lib64/libc.so.6
 4# doris::IPv6Value::from_string(unsigned __int128&, char const*, unsigned long) at /mnt/disk1/wangqiannan/amory/doris/be/src/vec/runtime/ipv6_value.h:55
 5# bool doris::vectorized::read_ipv6_text_impl<unsigned __int128>(unsigned __int128&, doris::vectorized::ReadBuffer&) at /mnt/disk1/wangqiannan/amory/doris/be/src/vec/io/io_helper.h:316
 6# doris::vectorized::DataTypeIPv6SerDe::read_one_cell_from_jsonb(doris::vectorized::IColumn&, doris::JsonbValue const*) const at /mnt/disk1/wangqiannan/amory/doris/be/src/vec/data_types/serde/data_type_ipv6_serde.cpp:76
 7# doris::vectorized::JsonbSerializeUtil::jsonb_to_block(std::vector<std::shared_ptr<doris::vectorized::DataTypeSerDe>, std::allocator<std::shared_ptr<doris::vectorized::DataTypeSerDe> > > const&, char const*, unsigned long, std::unordered_map<unsigned int, unsigned int, std::hash<unsigned int>, std::equal_to<unsigned int>, std::allocator<std::pair<unsigned int const, unsigned int> > > const&, doris::vectorized::Block&, std::vector<std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >, std::allocator<std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > > > const&, std::unordered_set<int, std::hash<int>, std::equal_to<int>, std::allocator<int> > const&) at /mnt/disk1/wangqiannan/amory/doris/be/src/vec/jsonb/serialize.cpp:104
 8# doris::vectorized::JsonbSerializeUtil::jsonb_to_block(std::vector<std::shared_ptr<doris::vectorized::DataTypeSerDe>, std::allocator<std::shared_ptr<doris::vectorized::DataTypeSerDe> > > const&, doris::vectorized::ColumnStr<unsigned int> const&, std::unordered_map<unsigned int, unsigned int, std::hash<unsigned int>, std::equal_to<unsigned int>, std::allocator<std::pair<unsigned int const, unsigned int> > > const&, doris::vectorized::Block&, std::vector<std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >, std::allocator<std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > > > const&, std::unordered_set<int, std::hash<int>, std::equal_to<int>, std::allocator<int> > const&) at /mnt/disk1/wangqiannan/amory/doris/be/src/vec/jsonb/serialize.cpp:83
 9# doris::BaseTablet::fetch_value_through_row_column(std::shared_ptr<doris::Rowset>, doris::TabletSchema const&, unsigned int, std::vector<unsigned int, std::allocator<unsigned int> > const&, std::vector<unsigned int, std::allocator<unsigned int> > const&, doris::vectorized::Block&) at /mnt/disk1/wangqiannan/amory/doris/be/src/olap/base_tablet.cpp:885
10# doris::FixedReadPlan::read_columns_by_plan(doris::TabletSchema const&, std::vector<unsigned int, std::allocator<unsigned int> >, std::map<doris::RowsetId, std::shared_ptr<doris::Rowset>, std::less<doris::RowsetId>, std::allocator<std::pair<doris::RowsetId const, std::shared_ptr<doris::Rowset> > > > const&, doris::vectorized::Block&, std::map<unsigned int, unsigned int, std::less<unsigned int>, std::allocator<std::pair<unsigned int const, unsigned int> > >*, signed char const*) const at /mnt/disk1/wangqiannan/amory/doris/be/src/olap/partial_update_info.cpp:295
11# doris::FixedReadPlan::fill_missing_columns(doris::RowsetWriterContext*, std::map<doris::RowsetId, std::shared_ptr<doris::Rowset>, std::less<doris::RowsetId>, std::allocator<std::pair<doris::RowsetId const, std::shared_ptr<doris::Rowset> > > > const&, doris::TabletSchema const&, doris::vectorized::Block&, std::vector<bool, std::allocator<bool> > const&, bool, unsigned long const&, doris::vectorized::Block const*) const at /mnt/disk1/wangqiannan/amory/doris/be/src/olap/partial_update_info.cpp:332
12# doris::segment_v2::VerticalSegmentWriter::_append_block_with_partial_content(doris::segment_v2::RowsInBlock&, doris::vectorized::Block&) at /mnt/disk1/wangqiannan/amory/doris/be/src/olap/rowset/segment_v2/vertical_segment_writer.cpp:502
```
yiguolei pushed a commit that referenced this pull request Nov 5, 2024
Cherry-picked from #43065

Co-authored-by: amory <wangqiannan@selectdb.com>
airborne12 pushed a commit that referenced this pull request Nov 6, 2024
before this pr: 
if we has ipv6 column in table which is support store_row_column 
we insert some data
and then make sql with update we will meet core
```
*** Aborted at 1730367188 (unix time) try "date -d @1730367188" if you are using GNU date ***
*** Current BE git commitID: face753 ***
*** SIGSEGV invalid permissions for mapped object (@0x60c000a339ae) received by PID 4176451 (TID 4187168 OR 0x7ff774f5a700) from PID 10697134; stack trace: ***
 0# doris::signal::(anonymous namespace)::FailureSignalHandler(int, siginfo_t*, void*) at /mnt/disk1/wangqiannan/amory/doris/be/src/common/signal_handler.h:421
 1# PosixSignals::chained_handler(int, siginfo*, void*) [clone .part.0] in /mnt/disk1/wangqiannan/tool/jdk-17.0.10/lib/server/libjvm.so
 2# JVM_handle_linux_signal in /mnt/disk1/wangqiannan/tool/jdk-17.0.10/lib/server/libjvm.so
 3# 0x00007FFFF63AEB50 in /lib64/libc.so.6
 4# doris::IPv6Value::from_string(unsigned __int128&, char const*, unsigned long) at /mnt/disk1/wangqiannan/amory/doris/be/src/vec/runtime/ipv6_value.h:55
 5# bool doris::vectorized::read_ipv6_text_impl<unsigned __int128>(unsigned __int128&, doris::vectorized::ReadBuffer&) at /mnt/disk1/wangqiannan/amory/doris/be/src/vec/io/io_helper.h:316
 6# doris::vectorized::DataTypeIPv6SerDe::read_one_cell_from_jsonb(doris::vectorized::IColumn&, doris::JsonbValue const*) const at /mnt/disk1/wangqiannan/amory/doris/be/src/vec/data_types/serde/data_type_ipv6_serde.cpp:76
 7# doris::vectorized::JsonbSerializeUtil::jsonb_to_block(std::vector<std::shared_ptr<doris::vectorized::DataTypeSerDe>, std::allocator<std::shared_ptr<doris::vectorized::DataTypeSerDe> > > const&, char const*, unsigned long, std::unordered_map<unsigned int, unsigned int, std::hash<unsigned int>, std::equal_to<unsigned int>, std::allocator<std::pair<unsigned int const, unsigned int> > > const&, doris::vectorized::Block&, std::vector<std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >, std::allocator<std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > > > const&, std::unordered_set<int, std::hash<int>, std::equal_to<int>, std::allocator<int> > const&) at /mnt/disk1/wangqiannan/amory/doris/be/src/vec/jsonb/serialize.cpp:104
 8# doris::vectorized::JsonbSerializeUtil::jsonb_to_block(std::vector<std::shared_ptr<doris::vectorized::DataTypeSerDe>, std::allocator<std::shared_ptr<doris::vectorized::DataTypeSerDe> > > const&, doris::vectorized::ColumnStr<unsigned int> const&, std::unordered_map<unsigned int, unsigned int, std::hash<unsigned int>, std::equal_to<unsigned int>, std::allocator<std::pair<unsigned int const, unsigned int> > > const&, doris::vectorized::Block&, std::vector<std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >, std::allocator<std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > > > const&, std::unordered_set<int, std::hash<int>, std::equal_to<int>, std::allocator<int> > const&) at /mnt/disk1/wangqiannan/amory/doris/be/src/vec/jsonb/serialize.cpp:83
 9# doris::BaseTablet::fetch_value_through_row_column(std::shared_ptr<doris::Rowset>, doris::TabletSchema const&, unsigned int, std::vector<unsigned int, std::allocator<unsigned int> > const&, std::vector<unsigned int, std::allocator<unsigned int> > const&, doris::vectorized::Block&) at /mnt/disk1/wangqiannan/amory/doris/be/src/olap/base_tablet.cpp:885
10# doris::FixedReadPlan::read_columns_by_plan(doris::TabletSchema const&, std::vector<unsigned int, std::allocator<unsigned int> >, std::map<doris::RowsetId, std::shared_ptr<doris::Rowset>, std::less<doris::RowsetId>, std::allocator<std::pair<doris::RowsetId const, std::shared_ptr<doris::Rowset> > > > const&, doris::vectorized::Block&, std::map<unsigned int, unsigned int, std::less<unsigned int>, std::allocator<std::pair<unsigned int const, unsigned int> > >*, signed char const*) const at /mnt/disk1/wangqiannan/amory/doris/be/src/olap/partial_update_info.cpp:295
11# doris::FixedReadPlan::fill_missing_columns(doris::RowsetWriterContext*, std::map<doris::RowsetId, std::shared_ptr<doris::Rowset>, std::less<doris::RowsetId>, std::allocator<std::pair<doris::RowsetId const, std::shared_ptr<doris::Rowset> > > > const&, doris::TabletSchema const&, doris::vectorized::Block&, std::vector<bool, std::allocator<bool> > const&, bool, unsigned long const&, doris::vectorized::Block const*) const at /mnt/disk1/wangqiannan/amory/doris/be/src/olap/partial_update_info.cpp:332
12# doris::segment_v2::VerticalSegmentWriter::_append_block_with_partial_content(doris::segment_v2::RowsInBlock&, doris::vectorized::Block&) at /mnt/disk1/wangqiannan/amory/doris/be/src/olap/rowset/segment_v2/vertical_segment_writer.cpp:502
```
eldenmoon pushed a commit that referenced this pull request Nov 7, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

approved Indicates a PR has been approved by one committer. dev/2.1.7-merged dev/3.0.3-merged p0_c reviewed

Projects

None yet

Development

Successfully merging this pull request may close these issues.

6 participants