Skip to content
Closed
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
3568 commits
Select commit Hold shift + click to select a range
f0839fb
[fix](Nereids) fix date function rewrite on datetimev1 column bug #32…
ziyanTOP Mar 25, 2024
e930123
[fix](Nereids) system default decimalv3 scale should be 9 (#32756)
morrySnow Mar 25, 2024
ce8e1a0
[fix](auth)fix Insert table command not check load auth (#32766)
zddr Mar 26, 2024
c48d4f3
[fix](planner)the decimal type's precision and scale of set operation…
starocean999 Mar 26, 2024
ac7a514
[fix](multicatalog) fix no data error when read table on cosn (#32779)
Yulei-Yang Mar 26, 2024
414eb2a
[fix](cooldown) Fix bug in follow cooldowned data (#32801)
platoneko Mar 26, 2024
4b23567
[update](tzdb) update Doris tzfiles to 2024a #32648 (#32705)
zclllyybb Mar 26, 2024
b1955a9
[chore](ColdHeatSeparation) Reduce the frequency of log following rea…
ByteYue Mar 26, 2024
a902716
[enhancement](nereids) only push having as agg's parent if having jus…
starocean999 Mar 26, 2024
69bdb35
[fix](Nereids) decimalv2 and int/date bit arithmetic need cast to big…
morrySnow Mar 26, 2024
7843729
[fix](Nereids) filter-limit-project translate to wrong plan (#32496) …
morrySnow Mar 26, 2024
73ed833
[fix](join) core caused by null-safe-equal join (#32623) (#32821)
mrhhsg Mar 27, 2024
d8a3d9a
[fix](test) fix duplicated catalog name in regression cases (#32442) …
morningman Mar 27, 2024
4d80df1
[branch-2.0](cherry-pick)node priv can show proc #32751 (#32826)
zddr Mar 27, 2024
d933046
[fix](hash_join) uninited hash table probe caused by short circui (#3…
mrhhsg Mar 27, 2024
2dca398
[branch-2.0](cherry-pick) Fix task repeat attach task DCHECK failed (…
xinyiZzz Mar 27, 2024
8650ac6
[chore](log) print query id before logging profile in be.INFO (#32915)
zhiqiang-hhhh Mar 27, 2024
4aa2111
[fix](nereids)EliminateGroupByConstant should replace agg's output af…
starocean999 Mar 28, 2024
f7670d6
[Fix](nereids) Fix deletestmt getting catalog (#32833)
feiniaofeiafei Mar 29, 2024
374c759
[Fix](nereids) remove duplicate expr in grouping set (#32834)
feiniaofeiafei Mar 29, 2024
2ae85e4
[conf](mysql) opt mysql network timeout to 600s #32545 (#32739)
cambyzju Mar 29, 2024
ea048ee
[opt](fqdn) Add DNS Cache for FE and BE (#32869) (#32995)
morningman Mar 29, 2024
59fb37e
[opt](iceberg) no need to check the name format of iceberg's database…
morningman Mar 29, 2024
2988eed
[Refactor](admin-stmt) rename some `admin-show` statestmt (#29492) (#…
morningman Mar 29, 2024
2345943
[fix](jni) avoid coredump if failed to get jni env (#32950) (#33012)
morningman Mar 29, 2024
ed4822f
[fix](nereids)column name should be case insensitive when selecting m…
starocean999 Mar 29, 2024
5711332
[fix](planner) remove and retain input slot for aggregate slot which …
nextdreamblue Mar 29, 2024
2f6e5bf
[branch-2.0](cherry-pick)fix insert overwrite getExecTimeout error (#…
zddr Mar 30, 2024
f5a305b
[fix](planner) retain groupingSlotIds as materialized for aggregate (…
nextdreamblue Mar 30, 2024
2e5fb94
[opt](rowcount) refresh external table's rowcount async (#32997) (#32…
morningman Apr 1, 2024
3160308
Limit the max string length to 1024 while collecting column stats to …
Jibing-Li Apr 1, 2024
fee37ff
[fix](avro) avoid BE crash if avro scanner's dependency jars is mssin…
morningman Apr 1, 2024
808c9cd
[Improve](spark-load)update spark version for spark load to resolve c…
gnehil Apr 1, 2024
bce3c22
[Bug](schame-change) fix wrong result after reorder mor table #29045 …
BiteTheDDDDt Apr 2, 2024
c997fbe
[fix](nereids)partition prune should consider <=> operator #32965 (#3…
starocean999 Apr 2, 2024
85779f4
[fix](function) fix milliseconds_diff function return wrong result (#…
zhangstar333 Apr 2, 2024
8642445
[fix](show_variables) fix default value for special variables #27651 …
Yulei-Yang Apr 2, 2024
7eafdb4
[branch-2.0][fix](broker) fix broker writer close issue (#33110)
morningman Apr 2, 2024
44d8383
[fix](tpcds-tool) Fix the echo in create-tpcds-tables.sh (#32415) (#…
xiaokang Apr 2, 2024
f55f0b3
[fix](pipeline) no alloc_resource projections in VSetOperationNode #2…
Mryange Apr 2, 2024
de7cabb
[bugfix](iceberg)Convert the datetime type in the predicate according…
wuwenchi Apr 2, 2024
1701be7
[opt](jdbc catalog) close when jdbcClient is not empty #32747 (#33141)
zy-kkk Apr 2, 2024
9ac0ddd
[enhancement](be-meta) disable sync rocksdb by default for better per…
liaoxin01 Apr 2, 2024
f52183d
[fix](merge-iterator) fix NOT_IMPLEMENTED_ERROR when read next block …
liaoxin01 Apr 2, 2024
bd74462
[fix](Nereids) fix bind having aggregate failed again (#33148)
924060929 Apr 2, 2024
fd06d86
[fix](nereids)SimplifyRange didn't process NULL value correctly #3285…
starocean999 Apr 2, 2024
96ff206
[fix](inverted index) clear the index cache corresponding to the tabl…
zzzxl1993 Apr 2, 2024
1641f1b
[fix] (vectorization) regexp all_pass string (#32515) (#33142)
xiaokang Apr 2, 2024
aec272e
[Fix](point query) avoid nullptr in _block_pool #33120 (#33144)
eldenmoon Apr 3, 2024
f70cff1
[fix](compaction) fix incorrect grouping of vertical compaction colum…
luwei16 Apr 3, 2024
fbf9f62
[fix](dns-cache) do not detach the refresh thread #33182 (#33184)
morningman Apr 3, 2024
38eb571
[bugfix](paimon)merge meta-inf/services for paimon FileIOLoader for 2…
wuwenchi Apr 3, 2024
819b910
[fix](inverted index) fix the incorrect result issue of COUNT_ON_INDE…
zzzxl1993 Apr 3, 2024
0f3d5a2
[fix](fe) partitionInfo is null, fe can not start (#33108) (#33203)
swjtu-zhanglei Apr 3, 2024
d138108
[opt](Nereids) let inverted index work with top opt (#29000) (#33200)
morrySnow Apr 3, 2024
dc641c3
[fix](Branch2.0) Catch error information after `hdfsCloseFile()` (#33…
BePPPower Apr 3, 2024
0a6803e
[fix](tvf) Support fs.defaultFS with postfix '/' #33202 (#33221)
morningman Apr 3, 2024
9e50bd8
[Fix](partial update) Fix partial update load false when schema inclu…
Yukang-Lian Apr 3, 2024
dbd1da4
[FIX](agg) fix vertical_compaction_reader for agg table with array/ma…
Apr 3, 2024
b366cad
[bugfix](hive)use originHiveKeys for hive partitionvalue for 2.0 (#33…
wuwenchi Apr 4, 2024
71872cd
[branch-2.0][improvement](serde) Handle NaN values in number for MySQ…
zy-kkk Apr 4, 2024
0968395
[opt](hive) simplify the isSplitable method to avoid too many hadoop …
morningman Apr 4, 2024
caba7e1
[fix](parquet) fix time zone error in parquet reader (#33228)
AshinGau Apr 5, 2024
39afff2
[release](version) change branch-2.0 version to 2.0.8 (#33219)
xiaokang Apr 5, 2024
c25f352
[fix](iceberg) fix iceberg predicate conversion bug #33283 (#33290)
morningman Apr 7, 2024
df3404f
[fix](test) fix the float output of regression test (#33292)
AshinGau Apr 7, 2024
d083188
[branch-2.0](test) fix some unstable test (#33304)
morningman Apr 7, 2024
bf2d528
[Improvement](materialized-view) adjust priority of materialized view…
BiteTheDDDDt Apr 8, 2024
af950f7
[feature](replica) support force set replicate allocation for olap ta…
cambyzju Apr 8, 2024
5819a3b
Set enable_unique_key_partial_update to false in statistics session v…
Jibing-Li Apr 8, 2024
e3535cc
[fix](external catalog) Reset external table creation status on log r…
zy-kkk Apr 9, 2024
e7bff5d
[bump](fe)upgrade dependencies (#33360)
CalvinKirs Apr 9, 2024
f915e38
[opt](fe-ui) support read hardware info from aarch64 MacOS (#23708) (…
htyoung Apr 9, 2024
529260b
[improve](load) lock free flush_async and wait_flush in LoadChannel (…
kaijchen Apr 10, 2024
b7ebbd8
[fix](script) Fix `start_fe.sh` missing `METADATA_FAILURE_RECOVERY` w…
swjtu-zhanglei Apr 10, 2024
73f3e4f
[improve](function) the offset params in lead/lag function could use …
zhangstar333 Apr 10, 2024
3bf0044
[fix](restore) Fix the conflict IDs between two cluster (#33440)
w41ter Apr 10, 2024
110a707
[fix](compaction) remove single replica compaction prepare input row…
csun5285 Apr 11, 2024
b85772f
[branch-2.0](cherry-pick) mishandling of exceptions in the publish ph…
zhannngchen Apr 11, 2024
9a049d9
[feature](branch20) support statement to show views from database (#3…
xy720 Apr 11, 2024
242e299
[Bug](array) fix array column core dump in get_shrinked_column as not…
zhangstar333 Apr 11, 2024
1aced46
[fix](compress) data decompress failed while max_len equals 8M (#3345…
cambyzju Apr 11, 2024
71229d5
[fix](catalog) fix resource is not reopen when rename catalog (#33432…
zy-kkk Apr 12, 2024
74a5692
[enhancement](merge-on-write) compaction should not check correctness…
zhannngchen Apr 12, 2024
43358a8
[enhancement](merge-iterator) catch exception to avoid coredump when …
liaoxin01 Apr 13, 2024
365b099
[fix](planner)fix bug of InlineViewRef's tableNameToSql method (#33586)
starocean999 Apr 13, 2024
d0ae17d
[bug](not in) if not in (null) could eos early (#33482) (#33568)
zhangstar333 Apr 13, 2024
0855a7b
[branch-2.0](cherr-pick) schema change may cause mow duplicate key (3…
zhannngchen Apr 13, 2024
631dbda
[Fix](compaction) Fix single compaction to get all local versions 334…
csun5285 Apr 15, 2024
360aef7
[fix](nereids)ExtractAndNormalizeWindowExpression should only normali…
starocean999 Apr 15, 2024
e6957e2
[Enhancement] (branch-2.0) when partition column is datetime, date ca…
xiedeyantu Apr 15, 2024
08344df
Fix alter column stats without min max value deserialize failure. (#3…
Jibing-Li Apr 15, 2024
ee47404
[feature](Nereids): date literal suppose Zone (#33534) (#33683)
jackwener Apr 16, 2024
6758dfe
[fix](nereids)InSubquery's withChildren method lost typeCoercionExpr …
starocean999 Apr 16, 2024
89fb441
[feature](window_function) support to secondary argument to ignore nu…
mrhhsg Apr 17, 2024
536f1b6
[fix](analyze) avoid java.util.ConcurrentModificationException (#3367…
morningman Apr 17, 2024
2969937
[fix](parquet) fix time zone error(isAdjustedToUTC=true) in parquet r…
AshinGau Apr 17, 2024
7ff7f88
Improve analyze mv/mtmv wait row count report logic. (#33695) (#33751)
Jibing-Li Apr 17, 2024
2465159
[branch-2.0](fix) fix row count cache block bug (#33755)
morningman Apr 17, 2024
10e9697
[fix](routine-load) fix get kafka offset timeout may too long (#33502…
sollhui Apr 17, 2024
f72acbd
[fix](routine-load) fix data lost when FE leader change (#33678) (#33…
sollhui Apr 17, 2024
f395365
[fix](regression_test) test_not_supported_agg_fn failed (#33767)
mrhhsg Apr 17, 2024
4adb907
Cherry-pick fix about restore indexes and ids (#33772)
w41ter Apr 17, 2024
d4d213f
[Pick](materialized-view) pick some mv fix from master #30215 #31962 …
BiteTheDDDDt Apr 17, 2024
7f4edf4
[FIX](load)Fix load with func split_by_string #33713 (#33783)
Apr 17, 2024
d5cbf77
[FIX](cast)fix full/right out join for cast array #33475 (#33537)
Apr 17, 2024
1c85db2
[opt](inverted index) topn opt reads only limit number of records #33…
zzzxl1993 Apr 18, 2024
d9970be
[Fix](Json type) forbit schema change adding JSON columns with none n…
eldenmoon Apr 18, 2024
b15854a
routine load date where expression rewrite should change over time (#…
sollhui Apr 18, 2024
4954b1c
[fix](planner)create view statement should forbid mv rewrite (#33785)
starocean999 Apr 18, 2024
a8d421e
[Fix](inverted index) fix build index error status when batch_next (#…
airborne12 Apr 18, 2024
e4ad1e4
[Fix](inverted index) fix fast execute problem when need read data op…
airborne12 Apr 18, 2024
7267e9c
[feature](proc)Add table's indexes info in show proc interface (#3343…
qidaye Apr 18, 2024
77689d8
[fix](timezone) fix miss of expected rounding of Date type with timez…
zclllyybb Apr 18, 2024
0c341bf
[Fix](Outfile) Fixed the problem that the concurrent Outfile wrote mu…
BePPPower Apr 18, 2024
50e291f
[Fix](nereids) forward the user define variables to master (#33013) (…
feiniaofeiafei Apr 18, 2024
33ab775
[feature](inverted index) add slop functionality to match_phrase #332…
zzzxl1993 Apr 18, 2024
85d10dd
[fix](merge-iterator) Fix mem leak when get next batch failed (#33627…
liaoxin01 Apr 18, 2024
67dfa39
[fix](inverted index) normal process query for null condition when in…
zzzxl1993 Apr 18, 2024
90f8a47
[improvement](mow) Add profile for delete_bitmap get_agg function #33…
hust-hhb Apr 18, 2024
239d1b8
[chore](workflow) Increase the build space for building third-party l…
adonis0147 Apr 18, 2024
e23e12e
[fix](fe) Fix finalizeCommand `sendAndFlush` NullPointerException #33…
swjtu-zhanglei Apr 18, 2024
b9be1b7
[fix](restore) Reset index id for MaterializedIndexMeta (#33835)
w41ter Apr 18, 2024
9f5bd52
[Fix](nereids) fix qualifier problem that affects delete stmt in anot…
feiniaofeiafei Apr 18, 2024
033c3a0
[fix](nereids)BE cannot find min-max runtime filter on nested loop jo…
englefly Apr 18, 2024
68f2718
[Bug](materialized-view) forbid create mv with value column before ke…
BiteTheDDDDt Apr 18, 2024
2b4efc7
[fix](routine-load) fix consumer hang when kafka exception causing ca…
sollhui Apr 18, 2024
7724017
[opt](auto bucket) add fe config autobucket_max_buckets #33842 (#33866)
xiaokang Apr 19, 2024
0e2edbc
[fix](fe)reduce memory usage in alter #32810 (#33873)
luwei16 Apr 19, 2024
6a3ccd0
[Fix](inverted index) fix wrong need read data opt when encounters co…
airborne12 Apr 19, 2024
42e6904
[branch-2.0](routine-load) fix single stream multi table load cannot …
sollhui Apr 19, 2024
ac6fa85
Revert "[improve](load) lock free flush_async and wait_flush in LoadC…
xinyiZzz Apr 19, 2024
c6622db
[opt](coord) use single instance only with small limit #33888 (#33903)
morningman Apr 19, 2024
be5fc63
[feature](Nereids) add expr depth limit and expr children limit in Ne…
keanji-x Apr 19, 2024
5c2fca8
[release](version) change branch-2.0 version to 2.0.9 (#33865)
xiaokang Apr 20, 2024
83ac44b
[feature](MultiPartition)user could modify multi partition prefix(#33…
felixwluo Apr 20, 2024
54f5d13
[chore](dependencies)upgrade hive catalog to 2.0.0 (#33424)
CalvinKirs Apr 22, 2024
475b065
[bug](branch-2.0) fix data loss and incorrect in random distribution …
xy720 Apr 23, 2024
325e18d
[fix](nereids) do not transpose semi join agg when mark join (#33949)
starocean999 Apr 24, 2024
7dcc83e
[chore](dependencies)Upgrade paimon to 0.7.0 (#33987) (#34037)
CalvinKirs Apr 24, 2024
a71f75a
[enhancement](backup-restore) add config for upload/download task num…
nextdreamblue Apr 24, 2024
b81cdf3
[fix](npe) fix kafka be id npe (#33151) (#34039)
yujun777 Apr 24, 2024
d1e614a
[improvement](replica) set replica drop write editlog (#30345) (#34033)
yujun777 Apr 24, 2024
7b73699
[chore](regression test) check disk is good (#29740) (#34029)
yujun777 Apr 24, 2024
54902f3
[bug](branch-2.0) fix stream load metric error (#34012)
xy720 Apr 24, 2024
a490686
[fix](migrate disk) fix tablet disk migration timeout too large (#298…
yujun777 Apr 24, 2024
d89789e
[200~fix unstable TabletRepairAndBalanceTest~ (#34031)
yujun777 Apr 24, 2024
ec86e02
[Fix](Csv-Reader)Fix the issue of BE core dump caused by improper con…
BePPPower Apr 24, 2024
422a92a
[fix](fd) remove fd from cache when tablet is deleted (#34004)
dataroaring Apr 25, 2024
4b02f3e
migrate disk check old tablet had deleted (#34030)
yujun777 Apr 25, 2024
991b6a7
[feature](Nereids): add ColumnPruningPostProcessor. (#32800) (#34077)
jackwener Apr 25, 2024
93471ca
[fix](planner)date_add function should accept date type as its param …
starocean999 Apr 25, 2024
fa7c1f7
[fix](nereids)move ReplaceVariableByLiteral rule to analyze phase (#3…
starocean999 Apr 25, 2024
ae9be51
[fix](bdb) Write OP_TIMESTAMP operation until it successed (#33967) (…
w41ter Apr 25, 2024
23bab29
[branch-2.0](cherry-pick) donot coredump when be can not start (#2792…
zxealous Apr 25, 2024
38dd009
[opt](Planner) convert varchar column to string when ctas from extern…
morrySnow Apr 25, 2024
a793ca8
[fix](nereids)prevent null pointer access if translate expression fai…
starocean999 Apr 26, 2024
a8120e9
[fix](planner)cast expr should do nothing in compactForLiteral method…
starocean999 Apr 26, 2024
05ced82
[fix](Nereids) check after rewrite cannot handle agg in other opeator…
morrySnow Apr 26, 2024
ddf292a
[fix](ES catalog)Make col != '' behavior consistent with SQL (#34151)…
qidaye Apr 26, 2024
fe8b851
[branch-2.0](feature) pick docker suite framework (#34154)
yujun777 Apr 26, 2024
0d37447
[branch-2.0](cherry-pick) Not add disk path to broken list if check s…
zxealous Apr 26, 2024
9af0738
[fix](auto bucket) Fix auto bucket regression case occasional fail (#…
deardeng Apr 26, 2024
971aa72
[fix](schema change) follow fe set sc fail replicas as bad #33569 (#3…
yujun777 Apr 27, 2024
7a15962
[fix](storage medium) Fix partition show storage medium not right whe…
deardeng Apr 27, 2024
c559bba
[fix](fs) Close local file writer when downloading finished (#33556) …
w41ter Apr 28, 2024
94815b1
[branch-2.0](create table) show create table print storage medium #29…
yujun777 Apr 28, 2024
7237743
[opt](paimon) support mapping Paimon column type "Row" to Doris type …
suxiaogang223 Apr 28, 2024
42681eb
[fix](inverted index) the rowset may be deleted and become nullptr. #…
zzzxl1993 Apr 29, 2024
6e72a54
[dependency](chore)Remove hadoop-yarn related dependencies and upgrad…
CalvinKirs Apr 29, 2024
fb97758
[fix](outfile)Fixed orcOutputStream.close() throwing an exception dur…
hubgeter Apr 29, 2024
ae30d6a
[fix](compaction test) show single replica compaction status and fix …
csun5285 Apr 29, 2024
1c55cf8
[bug](regexp) fix regexp function fallback to re2 failed (#34292)
zhangstar333 Apr 30, 2024
3da43a1
[Fix](orc-reader) Fix the issue when string col has mixed plain and d…
kaka11chen Apr 30, 2024
1eca457
[Enhancement](jdbc catalog) Change Jdbc connection pool to hikari (#3…
zy-kkk Apr 30, 2024
999b9cc
[feature](variable) add read_only and super_read_only (#33795) (#34330)
morningman Apr 30, 2024
27da207
[fix](jni-connector) avoid core dump if init connector failed (#34007…
morningman Apr 30, 2024
5f5cb63
[chore](tablet scheduler) update sched ctx err #27514 (#31189)
yujun777 Apr 30, 2024
e7b19b3
[fix](Nereids) support aggregate function only in having statement (#…
morrySnow Apr 30, 2024
4c04006
[enhance](Backup) Obscure the secret key for show backup's repository…
ByteYue Apr 30, 2024
5edf259
[fix](json) fix be crash while load json data (#34283) (#34346)
cambyzju Apr 30, 2024
4276041
[Chore](dependencies)bcprov-jdkon15 migration to bcprov-jdkon18 (#34344)
CalvinKirs Apr 30, 2024
74ed6e8
[Fix](partial update) Fix rowset not found error when doing partial u…
Yukang-Lian Apr 30, 2024
d0e89c0
[Fix](inverted index) fix memory leak when inverted index writer not …
xiaokang May 1, 2024
f31458e
[opt](inverted index) add inlist condition handling to compound #3413…
zzzxl1993 May 1, 2024
2d6b54e
[branch-2.0](create tablet) create tablet chose disk round robin #298…
yujun777 May 1, 2024
13d4f79
[opt](inverted index) the "unicode" tokenizer can be configured to di…
zzzxl1993 May 3, 2024
0196abe
[feature](regression test) stream load support direct load to be #268…
yujun777 May 4, 2024
7d0521a
[fix](inverted index) Add session switch to compound inlist (#34388)
zzzxl1993 May 4, 2024
8160437
[release](version) change branch-2.0 version to 2.0.10 (#34366)
xiaokang May 5, 2024
83b2550
[typo](log) Let env lock msg more distinct #27493 (#34486)
yujun777 May 8, 2024
7b9b8c9
[Feature](PreparedStatement) implement general server side prepared (…
eldenmoon May 8, 2024
6dfc857
[opt](inverted index)Modify the parameter passing method for compound…
zzzxl1993 May 8, 2024
ca7fb51
exclude today partition (#34507)
yujun777 May 8, 2024
909678e
[improvement](hint) update clone hint #32466 (#34510)
yujun777 May 8, 2024
21db960
[branch-2.0](log) add try lock db failed log #34503 (#34504)
yujun777 May 8, 2024
0a38945
[fix](csv-reader) fix column split error when there is escape charact…
liaoxin01 May 8, 2024
778a887
[improve] Make the schema change memory space adaptive #34350 (#34515)
Lchangliang May 8, 2024
a73792e
[opt](file-scanner) print current path when encountering error (#3436…
morningman May 8, 2024
9061b81
[Improve](config)The stream_load label length is changed to a configu…
DongLiang-0 May 8, 2024
9676cb0
[fix](load) acquire latest token instead of oldest token in TokenMana…
kaijchen May 8, 2024
2d5cd74
[Refactor](Sink) Remove is_append mode in table sink (#34549)
eldenmoon May 8, 2024
7268125
[improve](restore) Release useless info for the finished job to reduc…
w41ter May 8, 2024
c2b28f8
[fix](load) fix repeatedly open tablets_channel when tablets_channel …
liaoxin01 May 8, 2024
68c8bce
[opt](Nereids) support where, group by, having, order by clause witho…
starocean999 May 9, 2024
ea34cb0
[chore](sink) remove `load_block_to_single_tablet` flag in sink (#34569)
eldenmoon May 9, 2024
005eeb2
[fix](compatibility) add some keywords #29251 (#34428)
nextdreamblue May 9, 2024
68cae7e
[bug](branch2.0) Fix modifying label_num_threshold does not take effe…
xy720 May 9, 2024
06d3bb1
[branch-2.0](tablet invert index) fix tablet invert index leaky cause…
yujun777 May 9, 2024
af9f5a2
[bugfix](multi catalog) fixed an issue where the hive catalog field d…
felixwluo May 9, 2024
9ccacb4
[Fix](Planner) add date/month/year add function fe constant fold with…
LiBinfeng-01 May 10, 2024
036e2a6
[fix](jdbc catalog) Fix ClassLoader Scope in JdbcExecutor Initializat…
zy-kkk May 10, 2024
cc1aabb
[Update](clucene) update clucene commit (#34595)
airborne12 May 10, 2024
7ed116b
[improvement](decommission be) decommission check replica num #32748 …
yujun777 May 10, 2024
2fb8d68
[fix](compaction) fix time series compaction merge empty rowsets prio…
csun5285 May 10, 2024
836a974
[feature](planner) Support `select constant from dual` syntax sugar (…
zy-kkk May 11, 2024
998e070
[fix](bug) fix intersections/differences bug #34675 (#34697)
HappenLee May 11, 2024
2a5949c
[fix](function) json_object can not input null value (#34591) (#34700)
Mryange May 11, 2024
a3d1854
[fix](replication_allocation) fix two problems for force_olap_table_r…
cambyzju May 13, 2024
41e7da5
Fix failed p2 hive statistics case. (#34663) (#34745)
Jibing-Li May 13, 2024
3a21653
Use defaultSessionVariable instead of clone a new one. (#34672) (#34747)
Jibing-Li May 13, 2024
96e1280
[branch-2.0](resource)fix check available fail when s3 aws_token is s…
kobe6th May 13, 2024
f1eaf16
fix backup and restore failed between force_replication_allocation se…
cambyzju May 14, 2024
17b1df5
[Improvement](set) enable admin_set_frontend_config can apply to all …
Yulei-Yang May 14, 2024
3578ba6
[fix](planner) fix ScalarType.getAssignmentCompatibleType() when deal…
feiniaofeiafei May 15, 2024
f362280
[fix](nereids)4 phase agg may lost parameter in some case (#34826)
starocean999 May 15, 2024
5d719b8
[fix](planner)correlated predicate should include isnull predicate (#…
starocean999 May 15, 2024
ba1c3da
[Fix](Planner) fix date_xxx functions without complete function signa…
LiBinfeng-01 May 15, 2024
3b124e1
[fix](reader) avoid be coredump in block reader in abnormal situation…
jacktengg May 15, 2024
a8803fe
[branch-2.0](regression test) fix test_decommission_with_replica_num_…
yujun777 May 15, 2024
b055552
[Fix](nereids) modify the binding aggregate function in order by (#34…
feiniaofeiafei May 16, 2024
7103872
[branch-2.0](recover) support skipping missing version in select by s…
xy720 May 16, 2024
82e33fd
[feature](cmd) add UNSET_VARIABLE statement to set back variables (#3…
Yulei-Yang May 16, 2024
ccf8be8
[Fix](outfile) Fix the timing of setting the _is_closed flag in Parqu…
BePPPower May 16, 2024
5871e91
[fix](inverted index) fix race condition for column reader load inver…
airborne12 May 17, 2024
ea9dac5
[fix](prepare) fix datetimev2 return err when binary_row_format #3466…
nextdreamblue May 17, 2024
c84b033
[Fix](Nereids) ntile function should check argument (#32994) (#34661)
LiBinfeng-01 May 17, 2024
6566097
[Fix](test) add sync to ensure data synchronization in test_set_opera…
LiBinfeng-01 May 17, 2024
b810736
[chore](log) remove redundant log in segment.cpp (#35008)
mrhhsg May 17, 2024
90e5c59
[fix](show proc) Fix insert into command cannot be seen in show proc …
zhiqiang-hhhh May 17, 2024
6aaace1
[fix](auth)fix show row policy error when table deleted for 2.0 #3231…
zddr May 17, 2024
cddf62b
[fix](jdbc_catalog) fix error datetime literal caused be core (#34977)
Yulei-Yang May 17, 2024
8eeee84
[opt](jdbc catalog) opt oceanbase jdbc client (#34936)
zy-kkk May 17, 2024
7200bae
[fix](catalog) fix the that failed to check if input format is splita…
morningman May 18, 2024
c62acf5
[Bug](repeat) fix core dump coz output slot'order on repeat node not …
BiteTheDDDDt May 20, 2024
4fa2bde
[Pick](Branch-2.0) pick to fix tablet_id overflow #34912 #34962 (#34995)
eldenmoon May 20, 2024
7bee558
[fix](Nereids) column pruning do not do well (#34782)
morrySnow May 20, 2024
9e386c0
[feat](Nereids) Reject Commutativity Swap for Nested Loop Joins Affec…
keanji-x May 21, 2024
c0deda5
[branch-2.0](multi catalog) Print serde properties when show create h…
xy720 May 21, 2024
5d5798c
[Fix](tvf) Fix that tvf reading empty files in compressed formats. (#…
BePPPower May 21, 2024
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
The table of contents is too big for display.
Diff view
Diff view
  •  
  •  
  •  
The diff you're trying to view is too large. We only load the first 3000 changed files.
23 changes: 22 additions & 1 deletion .asf.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -52,12 +52,12 @@ github:
- Clang Formatter
- CheckStyle
- P0 Regression (Doris Regression)
- P1 Regression (Doris Regression)
- FE UT (Doris FE UT)
- BE UT (Doris BE UT)
- Build Broker
- Build Documents
- BE UT (Clang)
- ShellCheck
- clickbench (benchmark)
- BE UT (macOS)
- Build Third Party Libraries (Linux)
Expand All @@ -78,6 +78,27 @@ github:
required_pull_request_reviews:
dismiss_stale_reviews: true
required_approving_review_count: 1

branch-2.0:
required_status_checks:
# if strict is true, means "Require branches to be up to date before merging".
strict: false
contexts:
- License Check
- Clang Formatter
- CheckStyle
- Build Documents
- ShellCheck
- Need_2_Approval
- COMPILE (DORIS_COMPILE)
- P0 Regression (Doris Regression)
- FE UT (Doris FE UT)
- BE UT (Doris BE UT)
- clickbench-new (clickbench)
required_pull_request_reviews:
dismiss_stale_reviews: true
required_approving_review_count: 1

collaborators:
- LemonLiTree
- zy-kkk
Expand Down
7 changes: 7 additions & 0 deletions .dockerignore
Original file line number Diff line number Diff line change
@@ -0,0 +1,7 @@
be*
fs_brokers*
thirdparty*
fe*
.git*
fs_brokers*

1 change: 0 additions & 1 deletion .github/actions/action-sh-checker
Submodule action-sh-checker deleted from 76ab0b
1 change: 0 additions & 1 deletion .github/actions/clang-format-lint-action
Submodule clang-format-lint-action deleted from 6adbe1
1 change: 0 additions & 1 deletion .github/actions/clang-tidy-review
Submodule clang-tidy-review deleted from 2c55ef
13 changes: 0 additions & 13 deletions .github/actions/patches/action-sh-checker.patch

This file was deleted.

1 change: 1 addition & 0 deletions .github/workflows/auto_trigger_teamcity.yml
Original file line number Diff line number Diff line change
Expand Up @@ -95,6 +95,7 @@ jobs:

for pipeline in ${trigger_pipelines}
do
same_build_sign="false"
echo "-----------------------------------------------------------------"
running_builds_command="curl -s -X GET ${teamcity_url}/app/rest/builds\?locator\=buildType\:${pipeline}\,branch:pull/${pull_request_num}\,running:true"
echo "${running_builds_command}"
Expand Down
4 changes: 2 additions & 2 deletions .github/workflows/be-ut-mac.yml
Original file line number Diff line number Diff line change
Expand Up @@ -29,7 +29,7 @@ concurrency:
jobs:
run-ut:
name: BE UT (macOS)
runs-on: macos-12
runs-on: macos-13
steps:
- name: Checkout
uses: actions/checkout@v3
Expand Down Expand Up @@ -81,7 +81,7 @@ jobs:
'node'
'llvm@16'
)
brew install "${cellars[@]}"
brew install "${cellars[@]}" || true

pushd thirdparty
branch="${{ github.base_ref }}"
Expand Down
1 change: 1 addition & 0 deletions .github/workflows/build-extension.yml
Original file line number Diff line number Diff line change
Expand Up @@ -100,6 +100,7 @@ jobs:
run: |
git clone https://github.com/apache/doris-website.git website
cd website
echo "[\"current\"]" > versions.json
mkdir -p docs
cp -R ../docs/en/docs/* docs/
cp -R ../docs/sidebars.json sidebars.json
Expand Down
19 changes: 18 additions & 1 deletion .github/workflows/build-thirdparty.yml
Original file line number Diff line number Diff line change
Expand Up @@ -51,6 +51,21 @@ jobs:
if: ${{ needs.changes.outputs.thirdparty_changes == 'true' }}
runs-on: ubuntu-22.04
steps:
- name: Checkout easimon/maximize-build-space
run: |
git clone -b v7 https://github.com/easimon/maximize-build-space

- name: Maximize build space
uses: ./maximize-build-space
with:
root-reserve-mb: 4096
swap-size-mb: 8192
remove-dotnet: 'true'
remove-android: 'true'
remove-haskell: 'true'
remove-codeql: 'true'
remove-docker-images: 'true'

- name: Checkout ${{ github.ref }}
uses: actions/checkout@v3

Expand Down Expand Up @@ -151,10 +166,12 @@ jobs:
'llvm@16'
)

brew install "${packages[@]}"
brew install "${packages[@]}" || true

- name: Build
run: |
export MACOSX_DEPLOYMENT_TARGET=12.0

cd thirdparty
./build-thirdparty.sh -j "$(nproc)"

25 changes: 24 additions & 1 deletion .github/workflows/clang-format.yml
Original file line number Diff line number Diff line change
Expand Up @@ -30,7 +30,21 @@ jobs:
uses: actions/checkout@v3
with:
persist-credentials: false
submodules: recursive

- name: Checkout ${{ github.ref }} ( ${{ github.event.pull_request.head.sha }} )
if: ${{ github.event_name == 'pull_request_target' }}
uses: actions/checkout@v3
with:
ref: ${{ github.event.pull_request.head.sha }}

- name: Checkout paths-filter
run: |
rm -rf ./.github/actions/paths-filter
git clone https://github.com/dorny/paths-filter .github/actions/paths-filter

pushd .github/actions/paths-filter &>/dev/null
git checkout 4512585405083f25c027a35db413c2b3b9006d50
popd &>/dev/null

- name: Paths filter
uses: ./.github/actions/paths-filter
Expand All @@ -41,6 +55,15 @@ jobs:
- 'be/src/**'
- 'be/test/**'

- name: Checkout clang-format-lint-action
run: |
rm -rf ./.github/actions/clang-format-lint-action
git clone https://github.com/DoozyX/clang-format-lint-action .github/actions/clang-format-lint-action

pushd .github/actions/clang-format-lint-action &>/dev/null
git checkout 6adbe14579e5b8e19eb3e31e5ff2479f3bd302c7
popd &>/dev/null

- name: "Format it!"
if: ${{ steps.filter.outputs.be_changes == 'true' }}
uses: ./.github/actions/clang-format-lint-action
Expand Down
100 changes: 74 additions & 26 deletions .github/workflows/code-checks.yml
Original file line number Diff line number Diff line change
Expand Up @@ -27,40 +27,52 @@ jobs:
- name: Checkout ${{ github.ref }} ( ${{ github.sha }} )
if: ${{ github.event_name != 'pull_request_target' }}
uses: actions/checkout@v3
with:
submodules: recursive

- name: Checkout ${{ github.ref }} ( ${{ github.event.pull_request.head.sha }} )
if: ${{ github.event_name == 'pull_request_target' }}
uses: actions/checkout@v3
with:
ref: ${{ github.event.pull_request.head.sha }}
submodules: recursive

- name: Patch
- name: Checkout action-sh-checker
run: |
pushd .github/actions/action-sh-checker >/dev/null
git apply ../patches/action-sh-checker.patch
popd >/dev/null
rm -rf ./.github/actions/action-sh-checker
git clone https://github.com/luizm/action-sh-checker .github/actions/action-sh-checker

pushd .github/actions/action-sh-checker &>/dev/null
git checkout 76ab0b22e1f194e4a582edc7969df6485c4e9246
sed -i 's/\[ "$GITHUB_EVENT_NAME" == "pull_request" \]/\[\[ "$GITHUB_EVENT_NAME" == "pull_request" || "$GITHUB_EVENT_NAME" == "pull_request_target" \]\]/' entrypoint.sh
popd &>/dev/null

- name: Run ShellCheck
uses: ./.github/actions/action-sh-checker
env:
GITHUB_TOKEN: ${{ secrets.GITHUB_TOKEN }}
with:
sh_checker_comment: true
sh_checker_exclude: .git .github ^docker ^thirdparty/src ^thirdparty/installed ^ui ^docs/node_modules ^tools/clickbench-tools ^extension ^output ^fs_brokers/apache_hdfs_broker/output (^|.*/)Dockerfile$ ^be/src/apache-orc ^be/src/clucene
sh_checker_exclude: .git .github ^docker ^thirdparty/src ^thirdparty/installed ^ui ^docs/node_modules ^tools/clickbench-tools ^extension ^output ^fs_brokers/apache_hdfs_broker/output (^|.*/)Dockerfile$ ^be/src/apache-orc ^be/src/clucene ^pytest

clang-tidy:
name: "Clang Tidy"
preparation:
name: "Clang Tidy Preparation"
if: ${{ github.event_name == 'pull_request_target' }}
runs-on: ubuntu-22.04
permissions: read-all
outputs:
should_check: ${{ steps.generate.outputs.should_check }}
steps:
- name: Checkout ${{ github.ref }} ( ${{ github.event.pull_request.head.sha }} )
uses: actions/checkout@v3
with:
ref: ${{ github.event.pull_request.head.sha }}
submodules: recursive

- name: Checkout paths-filter
run: |
rm -rf ./.github/actions/paths-filter
git clone https://github.com/dorny/paths-filter .github/actions/paths-filter

pushd .github/actions/paths-filter &>/dev/null
git checkout 4512585405083f25c027a35db413c2b3b9006d50
popd &>/dev/null

- name: Paths Filter
uses: ./.github/actions/paths-filter
Expand All @@ -73,28 +85,64 @@ jobs:
- 'gensrc/thrift/**'

- name: Generate compile_commands.json
if: ${{ steps.filter.outputs.be_changes == 'true' }}
id: generate
run: |
export DEFAULT_DIR='/opt/doris'
if [[ "${{ steps.filter.outputs.be_changes }}" == 'true' ]]; then
export DEFAULT_DIR='/opt/doris'

mkdir "${DEFAULT_DIR}"
wget https://github.com/amosbird/ldb_toolchain_gen/releases/download/v0.18/ldb_toolchain_gen.sh \
-q -O /tmp/ldb_toolchain_gen.sh
bash /tmp/ldb_toolchain_gen.sh "${DEFAULT_DIR}/ldb-toolchain"
mkdir "${DEFAULT_DIR}"
wget https://github.com/amosbird/ldb_toolchain_gen/releases/download/v0.18/ldb_toolchain_gen.sh \
-q -O /tmp/ldb_toolchain_gen.sh
bash /tmp/ldb_toolchain_gen.sh "${DEFAULT_DIR}/ldb-toolchain"

sudo DEBIAN_FRONTEND=noninteractive apt install --yes tzdata byacc
sudo DEBIAN_FRONTEND=noninteractive apt install --yes tzdata byacc

pushd thirdparty
curl -L https://github.com/apache/doris-thirdparty/releases/download/automation/doris-thirdparty-prebuilt-linux-x86_64.tar.xz \
-o doris-thirdparty-prebuilt-linux-x86_64.tar.xz
tar -xvf doris-thirdparty-prebuilt-linux-x86_64.tar.xz
popd
pushd thirdparty
curl -L https://github.com/apache/doris-thirdparty/releases/download/automation/doris-thirdparty-prebuilt-linux-x86_64.tar.xz \
-o doris-thirdparty-prebuilt-linux-x86_64.tar.xz
tar -xvf doris-thirdparty-prebuilt-linux-x86_64.tar.xz
popd

export PATH="${DEFAULT_DIR}/ldb-toolchain/bin/:$(pwd)/thirdparty/installed/bin/:${PATH}"
DISABLE_JAVA_UDF=ON DORIS_TOOLCHAIN=clang OUTPUT_BE_BINARY=0 ./build.sh --be
export PATH="${DEFAULT_DIR}/ldb-toolchain/bin/:$(pwd)/thirdparty/installed/bin/:${PATH}"
DISABLE_JAVA_UDF=ON DORIS_TOOLCHAIN=clang ENABLE_PCH=OFF OUTPUT_BE_BINARY=0 ./build.sh --be
fi

- name: Run clang-tidy review
echo "should_check=${{ steps.filter.outputs.be_changes }}" >>${GITHUB_OUTPUT}

- name: Upload
uses: actions/upload-artifact@v3
if: ${{ steps.filter.outputs.be_changes == 'true' }}
with:
name: compile_commands
path: ./be/build_Release/compile_commands.json

clang-tidy:
name: "Clang Tidy"
needs: preparation
if: ${{ needs.preparation.outputs.should_check == 'true' }}
runs-on: ubuntu-22.04
steps:
- name: Checkout ${{ github.ref }} ( ${{ github.event.pull_request.head.sha }} )
uses: actions/checkout@v3
with:
ref: ${{ github.event.pull_request.head.sha }}

- name: Download
uses: actions/download-artifact@v3
with:
name: compile_commands
path: ./be/build_Release

- name: Checkout clang-tidy review
run: |
rm -rf ./.github/actions/clang-tidy-review
git clone https://github.com/ZedThree/clang-tidy-review .github/actions/clang-tidy-review

pushd .github/actions/clang-tidy-review &>/dev/null
git checkout 2c55ef8cfc9acb3715d433e58aea086dcec9b206
popd &>/dev/null

- name: Run clang-tidy review
uses: ./.github/actions/clang-tidy-review
id: review
with:
Expand Down
2 changes: 1 addition & 1 deletion .github/workflows/sonarcloud.yml
Original file line number Diff line number Diff line change
Expand Up @@ -62,4 +62,4 @@ jobs:
SONAR_TOKEN: ${{ secrets.SONAR_TOKEN }}
run: |
cd fe
mvn --batch-mode verify sonar:sonar -DskipTests -Dsonar.host.url=https://sonarcloud.io -Dsonar.organization=apache -Dsonar.projectKey=apache_incubator-doris -Dhttp.keepAlive=false -Dmaven.wagon.http.pool=false -Dmaven.wagon.httpconnectionManager.ttlSeconds=120
mvn --batch-mode verify sonar:sonar -DskipTests -Dsonar.host.url=https://sonarcloud.io -Dsonar.organization=apache -Dsonar.projectKey=apache_incubator-doris -Dhttp.keepAlive=false -Dmaven.wagon.http.pool=false -Dmaven.wagon.httpconnectionManager.ttlSeconds=120 -Xmx4g -XX:MaxPermSize=512m
9 changes: 7 additions & 2 deletions .gitignore
Original file line number Diff line number Diff line change
@@ -1,4 +1,5 @@
# ignore file with wildcard anywhere
*.swo
*.swp
*.pyc
*.class
Expand All @@ -13,13 +14,14 @@ core.*
.DS_Store
.classpath
nohup.out
custom_env.sh
custom_env_mac.sh
/custom_env.sh
/custom_env_mac.sh
derby.log
dependency-reduced-pom.xml
yarn.lock
ut_dir
package-lock.json
__pycache__

# ignore all sub `/bin` and `/build` directory
**/build/
Expand All @@ -42,6 +44,7 @@ docs/.temp

# output, thirdparty, extension
output/
output.bak/
rpc_data/
metastore_db/
thirdparty/src*
Expand Down Expand Up @@ -72,6 +75,7 @@ samples/doris-demo/remote-udf-cpp-demo/function_server_demo

# FE
fe/mocked/
fe/gen/
fe/fe-core/gen/
fe/fe-core/src/main/resources/static/
fe/fe-core/src/main/antlr4/org/apache/doris/nereids/DorisLexer.tokens
Expand All @@ -90,6 +94,7 @@ be/tags
be/test/olap/test_data/tablet_meta_test.hdr
be/.devcontainer/
be/src/apache-orc/
zoneinfo/

## tools
tools/ssb-tools/ssb-data/
Expand Down
Loading