Release Notes 0.14.0

[yangzhg]

Since the release of 0.13, Apache Doris (incubating) contains around 390 new features, bug fixes, performance enhancements, documentation improvements, code refactors from 60+ contributors. We are ready to release Apache Doris (incubating) 0.14.

New Feature

Import and delete

Support to delete multiple pieces of data at one time through the import method to avoid performance degradation caused by multiple deletions. For tables of the UniqueKey model, support to specify the Sequence column when importing. Doris will judge the sequence of the data according to the value of the Sequence column to ensure that the data is imported Time order

[#4310] [#4256]

Support database backup

The support in the backup stmt specifies the backup content (metadata and data).
Support exclude backup and restore some tables in stmt. When backing up the entire database, you can exclude some very large and unimportant tables.
Supports backing up and restoring the entire database instead of declaring each table name in the backup and restore statement.

[#5314]

ODBC external table support

Support access to external tables such as MySQL, postgresql, Oracle, etc. through ODBC protocol

[#4798] [#4438] [#4559] [#4699]

Support SQL level and Partition level result Cache

Support for caching query results to improve the efficiency of repeated queries, support SQL-level and Partition-level results Cache [#4330]

Built-in functions

• Support bitmap_xor function [add BE udf bitmap xor #5098]
• Add replace() function [udf: replace function #4347]
• Add the time_round function to support time alignment according to multiple time granularities [[Feature] Add time_round builtin functions #4640]

FE interface and HTTP interface

• The new FE UI interface can be enabled by setting the FE configuration item enable_http_server_v2 [[UI Part 5] Enable HTTP Server 2 by FE config #4684]

• BE adds an http interface to show the distribution of all tablets in a partition among different disks in a BE [[Feature] Add a http interface to acquire the tablets distribution between different disks #5096]

• BE adds an http interface to manually migrate a tablet to other disks on the same node [[Feature] Add a http interface for single tablet migration between different disks #5101]

• Support to modify the configuration items of FE and BE through http, and persist these modifications [[Feature][Config] Support persistence of configuration items modified at runtime #4704]

Compatibility with MySQL

• Added support for views table in the information_schema database [Error happened when open a view in DBeaver #4778]
• Added table_privileges, schema_privileges and user_privileges to the information_schema library for compatibility with certain MySQL applications [Added #4897: Add table_privileges, schema_privileges and user_privile… #4899]
• A new statistic table is added to the information_schema meta-database for compatibility with some MySQL tools [[Enhance] Add "statistics" meta table and fix some mysql compatibility problem #4991]

Monitoring

• BE added tablet-level monitoring indicators, including scanned data volume and row number, written data volume and row number, to help locate hot tablets [[Metrics] Support tablet level metrics #4428]

• BE added metrics to view the usage of various LRU caches [[LRUCache] Expose LRU Cache status to metrics #4688]

Table building related

• Added CREATE TABLE LIKE statement to facilitate the creation of a table metadata copy [[CREATE TABLE]Support new syntax CREATE TABLE LIKE to clone an existe… #4705]
• Support atomic replacement of two tables through replace statement [[Feature] Support REPLACE TABLE operation. #4669]

Support backup,restore,load,export directly connect to s3 [#5399]

Other

• Support adding Optimizer Hints of type SET_VAR in the Select statement to set session variables [[Feature]Support SELECT Optimizer Hints SET_VAR #4504]

• Support to repair damaged tablets by filling in empty tablets [[Tablet][Recovery] Support using empty tablet to repair the damaged or missing tablet #4255]

• Support Bucket Shuffle Join function (when the Join condition column is a subset of the table bucket column, the right table will be shuffled to the node where the data in the left table is located, which can significantly reduce the network overhead caused by Shuffle Join and improve query speed) [# 4677]

• Support batch cancel import tasks through cancel load statement [[Feature] Support cancel load jobs in batch #4515]

• Add a Session variable to set whether to allow the partition column to be NULL [[Repair] Add an option whether to allow the partition column to be NULL #5013]

• Support TopN aggregation function [[Feature] Add Topn udaf #4803]

• Support a new data balancing logic based on the number of partitions and buckets [[Rebalancer] support partition rebalancer #5010]

• Support creating indexes on the value column of unique table [Support create index on unique value column #5305]

Enhancement

Performance improvement

• Implemented a new compaction selection algorithm, providing lower write amplification and a more reasonable compaction strategy [Compaction rules optimization #4212]
• Optimize bit operation efficiency in variable length coding [Optimise coding bit operation in BE #4366]
• Improve the execution efficiency of monery_format function [[UDF] Improve performance of function money_format #4672]
• Optimize query execution plan: When the bucket column of the table is a subset of the GroupBy column in SQL, reduce the data shuffle step [Do not add exchange when table's distributioin satisfy the distribution requirements #4482]
• Improve the efficiency of column name search on BE [[Optimize] Add an unordered_map for TabletSchema to speed up column name lookup #4779]
• Improve the performance of the BE side LRU Cache [[Optimize] Improve LRU cache's performance #4781]
• Optimized the tablet selection strategy of Compaction, reducing the number of invalid selections [[Bug][Compaction] Fix bug that output rowset is not deleted after compaction failure. #4964]
• Optimized the reading efficiency of Unique Key table [Optimized the read performance of the table when have multi versions #4958]
• Optimized the memory usage of LoadJob on the FE side and reduced the memory overhead on the FE side [[Bug] fix finished load jobs cost too much heap  #4993]
• Reduce the lock granularity in FE metadata from Database level to Table level to support more fine-grained concurrent access to metadata [Support read and write lock in table level to reduce lock competition #3775]
• Avoid unnecessary memory copy when creating hash table [[optimization] avoid extra memory copy while build hash table #5301]
• Remove the path check when BE starts to speed up BE startup speed [(#5267) remove path check when start BE #5268]
• Optimize the import performance of Json data [Add fuzzy_parse option to speed up json import #5114]

Functional improvements

• SQL supports collate utf8_general_ci syntax to improve MySQL syntax compatibility [support collate field option in compare predicate sql from datagrip #4365]
• Improve the function of Batch delete, improve and optimize the related compaction process [Support batch delete[part 2]  #4425]
• Enhance the function of parse_url() function, support lowercase, support parsing port [Fix parse url bug #4429]
• When SQL execution specifies the execution mode of join (Join Hint), the Colocation Join function will be disabled by default [[Bug] Support disable colocate join where join clause has join hint #4497]
• Dynamic partition support hour level [[Feature] support hour time unit with dynamic parition #4514]
• HTTP interface on BE side supports gzip compression [[Enhance] Support gzip compression for http response #4533]
• Optimized the use of threads on the BE side [[refactor] Optimize threads usage mode in BE #4440]
• Optimize the checking process and error message of the rand() function in the query analysis stage [Validate the param of rand function in compile step #4439]
• Optimize the compaction triggering and execution logic to better limit the resource overhead (mainly memory overhead) of the compaction operation, and trigger the compaction operation more reasonably [[Optimize] Optimize the execution model of compaction to limit memory consumption #4670]
• Support pushing Limit conditions to ODBC/MySQL external tables [[ODBC/MySQL] Support Limit Clause Push Down For ODBC Table And MySQL Table(#4706) #4707]
• Increase the limit on the number of tablet versions on the BE side to prevent excessive data versions from causing abnormal cluster load [[Config] Limit the version number of tablet #4687]
• When an RPC error occurs in a query, it can quickly return specific error information to prevent the query from being stuck [[Enhance][Log] Make RPC error log more clear #4702]
• Support automatic mapping of count(distinct if(bool, bitmap, null)) to bitmap_union_count function [Rewrite count(distinct if(bool, bitmap, null)) to bitmap_union_count #4201]
• Support set sql_mode = concat(@@sql_mode, "STRICT_TRANS_TABLES") statement [[MySQL Compatibility 1/4][Bug] Fix bug that set sql_mode with concat() function failed #4359]
• Support all stream load features in multiload [Support full StreamLoad feature in multiload #4717]
• Optimize BE’s strategy for selecting disks when creating tablets, and use the "two random choices" algorithm to ensure tablet copies are more even [[Optimize]Optimize the disk selection strategy on BE for tablet creation #4373]
• When creating a materialized view, the bitmap_union aggregation method only supports integer columns, and hll_union does not support decimal columns [Forbidden the illegal column types on BITMAP_UNION OR HLL_UNION mv #4432]
• Optimize the log level of some FEs to avoid log writing becoming a bottleneck [ Make some debug log settings configurable and change some log level from info to debug to avoid performance bottlenecks #4766]
• In the describe table statement, display the definition expression of the aggregate column of the materialized view [Show column display name on Show Proc stmt #4446]
• Support convert() function [[Mysql Compatibility 3/4] Support convert() and signed/unsigned interger cast #4364]
  -Support cast (expr as signed/unsigned int) syntax to be compatible with MySQL ecology
  -Add more columns to the information_schema.columns table to be compatible with the MySQL ecosystem
• In Spark Load function, use yarn command line instead of yarn-client API to kill job or get job status [[SparkLoad]Use the yarn command to get status and kill the application #4383]
• Persistence of stale rowset meta-information to ensure that this information will not be lost after BE restarts [Persistence stale rowsets meta #4454]
• Return an error code in the schema change result to more clearly inform the user of the specific error [Add OLAP_ERR_DATE_QUALITY_ERR error status to display schema change failure #4388]
• Optimize the rowset selection logic of some compactions to make the selection strategy more accurate [(#5151) An already merged rowset should skip window check #5152]
• Optimize the Page Cache on the BE side, divide Page into data cache and index cache [[Optimize][Cache]Implementation of Separated Page Cache #5008]
• Optimized the accuracy of functions such as variance and standard deviation on Decimal type [[Bug] Fix the loss of precision when Decimal calculates variance/stddev #4959]
• Optimized the processing logic of predicates pushed down to ScanNode to avoid repeated filtering of predicate conditions at the query layer and improve query efficiency [[Performance Optimization] Remove push down conjuncts in olap scan node #4999]
• Optimized the predicate push-down logic of Unique Key table, and supports push-down the conditions of non-primary key columns [Push down predicate on value column of unique table to base rowset #5022]
• Support pushing down "not in" and "!=" to the storage layer to improve query efficiency [[Performance Improve] Push Down _conjunctf of 'not in' and '!=' to Storage Engine. #5207]
• Support writing multiple memtables of a tablet in parallel during import. Improve import efficiency [[Load Parallel][2/3] Support parallel flushing memtable during load #5163]
• Optimize the creation logic of ZoneMap. When the number of rows on a page is too small, ZoneMap will not be created anymore [Optimize Zone map create policy #5260]
• Added histogram monitoring indicator class on BE [[Feature] Implementation of histogram metric #5148]
• When importing Parquet files, if there is a parsing error, the specific file name will be displayed in the error message [[Improvement] Add parquet file name to the error message #4954]
• Optimize the creation logic of dynamic partitions, the table under construction directly triggers the creation of dynamic partitions [[Feature] Support Create Dynamic Partition Immediately FirstTime Without Wating Schedule. #5209]
• In the result of the SHOW BACKENDS command, display the real start time of BE [[Bug] Make 'LastStartTime' in backends list as the actual BE start time #4872]
• Support column names start with @ symbol, mainly used to support mapping ES tables [[Doris][Doris On ES] support @ leading column name #5006]
• Optimize the logic of the mapping and conversion relationship of the declared columns in the import statement to make the use more clear [Improve the processing logic of Load statement derived columns #5140]
• Optimize the execution logic of colocation join to make the query plan more evenly executed on multiple BE nodes [[Enhancement]Make Cholocate table join more load balance #5104]
• Optimize the predicate pushdown logic, and support pushdown of is null and is not null to the storage engine [[Performance Improve] Push Down _conjunct of 'A is NULL' and 'B is not NULL' to Storage Engine. #5092]
• Optimize the BE node selection logic in bucket join [[Enhancement] Optimize the algorithm of selecting host for a bucket scan task when a backend not alive #5133]
• Support UDF in import operation [[New Feature]Support udf when loading data #4863]

Other

• Added support for IN Predicate in delete statement [[Doc] Add in predicate support content in delete-manual.md #4404]
• Update the Dockerfile of the development image and add some new dependencies [[Dockerfile] Update Dockerfile #4474]
• Fix various spelling errors in the code and documentation [[Refactor] Fixes some be typo #4714] [[Docs] update data types doc and fix some typo #4712] [[documentation] Fix some typo in en docs part 1 #4722] [[documentation] Fix some typo in en docs part 2 #4723] [[documentation] Fix some typo in en docs part 3 #4724] [[documentation] Fix some typo in en docs part 4 #4725] [[documentation] Fix some typo in zh_cn docs part 1 #4726] [[documentation] Fix some typo in zh_cn docs part 2 #4727]
• Added two segment-related indicators in the OlapScanNode of the query profile to display the total number of segments and the number of filtered segments [[Profile] Add 2 Segment related metrics in query profile #4348]
• Add batch delete function description document [[DOCS] Add batch delete docs #4435]
• Added Spark Load syntax manual [[Doc] Add spark load sql statement doc and update manual #4463]
• Added the display of cumulative compaction strategy name and rowset data size in BE's /api/compaction/show API [Compaction show policy type and disk format #4466]
• Redirect the Spark Launcher log in Spark Load to a separate log file for easy viewing [[Spark Load] Redirect the spark launcher's log to a separated log file #4470]
• The BE configuration item streaming_load_max_batch_size_mb was renamed streaming_load_json_max_mb to make its meaning more clear [Change config name 'streaming_load_max_batch_size_mb' to 'streaming_load_json_max_mb' #4791]
• Adjust the default value of the FE configuration item thrift_client_timeout_ms to solve the problem of too long access to the information_schema library [[optimize] optimize default value for thriftserver's config key "thrift_client_timeout_ms" #4808]
• CPU or memory sampling of BE process is supported on BE web page to facilitate performance debugging [[Feature] Add CPU and Heap profile in BE webserver #4632]
• Extend the data slicing balance class on the FE side, so that it can extend more balance logic [[LoadBalance] make BeLoadRebalancer extends from base class Rebalancer #4771]
• The reorganized OLAP_SCAN_NODE profile information makes the profile clearer and easier to read [[Feature] Running Profile OLAP_SCAN_NODE layering and enhance readability #4825]
• Added monitoring indicators on the BE side to monitor cancelled Query Fragment [[Metrics] Add metric to monitor timeout canceled fragment count #4862]
• Reorganized the profile information of HASH_JOIN_NODE, CROSS_JOIN_NODE, UNION_NODE, ANALYTIC_EVAL_NODE to make the Profile more clear and easy to read [[Doc] Running Profile document add HASH_JOIN_NODE, etc. #4878]
• Modify the default value of query_colocate_join_memory_limit_penalty_factor to 1 to ensure that the default memory limit of the execution plan fragment is consistent with the user setting during the colocation join operation [[BUG] Fix colocate join memory limit problem (#4894) #4895]
• Added consideration of tablet scanning frequency in the selection of compaction strategy on the BE side [[Optimize] Take 'tablet scan frequency' into consideration when selecting a tablet for compaction #4837]
• Optimize the strategy of sending Query Fragments and reduce the number of sending public attributes to improve query plan scheduling performance [[Optimize] Avoid repeated sending of common components in Fragments #4904]
• Optimized the accuracy of load statistics for unavailable nodes when the query scheduler is scheduling query plans [【Optimize】optimize host selection strategy #4914]
• Add the code version information of the FE node in the result of the SHOW FRONTENDS statement [[Feature] Show FE commit hash on proc #4943]
• Support more column type conversion, such as support conversion from CHAR to numeric type, etc. [[Schema change] Support More column type in schema change #4938]
• Import function to identify complex types in Parquet files [[Bug]Parquet map/list/struct structure recognize #4968]
• In the BE monitoring indicators, increase the monitoring of used permits and waiting permits in the compaction logic [[Metrics][LOG] Add metrics for compaction permits and log for merge rowsets #4893]
• Optimize the execution time of BE single test [[UT] Speed up BE unit test #5131]
• Added more JVM-related monitoring items on the FE side [[Enhancement] Add more comprehensive prometheus jvm thread metrics on fe #5112]
• Add a session variable to control the timeout period for the transaction to take effect in the insert operation [For #5169 Add publish timout param when exec insert #5170]
• Optimize the logic of selecting scan nodes for query execution plans, and consider all ScanNode nodes in a query [[Optimize]Take all scan nodes of one sql into consideration when select host for a tablet #4984]
• Add more system monitoring indicators for FE nodes [[Enhancement] Add system memory metrics for fe #5149]
• Use of VLOG in unified BE code [Standardize the use of VLOG in code #5264]

BugFix

• Fix the bug that may be caused during playback of Erase Table metadata operations [Fix fe restart failed bug when replay erase table log #5221]

• Fix the problem that the BE process crashes due to the orc::TimezoneError not being caught when importing ORC format files [[Bug]Fix bug that BE crash when load ORC file #4350]

• Fix the problem that the result of the Except operator is incorrect [[BUG] Fix except wrong answer bug #4369]

• Fix the problem that the query always route to the same BE node when querying ES data [[Doris On ES][Bug-Fix] ES queries always route at same 3 BE nodes (#4351) #4352]

• Fix the problem that the operation is not correctly persisted when setting the Global Variable [[Bug] Fix bug that modification of global variable can not be persisted. #4324]

• Fixed the problem that the MemTracker was not constructed correctly in PushHandler which caused the BE process to crash [[Bug][MemTracker] Cleanup the mem tracker's constructor to avoid wrong usage #4345]

• Fix the problem of importing blank lines when importing Json data format [[JsonLoad] Fix bug that row num stat is not correct when loading json #4379]

• Fix the problem that the SQL rewriting rules failed to correctly handle count distinct [Modify mv rewrite rule on 'Count distinct' #4382]

• Fix the problem that the data model type of the materialized view is not set correctly when creating the materialized view [Fix errors when alter materialized view which based on dup table #4375]

• Fix the problem of wrong query result of left semi/anti join [[BUG] Remove the deduplication of LEFT SEMI/ANTI JOIN with not equal … #4417]

• Prioritize the join method specified by the user [Fix explicit broadcast join bug #4424]

• Fix the problem of incorrect results when Inline view is included in the Left join operation [FixTupleIsNull miss in SelectStmt resultExpr #4279]

• [[MySQL Compatibility 2/4][Bug] Fix bug and improve compatibility with mysql protocol #4362]

  select database() no longer returns the cluster qualified name, and fix the problem that select user() does not display the user ip

• Fix the problem that the number of table copies displayed by show create table is incorrect for tables that use the dynamic partition function [FIX: fix dynamic partition replicationNum error #4393]

• Fix the inconsistent precision of decimal, char and varchar columns in the base table and the materialized view in the materialized view [Keep the scale and precision of type when creating mv #4436]

• Fix the problem of wild pointer in PlanFragmentExecutor, fix the problem of null pointer when importing in json format [Fix core issue of 4447 and change declare order for compatibility  #4448]

• Fixed the problem that some remaining tablet directories on BE were not cleared [[Bug-Fix] Some deleted tablets are not recycled on BE #4401]

• Fix some issues with Spark Load [[Spark load] Fix dpp and submit push task bugs #4464]

• Fix the problem that the balance of the colocation table cannot be completed [[Colocation] Fix Colocation balance endless loop bug #4471]

• Fix MemIndex::load_segment possible memory copy exception problem [[Bug] Fix bug that memory copy may overflow in MemIndex::load_segment #4458]

• Fix the problem of BE crashing when using Load Error Hub function when WITH_MYSQL compilation option is not added [[Bug] Fix bug of load error hub and schema change #4486]

• Fix the problem of execution error when using @@sql_mode environment variable in SQL [[Bug] Fix bug of select @@sql_mode #4484]

• Fix the problem of splitting the same column in Spark Load and Broker Load, and the splitting behavior is inconsistent [[Spark load][Bug] Fix column terminator for spark load #4491]

• Fix the problem of BE downtime caused by querying the information_schema.columns table [[Bug] Fix bug that BE will crash when querying information_schema.columns #4511]

• Fix some issues in the persistence of rowset metadata in historical versions [[BUG] Fix recover persistent stale rowsets bug from multi-single version rowsets in stale rowsets #4513]

• Fix the problem of inconsistent behavior of str_do_date() function on FE side and BE side [[Bug] function str_to_date()'s behavior on BE and FE is inconsistent #4495]

• Fixed the issue where BE was down due to some historical data conversion when performing linked schema change [[BUG] Fix segment group add zone map bug when schema change. #4526]

• Fix the problem that Spark Load stays in the ETL stage after FE restart [[Spark Load] [Bug] Load job's state will stay in ETL state all the time after FE restart  #4528]

• Fixed an issue that caused unreadable data when the delete condition contained "\n" [[BUG] Tablet is not readable and delete handler report -1903 error, when condition value contains \n #4531]

• Fix the problem that Spark Load job in PENDING state cannot be cancelled [[Spark load][Bug] fix that cancelling a spark load in the PENDING phase will not succeed #4536]

• Fix the problem of inconsistent behavior when splitting columns between Spark Load and other import methods [[Spark load][Bug] fix that cancelling a spark load in the PENDING phase will not succeed #4536]

• Fix the problem that net.sourceforge.czt.dev cannot be found when compiling the FE module [[Compile] Add pluginRepository for java-cup-plugins #4636]

• Fix the problem that the statement parsing fails when the cast function exists in the case when statement [[Bug] Fix analysis error when there are different types in case-when-then-else with group by clause #4646]

• Fix the problem that all queries will fail when there is a problem with the RPC of a certain BE [Fix all queries failed when one BE network or disk has issue #4651]

• Fixed the issue that related import transactions were not cleaned up after the BE node went down [[BUG] Fix transaction not be cleared after BE down. #4661]

• Fix the problem that the column types of the columns table of information_schema are not compatible with MySQL [Fix DATA_TYPE in information_schema.columns is not compatible to mysql meta #4648]

• Fix the problem of SQL Cache access out of bounds [[Docs] Supply BE config docs of setting and examples #4641]

• Fix the problem that import throws a null pointer exception when there is no partition in the table [[Bug] Fix that the partitions of a dynamic-partitioned table has not been created at the time of load or insert #4658]

• Fix an error when tools/show_segment_status access external tables [[Bug]External engines(e.g. ES) don't have segments, ignore those tables #4671]

• Fix the issue that delete on clause may not take effect in Routine Load [[Bug]Fix information_schema.columns table column_comment does not show #4676]

• Fix the problem that the columns of information_schema do not display comments [Fix delete on clause may not work in routineLoad #4683]

• Fix the problem that hidden columns (delete flag column, etc.) may be lost after schema change [Fix hidden cloumn may disappeared #4686]

• Fix the problem that the window function lag()/lead() reports an error when matching the decimal type [Fix Windows function lag()/lead() function throw AnalysisException. #4666]

• Fix the problem that the client is stuck in high concurrency scenarios when using MySQL NIO Server [Fix mysqlslap hang under high concurrent #4680]

• Fix the problem of always reporting out of date in tablet report [[Bug] Fix bug that tablet report always out of date #4695]

• Fix the problem of duplicate columns in case when statement after query planning [[Bug] Fix duplicate columns in case when statement #4693]

• Fix the problem that the rand() function generates the same random value every time [Fix rand() function return same value #4709]

• Fix the problem of query error caused by incorrect column cardinality statistics [[Bug] Fix hard cardinality check which makes queries fail #4678]

• Fix the problem of BE downtime caused by function error of split_part function [[Bug] Fix the core problem of function split_part and add the UT of core case #4721]

• Fix the problem of query execution error when SQL statement contains constant subquery [[Bug] Add regular column when materialized slot is empty in tuple #4719]

• Fix the problem of join query error when the table contains the delete tag column [[BUG] Fix join error when the table has enbale batch delete #4734]

• Fix the problem of syntax parsing errors when the CTE statement contains nested subqueries [[Bug]Fix bug CTE statement with nested select #4731]

• Fix the problem of lead/lag type matching error in window function [[BUG] Ensure that the correct lead/lag function is selected #4732]

• Fix the problem that tablet cannot be selected correctly when selecting tablet for compaction [[Bug] Fix bug of cumulative compaction and deletion of stale version #4593]

• Fix the problem that limit conditions are incorrectly pushed down to the odbc external table and Es external table [[Bug] Do not push down limit operation when ODBC table do not push all conjunct as filter. #4764] [[Doris On ES][Bug-Fix] Can not pushdown limit when some predicate not processed by ES #4768]

• Fix the problem that the compaction thread stops working [[Bug][Compaction] Fix bug that compaction may be blocked #4750]

• Fix the problem that the timeout idle connection is not automatically killed in some cases [[Bug] Fix Bug that fe's connection which is timed out can't be released #4774]

• Fix the problem of error when querying tables with delete flag column when SQL contains join [Fix delete_sign predicate assing to join node #4770]

• Fix the calculation results of some time functions in FE to keep the results consistent with BE calculations [[Bug] Fix some date functions to make their result same as MySQL #4786]

• Fix the issue that BE crashes when displaying tablet information on BE web page [[Bug] Fix bug and optimize implementation logic of tablets web page #4775]

• Fix the type conversion problem of the time type filter condition, so that it can be correctly converted to the corresponding event type [[BUG] Cast int type to date type #4806]

• Fixed the problem of repeatedly creating hidden columns when creating Rollup [Fix create rollup may duplicate hidden column #4816]

• Fix the problem of hidden sequence column not displaying [[Bug] Sequence column should be visible when show_hidden_columns = true #4818]

• Fix the problem of incorrect query results of some union statements [[Bug] Fix union bug (#4772) #4807]

• Fixed an issue where offline node tasks could not be completed in some cases [[TabletScheduler] Fix some bug where decommission operations cannot be completed #4804]

• Intelligently identify illegal date constants during SQL parsing to avoid query scanning all partitions [[FEATURE]Check date type to avoid scan all partitions #4756]

• Fix the problem that BE crashes when the BE side selects the tablet for compaction without locking [[Compaction][Bug-Fix] Fix bug that meta lock need to be held when calculating compaction score #4829]

• Fix some front-end display issues and back-end cookie processing logic issues in the new version of the UI [[FE UI] Fix some bugs about new FE UI #4830]

• Fixed the problem that the tablet could not be found when querying errors when UNION and Colocation Join are included in SQL [[Bug][SQL] Fix bug that query failed when SQL contains Union and Colocate join #4842]

• When submitting import tasks, the submission failed due to the full task queue, but the failure exception was not captured correctly [[BUG] Catch retry submit exception #4796]

• Fix the problem of Broker Load job scheduling. Avoid the problem that some jobs cannot be scheduled after submission [[Bug] Fix some bugs of load job scheduler #4869]

• Just before Master FE is started, avoid forwarding commands to Master FE [【Improvement】Avoid null host when forward to master #4844]

• Ignore Parquet and ORC format empty files when importing to avoid reading errors [[Broker Load] Ignore empty file when file format is parquet or orc. #4810]

• Fix the problem that the materialized view name conflict is not checked when renaming the OLAP table [[Bug] Rename table logic error #4870]

• Fix the problem that the creation fails when using complex SQL to create a logical view [[Bug] Fix bug that failed to create view with complex select stmt #4840]

• Fixed an issue where Routine Load could not end the task correctly due to reading empty messages when consuming Kafka data [[Bug] Fix bug that routine load blocked with TOO_MANY_TASKS error #4861]

• Fix the problem that some column names are not recognized when using CTE syntax [[Bug] Fix bug #4886 and #4586 by refactoring code of method 'getDbs' #4887]

• Fix the problem that the content of the columns table of the Information_schema library is incorrect [[BUG] Fix field error in information_schema.columns #4858]

• Fix the problem that BitmapValue serialization fails when only 32-bit integers are included in the implementation of BitmapValue on the FE side [(#4883) Java Version BitmapValue deserialized failed #4884]

• Fix that when calculating BE disk usage, all disk space not used by Doris in the node is incorrectly included. This will cause calculation errors during the Decommission operation [[BUG] modify isDecommissioned be capacity calculate rule #4889]

• Fix the problem that an additional column may be added incorrectly when only constant expressions are included in the SELECT list [Avoid duplicate column when adding slot in empty tuple #4901]

• Fix the problem that the Thrift Server type on the FE side and the BE side are inconsistent and cause communication failure [[Bug] Fix bug that be thrift client cannot connect to fe thrift server when fe thrift server use TThreadedSelectorServer model #4908]

• When partition cutting, ignore the filter conditions on non-columns [[Bug] Fix partition prune (#4833) #4921]

• Fix the problem that the log directory is created incorrectly in the start_fe.sh startup script [fix the FE logs dir create issue  #4929]

• Fix the problem that some NULL values are not displayed when using CTE syntax [[Bug] Fix the bug of NULL do not show in CTE statement. #4932]

• Fix the problem that Colocation Group is always in unstable state when some BE nodes are down [[BUG] Fix Colocate table balance bug #4936]

• It is forbidden to create a table in Segment V1 format [disable the creation of segment v1 table #4913]

• Fix the problem that Bool type condition processing error when Doris queries ES data [[Doris On ES][Bug-fix] fix boolean predicate pushdown manner #4990]

• Fix a problem of Tablet Shard lock on BE side [[Bug] Fix concurrent access of _tablets_under_clone in TabletManager #5000]

• Fix the problem of ConcurrentModificationException that may appear on the FE side when deleting a table that is being imported [(#5002) ConcurrentModificationException when finish transaction #5003]

• Fix the problem of incorrect return type of str_to_date function [[Function] Let "str_to_date" return correct type  #5004]

• Fix the problem that the precision of some floating point types is lost when importing Json format data [[Bug] Fix the bug of Largetint and Decimal json load failed. #4983]

• Fix the problem of incomplete query results when using Union to connect multiple external tables to query [[Bug] Fix bug that query multi mysql external table with union will get incomplete result #5067]

• Fix the problem that the query result is incorrect when the SQL contains multiple in conditions [[Bug] Fix the bug of where condition a in ('A', 'B', 'V') and a in ('A') return error result #5072]

• Fix a problem that the order of Profile destruction caused BE downtime [[Bug] Fix a core dump of counter in BE #5078]

• Fix the problem of memory leakage when importing Json format data [[Bug] Fix Memory Leak in Json Load #5073]

• Fix the problem that Colocation balance logic occupies 100% CPU when there is no BE node [[BUG] Fix colocate balance bug when no available BE #5079]

• Fix the issue that creating a new tablet may cause BE downtime [[Bug] Fix coredump bug when create new tablets #5089]

• Fixed the problem that the shared pointer circular reference caused the tablet to be unable to be cleared and occupied disk space [[Bug] Fix tablet shared ptr circular reference causing the tablet not to be cleared #5100]

• Fix the issue that the BE will crash when the is null condition is included in the delete condition [[Bug] Fix bug when delete condition is null but zonemap is not null #5109]

• Fix a problem with Partition Cache hit strategy [[Bug-Fix] Fix partition cache match bug #5060]

• Optimize the strategy of Spark Load to read Hive tables to avoid full scanning of Hive tables [avoid to read whole hive table when spark load from hive table #5047]

• Added support for Ninjia build system to speed up the compilation speed of BE [support ninja build system #5076]

• Optimize the efficiency of importing data in Json format [[enhancement]improve performance of json load #5055]

• Support FE to directly use thrift protocol to transmit heartbeat information to avoid heartbeat blocking failure that may be caused by http communication model [ Support fe heartbeat use thrift protocol to get stable response #5027]

• Simplify the opening logic of the dynamic partition function, and prohibit hourly partitioning for date type columns [Forbidden creating table with dynamic partition when FE.config dynamic_partition_enable=false #5043]

• Support to view Broker Load Profile through FE Web page [[Enhance] Add profile for load job #5052]

• When viewing Resource information, clear text password is no longer displayed [[ODBC] ODBC Catalog do not show password in 'show resource' #5088]

• The BE side adds trace information for tablet creation to help locate the problem of slow tablet creation [[Trace] Add trace for create tablet tasks #5091]

• Fix the issue that may cause data loss when Routine Load consumes Kafka data in some cases [[Bug] Fix bug that routine load may lost some data #5093]

• Fix the problem that desc statement to view all materialized views may return Malformed packet [[Bug-Fix] Fix 'Malformed packet' error when desc OlapTable with Rollup #5115]

• Fix the issue that may cause BE to crash when BE starts loading the data directory [[Bug] Fix old tablet inserting bug #5113]

• Fix the problem that non-Master FE repeatedly sends non-query requests to Master FE [[BUG] Follower shouldn't forward non-query statement to master repeatedly #5160]

• Fix the problem of partition cache hit logic error [[Bug] Hit none partition cache, but hit range is still right #5065]

• Fixed an error when bucket join was executed on an empty table [[Bug-Fix] Bucket shuffle join executes failed when two tables have no data #5145]

• Fix the problem that the percentile_approx function returns the wrong result [[Bug-Fix] Fix the bug of PERCENTILE_APPROX return error result nan and add PERCENTILE_APPROX UT #5172]

• Fix the problem of the calling sequence of Olap Scanner thread ending [5111]

• Fixed an error when creating the colocation attribute for an empty partitioned table [Fix create colocate table bug #5139]

• Fixed an error when querying materialized views in CTE statement [Fix MaterializedView select with CTE bug #5165]

• Fix the problem that the min max function does not handle the null value of string type column correctly [[Bug] Fix bug that the min/max function has an error in handling string null values #5189]

• Modify the string encoding in Spark-Doris-Connector to utf8 [[Spark on Doris] fix the encode of varchar when convertArrowToRowBatch #5202]

• Fix the problem that delete column may be added repeatedly in routine load [Fix duplicated add delete condition when run routine load #5222]

• Fix bucket shuffle join bug [[Bug] Fix bucket shuffle join bug of query failed #5228]

• Fix the issue that the ALTER ROUTINE LOAD operation is invalid for some parameters [[BUG] fix alter routine load not work #5257]

• Fixed an issue where metadata signatures of different tables may be the same during backup and recovery operations [[Bug] Remove schema hash and fix bug of calculating table signature #5254]

• Fix the problem that Colocate Join and Buckets shuffle join may cause data to be scanned repeatedly [[Bug] Colocate Join and Bucket shuffle join may scan some tablet twice time. #5256]

• Fix the issue of metadata errors caused by unchecked log id when FE pushes metadata [Add some consistency check in image put api #5219]

• Fix the problem of error in aggregate query processing -0.0 [[Bug] Fix row_number and group by have inconsistent partition results for (0.0, -0.0) #5226]

• Fix outer join query error [[Bug] Fix bug of outer join cause error result #5285]

Other

• Add some non-Apache protocol code protocol declarations to the NOTICE file [Add other license declare in NOTICE #4831]

• Reformatted the code of BE using clang-format [Clang-format cpp sources #4965]

• Added clang-format checking and formatting scripts to unify the C++ code style of BE before submission [Add clang-format script #4934]

• The third-party library adds the AWS S3 SDK, which can be used to directly read the data in the object storage through the SDK [add aws sdk to thirdparty #5234]

• Fixed some issues related to License: [[License] Organize and modify the license of the code #4371]

  1. The dependencies of the two third-party libraries, MySQL client and LZO, will no longer be enabled in the default compilation options. If users need MySQL external table function, they need to turn it on

  2. Removed the js and css code in the code library and introduced it in the form of a third-party library dependency

• Updated the Docker development environment image build-env-1.2

• Updated the compilation method of the UnixODBC tripartite library, so that the BE process no longer depends on the libltdl.so dynamic library of the system when it is running

• Added third-party UDF to support more efficient set calculation of orthogonal bitmap data [Add bitmap longitudinal cutting udaf #4198]

• Added UnixODBC third-party library dependency to support ODBC external table function [[ODBC SCAN NODE] 1/4 Add unix odbc library. #4377]

API Change

• Prohibit the creation of segment v1 tables [disable the creation of segment v1 table #4913]
• Rename the configuration item streaming_load_max_batch_size_mb to streaming_load_json_max_mb [Change config name 'streaming_load_max_batch_size_mb' to 'streaming_load_json_max_mb' #4791]
• Support column reference passing in column definition of load statement [Improve the processing logic of Load statement derived columns #5140]
• Support creating indexes on the value column of unique table [Support create index on unique value column #5305]
• Support atomic replacement of two tables through replace statement [[Feature] Support REPLACE TABLE operation. #4669]
• Support CREATE TABLE LIKE statement

Credits

924060929
acelyc111
Astralidea
benbiti
blueChild
caiconghui
caoyang10
ccoffline
coalchan
Dam1029
e0c9
EmmyMiao87
gengjun-git
HangyuanLiu
HappenLee
hffariel
jollykingCN
kangkaisen
killxdcj
lihuigang
liutang123
luozenglin
marising
mengqinghuan
morningman
nimuyuhan
Nivane
pengxiangyu
px-l
qidaye
sduzh
Skysheepwang
songchuangyuan
stalary
stdpain
Sunt-ing
vagetablechicken
vergilchiu
wangbo
wangxiaobaidu11
weizuo93
WingsGo
wutiangan
wuyunfeng
xinghuayu007
xinyiZzz
Xpray
xy720
yangzhg
Youngwb
yxqweasd
zh0122
ZhangYu0123
zhaojintaozhao
xxiao2018
bookeezhou
JNSimba
killxdcj
yuliangwan

[yangzhg]

自从 0.13发布以来, Apache Doris (incubating) 已经有超过60个contributor贡献了 390 多个新特性, bug fixes, 性能优化, 文档, 代码重构 等相关的PR. 因此我们准备发布 Apache Doris (incubating) 0.14版本.

New Feature

导入和删除

支持通过导入方式一次性删除多条数据，避免多次删除造成的性能下降，针对UniqueKey模型的表，支持在导入时指定Sequence列Doris将按照Sequence列的值判断数据的先后关系，保证数据在导入时的有序性

[#4310] [#4256]

支持数据库整库备份

备份stmt中的支持指定备份内容（元数据和数据）。
支持排除备份和还原stmt中的某些表。 在备份整个数据库时，可以排除一些非常大且不重要的表。
支持备份和还原整个数据库，而不是在备份和还原语句中声明每个表名。

[#5314]

ODBC 外部表支持

支持通过 ODBC 协议访问 MySQL，postgresql，Oracle 等外部表

[#4798] [#4438] [#4559] [#4699]

支持SQL级别和Partition级别的结果Cache

支持在缓存查询结果，用来提高重复查询的效率,支持SQL级别和Partition级别的结果Cache [#4330]

内置函数

• 支持 bitmap_xor 函数 [add BE udf bitmap xor #5098]
• 新增 replace() 函数 [udf: replace function #4347]
• 增加time_round函数以支持按多种时间粒度对齐时间 [[Feature] Add time_round builtin functions #4640]

FE 界面和HTTP 接口

• 新的FE UI界面，可以通过设置FE配置项enable_http_server_v2开启使用 [[UI Part 5] Enable HTTP Server 2 by FE config #4684]

• BE增加一个http接口，用于展示一个分区下所有tablet在一个BE上不同磁盘间的分布情况 [[Feature] Add a http interface to acquire the tablets distribution between different disks #5096]

• BE增加一个http接口，用于手动将一个tablet迁移到同节点的其他磁盘 [[Feature] Add a http interface for single tablet migration between different disks #5101]

• 支持通过http修改FE和BE的配置项，并且持久化这些修改 [[Feature][Config] Support persistence of configuration items modified at runtime #4704]

与MySQL 兼容性

• 在information_schema数据库中增加对views表的支持 [Error happened when open a view in DBeaver #4778]
• information_schema库中新增table_privileges，schema_privileges和user_privileges三张表，用于兼容某些MySQL应用 [Added #4897: Add table_privileges, schema_privileges and user_privile… #4899]
• information_schema元数据库新增statistic表，用于兼容部分MySQL工具 [[Enhance] Add "statistics" meta table and fix some mysql compatibility problem #4991]

监控

• BE新增Tablet级别的监控指标，包括扫描数据量和行数、写入数据量和行数，帮助定位热tablet [[Metrics] Support tablet level metrics #4428]

• BE新增metrics用于查看各种LRU cache的使用情况 [[LRUCache] Expose LRU Cache status to metrics #4688]

建表相关

• 增加CREATE TABLE LIKE语句以方便创建一张表的元数据拷贝 [[CREATE TABLE]Support new syntax CREATE TABLE LIKE to clone an existe… #4705]
• 支持通过replace语句进行两表的原子替换 [[Feature] Support REPLACE TABLE operation. #4669]

支持跳过broker 直接使用S3协议 导入导出 备份恢复 [#5399]

其他

• 支持Select语句中添加SET_VAR类型的Optimizer Hints来设定会话变量 [[Feature]Support SELECT Optimizer Hints SET_VAR #4504]

• 支持通过使用空tablet填补的方式修复已损坏的tablet [[Tablet][Recovery] Support using empty tablet to repair the damaged or missing tablet #4255]

• 支持Bucket Shuffle Join功能（当Join条件列是表分桶列的子集时，右表会Shuffle到左表数据所在节点上，可以显著减少Shuffle Join带来的网络开销，提升查询速度） [Support Bucket Shuffle Join #4677]

• 支持通过cancel load语句批量取消导入任务 [[Feature] Support cancel load jobs in batch #4515]

• 增加一个Session变量用于设置是否允许分区列为NULL [[Repair] Add an option whether to allow the partition column to be NULL #5013]

• 支持TopN聚合函数 [[Feature] Add Topn udaf #4803]

• 支持一种新的基于分区分桶数量的数据均衡逻辑 [[Rebalancer] support partition rebalancer #5010]

• 支持在unique 表 value 列上创建索引 [Support create index on unique value column #5305]

Enhancement

性能改进

• 实现了新的Compaction的选择算法，提供更低的写放大和更合理的Compaction策略 [Compaction rules optimization #4212]
• 优化变长编码中的位运算效率 [Optimise coding bit operation in BE #4366]
• 提升monery_format函数的执行效率 [[UDF] Improve performance of function money_format #4672]
• 优化查询执行计划：当表的分桶列是SQL中的GroupBy列的子集时，减少对于的数据shuffle步骤 [Do not add exchange when table's distributioin satisfy the distribution requirements #4482]
• 提升BE端列名查找的效率 [[Optimize] Add an unordered_map for TabletSchema to speed up column name lookup #4779]
• 提升BE端LRU Cache的性能 [[Optimize] Improve LRU cache's performance #4781]
• 优化了Compaction选择Tablet的策略，减少了无效选择的次数 [[Bug][Compaction] Fix bug that output rowset is not deleted after compaction failure. #4964]
• 优化了Unique Key表的读取效率 [Optimized the read performance of the table when have multi versions #4958]
• 优化了LoadJob在FE端的内存占用，减少FE端的内存开销 [[Bug] fix finished load jobs cost too much heap  #4993]
• 将FE元数据中的锁粒度由Database级别降低至Table级别，以支持更细粒度的元数据并发访问 [Support read and write lock in table level to reduce lock competition #3775]
• 创建hash table 时避免不必要的内存拷贝 [[optimization] avoid extra memory copy while build hash table #5301]
• 移除BE启动时的路径检查，以加速BE启动速度 [(#5267) remove path check when start BE #5268]
• 优化 Json 数据的导入性能 [Add fuzzy_parse option to speed up json import #5114]

功能改进

• SQL支持 collate utf8_general_ci 语法，以提高MySQL的语法兼容性 [support collate field option in compare predicate sql from datagrip #4365]
• 改善 Batch delete 功能，对相关compaction流程进行改进和优化 [Support batch delete[part 2]  #4425]
• 增强parse_url()函数的功能，支持小写，支持解析端口 [Fix parse url bug #4429]
• 当SQL执行指定了join的执行方式（Join Hint）时，将默认关闭Colocation Join功能 [[Bug] Support disable colocate join where join clause has join hint #4497]
• 动态分区支持小时级别 [[Feature] support hour time unit with dynamic parition #4514]
• BE端HTTP接口支持gzip压缩 [[Enhance] Support gzip compression for http response #4533]
• 优化了BE端对线程的使用方式 [[refactor] Optimize threads usage mode in BE #4440]
• 优化rand()函数在查询解析阶段的检查流程和报错信息 [Validate the param of rand function in compile step #4439]
• 优化Compaction触发和执行逻辑，能够更好的限制compaction操作的资源开销（主要是内存开销），并且更合理的触发compaction操作 [[Optimize] Optimize the execution model of compaction to limit memory consumption #4670]
• 支持将Limit条件下推给ODBC/MySQL外部表 [[ODBC/MySQL] Support Limit Clause Push Down For ODBC Table And MySQL Table(#4706) #4707]
• 在BE端增加对tablet版本数量的限制，以防止过多的数据版本导致集群负载异常 [[Config] Limit the version number of tablet #4687]
• 当查询发生RPC错误时，能够快速返回具体错误信息，避免查询一直卡住 [[Enhance][Log] Make RPC error log more clear #4702]
• 支持将 count(distinct if(bool, bitmap, null)) 自动映射为 bitmap_union_count 函数 [Rewrite count(distinct if(bool, bitmap, null)) to bitmap_union_count #4201]
• 支持 set sql_mode = concat(@@sql_mode, "STRICT_TRANS_TABLES") 语句 [[MySQL Compatibility 1/4][Bug] Fix bug that set sql_mode with concat() function failed #4359]
• 在multiload 中支持全部stream load 特性 [Support full StreamLoad feature in multiload #4717]
• 优化BE创建tablet时选择磁盘的策略，使用 "two random choices" 算法保证tablet副本更加均匀 [[Optimize]Optimize the disk selection strategy on BE for tablet creation #4373]
• 限制当创建物化视图时，bitmap_union 聚合方式只支持整型列，hll_union 不支持 decimal 列 [Forbidden the illegal column types on BITMAP_UNION OR HLL_UNION mv #4432]
• 优化部分FE的日志级别以避免日志写入成为瓶颈 [ Make some debug log settings configurable and change some log level from info to debug to avoid performance bottlenecks #4766]
• 在 describe table 语句中，显示物化视图聚合列的定义表达式 [Show column display name on Show Proc stmt #4446]
• 支持 convert() 函数 [[Mysql Compatibility 3/4] Support convert() and signed/unsigned interger cast #4364]
  • 支持 cast (expr as signed/unsigned int) 语法以兼容MySQL生态
  • 在information_schema.columns表中增加更多的列以兼容MySQL生态
• 在 Spark Load 功能中，使用 yarn 命令行取代 yarn-client API，用于杀死作业，或获取作业状态 [[SparkLoad]Use the yarn command to get status and kill the application #4383]
• 持久化stale rowset 元信息，以保证BE宕机重启后，这些信息不会丢失 [Persistence stale rowsets meta #4454]
• 在schema change结果中返回错误码以更明确的告知用户具体错误 [Add OLAP_ERR_DATE_QUALITY_ERR error status to display schema change failure #4388]
• 优化一些compaction的rowset选择逻辑，使得选择策略更加准确 [(#5151) An already merged rowset should skip window check #5152]
• 优化BE端Page Cache，将Page分为data cache 和 index cache [[Optimize][Cache]Implementation of Separated Page Cache #5008]
• 优化了方差、标准差等函数在Decimal类型上的精度问题 [[Bug] Fix the loss of precision when Decimal calculates variance/stddev #4959]
• 优化了下推到ScanNode的谓词的处理逻辑，避免在查询层重复过滤谓词条件，提升查询效率 [[Performance Optimization] Remove push down conjuncts in olap scan node #4999]
• 优化了Unique Key表的谓词下推逻辑，支持将非主键列的条件进行下推 [Push down predicate on value column of unique table to base rowset #5022]
• 支持将“not in”和“!=”下推到存储层，提升查询效率 [[Performance Improve] Push Down _conjunctf of 'not in' and '!=' to Storage Engine. #5207]
• 支持在导入时并行写入一个tablet的多个memtable。提升导入效率 [[Load Parallel][2/3] Support parallel flushing memtable during load #5163]
• 优化对ZoneMap的创建逻辑，当一个page的行数过小时，不再创建ZoneMap [Optimize Zone map create policy #5260]
• BE端新增直方图监控指标类 [[Feature] Implementation of histogram metric #5148]
• 在导入Parquet文件时，如遇解析错误，会在错误信息中显示具体的文件名 [[Improvement] Add parquet file name to the error message #4954]
• 优化动态分区的创建逻辑，在建表是直接触发动态分区的创建 [[Feature] Support Create Dynamic Partition Immediately FirstTime Without Wating Schedule. #5209]
• 在SHOW BACKENDS命令结果中，显示BE的真实启动时间 [[Bug] Make 'LastStartTime' in backends list as the actual BE start time #4872]
• 支持列名使用@符号开头，主要用于支持映射ES表 [[Doris][Doris On ES] support @ leading column name #5006]
• 优化导入语句中声明列的映射和转换关系的逻辑，使得使用上更加明晰 [Improve the processing logic of Load statement derived columns #5140]
• 优化colocation join的执行逻辑，使得查询计划更加均匀的在多个BE节点上执行 [[Enhancement]Make Cholocate table join more load balance #5104]
• 优化谓词下推逻辑，支持将 is null 和 is not null 下推到存储引擎 [[Performance Improve] Push Down _conjunct of 'A is NULL' and 'B is not NULL' to Storage Engine. #5092]
• 优化bucket join 中BE节点选择逻辑 [[Enhancement] Optimize the algorithm of selecting host for a bucket scan task when a backend not alive #5133]
• 支持在导入操作中使用UDF [[New Feature]Support udf when loading data #4863]

其他

• 增加了对 delete 语句中对 IN Predicate 支持的文档 [[Doc] Add in predicate support content in delete-manual.md #4404]
• 更新开发镜像的Dockerfile，增加一些新的依赖 [[Dockerfile] Update Dockerfile #4474]
• 修正代码和文档中的各类拼写错误 [[Refactor] Fixes some be typo #4714] [[Docs] update data types doc and fix some typo #4712] [[documentation] Fix some typo in en docs part 1 #4722] [[documentation] Fix some typo in en docs part 2 #4723] [[documentation] Fix some typo in en docs part 3 #4724] [[documentation] Fix some typo in en docs part 4 #4725] [[documentation] Fix some typo in zh_cn docs part 1 #4726] [[documentation] Fix some typo in zh_cn docs part 2 #4727]

• 在 query profile 的 OlapScanNode 中新增两个 segment相关的指标，用于展示总的segment数量和被过滤segment数量 [#4348]
  

• 增加 batch delete 功能说明文档 [[DOCS] Add batch delete docs #4435]
• 增加 Spark Load 语法手册 [[Doc] Add spark load sql statement doc and update manual #4463]
• 在 BE 的 /api/compaction/show API中增加 cumulative compaction 策略名称和 rowset 数据大小的显示 [Compaction show policy type and disk format #4466]
• 将Spark Load 中 Spark Launcher的日志重定向到独立的日志文件，方便查看 [[Spark Load] Redirect the spark launcher's log to a separated log file #4470]
• 将BE的配置项streaming_load_max_batch_size_mb更名为streaming_load_json_max_mb，使其含义更加明确 [Change config name 'streaming_load_max_batch_size_mb' to 'streaming_load_json_max_mb' #4791]
• 调整FE的配置项thrift_client_timeout_ms的默认值，以解决访问information_schema库耗时过长的问题 [[optimize] optimize default value for thriftserver's config key "thrift_client_timeout_ms" #4808]
• BE的Web页面上支持对BE进程进行CPU或内存采样，方便进行性能调试 [[Feature] Add CPU and Heap profile in BE webserver #4632]
• 扩展FE端的数据分片均衡类，使其能够扩展更多的均衡逻辑 [[LoadBalance] make BeLoadRebalancer extends from base class Rebalancer #4771]
• 重新组织的OLAP_SCAN_NODE的Profile信息，使得Profile更加清晰易读 [[Feature] Running Profile OLAP_SCAN_NODE layering and enhance readability #4825]
• BE端新增监控指标，用于监控被取消的Query Fragment [[Metrics] Add metric to monitor timeout canceled fragment count #4862]
• 重新组织了HASH_JOIN_NODE，CROSS_JOIN_NODE，UNION_NODE，ANALYTIC_EVAL_NODE的Profile信息，使得Profile更加清晰易读 [[Doc] Running Profile document add HASH_JOIN_NODE, etc. #4878]
• 将query_colocate_join_memory_limit_penalty_factor参数默认值修改为1，以保证在colocation join操作中，执行计划分片默认的内存限制和用户设置的一致 [[BUG] Fix colocate join memory limit problem (#4894) #4895]
• 在BE端选择compaction策略中增加对tablet扫描频率的考虑 [[Optimize] Take 'tablet scan frequency' into consideration when selecting a tablet for compaction #4837]
• 优化发送Query Fragments的策略，减少公共属性的发送次数以提升查询查询计划调度性能 [[Optimize] Avoid repeated sending of common components in Fragments #4904]
• 优化了查询调度器在调度查询计划时，对不可用节点的负载统计准确度 [【Optimize】optimize host selection strategy #4914]
• 在 SHOW FRONTENDS 语句的结果中添加FE节点的代码版本信息 [[Feature] Show FE commit hash on proc #4943]
• 支持更多的列类型转换，如支持从CHAR转换到数字类型等 [[Schema change] Support More column type in schema change #4938]
• 导入功能功能识别Parquet文件中的复杂类型 [[Bug]Parquet map/list/struct structure recognize #4968]
• BE监控指标中，增加compaction逻辑中，已使用的permits和正在等待的permits的监控 [[Metrics][LOG] Add metrics for compaction permits and log for merge rowsets #4893]
• 优化BE单测的执行时间 [[UT] Speed up BE unit test #5131]
• FE端增加更多JVM相关的监控项 [[Enhancement] Add more comprehensive prometheus jvm thread metrics on fe #5112]
• 增加一个会话变量用于控制insert 操作中，事务生效的超时时间 [For #5169 Add publish timout param when exec insert #5170]
• 优化查询执行计划选择扫描节点的逻辑，将一个查询中的所有ScanNode节点统一考虑 [[Optimize]Take all scan nodes of one sql into consideration when select host for a tablet #4984]
• 增加更多的FE节点的系统监控指标 [[Enhancement] Add system memory metrics for fe #5149]
• 统一BE代码中对 VLOG 的使用 [Standardize the use of VLOG in code #5264]

BugFix

• 修复在回放Erase Table元数据操作时可能引起的bug [Fix fe restart failed bug when replay erase table log #5221]

• 修复导入ORC格式文件时，未捕获orc::TimezoneError导致BE进程crash的问题 [[Bug]Fix bug that BE crash when load ORC file #4350]

• 修复Except算子结果不正确的问题 [[BUG] Fix except wrong answer bug #4369]

• 修复查询ES数据时，查询总是路由到相同BE节点的问题 [[Doris On ES][Bug-Fix] ES queries always route at same 3 BE nodes (#4351) #4352]

• 修复设置全局变量（Global Variable）时，操作没有被正确的持久化的问题 [[Bug] Fix bug that modification of global variable can not be persisted. #4324]

• 修复了PushHandler中，MemTracker没有被正确构造导致BE进程Crash的问题 [[Bug][MemTracker] Cleanup the mem tracker's constructor to avoid wrong usage #4345]

• 修复导入Json数据格式时，可能出现的导入空行的问题 [[JsonLoad] Fix bug that row num stat is not correct when loading json #4379]

• 修复SQL改写规则未能正确处理 count distinct的问题 [Modify mv rewrite rule on 'Count distinct' #4382]

• 修复创建物化视图时，物化视图的数据模型类型未能正确设置的问题 [Fix errors when alter materialized view which based on dup table #4375]

• 修复left semi/anti join查询结果错误的问题 [[BUG] Remove the deduplication of LEFT SEMI/ANTI JOIN with not equal … #4417]

• 优先使用用户指定的方式进行 join [Fix explicit broadcast join bug #4424]

• 修复Left join 操作中包含Inline view 时，结果不正确的问题 [FixTupleIsNull miss in SelectStmt resultExpr #4279]

• [[MySQL Compatibility 2/4][Bug] Fix bug and improve compatibility with mysql protocol #4362]

  select database() 不再返回 cluster 限定名，同时修复 select user() 不显示用户ip的问题

• 修复对于使用动态分区功能的表，show create table 显示的表副本数不正确的问题 [FIX: fix dynamic partition replicationNum error #4393]

• 修复物化视图中，base表和物化视图的decimal、char、varchar 列精度不一致的问题 [Keep the scale and precision of type when creating mv #4436]

• 修复 PlanFragmentExecutor 中的野指针问题, 修复 json 格式导入时空指针的问题 [Fix core issue of 4447 and change declare order for compatibility  #4448]

• 修复BE上一些残留的tablet目录未被清除的问题 [[Bug-Fix] Some deleted tablets are not recycled on BE #4401]

• 修复 Spark Load 的若干问题 [[Spark load] Fix dpp and submit push task bugs #4464]

• 修复对于colocation 表的均衡无法完成的问题 [[Colocation] Fix Colocation balance endless loop bug #4471]

• 修复 MemIndex::load_segment 可能出现的内存拷贝异常问题 [[Bug] Fix bug that memory copy may overflow in MemIndex::load_segment #4458]

• 修复在未添加 WITH_MYSQL 编译选项时，使用Load Error Hub功能导致BE宕机的问题 [[Bug] Fix bug of load error hub and schema change #4486]

• 修复在SQL中使用@@sql_mode环境变量时，执行报错的问题 [[Bug] Fix bug of select @@sql_mode #4484]

• 修复Spark Load和Broker Load中对相同的列分割，分割行为不一致的问题 [[Spark load][Bug] Fix column terminator for spark load #4491]

• 修复查询information_schema.columns表导致BE宕机的问题 [[Bug] Fix bug that BE will crash when querying information_schema.columns #4511]

• 修复历史版本的rowset元数据持久化方面的一些问题 [[BUG] Fix recover persistent stale rowsets bug from multi-single version rowsets in stale rowsets #4513]

• 修复str_do_date()函数在FE端和BE端行为不一致的问题 [[Bug] function str_to_date()'s behavior on BE and FE is inconsistent #4495]

• 修复在执行linked schema change时，一些历史数据转换导致BE宕机的问题 [[BUG] Fix segment group add zone map bug when schema change. #4526]

• 修复在FE重启后，Spark Load一直停留在ETL阶段的问题 [[Spark Load] [Bug] Load job's state will stay in ETL state all the time after FE restart  #4528]

• 修复当delete条件中包含”\n”时，导致数据不可读的问题 [[BUG] Tablet is not readable and delete handler report -1903 error, when condition value contains \n #4531]

• 修复无法取消处于PENDING状态的Spark Load作业的问题 [[Spark load][Bug] fix that cancelling a spark load in the PENDING phase will not succeed #4536]

• 修复Spark Load与其他导入方式，在分割列时的行为不一致的问题 [[Spark load][Bug] fix that cancelling a spark load in the PENDING phase will not succeed #4536]

• 修复在编译FE模块时，无法找到net.sourceforge.czt.dev依赖的问题 [[Compile] Add pluginRepository for java-cup-plugins #4636]

• 修复在case when语句中存在cast函数是，语句解析失败的问题 [[Bug] Fix analysis error when there are different types in case-when-then-else with group by clause #4646]

• 修复当某个BE的RPC出现问题，所有查询都会失败的问题 [Fix all queries failed when one BE network or disk has issue #4651]

• 修复当BE节点宕机后，相关的导入事务没有清理的问题 [[BUG] Fix transaction not be cleared after BE down. #4661]

• 修复information_schema的columns表的列类型和MySQL不兼容的问题 [Fix DATA_TYPE in information_schema.columns is not compatible to mysql meta #4648]

• 修复SQL Cache访问越界的问题 [[Docs] Supply BE config docs of setting and examples #4641]

• 修复当表中没有分区时，导入抛出空指针异常的问题 [[Bug] Fix that the partitions of a dynamic-partitioned table has not been created at the time of load or insert #4658]

• 修复tools/show_segment_status工具访问外部表时出错的问题 [[Bug]External engines(e.g. ES) don't have segments, ignore those tables #4671]

• 修复delete on子句在Routine Load中可能不生效的问题 [[Bug]Fix information_schema.columns table column_comment does not show #4676]

• 修复information_schema的columns不显示comment的问题 [Fix delete on clause may not work in routineLoad #4683]

• 修复隐藏列（delete flag column等）可能在进行schema change后丢失的问题 [Fix hidden cloumn may disappeared #4686]

• 修复窗口函数lag()/lead()在匹配decimal类型时报错的问题 [Fix Windows function lag()/lead() function throw AnalysisException. #4666]

• 修复在使用MySQL NIO Server时，在高并发场景下客户端夯住的问题 [Fix mysqlslap hang under high concurrent #4680]

• 修复在tablet report总是报错out of date的问题 [[Bug] Fix bug that tablet report always out of date #4695]

• 修复case when语句在查询规划后产生重复列的问题 [[Bug] Fix duplicate columns in case when statement #4693]

• 修复rand()函数每次都产生相同的随机值的问题 [Fix rand() function return same value #4709]

• 修复因列基数统计信息错误导致的查询报错的问题 [[Bug] Fix hard cardinality check which makes queries fail #4678]

• 修复split_part函数功能错误导致BE宕机的问题 [[Bug] Fix the core problem of function split_part and add the UT of core case #4721]

• 修复SQL语句中包含常量子查询时，查询执行报错的问题 [[Bug] Add regular column when materialized slot is empty in tuple #4719]

• 修复当表中包含delete标记列时，join查询出错的问题 [[BUG] Fix join error when the table has enbale batch delete #4734]

• 修复CTE语句中包含嵌套子查询时，语法解析出错的问题 [[Bug]Fix bug CTE statement with nested select #4731]

• 修复窗口函数lead/lag类型匹配错误的问题 [[BUG] Ensure that the correct lead/lag function is selected #4732]

• 修复在选择tablet进行compaction时，无法正确选择tablet的问题 [[Bug] Fix bug of cumulative compaction and deletion of stale version #4593]

• 修复limit条件被错误的下推到odbc外部表和Es外部表的问题 [[Bug] Do not push down limit operation when ODBC table do not push all conjunct as filter. #4764] [[Doris On ES][Bug-Fix] Can not pushdown limit when some predicate not processed by ES #4768]

• 修复compaction线程停止工作的问题 [[Bug][Compaction] Fix bug that compaction may be blocked #4750]

• 修复在某些情况下，超时的空闲连接没有被自动杀掉的问题 [[Bug] Fix Bug that fe's connection which is timed out can't be released #4774]

• 修复当SQL中包含join时，查询带有 delete flag列的表报错的问题 [Fix delete_sign predicate assing to join node #4770]

• 修复部分时间函数的在FE计算的结果，以保持和BE计算结果一致 [[Bug] Fix some date functions to make their result same as MySQL #4786]

• 修复BE的web页面在展示tablet信息时可能导致BE宕机的问题 [[Bug] Fix bug and optimize implementation logic of tablets web page #4775]

• 修复时间类型过滤条件的类型转换问题，使其能够正确的转换为对应的事件类型 [[BUG] Cast int type to date type #4806]

• 修复在创建Rollup时，可能会出现重复创建隐藏列的问题 [Fix create rollup may duplicate hidden column #4816]

• 修复sequence column隐藏列不显示的问题 [[Bug] Sequence column should be visible when show_hidden_columns = true #4818]

• 修复部分union语句查询结果错误的问题 [[Bug] Fix union bug (#4772) #4807]

• 修复部分情况下，下线节点任务无法完成的问题 [[TabletScheduler] Fix some bug where decommission operations cannot be completed #4804]

• SQL解析时智能识别非法的日期常量，以避免查询扫描所有分区 [[FEATURE]Check date type to avoid scan all partitions #4756]

• 修复BE端挑选tablet进行compaction时，没有加锁导致BE宕机的问题 [[Compaction][Bug-Fix] Fix bug that meta lock need to be held when calculating compaction score #4829]

• 修复新版本UI的一些前端显示问题和后端Cookie处理逻辑问题 [[FE UI] Fix some bugs about new FE UI #4830]

• 修复SQL中包含UNION和Colocation Join时，查询报错tablet找不到的问题 [[Bug][SQL] Fix bug that query failed when SQL contains Union and Colocate join #4842]

• 修复当提交导入任务时，因任务队列已满导致提交失败，但失败异常没有被正确捕获的问题 [[BUG] Catch retry submit exception #4796]

• 修复Broker Load作业调度方面的问题。避免部分作业提交后无法被调度的问题 [[Bug] Fix some bugs of load job scheduler #4869]

• 刚Master FE没有启动完成前，避免将命令转发到Master FE [【Improvement】Avoid null host when forward to master #4844]

• 导入时忽略Parquet，ORC格式的空文件，避免读取错误 [[Broker Load] Ignore empty file when file format is parquet or orc. #4810]

• 修复重命名OLAP表时，未检查物化视图名称是否冲突的问题 [[Bug] Rename table logic error #4870]

• 修复使用复杂SQL创建逻辑视图时，创建失败的问题 [[Bug] Fix bug that failed to create view with complex select stmt #4840]

• 修复Routine Load在消费Kafka数据时，因读取到空消息导致任务无法正确结束的问题 [[Bug] Fix bug that routine load blocked with TOO_MANY_TASKS error #4861]

• 修复使用CTE语法时，部分列名不识别的问题 [[Bug] Fix bug #4886 and #4586 by refactoring code of method 'getDbs' #4887]

• 修复Information_schema库的columns表内容错误的问题 [[BUG] Fix field error in information_schema.columns #4858]

• 修复FE端BitmapValue实现中，当仅包含32位整型时，BitmapValue序列化失败的问题 [(#4883) Java Version BitmapValue deserialized failed #4884]

• 修复在计算BE磁盘使用量时，错误的包含了节点中所有非Doris使用的磁盘空间。这会导致在进行Decommission操作时计算出现错误 [[BUG] modify isDecommissioned be capacity calculate rule #4889]

• 修复当SELECT列表中仅包含常量表达式时，可能会错误的额外添加一个列的问题 [Avoid duplicate column when adding slot in empty tuple #4901]

• 修复FE端和BE端Thrift Server类型不一致导致无法通讯的问题 [[Bug] Fix bug that be thrift client cannot connect to fe thrift server when fe thrift server use TThreadedSelectorServer model #4908]

• 分区裁剪时，忽略非列上的过滤条件 [[Bug] Fix partition prune (#4833) #4921]

• 修复start_fe.sh启动脚本中，创建log目录错误的问题 [fix the FE logs dir create issue  #4929]

• 修复使用CTE语法时，部分NULL值不显示的问题 [[Bug] Fix the bug of NULL do not show in CTE statement. #4932]

• 修复在部分BE节点宕机情况下，Colocation Group一直处于unstable状态的问题 [[BUG] Fix Colocate table balance bug #4936]

• 禁止创建Segment V1 格式的表 [disable the creation of segment v1 table #4913]

• 修复Doris查询ES数据时，Bool类型条件处理错误的问题 [[Doris On ES][Bug-fix] fix boolean predicate pushdown manner #4990]

• 修复一个BE端Tablet Shard锁的问题 [[Bug] Fix concurrent access of _tablets_under_clone in TabletManager #5000]

• 修复当删除一个正在进行导入的表时，FE端可能出现的ConcurrentModificationException的问题 [(#5002) ConcurrentModificationException when finish transaction #5003]

• 修复str_to_date函数返回类型不正确的问题 [[Function] Let "str_to_date" return correct type  #5004]

• 修复导入Json格式数据时，某些浮点类型精度丢失的问题 [[Bug] Fix the bug of Largetint and Decimal json load failed. #4983]

• 修复使用Union连接多张外部表查询时，查询结果不完整的问题 [[Bug] Fix bug that query multi mysql external table with union will get incomplete result #5067]

• 修复SQL中包含多个 in 条件时，查询结果不正确的问题 [[Bug] Fix the bug of where condition a in ('A', 'B', 'V') and a in ('A') return error result #5072]

• 修复一个Profile析构顺序导致BE宕机的问题 [[Bug] Fix a core dump of counter in BE #5078]

• 修复导入Json格式数据存在内存泄露的问题 [[Bug] Fix Memory Leak in Json Load #5073]

• 修复当没有BE节点时，Colocation均衡逻辑占用100%CPU的问题 [[BUG] Fix colocate balance bug when no available BE #5079]

• 修复创建新tablet可能导致BE宕机的问题 [[Bug] Fix coredump bug when create new tablets #5089]

• 修复共享指针循环引用导致tablet无法被清除，占用磁盘空间的问题 [[Bug] Fix tablet shared ptr circular reference causing the tablet not to be cleared #5100]

• 修复当delete条件中包含is null 条件时，会导致BE宕机的问题 [[Bug] Fix bug when delete condition is null but zonemap is not null #5109]

• 修复Partition Cache命中策略的一个问题 [[Bug-Fix] Fix partition cache match bug #5060]

• 优化Spark Load读取Hive表的策略，避免全量扫描Hive表 [avoid to read whole hive table when spark load from hive table #5047]

• 新增对Ninjia构建系统的支持，加速BE端的编译速度 [support ninja build system #5076]

• 优化Json格式数据导入的效率 [[enhancement]improve performance of json load #5055]

• 支持FE直接采用thrift协议传递心跳信息，以避免http通讯模型可能导致的心跳阻塞失败的问题 [ Support fe heartbeat use thrift protocol to get stable response #5027]

• 简化动态分区功能的开启逻辑，并禁止对date类型的列做小时级别的分区 [Forbidden creating table with dynamic partition when FE.config dynamic_partition_enable=false #5043]

• 支持通过FE Web页面查看Broker Load的Profile [[Enhance] Add profile for load job #5052]

• 查看Resource信息时，不再显示明文密码 [[ODBC] ODBC Catalog do not show password in 'show resource' #5088]

• BE端增加创建tablet的的trace信息，帮助定位tablet创建慢的问题 [[Trace] Add trace for create tablet tasks #5091]

• 修复在某些情况下，Routine Load 消费kafka数据时，可能会导致数据丢失的问题 [[Bug] Fix bug that routine load may lost some data #5093]

• 修复desc语句查看所有物化视图，可能返回 Malformed packet 的问题 [[Bug-Fix] Fix 'Malformed packet' error when desc OlapTable with Rollup #5115]

• 修复BE启动加载数据目录时，可能导致BE宕机的问题 [[Bug] Fix old tablet inserting bug #5113]

• 修复非Master FE重复发送非query请求到Master FE的问题 [[BUG] Follower shouldn't forward non-query statement to master repeatedly #5160]

• 修复partition cache命中逻辑错误的问题 [[Bug] Hit none partition cache, but hit range is still right #5065]

• 修复对空表执行bucket join 时报错的问题 [[Bug-Fix] Bucket shuffle join executes failed when two tables have no data #5145]

• 修复percentile_approx函数返回结果错误的问题 [[Bug-Fix] Fix the bug of PERCENTILE_APPROX return error result nan and add PERCENTILE_APPROX UT #5172]

• 修复Olap Scanner 线程结束调用顺序的问题 [5111]

• 修复对空分区的表创建colocation属性时报错的问题 [Fix create colocate table bug #5139]

• 修复CTE语句中查询物化视图时报错的问题 [Fix MaterializedView select with CTE bug #5165]

• 修复min max 函数对string 类型的列的null值处理不正确的问题 [[Bug] Fix bug that the min/max function has an error in handling string null values #5189]

• 将Spark-Doris-Connector 中字符串编码修改为 utf8 [[Spark on Doris] fix the encode of varchar when convertArrowToRowBatch #5202]

• 修复在routine load中可能重复添加delete列的问题 [Fix duplicated add delete condition when run routine load #5222]

• 修复bucket shuffle join的bug [[Bug] Fix bucket shuffle join bug of query failed #5228]

• 修复 ALTER ROUTINE LOAD 操作对部分参数无效的问题 [[BUG] fix alter routine load not work #5257]

• 修复在备份恢复操作中，不同Table的元数据签名可能相同的问题 [[Bug] Remove schema hash and fix bug of calculating table signature #5254]

• 修复Colocate Join 和 Buckets shuffle join 可能导致数据被重复扫描的问题 [[Bug] Colocate Join and Bucket shuffle join may scan some tablet twice time. #5256]

• 修复FE推送元数据时，未检查日志id导致元数据错误的问题 [Add some consistency check in image put api #5219]

• 修复聚合查询处理-0.0有误的问题 [[Bug] Fix row_number and group by have inconsistent partition results for (0.0, -0.0) #5226]

• 修复outer join查询错误 [[Bug] Fix bug of outer join cause error result #5285]

Other

• 将一些非Apache协议的代码协议声明添加至NOTICE文件 [Add other license declare in NOTICE #4831]

• 使用clang-format重新格式化了BE的代码 [Clang-format cpp sources #4965]

• 添加了clang-format检查和格式化脚本，用于在提交前统一BE的C++代码风格 [Add clang-format script #4934]

• 第三方库新增 AWS S3 SDK，用于之后通过sdk直接读取对象存储中的数据 [add aws sdk to thirdparty #5234]

• 修复了License相关的一些问题：[[License] Organize and modify the license of the code #4371]

  1. 默认编译选项中将不再开启MySQL client 和 LZO 两个第三方库的依赖。如果用户需要 MySQL 外表功能，需自行开启

  2. 移除了代码库中的 js 和 css 代码，采用第三方库依赖的形式引入

• 更新了Docker开发环境镜像build-env-1.2

• 更新了UnixODBC三方库的编译方式，使得BE进程在运行时不在依赖系统的libltdl.so动态库

• 新增第三方UDF，支持对正交的bitmap数据进行更高效的集合计算 [Add bitmap longitudinal cutting udaf #4198]

• 新增UnixODBC第三方库依赖，用于支持ODBC外部表功能 [[ODBC SCAN NODE] 1/4 Add unix odbc library. #4377]

API Change

• 禁止创建segment v1 的表 [disable the creation of segment v1 table #4913]
• 重命名配置项 streaming_load_max_batch_size_mb to streaming_load_json_max_mb [Change config name 'streaming_load_max_batch_size_mb' to 'streaming_load_json_max_mb' #4791]
• 支持 load 语句columns 定义中 列引用传递 [Improve the processing logic of Load statement derived columns #5140]
• 支持在unique 表 value 列上创建索引 [Support create index on unique value column #5305]
• 支持通过replace语句进行两表的原子替换 [[Feature] Support REPLACE TABLE operation. #4669]
• 支持CREATE TABLE LIKE 语句

Credits

924060929
acelyc111
Astralidea
benbiti
blueChild
caiconghui
caoyang10
ccoffline
coalchan
Dam1029
e0c9
EmmyMiao87
gengjun-git
HangyuanLiu
HappenLee
hffariel
jollykingCN
kangkaisen
killxdcj
lihuigang
liutang123
luozenglin
marising
mengqinghuan
morningman
nimuyuhan
Nivane
pengxiangyu
px-l
qidaye
sduzh
Skysheepwang
songchuangyuan
stalary
stdpain
Sunt-ing
vagetablechicken
vergilchiu
wangbo
wangxiaobaidu11
weizuo93
WingsGo
wutiangan
wuyunfeng
xinghuayu007
xinyiZzz
Xpray
xy720
yangzhg
Youngwb
yxqweasd
zh0122
ZhangYu0123
zhaojintaozhao
xxiao2018
bookeezhou
JNSimba
killxdcj
yuliangwan

[hf200012]

good

[li215065046]

nice

[yangzhg]

the last commit is 577b62b

[xinghuayu007]

#4756 has been reverted.

[haboshara1]

nice