From fc6990e877e99afbf97b3ca781f23b18f0bcc1d1 Mon Sep 17 00:00:00 2001 From: ti-srebot Date: Mon, 28 Jun 2021 11:39:06 +0800 Subject: [PATCH 01/26] update v5.0.3 release notes at 2021-06-28T11:39:05 Signed-off-by: ti-srebot --- releases/5.0.3.md | 124 ++++++++++++++++++++++++++++++++++++++++++++++ 1 file changed, 124 insertions(+) create mode 100644 releases/5.0.3.md diff --git a/releases/5.0.3.md b/releases/5.0.3.md new file mode 100644 index 0000000000000..afa423c6b74c7 --- /dev/null +++ b/releases/5.0.3.md @@ -0,0 +1,124 @@ +--- +title: tidb v5.0.3 Release Notes +category: Releases +aliases: ['/docs/dev/releases/v5.0.3/'] +--- + +# tidb v5.0.3 Release Notes + +Release date: June 28, 2021 + +TiDB version: v5.0.3 + +## Bug Fixes + ++ TiDB + + - Fix incorrect result of set type for merge join [#25694](https://github.com/pingcap/tidb/pull/25694) + - Expression: fix IN expr critical bug [#25666](https://github.com/pingcap/tidb/pull/25666) + - Avoid sessions of GC being affected by global variables [#25609](https://github.com/pingcap/tidb/pull/25609) + - Make sure limit outputs no more columns than its child [#25517](https://github.com/pingcap/tidb/pull/25517) + - Planner: fix a panic caused by sinking a Limit with inlined Proj into IndexLookUp when accessing a partition table [#25139](https://github.com/pingcap/tidb/pull/25139) + - Executor: fix ifnull bug when arg is enum/set [#25116](https://github.com/pingcap/tidb/pull/25116) + - Generate correct number of rows when all agg funcs are pruned [#25062](https://github.com/pingcap/tidb/pull/25062) + - Executor: make the ParallelApply be safe to be called again after returning empty results [#25011](https://github.com/pingcap/tidb/pull/25011) + - Fix the case that there could be duplicate ranges for multi-column index. [#24635](https://github.com/pingcap/tidb/pull/24635) + - Fix a nulleq bug [#24633](https://github.com/pingcap/tidb/pull/24633) + - Executor: fix data race of parallel apply operator [#24345](https://github.com/pingcap/tidb/pull/24345) + - Fix an issue that sorting on index-merge results in partition union reports 'index out of range'. [#24155](https://github.com/pingcap/tidb/pull/24155) + ++ TiFlash + + - Fix the issue that TiFlash nodes keep restart because of split failure. [#2219](https://github.com/pingcap/tics/pull/2219) + - Fix the bug that TiFlash can not GC delta data under rare case [#2185](https://github.com/pingcap/tics/pull/2185) + - Fix the bug that tiflash wrongly add padding for non-binary chars in cast function [#2092](https://github.com/pingcap/tics/pull/2092) + - Fix a bug that aggregation query with complex group by column may got wrong results. [#2072](https://github.com/pingcap/tics/pull/2072) + - Fix the bug that TiFlash may panic under heavy write pressure [#2055](https://github.com/pingcap/tics/pull/2055) + ++ Tools + + - BR + + * Fix parquet parse when parse decimal type [#1277](https://github.com/pingcap/br/pull/1277) + * Fix the bug that lightning returns EOF error when CSV file without '\r\n' at the last line and `strict-format = true`. [#1189](https://github.com/pingcap/br/pull/1189) + * Fix the bug that lightning rebase wrong auto_increment base when the auto_increment field type is float or double. [#1186](https://github.com/pingcap/br/pull/1186) + +## Improvements + ++ TiDB + + - Planner: push down topN to mpp. [#25162](https://github.com/pingcap/tidb/pull/25162) + ++ TiFlash + + - Use multi threads for not joined data in right outer join. [#2094](https://github.com/pingcap/tics/pull/2094) + +## New Features + ++ TiFlash + + - Support cast string as double push down [#2068](https://github.com/pingcap/tics/pull/2068) + - Support pushing down the `str_to_date` function to TiFlash [#2063](https://github.com/pingcap/tics/pull/2063) + +## Others + ++ TiDB + + - Do not allow setting read timestamp to a future time. [#25761](https://github.com/pingcap/tidb/pull/25761) + - Enable the pushdown of builtin function `json_unquote()` to TiKV. [#25720](https://github.com/pingcap/tidb/pull/25720) + - Planner/core: remove the union branch with dual table. [#25614](https://github.com/pingcap/tidb/pull/25614) + - Fix the issue that ODBC-styled literal(like `{d '2020-01-01'}`...) cannot be used as the expression. [#25577](https://github.com/pingcap/tidb/pull/25577) + - Support push down function replace to TiFlash. [#25565](https://github.com/pingcap/tidb/pull/25565) + - Support push fucntion unix_timestamp,concat,year,day,datediff,datesub,castTimeAsString,concat_ws down to TiFlash. [#25564](https://github.com/pingcap/tidb/pull/25564) + - Planner: select distinct should bypass batchget [#25533](https://github.com/pingcap/tidb/pull/25533) + - Planner/core: change agg cost factor [#25241](https://github.com/pingcap/tidb/pull/25241) + - Planner/core: support limit push down [#25159](https://github.com/pingcap/tidb/pull/25159) + - Support pushing down the `str_to_date` functions to TiFlash [#25148](https://github.com/pingcap/tidb/pull/25148) + - Allow mpp outer join to choose the build table based on table row count [#25142](https://github.com/pingcap/tidb/pull/25142) + - Push down left/right/abs to tiflash [#25133](https://github.com/pingcap/tidb/pull/25133) + - Support push down broadcast cartesian join to TiFlash [#25106](https://github.com/pingcap/tidb/pull/25106) + - Planner/core: support union all for mpp. [#25051](https://github.com/pingcap/tidb/pull/25051) + - Balance region for batch cop task [#24724](https://github.com/pingcap/tidb/pull/24724) + - Store/tikv: change backoff type for missed tiflash peer. [#24600](https://github.com/pingcap/tidb/pull/24600) + - Store/copr: invalidate stale regions for Mpp query. [#24432](https://github.com/pingcap/tidb/pull/24432) + - Fix index-out-of-range error when checking only_full_group_by [#24016](https://github.com/pingcap/tidb/pull/24016) + ++ TiKV + + - ```release-note [#10434](https://github.com/tikv/tikv/pull/10434) + - ```release-note [#10431](https://github.com/tikv/tikv/pull/10431) + - Copr: fix the wrong arguments type of json_unquote [#10424](https://github.com/tikv/tikv/pull/10424) + - Fix the issue that br reports file already exists error when TDE enabled during restoration. [#10421](https://github.com/tikv/tikv/pull/10421) + - This bug does not affects existing releases. [#10417](https://github.com/tikv/tikv/pull/10417) + - ```release-note [#10401](https://github.com/tikv/tikv/pull/10401) + - ```release-note [#10396](https://github.com/tikv/tikv/pull/10396) + - Fix a bug that share read index for replica reads on a leader [#10391](https://github.com/tikv/tikv/pull/10391) + - ```release-note [#10388](https://github.com/tikv/tikv/pull/10388) + - ```release-note [#10313](https://github.com/tikv/tikv/pull/10313) + - Limit CDC sink memory consumption. [#10305](https://github.com/tikv/tikv/pull/10305) + ++ PD + + - ```release-note [#3798](https://github.com/pingcap/pd/pull/3798) + ++ TiFlash + + - Fix segment fault for right join if the right jon key is not nullalbe and the left join key is nullable [#2201](https://github.com/pingcap/tics/pull/2201) + - Fix the potential issue that read-index requests cost long time [#2091](https://github.com/pingcap/tics/pull/2091) + - Support cartesian join in TiFlash [#2078](https://github.com/pingcap/tics/pull/2078) + - Push down Left/right to tiflash [#2076](https://github.com/pingcap/tics/pull/2076) + - Push down abs() to tiflash [#2075](https://github.com/pingcap/tics/pull/2075) + - Invalidate stale regions for Mpp query. [#1877](https://github.com/pingcap/tics/pull/1877) + ++ Tools + + - TiCDC + + * Fix potential deadlocks [#2142](https://github.com/pingcap/ticdc/pull/2142) + * Fix a bug that could cause cdc server panic because of the late calculation of resolved ts [#2047](https://github.com/pingcap/ticdc/pull/2047) + * Fix panic when TiCDC fails to read `/proc/meminfo` [#2024](https://github.com/pingcap/ticdc/pull/2024) + * Reduce unnecessary memory consumption [#2012](https://github.com/pingcap/ticdc/pull/2012) + * Make sorter IO errors more user-friendly. [#1977](https://github.com/pingcap/ticdc/pull/1977) + * Fix Unified Sorter memory consumption when tables are many. [#1958](https://github.com/pingcap/ticdc/pull/1958) + * Decrease the default gRPC connection pool size to decrease goroutines count. [#1951](https://github.com/pingcap/ticdc/pull/1951) + * Fix a bug that some MySQL connection could leak after MySQL sink meets error and pauses. [#1946](https://github.com/pingcap/ticdc/pull/1946) From ce6792df9a698e0e10ab2440a1bb07e714f69451 Mon Sep 17 00:00:00 2001 From: TomShawn <41534398+TomShawn@users.noreply.github.com> Date: Mon, 28 Jun 2021 11:47:56 +0800 Subject: [PATCH 02/26] add toc --- TOC.md | 1 + releases/{5.0.3.md => release-5.0.3.md} | 61 ++++++++++++------------- releases/release-notes.md | 1 + 3 files changed, 32 insertions(+), 31 deletions(-) rename releases/{5.0.3.md => release-5.0.3.md} (90%) diff --git a/TOC.md b/TOC.md index 5890dec055803..c6f1eb4005d73 100644 --- a/TOC.md +++ b/TOC.md @@ -551,6 +551,7 @@ + v5.1 + [5.1.0](/releases/release-5.1.0.md) + v5.0 + + [5.0.3](/releases/release-5.0.3.md) + [5.0.2](/releases/release-5.0.2.md) + [5.0.1](/releases/release-5.0.1.md) + [5.0 GA](/releases/release-5.0.0.md) diff --git a/releases/5.0.3.md b/releases/release-5.0.3.md similarity index 90% rename from releases/5.0.3.md rename to releases/release-5.0.3.md index afa423c6b74c7..176a9e1bc8fd7 100644 --- a/releases/5.0.3.md +++ b/releases/release-5.0.3.md @@ -1,14 +1,31 @@ --- -title: tidb v5.0.3 Release Notes -category: Releases -aliases: ['/docs/dev/releases/v5.0.3/'] +title: TiDB 5.0.3 Release Notes --- -# tidb v5.0.3 Release Notes +# TiDB 5.0.3 Release Notes -Release date: June 28, 2021 +Release date: June 30, 2021 -TiDB version: v5.0.3 +TiDB version: 5.0.3 + +## Compatibility Changes + +## New Features + ++ TiFlash + + - Support cast string as double push down [#2068](https://github.com/pingcap/tics/pull/2068) + - Support pushing down the `str_to_date` function to TiFlash [#2063](https://github.com/pingcap/tics/pull/2063) + +## Improvements + ++ TiDB + + - Planner: push down topN to mpp. [#25162](https://github.com/pingcap/tidb/pull/25162) + ++ TiFlash + + - Use multi threads for not joined data in right outer join. [#2094](https://github.com/pingcap/tics/pull/2094) ## Bug Fixes @@ -43,24 +60,7 @@ TiDB version: v5.0.3 * Fix the bug that lightning returns EOF error when CSV file without '\r\n' at the last line and `strict-format = true`. [#1189](https://github.com/pingcap/br/pull/1189) * Fix the bug that lightning rebase wrong auto_increment base when the auto_increment field type is float or double. [#1186](https://github.com/pingcap/br/pull/1186) -## Improvements - -+ TiDB - - - Planner: push down topN to mpp. [#25162](https://github.com/pingcap/tidb/pull/25162) - -+ TiFlash - - - Use multi threads for not joined data in right outer join. [#2094](https://github.com/pingcap/tics/pull/2094) - -## New Features - -+ TiFlash - - - Support cast string as double push down [#2068](https://github.com/pingcap/tics/pull/2068) - - Support pushing down the `str_to_date` function to TiFlash [#2063](https://github.com/pingcap/tics/pull/2063) - -## Others +## 以下 note 未分类。请将以下 note 进行分类 (New feature, Improvements, Bug fixes, Compatibility Changes 四类)，并移动到上面对应的标题下。如果某条 note 为多余的，请删除。如果漏抓取了 note，请手动补充 + TiDB @@ -85,21 +85,20 @@ TiDB version: v5.0.3 + TiKV - - ```release-note [#10434](https://github.com/tikv/tikv/pull/10434) - - ```release-note [#10431](https://github.com/tikv/tikv/pull/10431) + - release-note [#10431](https://github.com/tikv/tikv/pull/10431) - Copr: fix the wrong arguments type of json_unquote [#10424](https://github.com/tikv/tikv/pull/10424) - Fix the issue that br reports file already exists error when TDE enabled during restoration. [#10421](https://github.com/tikv/tikv/pull/10421) - This bug does not affects existing releases. [#10417](https://github.com/tikv/tikv/pull/10417) - - ```release-note [#10401](https://github.com/tikv/tikv/pull/10401) - - ```release-note [#10396](https://github.com/tikv/tikv/pull/10396) + - release-note [#10401](https://github.com/tikv/tikv/pull/10401) + - release-note [#10396](https://github.com/tikv/tikv/pull/10396) - Fix a bug that share read index for replica reads on a leader [#10391](https://github.com/tikv/tikv/pull/10391) - - ```release-note [#10388](https://github.com/tikv/tikv/pull/10388) - - ```release-note [#10313](https://github.com/tikv/tikv/pull/10313) + - release-note [#10388](https://github.com/tikv/tikv/pull/10388) + - release-note [#10313](https://github.com/tikv/tikv/pull/10313) - Limit CDC sink memory consumption. [#10305](https://github.com/tikv/tikv/pull/10305) + PD - - ```release-note [#3798](https://github.com/pingcap/pd/pull/3798) + - release-note [#3798](https://github.com/pingcap/pd/pull/3798) + TiFlash diff --git a/releases/release-notes.md b/releases/release-notes.md index 19b4940ef2e51..ca02d43d472e3 100644 --- a/releases/release-notes.md +++ b/releases/release-notes.md @@ -11,6 +11,7 @@ aliases: ['/docs/dev/releases/release-notes/','/docs/dev/releases/rn/'] ## 5.0 +- [5.0.3](/releases/release-5.0.3.md) - [5.0.2](/releases/release-5.0.2.md) - [5.0.1](/releases/release-5.0.1.md) - [5.0 GA](/releases/release-5.0.0.md) From e4f0b5c62f728df709cd1529b8419979c59e7c3b Mon Sep 17 00:00:00 2001 From: TomShawn <41534398+TomShawn@users.noreply.github.com> Date: Mon, 28 Jun 2021 17:55:45 +0800 Subject: [PATCH 03/26] Apply suggestions from code review Co-authored-by: tangenta --- releases/release-5.0.3.md | 6 +++--- 1 file changed, 3 insertions(+), 3 deletions(-) diff --git a/releases/release-5.0.3.md b/releases/release-5.0.3.md index 176a9e1bc8fd7..2fc28b8935896 100644 --- a/releases/release-5.0.3.md +++ b/releases/release-5.0.3.md @@ -21,7 +21,7 @@ TiDB version: 5.0.3 + TiDB - - Planner: push down topN to mpp. [#25162](https://github.com/pingcap/tidb/pull/25162) + - Support planner pushing down the TopN operator to MPP. [#25162](https://github.com/pingcap/tidb/pull/25162) + TiFlash @@ -31,8 +31,8 @@ TiDB version: 5.0.3 + TiDB - - Fix incorrect result of set type for merge join [#25694](https://github.com/pingcap/tidb/pull/25694) - - Expression: fix IN expr critical bug [#25666](https://github.com/pingcap/tidb/pull/25666) + - Fix the issue that an incorrect result is returned when using merge join on the `SET` types. [#25694](https://github.com/pingcap/tidb/pull/25694) + - Fix the `IN` expression arguments corruption issue. [#25666](https://github.com/pingcap/tidb/pull/25666) - Avoid sessions of GC being affected by global variables [#25609](https://github.com/pingcap/tidb/pull/25609) - Make sure limit outputs no more columns than its child [#25517](https://github.com/pingcap/tidb/pull/25517) - Planner: fix a panic caused by sinking a Limit with inlined Proj into IndexLookUp when accessing a partition table [#25139](https://github.com/pingcap/tidb/pull/25139) From bea8927a098f4638e783773716ea06c0cefd1672 Mon Sep 17 00:00:00 2001 From: TomShawn <41534398+TomShawn@users.noreply.github.com> Date: Mon, 28 Jun 2021 19:16:58 +0800 Subject: [PATCH 04/26] Update releases/release-5.0.3.md Co-authored-by: tangenta --- releases/release-5.0.3.md | 13 +++++++++++++ 1 file changed, 13 insertions(+) diff --git a/releases/release-5.0.3.md b/releases/release-5.0.3.md index 2fc28b8935896..d46a766189222 100644 --- a/releases/release-5.0.3.md +++ b/releases/release-5.0.3.md @@ -22,6 +22,19 @@ TiDB version: 5.0.3 + TiDB - Support planner pushing down the TopN operator to MPP. [#25162](https://github.com/pingcap/tidb/pull/25162) + - Enable the pushdown of builtin function `json_unquote()` to TiKV. [#25720](https://github.com/pingcap/tidb/pull/25720) + - Planner/core: remove the union branch with dual table. [#25614](https://github.com/pingcap/tidb/pull/25614) + - Support push down function replace to TiFlash. [#25565](https://github.com/pingcap/tidb/pull/25565) + - Support push fucntion unix_timestamp,concat,year,day,datediff,datesub,castTimeAsString,concat_ws down to TiFlash. [#25564](https://github.com/pingcap/tidb/pull/25564) + - Planner/core: change agg cost factor [#25241](https://github.com/pingcap/tidb/pull/25241) + - Planner/core: support limit push down [#25159](https://github.com/pingcap/tidb/pull/25159) + - Support pushing down the `str_to_date` functions to TiFlash [#25148](https://github.com/pingcap/tidb/pull/25148) + - Allow mpp outer join to choose the build table based on table row count [#25142](https://github.com/pingcap/tidb/pull/25142) + - Push down left/right/abs to tiflash [#25133](https://github.com/pingcap/tidb/pull/25133) + - Support push down broadcast cartesian join to TiFlash [#25106](https://github.com/pingcap/tidb/pull/25106) + - Planner/core: support union all for mpp. [#25051](https://github.com/pingcap/tidb/pull/25051) + - Balance region for batch cop task [#24724](https://github.com/pingcap/tidb/pull/24724) + - Store/copr: invalidate stale regions for Mpp query. [#24432](https://github.com/pingcap/tidb/pull/24432) + TiFlash From d0d4807b8a105f4e7907859e7eeb1abcff9a9132 Mon Sep 17 00:00:00 2001 From: TomShawn <41534398+TomShawn@users.noreply.github.com> Date: Mon, 28 Jun 2021 19:17:05 +0800 Subject: [PATCH 05/26] Update releases/release-5.0.3.md Co-authored-by: tangenta --- releases/release-5.0.3.md | 5 +++++ 1 file changed, 5 insertions(+) diff --git a/releases/release-5.0.3.md b/releases/release-5.0.3.md index d46a766189222..8a9f4b0841825 100644 --- a/releases/release-5.0.3.md +++ b/releases/release-5.0.3.md @@ -56,6 +56,11 @@ TiDB version: 5.0.3 - Fix a nulleq bug [#24633](https://github.com/pingcap/tidb/pull/24633) - Executor: fix data race of parallel apply operator [#24345](https://github.com/pingcap/tidb/pull/24345) - Fix an issue that sorting on index-merge results in partition union reports 'index out of range'. [#24155](https://github.com/pingcap/tidb/pull/24155) + - Do not allow setting read timestamp to a future time. [#25761](https://github.com/pingcap/tidb/pull/25761) + - Fix the issue that ODBC-styled literal(like `{d '2020-01-01'}`...) cannot be used as the expression. [#25577](https://github.com/pingcap/tidb/pull/25577) + - Planner: select distinct should bypass batchget [#25533](https://github.com/pingcap/tidb/pull/25533) + - Store/tikv: change backoff type for missed tiflash peer. [#24600](https://github.com/pingcap/tidb/pull/24600) + - Fix index-out-of-range error when checking only_full_group_by [#24016](https://github.com/pingcap/tidb/pull/24016) + TiFlash From 96988f84c7cca660792e3022b2e025c2222d9bea Mon Sep 17 00:00:00 2001 From: TomShawn <41534398+TomShawn@users.noreply.github.com> Date: Mon, 28 Jun 2021 19:17:14 +0800 Subject: [PATCH 06/26] Update releases/release-5.0.3.md Co-authored-by: tangenta --- releases/release-5.0.3.md | 21 --------------------- 1 file changed, 21 deletions(-) diff --git a/releases/release-5.0.3.md b/releases/release-5.0.3.md index 8a9f4b0841825..e9dc02fe2900e 100644 --- a/releases/release-5.0.3.md +++ b/releases/release-5.0.3.md @@ -80,27 +80,6 @@ TiDB version: 5.0.3 ## 以下 note 未分类。请将以下 note 进行分类 (New feature, Improvements, Bug fixes, Compatibility Changes 四类)，并移动到上面对应的标题下。如果某条 note 为多余的，请删除。如果漏抓取了 note，请手动补充 -+ TiDB - - - Do not allow setting read timestamp to a future time. [#25761](https://github.com/pingcap/tidb/pull/25761) - - Enable the pushdown of builtin function `json_unquote()` to TiKV. [#25720](https://github.com/pingcap/tidb/pull/25720) - - Planner/core: remove the union branch with dual table. [#25614](https://github.com/pingcap/tidb/pull/25614) - - Fix the issue that ODBC-styled literal(like `{d '2020-01-01'}`...) cannot be used as the expression. [#25577](https://github.com/pingcap/tidb/pull/25577) - - Support push down function replace to TiFlash. [#25565](https://github.com/pingcap/tidb/pull/25565) - - Support push fucntion unix_timestamp,concat,year,day,datediff,datesub,castTimeAsString,concat_ws down to TiFlash. [#25564](https://github.com/pingcap/tidb/pull/25564) - - Planner: select distinct should bypass batchget [#25533](https://github.com/pingcap/tidb/pull/25533) - - Planner/core: change agg cost factor [#25241](https://github.com/pingcap/tidb/pull/25241) - - Planner/core: support limit push down [#25159](https://github.com/pingcap/tidb/pull/25159) - - Support pushing down the `str_to_date` functions to TiFlash [#25148](https://github.com/pingcap/tidb/pull/25148) - - Allow mpp outer join to choose the build table based on table row count [#25142](https://github.com/pingcap/tidb/pull/25142) - - Push down left/right/abs to tiflash [#25133](https://github.com/pingcap/tidb/pull/25133) - - Support push down broadcast cartesian join to TiFlash [#25106](https://github.com/pingcap/tidb/pull/25106) - - Planner/core: support union all for mpp. [#25051](https://github.com/pingcap/tidb/pull/25051) - - Balance region for batch cop task [#24724](https://github.com/pingcap/tidb/pull/24724) - - Store/tikv: change backoff type for missed tiflash peer. [#24600](https://github.com/pingcap/tidb/pull/24600) - - Store/copr: invalidate stale regions for Mpp query. [#24432](https://github.com/pingcap/tidb/pull/24432) - - Fix index-out-of-range error when checking only_full_group_by [#24016](https://github.com/pingcap/tidb/pull/24016) - + TiKV - release-note [#10431](https://github.com/tikv/tikv/pull/10431) From ac0cb199f00fe92112cdeb723637594aae3c4f28 Mon Sep 17 00:00:00 2001 From: TomShawn <41534398+TomShawn@users.noreply.github.com> Date: Mon, 28 Jun 2021 19:45:10 +0800 Subject: [PATCH 07/26] add tiflash notes --- releases/release-5.0.3.md | 38 ++++++++++++++++---------------------- 1 file changed, 16 insertions(+), 22 deletions(-) diff --git a/releases/release-5.0.3.md b/releases/release-5.0.3.md index e9dc02fe2900e..05fba6ca5dd83 100644 --- a/releases/release-5.0.3.md +++ b/releases/release-5.0.3.md @@ -12,11 +12,6 @@ TiDB version: 5.0.3 ## New Features -+ TiFlash - - - Support cast string as double push down [#2068](https://github.com/pingcap/tics/pull/2068) - - Support pushing down the `str_to_date` function to TiFlash [#2063](https://github.com/pingcap/tics/pull/2063) - ## Improvements + TiDB @@ -38,7 +33,13 @@ TiDB version: 5.0.3 + TiFlash - - Use multi threads for not joined data in right outer join. [#2094](https://github.com/pingcap/tics/pull/2094) + - Support casting the `STRING` type to `DOUBLE` type + - Support `STR_TO_DATE` function + - Optimize non-joined data in right outer join by multi-threads + - Support cartesian join + - Support `LEFT` and `RIGHT` function + - Invalidate stale regions for MPP queries + - Support `ABS` function ## Bug Fixes @@ -64,19 +65,21 @@ TiDB version: 5.0.3 + TiFlash - - Fix the issue that TiFlash nodes keep restart because of split failure. [#2219](https://github.com/pingcap/tics/pull/2219) - - Fix the bug that TiFlash can not GC delta data under rare case [#2185](https://github.com/pingcap/tics/pull/2185) - - Fix the bug that tiflash wrongly add padding for non-binary chars in cast function [#2092](https://github.com/pingcap/tics/pull/2092) - - Fix a bug that aggregation query with complex group by column may got wrong results. [#2072](https://github.com/pingcap/tics/pull/2072) - - Fix the bug that TiFlash may panic under heavy write pressure [#2055](https://github.com/pingcap/tics/pull/2055) + - Fix the issue that TiFlash keeps restarting because of split failure + - Fix the potential issue that TiFlash can not GC delta data + - Fix the bug that TiFlash adds wrong padding for non-binary chars in `CAST` function + - Fix the issue of incorrect results when handling aggregation queries with complex `GROUP BY` columns + - Fix the TiFlash panic issue that occurs under heavy write pressure + - Fix the panic that occurs when right join if the right jon key is not nullalbe and the left join key is nullable + - Fix the potential issue that read-index requests cost long time + Tools - BR * Fix parquet parse when parse decimal type [#1277](https://github.com/pingcap/br/pull/1277) - * Fix the bug that lightning returns EOF error when CSV file without '\r\n' at the last line and `strict-format = true`. [#1189](https://github.com/pingcap/br/pull/1189) - * Fix the bug that lightning rebase wrong auto_increment base when the auto_increment field type is float or double. [#1186](https://github.com/pingcap/br/pull/1186) + * Fix the bug that lightning returns EOF error when CSV file without '\r\n' at the last line and `strict-format = true` [#1189](https://github.com/pingcap/br/pull/1189) + * Fix the bug that lightning rebase wrong auto_increment base when the auto_increment field type is float or double [#1186](https://github.com/pingcap/br/pull/1186) ## 以下 note 未分类。请将以下 note 进行分类 (New feature, Improvements, Bug fixes, Compatibility Changes 四类)，并移动到上面对应的标题下。如果某条 note 为多余的，请删除。如果漏抓取了 note，请手动补充 @@ -97,15 +100,6 @@ TiDB version: 5.0.3 - release-note [#3798](https://github.com/pingcap/pd/pull/3798) -+ TiFlash - - - Fix segment fault for right join if the right jon key is not nullalbe and the left join key is nullable [#2201](https://github.com/pingcap/tics/pull/2201) - - Fix the potential issue that read-index requests cost long time [#2091](https://github.com/pingcap/tics/pull/2091) - - Support cartesian join in TiFlash [#2078](https://github.com/pingcap/tics/pull/2078) - - Push down Left/right to tiflash [#2076](https://github.com/pingcap/tics/pull/2076) - - Push down abs() to tiflash [#2075](https://github.com/pingcap/tics/pull/2075) - - Invalidate stale regions for Mpp query. [#1877](https://github.com/pingcap/tics/pull/1877) - + Tools - TiCDC From 673411e2a60d00074d41db20eaec57b532a11a1a Mon Sep 17 00:00:00 2001 From: TomShawn <41534398+TomShawn@users.noreply.github.com> Date: Tue, 29 Jun 2021 11:20:59 +0800 Subject: [PATCH 08/26] add tikv notes --- releases/release-5.0.3.md | 27 ++++++++++++++------------- 1 file changed, 14 insertions(+), 13 deletions(-) diff --git a/releases/release-5.0.3.md b/releases/release-5.0.3.md index 05fba6ca5dd83..6aff9a6edfb41 100644 --- a/releases/release-5.0.3.md +++ b/releases/release-5.0.3.md @@ -31,6 +31,11 @@ TiDB version: 5.0.3 - Balance region for batch cop task [#24724](https://github.com/pingcap/tidb/pull/24724) - Store/copr: invalidate stale regions for Mpp query. [#24432](https://github.com/pingcap/tidb/pull/24432) ++ TiKV + + - CDC: limit CDC sink memory consumption [#10305](https://github.com/tikv/tikv/pull/10305) + - CDC: change old value cache to memory-bounded [#10313](https://github.com/tikv/tikv/pull/10313) + + TiFlash - Support casting the `STRING` type to `DOUBLE` type @@ -63,6 +68,15 @@ TiDB version: 5.0.3 - Store/tikv: change backoff type for missed tiflash peer. [#24600](https://github.com/pingcap/tidb/pull/24600) - Fix index-out-of-range error when checking only_full_group_by [#24016](https://github.com/pingcap/tidb/pull/24016) ++ TiKV + + - Fix wrong tikv_raftstore_hibernated_peer_state metric [#10431](https://github.com/tikv/tikv/pull/10431) + - Copr: fix the wrong arguments type of json_unquote [#10424](https://github.com/tikv/tikv/pull/10424) + - Fix the issue that br reports file already exists error when TDE enabled during restoration [#10421](https://github.com/tikv/tikv/pull/10421) + - Skip clearing callback during graceful shutdown to avoid breaking ACID in some cases [#10396](https://github.com/tikv/tikv/pull/10396) + - Fix the bug that share read index for replica reads on a leader [#10391](https://github.com/tikv/tikv/pull/10391) + - Copr: fix wrong function cast double to double [#10388](https://github.com/tikv/tikv/pull/10388) + + TiFlash - Fix the issue that TiFlash keeps restarting because of split failure @@ -83,19 +97,6 @@ TiDB version: 5.0.3 ## 以下 note 未分类。请将以下 note 进行分类 (New feature, Improvements, Bug fixes, Compatibility Changes 四类)，并移动到上面对应的标题下。如果某条 note 为多余的，请删除。如果漏抓取了 note，请手动补充 -+ TiKV - - - release-note [#10431](https://github.com/tikv/tikv/pull/10431) - - Copr: fix the wrong arguments type of json_unquote [#10424](https://github.com/tikv/tikv/pull/10424) - - Fix the issue that br reports file already exists error when TDE enabled during restoration. [#10421](https://github.com/tikv/tikv/pull/10421) - - This bug does not affects existing releases. [#10417](https://github.com/tikv/tikv/pull/10417) - - release-note [#10401](https://github.com/tikv/tikv/pull/10401) - - release-note [#10396](https://github.com/tikv/tikv/pull/10396) - - Fix a bug that share read index for replica reads on a leader [#10391](https://github.com/tikv/tikv/pull/10391) - - release-note [#10388](https://github.com/tikv/tikv/pull/10388) - - release-note [#10313](https://github.com/tikv/tikv/pull/10313) - - Limit CDC sink memory consumption. [#10305](https://github.com/tikv/tikv/pull/10305) - + PD - release-note [#3798](https://github.com/pingcap/pd/pull/3798) From b7ed27fd0c0ca9899d4bb9c10fb1a09f64a9f738 Mon Sep 17 00:00:00 2001 From: TomShawn <41534398+TomShawn@users.noreply.github.com> Date: Tue, 29 Jun 2021 15:12:07 +0800 Subject: [PATCH 09/26] modify and edit notes for tidb, tikv and tiflash --- releases/release-5.0.3.md | 100 +++++++++++++++++++------------------- 1 file changed, 50 insertions(+), 50 deletions(-) diff --git a/releases/release-5.0.3.md b/releases/release-5.0.3.md index 6aff9a6edfb41..be0fb45c7c9d5 100644 --- a/releases/release-5.0.3.md +++ b/releases/release-5.0.3.md @@ -16,76 +16,76 @@ TiDB version: 5.0.3 + TiDB - - Support planner pushing down the TopN operator to MPP. [#25162](https://github.com/pingcap/tidb/pull/25162) - - Enable the pushdown of builtin function `json_unquote()` to TiKV. [#25720](https://github.com/pingcap/tidb/pull/25720) - - Planner/core: remove the union branch with dual table. [#25614](https://github.com/pingcap/tidb/pull/25614) - - Support push down function replace to TiFlash. [#25565](https://github.com/pingcap/tidb/pull/25565) - - Support push fucntion unix_timestamp,concat,year,day,datediff,datesub,castTimeAsString,concat_ws down to TiFlash. [#25564](https://github.com/pingcap/tidb/pull/25564) - - Planner/core: change agg cost factor [#25241](https://github.com/pingcap/tidb/pull/25241) - - Planner/core: support limit push down [#25159](https://github.com/pingcap/tidb/pull/25159) - - Support pushing down the `str_to_date` functions to TiFlash [#25148](https://github.com/pingcap/tidb/pull/25148) - - Allow mpp outer join to choose the build table based on table row count [#25142](https://github.com/pingcap/tidb/pull/25142) - - Push down left/right/abs to tiflash [#25133](https://github.com/pingcap/tidb/pull/25133) - - Support push down broadcast cartesian join to TiFlash [#25106](https://github.com/pingcap/tidb/pull/25106) - - Planner/core: support union all for mpp. [#25051](https://github.com/pingcap/tidb/pull/25051) - - Balance region for batch cop task [#24724](https://github.com/pingcap/tidb/pull/24724) - - Store/copr: invalidate stale regions for Mpp query. [#24432](https://github.com/pingcap/tidb/pull/24432) + - Support pushing down the `TopN` operator to TiFlash [#25162](https://github.com/pingcap/tidb/pull/25162) + - Support pushing down the built-in function `json_unquote()` to TiKV [#25720](https://github.com/pingcap/tidb/pull/25720) + - Support removing the union branch from the dual table [#25614](https://github.com/pingcap/tidb/pull/25614) + - Support pushing down the built-in function `replace()` to TiFlash [#25565](https://github.com/pingcap/tidb/pull/25565) + - Support pushing down the built-in functions `unix_timestamp()`, `concat()`, `year()`, `day()`, `datediff()`, `datesub()`, `castTimeAsString()`, and `concat_ws()` to TiFlash [#25564](https://github.com/pingcap/tidb/pull/25564) + - Change the aggregate operator's cost factor [#25241](https://github.com/pingcap/tidb/pull/25241) + - Support pushing down the `Limit` operator to TiFlash [#25159](https://github.com/pingcap/tidb/pull/25159) + - Support pushing down the built-in function `str_to_date` to TiFlash [#25148](https://github.com/pingcap/tidb/pull/25148) + - Allow the MPP outer join to choose the build table based on the table row count [#25142](https://github.com/pingcap/tidb/pull/25142) + - Support pushing down the built-in functions `left()`, `right()`, and `abs()` to TiFlash [#25133](https://github.com/pingcap/tidb/pull/25133) + - Support pushing down the Broadcast Cartesian join to TiFlash [#25106](https://github.com/pingcap/tidb/pull/25106) + - Support pushing down the `Union All` operator to TiFlash [#25051](https://github.com/pingcap/tidb/pull/25051) + - Support balancing the MPP query workload among different TiFlash nodes based on Regions [#24724](https://github.com/pingcap/tidb/pull/24724) + - Support invalidating stale Regions in the cache after the MPP query is executed [#24432](https://github.com/pingcap/tidb/pull/24432) + TiKV - - CDC: limit CDC sink memory consumption [#10305](https://github.com/tikv/tikv/pull/10305) - - CDC: change old value cache to memory-bounded [#10313](https://github.com/tikv/tikv/pull/10313) + - Limit the TiCDC sink's memory consumption [#10305](https://github.com/tikv/tikv/pull/10305) + - Add the memory-bounded upper limit for the TiCDC old value cache [#10313](https://github.com/tikv/tikv/pull/10313) + TiFlash - - Support casting the `STRING` type to `DOUBLE` type - - Support `STR_TO_DATE` function - - Optimize non-joined data in right outer join by multi-threads - - Support cartesian join - - Support `LEFT` and `RIGHT` function - - Invalidate stale regions for MPP queries - - Support `ABS` function + - Support casting the `STRING` type to the `DOUBLE` type + - Support the `STR_TO_DATE` function + - Optimize the non-joined data in right outer join using multiple threads + - Support the Cartesian join + - Support the `LEFT()` and `RIGHT()` functions + - Support automatically invalidating stale Regions in MPP queries + - Support the `ABS()` function ## Bug Fixes + TiDB - - Fix the issue that an incorrect result is returned when using merge join on the `SET` types. [#25694](https://github.com/pingcap/tidb/pull/25694) - - Fix the `IN` expression arguments corruption issue. [#25666](https://github.com/pingcap/tidb/pull/25666) - - Avoid sessions of GC being affected by global variables [#25609](https://github.com/pingcap/tidb/pull/25609) - - Make sure limit outputs no more columns than its child [#25517](https://github.com/pingcap/tidb/pull/25517) - - Planner: fix a panic caused by sinking a Limit with inlined Proj into IndexLookUp when accessing a partition table [#25139](https://github.com/pingcap/tidb/pull/25139) - - Executor: fix ifnull bug when arg is enum/set [#25116](https://github.com/pingcap/tidb/pull/25116) - - Generate correct number of rows when all agg funcs are pruned [#25062](https://github.com/pingcap/tidb/pull/25062) - - Executor: make the ParallelApply be safe to be called again after returning empty results [#25011](https://github.com/pingcap/tidb/pull/25011) - - Fix the case that there could be duplicate ranges for multi-column index. [#24635](https://github.com/pingcap/tidb/pull/24635) - - Fix a nulleq bug [#24633](https://github.com/pingcap/tidb/pull/24633) - - Executor: fix data race of parallel apply operator [#24345](https://github.com/pingcap/tidb/pull/24345) - - Fix an issue that sorting on index-merge results in partition union reports 'index out of range'. [#24155](https://github.com/pingcap/tidb/pull/24155) - - Do not allow setting read timestamp to a future time. [#25761](https://github.com/pingcap/tidb/pull/25761) - - Fix the issue that ODBC-styled literal(like `{d '2020-01-01'}`...) cannot be used as the expression. [#25577](https://github.com/pingcap/tidb/pull/25577) - - Planner: select distinct should bypass batchget [#25533](https://github.com/pingcap/tidb/pull/25533) - - Store/tikv: change backoff type for missed tiflash peer. [#24600](https://github.com/pingcap/tidb/pull/24600) - - Fix index-out-of-range error when checking only_full_group_by [#24016](https://github.com/pingcap/tidb/pull/24016) + - Fix the issue that an incorrect result is returned when using merge join on the `SET` type column [#25694](https://github.com/pingcap/tidb/pull/25694) + - Fix the data corruption issue in the `IN` expression's arguments [#25666](https://github.com/pingcap/tidb/pull/25666) + - Avoid the sessions of GC being affected by global variables [#25609](https://github.com/pingcap/tidb/pull/25609) + - Fix the panic issue that occurs when using `limit` in the window function queries [#25517](https://github.com/pingcap/tidb/pull/25517) + - Fix the wrong value returned when querying a partitioned table using `Limit` [#25139](https://github.com/pingcap/tidb/pull/25139) + - Fix the issue that `IFNULL` does not correctly take effect on the `ENUM` or `SET` type column [#25116](https://github.com/pingcap/tidb/pull/25116) + - Fix the wrong results caused by changing the `count` in the join subqueries to `first_row` [#25062](https://github.com/pingcap/tidb/pull/25062) + - Fix the query hang issue that occurs when `ParallelApply` is used under the `TopN` operator [#25011](https://github.com/pingcap/tidb/pull/25011) + - Fix the issue that more results than expected are returned when executing SQL statements using multi-column prefix indexes [#24635](https://github.com/pingcap/tidb/pull/24635) + - Fix the issue that the `<=>` operator cannot correctly take effect [#24633](https://github.com/pingcap/tidb/pull/24633) + - Fix the data race issue of the parallel `Apply` operator [#24345](https://github.com/pingcap/tidb/pull/24345) + ?- Fix the issue that the sorting on `IndexMerge` results in the partition union reports the `index out of range` error [#24155](https://github.com/pingcap/tidb/pull/24155) + - Do not allow setting a read timestamp to a future time [#25761](https://github.com/pingcap/tidb/pull/25761) + - Fix the issue that the ODBC-styled constant (for example, `{d '2020-01-01'}`) cannot be used as the expression [#25577](https://github.com/pingcap/tidb/pull/25577) + - Fix the issue that `SELECT DISTINCT` converted to `Batch Get` causes incorrect results [#25533](https://github.com/pingcap/tidb/pull/25533) + - Fix the issue that backing off queries from TiFlash to TiKV cannot be triggered [#24600](https://github.com/pingcap/tidb/pull/24600) + - Fix the `index-out-of-range` error that occurs when checking `only_full_group_by` [#24016](https://github.com/pingcap/tidb/pull/24016) + TiKV - - Fix wrong tikv_raftstore_hibernated_peer_state metric [#10431](https://github.com/tikv/tikv/pull/10431) - - Copr: fix the wrong arguments type of json_unquote [#10424](https://github.com/tikv/tikv/pull/10424) - - Fix the issue that br reports file already exists error when TDE enabled during restoration [#10421](https://github.com/tikv/tikv/pull/10421) + - Fix the wrong `tikv_raftstore_hibernated_peer_state` metric [#10431](https://github.com/tikv/tikv/pull/10431) + - Fix the wrong arguments type of the `json_unquote()` function in the coprocessor [#10424](https://github.com/tikv/tikv/pull/10424) + - Fix the issue that Backup & Restore reports the error of "file already exists" when TDE is enabled during the restore [#10421](https://github.com/tikv/tikv/pull/10421) - Skip clearing callback during graceful shutdown to avoid breaking ACID in some cases [#10396](https://github.com/tikv/tikv/pull/10396) - - Fix the bug that share read index for replica reads on a leader [#10391](https://github.com/tikv/tikv/pull/10391) - - Copr: fix wrong function cast double to double [#10388](https://github.com/tikv/tikv/pull/10388) + - Fix a bug that the read index is shared for replica reads on a Leader [#10391](https://github.com/tikv/tikv/pull/10391) + - Fix the wrong function that casts `DOUBLE` to `DOUBLE` [#10388](https://github.com/tikv/tikv/pull/10388) + TiFlash - - Fix the issue that TiFlash keeps restarting because of split failure - - Fix the potential issue that TiFlash can not GC delta data - - Fix the bug that TiFlash adds wrong padding for non-binary chars in `CAST` function + - Fix the issue that TiFlash keeps restarting because of the split failure + ?- Fix the potential issue that TiFlash cannot GC delta data + - Fix a bug that TiFlash adds wrong padding for non-binary characters in the `CAST` function - Fix the issue of incorrect results when handling aggregation queries with complex `GROUP BY` columns - Fix the TiFlash panic issue that occurs under heavy write pressure - - Fix the panic that occurs when right join if the right jon key is not nullalbe and the left join key is nullable - - Fix the potential issue that read-index requests cost long time + - Fix the panic that occurs when the right jon key is not nullalbe and the left join key is nullable + - Fix the potential issue that the `read-index` requests take a long time + Tools From be6e562d77c43a43b2f838246dd239e2e9254e7f Mon Sep 17 00:00:00 2001 From: TomShawn <41534398+TomShawn@users.noreply.github.com> Date: Tue, 29 Jun 2021 18:07:49 +0800 Subject: [PATCH 10/26] add tools notes --- releases/release-5.0.3.md | 54 ++++++++++++++++++++++++--------------- 1 file changed, 33 insertions(+), 21 deletions(-) diff --git a/releases/release-5.0.3.md b/releases/release-5.0.3.md index be0fb45c7c9d5..fd509a3afd1e5 100644 --- a/releases/release-5.0.3.md +++ b/releases/release-5.0.3.md @@ -8,10 +8,16 @@ Release date: June 30, 2021 TiDB version: 5.0.3 -## Compatibility Changes - ## New Features ++ Tools + + + TiCDC + + - Add an HTTP API to get the changefeed information and the health information of the node [#1955](https://github.com/pingcap/ticdc/pull/1955) + - Add the SASL/SCRAM support for the kafka sink [#1942](https://github.com/pingcap/ticdc/pull/1942) + - Makes TiCDC support `--data-dir` at the server level [#2070](https://github.com/pingcap/ticdc/pull/2070) + ## Improvements + TiDB @@ -36,6 +42,10 @@ TiDB version: 5.0.3 - Limit the TiCDC sink's memory consumption [#10305](https://github.com/tikv/tikv/pull/10305) - Add the memory-bounded upper limit for the TiCDC old value cache [#10313](https://github.com/tikv/tikv/pull/10313) ++ PD + + - Update TiDB Dashboard to v2021.06.15.1 [#3798](https://github.com/pingcap/pd/pull/3798) + + TiFlash - Support casting the `STRING` type to the `DOUBLE` type @@ -46,6 +56,13 @@ TiDB version: 5.0.3 - Support automatically invalidating stale Regions in MPP queries - Support the `ABS()` function ++ Tools + + + TiCDC + + - Refine gRPC's reconnection logic and increase the KV client's throughput [#1922](https://github.com/pingcap/ticdc/pull/1922) + - Make the sorter I/O errors more user-friendly [#1977](https://github.com/pingcap/ticdc/pull/1977) + ## Bug Fixes + TiDB @@ -89,27 +106,22 @@ TiDB version: 5.0.3 + Tools - - BR + + TiCDC - * Fix parquet parse when parse decimal type [#1277](https://github.com/pingcap/br/pull/1277) - * Fix the bug that lightning returns EOF error when CSV file without '\r\n' at the last line and `strict-format = true` [#1189](https://github.com/pingcap/br/pull/1189) - * Fix the bug that lightning rebase wrong auto_increment base when the auto_increment field type is float or double [#1186](https://github.com/pingcap/br/pull/1186) + - Fix the issue that TiCDC owner exits when refreshing the checkpoint [#2031](https://github.com/pingcap/ticdc/pull/2031) + - Fix a bug that some MySQL connection might leak after MySQL sink meets the error and pauses [#1946](https://github.com/pingcap/ticdc/pull/1946) + - Fix the panic issue that occurs when TiCDC fails to read `/proc/meminfo` [#2024](https://github.com/pingcap/ticdc/pull/2024) + - Reduce TiCDC's runtime memory consumption [#2012](https://github.com/pingcap/ticdc/pull/2012), [#1958](https://github.com/pingcap/ticdc/pull/1958) + - Fix a bug that might cause TiCDC server panic due to the late calculation of resolved ts [#2047](https://github.com/pingcap/ticdc/pull/2047) + - Fix the potential deadlock issue for the processor [#2142](https://github.com/pingcap/ticdc/pull/2142) -## 以下 note 未分类。请将以下 note 进行分类 (New feature, Improvements, Bug fixes, Compatibility Changes 四类)，并移动到上面对应的标题下。如果某条 note 为多余的，请删除。如果漏抓取了 note，请手动补充 + + Backup & Restore (BR) -+ PD - - - release-note [#3798](https://github.com/pingcap/pd/pull/3798) - -+ Tools + - Fix a bug that all system tables are filtered during restore [#1224](https://github.com/pingcap/br/pull/1224) - - TiCDC + + TiDB Lightning - * Fix potential deadlocks [#2142](https://github.com/pingcap/ticdc/pull/2142) - * Fix a bug that could cause cdc server panic because of the late calculation of resolved ts [#2047](https://github.com/pingcap/ticdc/pull/2047) - * Fix panic when TiCDC fails to read `/proc/meminfo` [#2024](https://github.com/pingcap/ticdc/pull/2024) - * Reduce unnecessary memory consumption [#2012](https://github.com/pingcap/ticdc/pull/2012) - * Make sorter IO errors more user-friendly. [#1977](https://github.com/pingcap/ticdc/pull/1977) - * Fix Unified Sorter memory consumption when tables are many. [#1958](https://github.com/pingcap/ticdc/pull/1958) - * Decrease the default gRPC connection pool size to decrease goroutines count. [#1951](https://github.com/pingcap/ticdc/pull/1951) - * Fix a bug that some MySQL connection could leak after MySQL sink meets error and pauses. [#1946](https://github.com/pingcap/ticdc/pull/1946) + - Fix the TiDB Lightning panic issue for some special data [#1268](https://github.com/pingcap/br/pull/1268) + - Fix the EOF error reported when TiDB Lightning splits the imported large CSV files [#1189](https://github.com/pingcap/br/pull/1189) + ?- Fix a bug that TiDB Lightning rebase wrong `auto_increment` base when the `auto_increment` field type is `FLOAT` or `DOUBLE` [#1186](https://github.com/pingcap/br/pull/1186) + - Fix the issue that TiDB fails to parse the `DECIMAL` type data in Parquet files [#1277](https://github.com/pingcap/br/pull/1277) From a7d7be57b0cb158f9acb01c33dae452a80b77f08 Mon Sep 17 00:00:00 2001 From: TomShawn <41534398+TomShawn@users.noreply.github.com> Date: Tue, 29 Jun 2021 19:22:17 +0800 Subject: [PATCH 11/26] Apply suggestions from code review --- releases/release-5.0.3.md | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git a/releases/release-5.0.3.md b/releases/release-5.0.3.md index fd509a3afd1e5..19e97f168c5c6 100644 --- a/releases/release-5.0.3.md +++ b/releases/release-5.0.3.md @@ -78,7 +78,7 @@ TiDB version: 5.0.3 - Fix the issue that more results than expected are returned when executing SQL statements using multi-column prefix indexes [#24635](https://github.com/pingcap/tidb/pull/24635) - Fix the issue that the `<=>` operator cannot correctly take effect [#24633](https://github.com/pingcap/tidb/pull/24633) - Fix the data race issue of the parallel `Apply` operator [#24345](https://github.com/pingcap/tidb/pull/24345) - ?- Fix the issue that the sorting on `IndexMerge` results in the partition union reports the `index out of range` error [#24155](https://github.com/pingcap/tidb/pull/24155) + - Fix the issue that the `index out of range` error is reported when sorting the IndexMerge results of the PartitionUnion operator [#24155](https://github.com/pingcap/tidb/pull/24155) - Do not allow setting a read timestamp to a future time [#25761](https://github.com/pingcap/tidb/pull/25761) - Fix the issue that the ODBC-styled constant (for example, `{d '2020-01-01'}`) cannot be used as the expression [#25577](https://github.com/pingcap/tidb/pull/25577) - Fix the issue that `SELECT DISTINCT` converted to `Batch Get` causes incorrect results [#25533](https://github.com/pingcap/tidb/pull/25533) @@ -97,7 +97,7 @@ TiDB version: 5.0.3 + TiFlash - Fix the issue that TiFlash keeps restarting because of the split failure - ?- Fix the potential issue that TiFlash cannot GC delta data + - Fix the potential issue that TiFlash cannot delete the delta data - Fix a bug that TiFlash adds wrong padding for non-binary characters in the `CAST` function - Fix the issue of incorrect results when handling aggregation queries with complex `GROUP BY` columns - Fix the TiFlash panic issue that occurs under heavy write pressure From 05d45be8206150e3e42d2ed329acbce3edd20f56 Mon Sep 17 00:00:00 2001 From: TomShawn <41534398+TomShawn@users.noreply.github.com> Date: Thu, 1 Jul 2021 11:46:06 +0800 Subject: [PATCH 12/26] Apply suggestions from code review Co-authored-by: tangenta Co-authored-by: JaySon --- releases/release-5.0.3.md | 8 ++++++-- 1 file changed, 6 insertions(+), 2 deletions(-) diff --git a/releases/release-5.0.3.md b/releases/release-5.0.3.md index 19e97f168c5c6..c6ab14810d9be 100644 --- a/releases/release-5.0.3.md +++ b/releases/release-5.0.3.md @@ -27,7 +27,7 @@ TiDB version: 5.0.3 - Support removing the union branch from the dual table [#25614](https://github.com/pingcap/tidb/pull/25614) - Support pushing down the built-in function `replace()` to TiFlash [#25565](https://github.com/pingcap/tidb/pull/25565) - Support pushing down the built-in functions `unix_timestamp()`, `concat()`, `year()`, `day()`, `datediff()`, `datesub()`, `castTimeAsString()`, and `concat_ws()` to TiFlash [#25564](https://github.com/pingcap/tidb/pull/25564) - - Change the aggregate operator's cost factor [#25241](https://github.com/pingcap/tidb/pull/25241) + - Optimize the aggregate operator's cost factor [#25241](https://github.com/pingcap/tidb/pull/25241) - Support pushing down the `Limit` operator to TiFlash [#25159](https://github.com/pingcap/tidb/pull/25159) - Support pushing down the built-in function `str_to_date` to TiFlash [#25148](https://github.com/pingcap/tidb/pull/25148) - Allow the MPP outer join to choose the build table based on the table row count [#25142](https://github.com/pingcap/tidb/pull/25142) @@ -36,6 +36,7 @@ TiDB version: 5.0.3 - Support pushing down the `Union All` operator to TiFlash [#25051](https://github.com/pingcap/tidb/pull/25051) - Support balancing the MPP query workload among different TiFlash nodes based on Regions [#24724](https://github.com/pingcap/tidb/pull/24724) - Support invalidating stale Regions in the cache after the MPP query is executed [#24432](https://github.com/pingcap/tidb/pull/24432) + - Improve the MySQL compatibility of the built-in function `str_to_date` for the format specifiers `%b/%M/%r/%T` [#25767](https://github.com/pingcap/tidb/pull/25767) + TiKV @@ -84,6 +85,8 @@ TiDB version: 5.0.3 - Fix the issue that `SELECT DISTINCT` converted to `Batch Get` causes incorrect results [#25533](https://github.com/pingcap/tidb/pull/25533) - Fix the issue that backing off queries from TiFlash to TiKV cannot be triggered [#24600](https://github.com/pingcap/tidb/pull/24600) - Fix the `index-out-of-range` error that occurs when checking `only_full_group_by` [#24016](https://github.com/pingcap/tidb/pull/24016) + - Fix the issue that queries with `TABLESAMPLE` on an empty table returns unexpected rows [#25795](https://github.com/pingcap/tidb/pull/25795) + - Fix the issue that the result of index join in correlated subqueries is wrong [#25818](https://github.com/pingcap/tidb/pull/25818) + TiKV @@ -103,6 +106,7 @@ TiDB version: 5.0.3 - Fix the TiFlash panic issue that occurs under heavy write pressure - Fix the panic that occurs when the right jon key is not nullalbe and the left join key is nullable - Fix the potential issue that the `read-index` requests take a long time + - Fix the panic issue that occurs when the read load is heavy + Tools @@ -123,5 +127,5 @@ TiDB version: 5.0.3 - Fix the TiDB Lightning panic issue for some special data [#1268](https://github.com/pingcap/br/pull/1268) - Fix the EOF error reported when TiDB Lightning splits the imported large CSV files [#1189](https://github.com/pingcap/br/pull/1189) - ?- Fix a bug that TiDB Lightning rebase wrong `auto_increment` base when the `auto_increment` field type is `FLOAT` or `DOUBLE` [#1186](https://github.com/pingcap/br/pull/1186) + - Fix a bug that an excessively large base value is generated when TiDB Lightning imports tables with the `auto_increment` column of the `FLOAT` or `DOUBLE` type [#1186](https://github.com/pingcap/br/pull/1186) - Fix the issue that TiDB fails to parse the `DECIMAL` type data in Parquet files [#1277](https://github.com/pingcap/br/pull/1277) From d0d801e6c947d494ef1a2848b33f1bd7854856d1 Mon Sep 17 00:00:00 2001 From: TomShawn <41534398+TomShawn@users.noreply.github.com> Date: Thu, 1 Jul 2021 11:46:54 +0800 Subject: [PATCH 13/26] Update releases/release-5.0.3.md --- releases/release-5.0.3.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/releases/release-5.0.3.md b/releases/release-5.0.3.md index c6ab14810d9be..c52e3c8c5991d 100644 --- a/releases/release-5.0.3.md +++ b/releases/release-5.0.3.md @@ -4,7 +4,7 @@ title: TiDB 5.0.3 Release Notes # TiDB 5.0.3 Release Notes -Release date: June 30, 2021 +Release date: July 2, 2021 TiDB version: 5.0.3 From 1cd345712be97109a55f672adbd1b6c03e776537 Mon Sep 17 00:00:00 2001 From: TomShawn <41534398+TomShawn@users.noreply.github.com> Date: Thu, 1 Jul 2021 14:24:54 +0800 Subject: [PATCH 14/26] Update releases/release-5.0.3.md Co-authored-by: tangenta --- releases/release-5.0.3.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/releases/release-5.0.3.md b/releases/release-5.0.3.md index c52e3c8c5991d..1d80f036e24d6 100644 --- a/releases/release-5.0.3.md +++ b/releases/release-5.0.3.md @@ -26,7 +26,7 @@ TiDB version: 5.0.3 - Support pushing down the built-in function `json_unquote()` to TiKV [#25720](https://github.com/pingcap/tidb/pull/25720) - Support removing the union branch from the dual table [#25614](https://github.com/pingcap/tidb/pull/25614) - Support pushing down the built-in function `replace()` to TiFlash [#25565](https://github.com/pingcap/tidb/pull/25565) - - Support pushing down the built-in functions `unix_timestamp()`, `concat()`, `year()`, `day()`, `datediff()`, `datesub()`, `castTimeAsString()`, and `concat_ws()` to TiFlash [#25564](https://github.com/pingcap/tidb/pull/25564) + - Support pushing down the built-in functions `unix_timestamp()`, `concat()`, `year()`, `day()`, `datediff()`, `datesub()`, and `concat_ws()` to TiFlash [#25564](https://github.com/pingcap/tidb/pull/25564) - Optimize the aggregate operator's cost factor [#25241](https://github.com/pingcap/tidb/pull/25241) - Support pushing down the `Limit` operator to TiFlash [#25159](https://github.com/pingcap/tidb/pull/25159) - Support pushing down the built-in function `str_to_date` to TiFlash [#25148](https://github.com/pingcap/tidb/pull/25148) From 191a869f724ec87e7819df07624acba8ea4fedac Mon Sep 17 00:00:00 2001 From: TomShawn <41534398+TomShawn@users.noreply.github.com> Date: Thu, 1 Jul 2021 15:32:42 +0800 Subject: [PATCH 15/26] Update releases/release-5.0.3.md Co-authored-by: ShuNing --- releases/release-5.0.3.md | 6 ++++++ 1 file changed, 6 insertions(+) diff --git a/releases/release-5.0.3.md b/releases/release-5.0.3.md index 1d80f036e24d6..1aaeb979e467b 100644 --- a/releases/release-5.0.3.md +++ b/releases/release-5.0.3.md @@ -96,6 +96,12 @@ TiDB version: 5.0.3 - Skip clearing callback during graceful shutdown to avoid breaking ACID in some cases [#10396](https://github.com/tikv/tikv/pull/10396) - Fix a bug that the read index is shared for replica reads on a Leader [#10391](https://github.com/tikv/tikv/pull/10391) - Fix the wrong function that casts `DOUBLE` to `DOUBLE` [#10388](https://github.com/tikv/tikv/pull/10388) ++ PD + + - Fix the data race issue that occurs when loading TTL configurations after the scheduler is started [#3774](https://github.com/tikv/pd/pull/3774) + - Fix a bug that the `is_learner` field of the `TIKV_REGION_PEERS` table in TiDB is incorrect [#3743](https://github.com/tikv/pd/pull/3743) + - Fix the issue that when all TiKV nodes in a zone are offline or down, PD does not schedule replicas to other zones [#3742](https://github.com/tikv/pd/pull/3742) + - Fix the issue that PD might get panic after the scatter Region scheduler is added [#3762](https://github.com/tikv/pd/pull/3762) + TiFlash From 948a60275833c63d6ed59f368c9861146febe2cc Mon Sep 17 00:00:00 2001 From: TomShawn <41534398+TomShawn@users.noreply.github.com> Date: Thu, 1 Jul 2021 16:24:52 +0800 Subject: [PATCH 16/26] change pr to issue in bug fix section --- releases/release-5.0.3.md | 64 +++++++++++++++++++-------------------- 1 file changed, 32 insertions(+), 32 deletions(-) diff --git a/releases/release-5.0.3.md b/releases/release-5.0.3.md index 1aaeb979e467b..6b2206eacad05 100644 --- a/releases/release-5.0.3.md +++ b/releases/release-5.0.3.md @@ -68,39 +68,39 @@ TiDB version: 5.0.3 + TiDB - - Fix the issue that an incorrect result is returned when using merge join on the `SET` type column [#25694](https://github.com/pingcap/tidb/pull/25694) - - Fix the data corruption issue in the `IN` expression's arguments [#25666](https://github.com/pingcap/tidb/pull/25666) - - Avoid the sessions of GC being affected by global variables [#25609](https://github.com/pingcap/tidb/pull/25609) - - Fix the panic issue that occurs when using `limit` in the window function queries [#25517](https://github.com/pingcap/tidb/pull/25517) - - Fix the wrong value returned when querying a partitioned table using `Limit` [#25139](https://github.com/pingcap/tidb/pull/25139) - - Fix the issue that `IFNULL` does not correctly take effect on the `ENUM` or `SET` type column [#25116](https://github.com/pingcap/tidb/pull/25116) - - Fix the wrong results caused by changing the `count` in the join subqueries to `first_row` [#25062](https://github.com/pingcap/tidb/pull/25062) - - Fix the query hang issue that occurs when `ParallelApply` is used under the `TopN` operator [#25011](https://github.com/pingcap/tidb/pull/25011) - - Fix the issue that more results than expected are returned when executing SQL statements using multi-column prefix indexes [#24635](https://github.com/pingcap/tidb/pull/24635) - - Fix the issue that the `<=>` operator cannot correctly take effect [#24633](https://github.com/pingcap/tidb/pull/24633) - - Fix the data race issue of the parallel `Apply` operator [#24345](https://github.com/pingcap/tidb/pull/24345) - - Fix the issue that the `index out of range` error is reported when sorting the IndexMerge results of the PartitionUnion operator [#24155](https://github.com/pingcap/tidb/pull/24155) + - Fix the issue that an incorrect result is returned when using merge join on the `SET` type column [#25669](https://github.com/pingcap/tidb/issues/25669) + - Fix the data corruption issue in the `IN` expression's arguments [#25591](https://github.com/pingcap/tidb/issues/25591) + - Avoid the sessions of GC being affected by global variables [#24976](https://github.com/pingcap/tidb/issues/24976) + - Fix the panic issue that occurs when using `limit` in the window function queries [#25344](https://github.com/pingcap/tidb/issues/25344) + - Fix the wrong value returned when querying a partitioned table using `Limit` [#24636](https://github.com/pingcap/tidb/issues/24636) + - Fix the issue that `IFNULL` does not correctly take effect on the `ENUM` or `SET` type column [#24944](https://github.com/pingcap/tidb/issues/24944) + - Fix the wrong results caused by changing the `count` in the join subqueries to `first_row` [#24865](https://github.com/pingcap/tidb/issues/24865) + - Fix the query hang issue that occurs when `ParallelApply` is used under the `TopN` operator [#24930](https://github.com/pingcap/tidb/issues/24930) + - Fix the issue that more results than expected are returned when executing SQL statements using multi-column prefix indexes [#24356](https://github.com/pingcap/tidb/issues/24356) + - Fix the issue that the `<=>` operator cannot correctly take effect [#24477](https://github.com/pingcap/tidb/issues/24477) + - Fix the data race issue of the parallel `Apply` operator [#23280](https://github.com/pingcap/tidb/issues/23280) + - Fix the issue that the `index out of range` error is reported when sorting the IndexMerge results of the PartitionUnion operator [#23919](https://github.com/pingcap/tidb/issues/23919) - Do not allow setting a read timestamp to a future time [#25761](https://github.com/pingcap/tidb/pull/25761) - - Fix the issue that the ODBC-styled constant (for example, `{d '2020-01-01'}`) cannot be used as the expression [#25577](https://github.com/pingcap/tidb/pull/25577) - - Fix the issue that `SELECT DISTINCT` converted to `Batch Get` causes incorrect results [#25533](https://github.com/pingcap/tidb/pull/25533) + - Fix the issue that the ODBC-styled constant (for example, `{d '2020-01-01'}`) cannot be used as the expression [#25531](https://github.com/pingcap/tidb/issues/25531) + - Fix the issue that `SELECT DISTINCT` converted to `Batch Get` causes incorrect results [#25320](https://github.com/pingcap/tidb/issues/25320) - Fix the issue that backing off queries from TiFlash to TiKV cannot be triggered [#24600](https://github.com/pingcap/tidb/pull/24600) - - Fix the `index-out-of-range` error that occurs when checking `only_full_group_by` [#24016](https://github.com/pingcap/tidb/pull/24016) - - Fix the issue that queries with `TABLESAMPLE` on an empty table returns unexpected rows [#25795](https://github.com/pingcap/tidb/pull/25795) - - Fix the issue that the result of index join in correlated subqueries is wrong [#25818](https://github.com/pingcap/tidb/pull/25818) + - Fix the `index-out-of-range` error that occurs when checking `only_full_group_by` [#23839](https://github.com/pingcap/tidb/issues/23839)) + - Fix the issue that queries with `TABLESAMPLE` on an empty table returns unexpected rows [#25257](https://github.com/pingcap/tidb/issues/25257) + - Fix the issue that the result of index join in correlated subqueries is wrong [#25799](https://github.com/pingcap/tidb/issues/25799) + TiKV - - Fix the wrong `tikv_raftstore_hibernated_peer_state` metric [#10431](https://github.com/tikv/tikv/pull/10431) - - Fix the wrong arguments type of the `json_unquote()` function in the coprocessor [#10424](https://github.com/tikv/tikv/pull/10424) - - Fix the issue that Backup & Restore reports the error of "file already exists" when TDE is enabled during the restore [#10421](https://github.com/tikv/tikv/pull/10421) - - Skip clearing callback during graceful shutdown to avoid breaking ACID in some cases [#10396](https://github.com/tikv/tikv/pull/10396) - - Fix a bug that the read index is shared for replica reads on a Leader [#10391](https://github.com/tikv/tikv/pull/10391) - - Fix the wrong function that casts `DOUBLE` to `DOUBLE` [#10388](https://github.com/tikv/tikv/pull/10388) + - Fix the wrong `tikv_raftstore_hibernated_peer_state` metric [#10330](https://github.com/tikv/tikv/issues/10330) + - Fix the wrong arguments type of the `json_unquote()` function in the coprocessor [#10176](https://github.com/tikv/tikv/issues/10176) + - Fix the issue that Backup & Restore reports the error of "file already exists" when TDE is enabled during the restore [#1179](https://github.com/pingcap/br/issues/1179) + - Skip clearing callback during graceful shutdown to avoid breaking ACID in some cases [#10353](https://github.com/tikv/tikv/issues/10353) [#10307](https://github.com/tikv/tikv/issues/10307) + - Fix a bug that the read index is shared for replica reads on a Leader [#10347](https://github.com/tikv/tikv/issues/10347) + - Fix the wrong function that casts `DOUBLE` to `DOUBLE` [#25200](https://github.com/pingcap/tidb/issues/25200) + PD - - Fix the data race issue that occurs when loading TTL configurations after the scheduler is started [#3774](https://github.com/tikv/pd/pull/3774) - - Fix a bug that the `is_learner` field of the `TIKV_REGION_PEERS` table in TiDB is incorrect [#3743](https://github.com/tikv/pd/pull/3743) - - Fix the issue that when all TiKV nodes in a zone are offline or down, PD does not schedule replicas to other zones [#3742](https://github.com/tikv/pd/pull/3742) + - Fix the data race issue that occurs when loading TTL configurations after the scheduler is started [#3771](https://github.com/tikv/pd/issues/3771) + - Fix a bug that the `is_learner` field of the `TIKV_REGION_PEERS` table in TiDB is incorrect [#3372](https://github.com/tikv/pd/issues/3372) [#24293](https://github.com/pingcap/tidb/issues/24293) + - Fix the issue that when all TiKV nodes in a zone are offline or down, PD does not schedule replicas to other zones [#3705](https://github.com/tikv/pd/issues/3705) - Fix the issue that PD might get panic after the scatter Region scheduler is added [#3762](https://github.com/tikv/pd/pull/3762) + TiFlash @@ -118,20 +118,20 @@ TiDB version: 5.0.3 + TiCDC - - Fix the issue that TiCDC owner exits when refreshing the checkpoint [#2031](https://github.com/pingcap/ticdc/pull/2031) + - Fix the issue that TiCDC owner exits when refreshing the checkpoint [#1902](https://github.com/pingcap/ticdc/issues/1902) - Fix a bug that some MySQL connection might leak after MySQL sink meets the error and pauses [#1946](https://github.com/pingcap/ticdc/pull/1946) - Fix the panic issue that occurs when TiCDC fails to read `/proc/meminfo` [#2024](https://github.com/pingcap/ticdc/pull/2024) - - Reduce TiCDC's runtime memory consumption [#2012](https://github.com/pingcap/ticdc/pull/2012), [#1958](https://github.com/pingcap/ticdc/pull/1958) - - Fix a bug that might cause TiCDC server panic due to the late calculation of resolved ts [#2047](https://github.com/pingcap/ticdc/pull/2047) + - Reduce TiCDC's runtime memory consumption [#2012](https://github.com/pingcap/ticdc/pull/2012) [#1958](https://github.com/pingcap/ticdc/pull/1958) + - Fix a bug that might cause TiCDC server panic due to the late calculation of resolved ts [#1576](https://github.com/pingcap/ticdc/issues/1576) - Fix the potential deadlock issue for the processor [#2142](https://github.com/pingcap/ticdc/pull/2142) + Backup & Restore (BR) - - Fix a bug that all system tables are filtered during restore [#1224](https://github.com/pingcap/br/pull/1224) + - Fix a bug that all system tables are filtered during restore [#1197](https://github.com/pingcap/br/issues/1197) [#1201](https://github.com/pingcap/br/issues/1201) + TiDB Lightning - - Fix the TiDB Lightning panic issue for some special data [#1268](https://github.com/pingcap/br/pull/1268) - - Fix the EOF error reported when TiDB Lightning splits the imported large CSV files [#1189](https://github.com/pingcap/br/pull/1189) + - Fix the TiDB Lightning panic issue for some special data [#1213](https://github.com/pingcap/br/issues/1213) + - Fix the EOF error reported when TiDB Lightning splits the imported large CSV files [#1133](https://github.com/pingcap/br/issues/1133) - Fix a bug that an excessively large base value is generated when TiDB Lightning imports tables with the `auto_increment` column of the `FLOAT` or `DOUBLE` type [#1186](https://github.com/pingcap/br/pull/1186) - Fix the issue that TiDB fails to parse the `DECIMAL` type data in Parquet files [#1277](https://github.com/pingcap/br/pull/1277) From 52550caae51284b0994bfa12a5425b52e34dd2b6 Mon Sep 17 00:00:00 2001 From: TomShawn <41534398+TomShawn@users.noreply.github.com> Date: Thu, 1 Jul 2021 17:55:24 +0800 Subject: [PATCH 17/26] address comments from alex-quan and bb7133 --- releases/release-5.0.3.md | 13 +++++++------ 1 file changed, 7 insertions(+), 6 deletions(-) diff --git a/releases/release-5.0.3.md b/releases/release-5.0.3.md index 6b2206eacad05..2cb9c75c543b7 100644 --- a/releases/release-5.0.3.md +++ b/releases/release-5.0.3.md @@ -8,7 +8,7 @@ Release date: July 2, 2021 TiDB version: 5.0.3 -## New Features +## Feature Enhancements + Tools @@ -61,8 +61,8 @@ TiDB version: 5.0.3 + TiCDC - - Refine gRPC's reconnection logic and increase the KV client's throughput [#1922](https://github.com/pingcap/ticdc/pull/1922) - - Make the sorter I/O errors more user-friendly [#1977](https://github.com/pingcap/ticdc/pull/1977) + - Refine gRPC's reconnection logic and increase the KV client's throughput [#1586](https://github.com/pingcap/ticdc/issues/1586) [#1501](https://github.com/pingcap/ticdc/issues/1501#issuecomment-820027078) [#1682](https://github.com/pingcap/ticdc/pull/1682) [#1393](https://github.com/pingcap/ticdc/issues/1393) [#184s7](https://github.com/pingcap/ticdc/pull/1847) [#1905](https://github.com/pingcap/ticdc/issues/1905) [#1904](https://github.com/pingcap/ticdc/issues/1904) + - Make the sorter I/O errors more user-friendly ## Bug Fixes @@ -80,10 +80,10 @@ TiDB version: 5.0.3 - Fix the issue that the `<=>` operator cannot correctly take effect [#24477](https://github.com/pingcap/tidb/issues/24477) - Fix the data race issue of the parallel `Apply` operator [#23280](https://github.com/pingcap/tidb/issues/23280) - Fix the issue that the `index out of range` error is reported when sorting the IndexMerge results of the PartitionUnion operator [#23919](https://github.com/pingcap/tidb/issues/23919) - - Do not allow setting a read timestamp to a future time [#25761](https://github.com/pingcap/tidb/pull/25761) + - Fix the issue that setting the `tidb_snapshot` variable to an unexpectedly large value might damage the transaction isolation [25680](https://github.com/pingcap/tidb/issues/25680) - Fix the issue that the ODBC-styled constant (for example, `{d '2020-01-01'}`) cannot be used as the expression [#25531](https://github.com/pingcap/tidb/issues/25531) - Fix the issue that `SELECT DISTINCT` converted to `Batch Get` causes incorrect results [#25320](https://github.com/pingcap/tidb/issues/25320) - - Fix the issue that backing off queries from TiFlash to TiKV cannot be triggered [#24600](https://github.com/pingcap/tidb/pull/24600) + - Fix the issue that backing off queries from TiFlash to TiKV cannot be triggered [#23665](https://github.com/pingcap/tidb/issues/23665) [#24421](https://github.com/pingcap/tidb/issues/24421) - Fix the `index-out-of-range` error that occurs when checking `only_full_group_by` [#23839](https://github.com/pingcap/tidb/issues/23839)) - Fix the issue that queries with `TABLESAMPLE` on an empty table returns unexpected rows [#25257](https://github.com/pingcap/tidb/issues/25257) - Fix the issue that the result of index join in correlated subqueries is wrong [#25799](https://github.com/pingcap/tidb/issues/25799) @@ -92,7 +92,6 @@ TiDB version: 5.0.3 - Fix the wrong `tikv_raftstore_hibernated_peer_state` metric [#10330](https://github.com/tikv/tikv/issues/10330) - Fix the wrong arguments type of the `json_unquote()` function in the coprocessor [#10176](https://github.com/tikv/tikv/issues/10176) - - Fix the issue that Backup & Restore reports the error of "file already exists" when TDE is enabled during the restore [#1179](https://github.com/pingcap/br/issues/1179) - Skip clearing callback during graceful shutdown to avoid breaking ACID in some cases [#10353](https://github.com/tikv/tikv/issues/10353) [#10307](https://github.com/tikv/tikv/issues/10307) - Fix a bug that the read index is shared for replica reads on a Leader [#10347](https://github.com/tikv/tikv/issues/10347) - Fix the wrong function that casts `DOUBLE` to `DOUBLE` [#25200](https://github.com/pingcap/tidb/issues/25200) @@ -113,6 +112,7 @@ TiDB version: 5.0.3 - Fix the panic that occurs when the right jon key is not nullalbe and the left join key is nullable - Fix the potential issue that the `read-index` requests take a long time - Fix the panic issue that occurs when the read load is heavy + - Fix the panic issue that might occur when the `Date_Format` function is called with the `STRING` type argument and `NULL` values + Tools @@ -128,6 +128,7 @@ TiDB version: 5.0.3 + Backup & Restore (BR) - Fix a bug that all system tables are filtered during restore [#1197](https://github.com/pingcap/br/issues/1197) [#1201](https://github.com/pingcap/br/issues/1201) + - Fix the issue that Backup & Restore reports the error of "file already exists" when TDE is enabled during the restore [#1179](https://github.com/pingcap/br/issues/1179) + TiDB Lightning From 4938f2ac6911414f0fca0d57843a5f5522f23ece Mon Sep 17 00:00:00 2001 From: TomShawn <41534398+TomShawn@users.noreply.github.com> Date: Fri, 2 Jul 2021 13:29:29 +0800 Subject: [PATCH 18/26] add tidb_multi_stmt-mode note --- releases/release-5.0.3.md | 6 ++++++ 1 file changed, 6 insertions(+) diff --git a/releases/release-5.0.3.md b/releases/release-5.0.3.md index 2cb9c75c543b7..f5205ebbccb30 100644 --- a/releases/release-5.0.3.md +++ b/releases/release-5.0.3.md @@ -8,6 +8,12 @@ Release date: July 2, 2021 TiDB version: 5.0.3 +## Compatibility Change + ++ TiDB + + - After a v4.0 cluster is upgraded to v5.0 or a later version (dev or v5.1), the default value of the `tidb_multi_statement_mode` variable changes from `WARN` to `OFF` + ## Feature Enhancements + Tools From e8336b282c0031011af346cadf122f1b1c033e66 Mon Sep 17 00:00:00 2001 From: TomShawn <41534398+TomShawn@users.noreply.github.com> Date: Fri, 2 Jul 2021 15:10:22 +0800 Subject: [PATCH 19/26] Update releases/release-5.0.3.md Co-authored-by: Chunzhu Li --- releases/release-5.0.3.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/releases/release-5.0.3.md b/releases/release-5.0.3.md index f5205ebbccb30..4631ce8eb7df6 100644 --- a/releases/release-5.0.3.md +++ b/releases/release-5.0.3.md @@ -67,7 +67,7 @@ TiDB version: 5.0.3 + TiCDC - - Refine gRPC's reconnection logic and increase the KV client's throughput [#1586](https://github.com/pingcap/ticdc/issues/1586) [#1501](https://github.com/pingcap/ticdc/issues/1501#issuecomment-820027078) [#1682](https://github.com/pingcap/ticdc/pull/1682) [#1393](https://github.com/pingcap/ticdc/issues/1393) [#184s7](https://github.com/pingcap/ticdc/pull/1847) [#1905](https://github.com/pingcap/ticdc/issues/1905) [#1904](https://github.com/pingcap/ticdc/issues/1904) + - Refine gRPC's reconnection logic and increase the KV client's throughput [#1586](https://github.com/pingcap/ticdc/issues/1586) [#1501](https://github.com/pingcap/ticdc/issues/1501#issuecomment-820027078) [#1682](https://github.com/pingcap/ticdc/pull/1682) [#1393](https://github.com/pingcap/ticdc/issues/1393) [#1847](https://github.com/pingcap/ticdc/pull/1847) [#1905](https://github.com/pingcap/ticdc/issues/1905) [#1904](https://github.com/pingcap/ticdc/issues/1904) - Make the sorter I/O errors more user-friendly ## Bug Fixes From 0087c4e747b0b537145a026bf3ad6d60a2938718 Mon Sep 17 00:00:00 2001 From: TomShawn <41534398+TomShawn@users.noreply.github.com> Date: Fri, 2 Jul 2021 15:11:21 +0800 Subject: [PATCH 20/26] Update releases/release-5.0.3.md --- releases/release-5.0.3.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/releases/release-5.0.3.md b/releases/release-5.0.3.md index 4631ce8eb7df6..cb514ec763532 100644 --- a/releases/release-5.0.3.md +++ b/releases/release-5.0.3.md @@ -29,7 +29,7 @@ TiDB version: 5.0.3 + TiDB - Support pushing down the `TopN` operator to TiFlash [#25162](https://github.com/pingcap/tidb/pull/25162) - - Support pushing down the built-in function `json_unquote()` to TiKV [#25720](https://github.com/pingcap/tidb/pull/25720) + - Support pushing down the built-in function `json_unquote()` to TiKV [#24415](https://github.com/pingcap/tidb/issues/24415) - Support removing the union branch from the dual table [#25614](https://github.com/pingcap/tidb/pull/25614) - Support pushing down the built-in function `replace()` to TiFlash [#25565](https://github.com/pingcap/tidb/pull/25565) - Support pushing down the built-in functions `unix_timestamp()`, `concat()`, `year()`, `day()`, `datediff()`, `datesub()`, and `concat_ws()` to TiFlash [#25564](https://github.com/pingcap/tidb/pull/25564) From e2291d1950fc5c78f38866a8417429884fb17bb0 Mon Sep 17 00:00:00 2001 From: TomShawn <41534398+TomShawn@users.noreply.github.com> Date: Fri, 2 Jul 2021 15:31:44 +0800 Subject: [PATCH 21/26] add innodb_default_row_format note --- releases/release-5.0.3.md | 1 + 1 file changed, 1 insertion(+) diff --git a/releases/release-5.0.3.md b/releases/release-5.0.3.md index cb514ec763532..b3d8740dc5803 100644 --- a/releases/release-5.0.3.md +++ b/releases/release-5.0.3.md @@ -13,6 +13,7 @@ TiDB version: 5.0.3 + TiDB - After a v4.0 cluster is upgraded to v5.0 or a later version (dev or v5.1), the default value of the `tidb_multi_statement_mode` variable changes from `WARN` to `OFF` + - TiDB is now compatible with MySQL 5.7's noop variable `innodb_default_row_format` [#23541](https://github.com/pingcap/tidb/issues/23541) ## Feature Enhancements From 80c44777d277f1a4cbc12eab5ae7e482659f5233 Mon Sep 17 00:00:00 2001 From: TomShawn <41534398+TomShawn@users.noreply.github.com> Date: Fri, 2 Jul 2021 15:32:20 +0800 Subject: [PATCH 22/26] Update releases/release-5.0.3.md --- releases/release-5.0.3.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/releases/release-5.0.3.md b/releases/release-5.0.3.md index b3d8740dc5803..2983d9ad2a45a 100644 --- a/releases/release-5.0.3.md +++ b/releases/release-5.0.3.md @@ -8,7 +8,7 @@ Release date: July 2, 2021 TiDB version: 5.0.3 -## Compatibility Change +## Compatibility Changes + TiDB From 751e8b7b86bff95caea79eb6ce35d2c6e88e8449 Mon Sep 17 00:00:00 2001 From: TomShawn <41534398+TomShawn@users.noreply.github.com> Date: Fri, 2 Jul 2021 15:55:37 +0800 Subject: [PATCH 23/26] Update release-5.0.3.md --- releases/release-5.0.3.md | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git a/releases/release-5.0.3.md b/releases/release-5.0.3.md index 2983d9ad2a45a..295629f7b0806 100644 --- a/releases/release-5.0.3.md +++ b/releases/release-5.0.3.md @@ -23,7 +23,7 @@ TiDB version: 5.0.3 - Add an HTTP API to get the changefeed information and the health information of the node [#1955](https://github.com/pingcap/ticdc/pull/1955) - Add the SASL/SCRAM support for the kafka sink [#1942](https://github.com/pingcap/ticdc/pull/1942) - - Makes TiCDC support `--data-dir` at the server level [#2070](https://github.com/pingcap/ticdc/pull/2070) + - Make TiCDC support `--data-dir` at the server level [#2070](https://github.com/pingcap/ticdc/pull/2070) ## Improvements @@ -87,7 +87,7 @@ TiDB version: 5.0.3 - Fix the issue that the `<=>` operator cannot correctly take effect [#24477](https://github.com/pingcap/tidb/issues/24477) - Fix the data race issue of the parallel `Apply` operator [#23280](https://github.com/pingcap/tidb/issues/23280) - Fix the issue that the `index out of range` error is reported when sorting the IndexMerge results of the PartitionUnion operator [#23919](https://github.com/pingcap/tidb/issues/23919) - - Fix the issue that setting the `tidb_snapshot` variable to an unexpectedly large value might damage the transaction isolation [25680](https://github.com/pingcap/tidb/issues/25680) + - Fix the issue that setting the `tidb_snapshot` variable to an unexpectedly large value might damage the transaction isolation [#25680](https://github.com/pingcap/tidb/issues/25680) - Fix the issue that the ODBC-styled constant (for example, `{d '2020-01-01'}`) cannot be used as the expression [#25531](https://github.com/pingcap/tidb/issues/25531) - Fix the issue that `SELECT DISTINCT` converted to `Batch Get` causes incorrect results [#25320](https://github.com/pingcap/tidb/issues/25320) - Fix the issue that backing off queries from TiFlash to TiKV cannot be triggered [#23665](https://github.com/pingcap/tidb/issues/23665) [#24421](https://github.com/pingcap/tidb/issues/24421) From d5bf23e4111b40ccfd1bdeba667999defa35209c Mon Sep 17 00:00:00 2001 From: TomShawn <41534398+TomShawn@users.noreply.github.com> Date: Fri, 2 Jul 2021 16:15:41 +0800 Subject: [PATCH 24/26] Update releases/release-5.0.3.md --- releases/release-5.0.3.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/releases/release-5.0.3.md b/releases/release-5.0.3.md index 295629f7b0806..702b6c499c38a 100644 --- a/releases/release-5.0.3.md +++ b/releases/release-5.0.3.md @@ -13,7 +13,7 @@ TiDB version: 5.0.3 + TiDB - After a v4.0 cluster is upgraded to v5.0 or a later version (dev or v5.1), the default value of the `tidb_multi_statement_mode` variable changes from `WARN` to `OFF` - - TiDB is now compatible with MySQL 5.7's noop variable `innodb_default_row_format` [#23541](https://github.com/pingcap/tidb/issues/23541) + - TiDB is now compatible with MySQL 5.7's noop variable `innodb_default_row_format`. Setting this variable will have no effect. [#23541](https://github.com/pingcap/tidb/issues/23541) ## Feature Enhancements From 5f7c23f5c4d17f9eee7d355c647fc9ee0b2bcb99 Mon Sep 17 00:00:00 2001 From: TomShawn <41534398+TomShawn@users.noreply.github.com> Date: Fri, 2 Jul 2021 18:15:20 +0800 Subject: [PATCH 25/26] Update releases/release-5.0.3.md MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit Co-authored-by: Daniël van Eeden --- releases/release-5.0.3.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/releases/release-5.0.3.md b/releases/release-5.0.3.md index 702b6c499c38a..fcd4706e33d90 100644 --- a/releases/release-5.0.3.md +++ b/releases/release-5.0.3.md @@ -57,7 +57,7 @@ TiDB version: 5.0.3 + TiFlash - Support casting the `STRING` type to the `DOUBLE` type - - Support the `STR_TO_DATE` function + - Support the `STR_TO_DATE()` function - Optimize the non-joined data in right outer join using multiple threads - Support the Cartesian join - Support the `LEFT()` and `RIGHT()` functions From 2af9249645963f4cac1c9ff2818d1a23ce9d6afe Mon Sep 17 00:00:00 2001 From: TomShawn <41534398+TomShawn@users.noreply.github.com> Date: Fri, 2 Jul 2021 19:10:25 +0800 Subject: [PATCH 26/26] Update releases/release-5.0.3.md --- releases/release-5.0.3.md | 1 - 1 file changed, 1 deletion(-) diff --git a/releases/release-5.0.3.md b/releases/release-5.0.3.md index fcd4706e33d90..dd0cd804340e2 100644 --- a/releases/release-5.0.3.md +++ b/releases/release-5.0.3.md @@ -92,7 +92,6 @@ TiDB version: 5.0.3 - Fix the issue that `SELECT DISTINCT` converted to `Batch Get` causes incorrect results [#25320](https://github.com/pingcap/tidb/issues/25320) - Fix the issue that backing off queries from TiFlash to TiKV cannot be triggered [#23665](https://github.com/pingcap/tidb/issues/23665) [#24421](https://github.com/pingcap/tidb/issues/24421) - Fix the `index-out-of-range` error that occurs when checking `only_full_group_by` [#23839](https://github.com/pingcap/tidb/issues/23839)) - - Fix the issue that queries with `TABLESAMPLE` on an empty table returns unexpected rows [#25257](https://github.com/pingcap/tidb/issues/25257) - Fix the issue that the result of index join in correlated subqueries is wrong [#25799](https://github.com/pingcap/tidb/issues/25799) + TiKV