From 2ff20e9fa24829e369ce11eac7a7f701aacfd09c Mon Sep 17 00:00:00 2001 From: ti-srebot <66930949+ti-srebot@users.noreply.github.com> Date: Tue, 21 Dec 2021 19:16:29 +0800 Subject: [PATCH 01/51] releases: add TiDB 5.0.6-19-16-27 release notes * releases: add TiDB 5.0.6-19-16-27 release notes * Update releases/release-5.0.6-19-16-27.md --- releases/release-5.0.6-19-16-27.md | 174 +++++++++++++++++++++++++++++ 1 file changed, 174 insertions(+) create mode 100644 releases/release-5.0.6-19-16-27.md diff --git a/releases/release-5.0.6-19-16-27.md b/releases/release-5.0.6-19-16-27.md new file mode 100644 index 0000000000000..197db410ebc1c --- /dev/null +++ b/releases/release-5.0.6-19-16-27.md @@ -0,0 +1,174 @@ +--- +title: TiDB 5.0.6 Release Notes +category: Releases +--- + + + +# TiDB 5.0.6 Release Notes + +Release Date: December 21, 2021 + +TiDB version: 5.0.6 + +## __unsorted + ++ PingCAP/TiDB + + - This is a fix for grant global level case in v4.0 and v5.0 [#30161](https://github.com/pingcap/tidb/pull/30161) + - Fix an issue that adding index panics by chance. [#30125](https://github.com/pingcap/tidb/pull/30125) + - fix wrong result type for greatest/least [#29912](https://github.com/pingcap/tidb/pull/29912) + - Prevent conflicted optimistic transactions from locking each other. [#29776](https://github.com/pingcap/tidb/pull/29776) + - config: fix the bug that enforce-mpp *config item* is useless in v5.0.4 [#29637](https://github.com/pingcap/tidb/pull/29637) + - Fix panic for caseWhen function with enum type [#29509](https://github.com/pingcap/tidb/pull/29509) + - Fix wrong result of microsecond function in vectorized [#29385](https://github.com/pingcap/tidb/pull/29385) + - Fix incomplete log information about auto analyze. [#29228](https://github.com/pingcap/tidb/pull/29228) + - Fix wrong result of hour function in vectorized expression [#28871](https://github.com/pingcap/tidb/pull/28871) + - Fix unexpected error like `tidb_cast to Int32 is not supported` when unsupported cast is pushed down to TiFlash [#28651](https://github.com/pingcap/tidb/pull/28651) + - Fix bug that mpp node availability detect does not work in some corner cases [#28287](https://github.com/pingcap/tidb/pull/28287) + - sessionctx: fix data-race bug when alloc task id [#28284](https://github.com/pingcap/tidb/pull/28284) + - Fix index out of bound bug when empty dual table is remove for mpp query [#28278](https://github.com/pingcap/tidb/pull/28278) + - Avoid false positive error log about `invalid cop task execution summaries length` when running MPP query. [#28262](https://github.com/pingcap/tidb/pull/28262) + - Fixed a bug that causes TiDB panic when inserting invalid date value concurrently. [#28198](https://github.com/pingcap/tidb/pull/28198) + - Fix `can not found column in Schema column` error for mpp queries [#28147](https://github.com/pingcap/tidb/pull/28147) + - Fix a bug that TiDB may crash when TiFlash is shutting down. [#28138](https://github.com/pingcap/tidb/pull/28138) + - None. [#27927](https://github.com/pingcap/tidb/pull/27927) + + ++ TiKV/TiKV + + - Fix resolved ts lag increased after stoping a tikv [#11538](https://github.com/tikv/tikv/pull/11538) + - Fix connection abort when too many raft entries are batched into one messages [#11532](https://github.com/tikv/tikv/pull/11532) + - Fix panic in rare conditions when merge, conf change and snapshot happen at the same time [#11510](https://github.com/tikv/tikv/pull/11510) + - Fix the issue that reverse scan can't detect memory locks and may read stale data. [#11453](https://github.com/tikv/tikv/pull/11453) + - Fix GC scan effectiveness to avoid OOM [#11419](https://github.com/tikv/tikv/pull/11419) + - None. [#11381](https://github.com/tikv/tikv/pull/11381) + - fix negative sign when decimal divide to zero [#11333](https://github.com/tikv/tikv/pull/11333) + - Fix incorrect by-instance gRPC average duration. [#11327](https://github.com/tikv/tikv/pull/11327) + - move verify_checksum to import-thread from apply-thread. [#11257](https://github.com/tikv/tikv/pull/11257) + - Fix label leaking of thread metrics [#11201](https://github.com/tikv/tikv/pull/11201) + - Fix CDC panic due to missing downstream. [#11136](https://github.com/tikv/tikv/pull/11136) + - Fix frequent CDC incremental scan retry due to `Congest` error. [#11090](https://github.com/tikv/tikv/pull/11090) + - fix channel full could break the raft connection [#11070](https://github.com/tikv/tikv/pull/11070) + - Hide untouched storage commands' metrics in grafana dashboard [#11001](https://github.com/tikv/tikv/pull/11001) + - Do not delete import files during Lightning import. [#10740](https://github.com/tikv/tikv/pull/10740) + - copr: fix Max/Min bug when comparing signed and unsigned int64 [#10617](https://github.com/tikv/tikv/pull/10617) + - - fix follower meta corruption in rare cases with more than 4 replicas [#10500](https://github.com/tikv/tikv/pull/10500) + - ```release-note [#10361](https://github.com/tikv/tikv/pull/10361) + - copr cast invalid utf8 string to real bug fix [#9871](https://github.com/tikv/tikv/pull/9871) + + ++ PingCAP/TiFlash + + - Fix potential data inconsistency when widen pk column type if pk is handle [#3572](https://github.com/pingcap/tics/pull/3572) + - Fix the bug that results of `where ` is wrong because it will be converted to int type. [#3477](https://github.com/pingcap/tics/pull/3477) + - Fix tiflash randomly crash when a mpp query is killed. [#3448](https://github.com/pingcap/tics/pull/3448) + - Fix the issue of unexpected error that `Unexpected type of column: Nullable(Nothing)` [#3376](https://github.com/pingcap/tics/pull/3376) + - [#2349](https://github.com/pingcap/tics/pull/2349) + + ++ PD + + - fix the problem that the hot cache cannot be emptied when the interval is less than 60 [#4432](https://github.com/tikv/pd/pull/4432) + - None. [#4288](https://github.com/tikv/pd/pull/4288) + - speed scheduler exit [#4201](https://github.com/tikv/pd/pull/4201) + - allow empty region to be scheduled and use a sperate tolerance config in scatter range scheduler [#4116](https://github.com/tikv/pd/pull/4116) + + ++ Tools + + + PingCAP/BR + + - Increase the robustness for restoring. [#1438](https://github.com/pingcap/br/pull/1438) + - ```release-note [#1436](https://github.com/pingcap/br/pull/1436) + - Expression index and index depending on virtual generated columns are now valid. Previously these indices are broken when importing through Lightning local or importer backend. [#1419](https://github.com/pingcap/br/pull/1419) + - fix the bug that the average speed isn't accurate in backup and restore [#1411](https://github.com/pingcap/br/pull/1411) + + + + PingCAP/Dumpling + + - fix the bug that dumpling gets very slow when dumping composite primary/unique key tables. [#399](https://github.com/pingcap/dumpling/pull/399) + + + + PingCAP/TiCDC + + - None (not released yet) [#4000](https://github.com/pingcap/tiflow/pull/4000) + - ```release-note [#3922](https://github.com/pingcap/tiflow/pull/3922) + - Fix timezone related error that cause cdc server can't run in some RHEL release version (6.8, 6.9 etc). [#3908](https://github.com/pingcap/tiflow/pull/3908) + - Fix mounter default date value not support [#3856](https://github.com/pingcap/tiflow/pull/3856) + - Reduce log "synchronize is taking too long, report a bug" in some cases. [#3797](https://github.com/pingcap/tiflow/pull/3797) + - Fix the problem that old value is not forced on automatically in Canal and Maxwell protocols [#3780](https://github.com/pingcap/tiflow/pull/3780) + - `None`. [#3762](https://github.com/pingcap/tiflow/pull/3762) + - The Avro sink was updated to handle JSON columns [#3651](https://github.com/pingcap/tiflow/pull/3651) + - Please add a release note. +If you don't think this PR needs a release note then fill it with `None`. [#3566](https://github.com/pingcap/tiflow/pull/3566) + - fix changefeed checkpoint lag negative value error [#3533](https://github.com/pingcap/tiflow/pull/3533) + - Fix OOM in container environments. [#3441](https://github.com/pingcap/tiflow/pull/3441) + - Please add a release note. +If you don't think this PR needs a release note then fill it with `None`. [#3391](https://github.com/pingcap/tiflow/pull/3391) + - Show changefeed checkepoint catch-up ETA in metrics. [#3314](https://github.com/pingcap/tiflow/pull/3314) + - Fix a bug that TiCDC could meet replication interruption when multiple TiKVs crash or forcing restart. [#3291](https://github.com/pingcap/tiflow/pull/3291) + - Fix memory leak after processing DDLs. [#3275](https://github.com/pingcap/tiflow/pull/3275) + - Please add a release note. +If you don't think this PR needs a release note then fill it with `None`. [#3268](https://github.com/pingcap/tiflow/pull/3268) + - `None`. [#3211](https://github.com/pingcap/tiflow/pull/3211) + - Please add a release note. +If you don't think this PR needs a release note then fill it with `None`. [#3177](https://github.com/pingcap/tiflow/pull/3177) + - bugfix: fix changefeed does not fast fail when occur ErrGCTTLExceeded error. [#3135](https://github.com/pingcap/tiflow/pull/3135) + - Optimize the rate limit control when TiKV reloads and fix the congestion in gPRC, which may cause slow initialization phase. [#3132](https://github.com/pingcap/tiflow/pull/3132) + - change Kafka sink default `MaxMessageBytes` to 1MB. [#3107](https://github.com/pingcap/tiflow/pull/3107) + - fix the bug that fallback resolvedTs event will block the progress of resolve lock when occur region merging [#3100](https://github.com/pingcap/tiflow/pull/3100) + - Close gPRC stream and re-create it when meeting `ErrPrewriteNotMatch` to avoid duplicated request error [#3091](https://github.com/pingcap/tiflow/pull/3091) + - fix kafka sink can not send message due to constraint by `max-message-size` option. [#3047](https://github.com/pingcap/tiflow/pull/3047) + - Nond [#3043](https://github.com/pingcap/tiflow/pull/3043) + - Add metrics to observe incremental scan remaining time [#3033](https://github.com/pingcap/tiflow/pull/3033) + - Fix tikv_cdc_min_resolved_ts_no_change_for_1m keep firing when there is no changefeed. [#3024](https://github.com/pingcap/tiflow/pull/3024) + - Fix possible deadlocking when Kafka producer reports an error. [#3016](https://github.com/pingcap/tiflow/pull/3016) + - Release new owner and processor implementation to release-5.0. +Highly available model and core modules refactoring.(ref: https://github.com/pingcap/ticdc/pull/1927) [#2946](https://github.com/pingcap/tiflow/pull/2946) + - `None`. [#2918](https://github.com/pingcap/tiflow/pull/2918) + - ignore the global flag for changefeed update command. [#2876](https://github.com/pingcap/tiflow/pull/2876) + - Fix dml is not replicated after adding partition in partition table without valid index [#2864](https://github.com/pingcap/tiflow/pull/2864) + - Extend creating service gc safepoint ttl to 1 hr to support creating changefeeds that needs long initialization time. [#2852](https://github.com/pingcap/tiflow/pull/2852) + - Fix json encoding could panic when processing a string type value in some cases. [#2782](https://github.com/pingcap/tiflow/pull/2782) + - Fixed a bug in DDL handling when the owner restarts. [#2610](https://github.com/pingcap/tiflow/pull/2610) + - Fix the bug that table is not replicated when it changes from ineligible to eligible by DDL [#1488](https://github.com/pingcap/tiflow/pull/1488) + + +## Bug Fixes + ++ PingCAP/TiDB + + - ```release-note [#30881](https://github.com/pingcap/tidb/pull/30881) + - Fix wrong result for control function with enum type. [#30857](https://github.com/pingcap/tidb/pull/30857) + - bugfix: concat(ifnull(time(3)) returns different results from MySQL [#30830](https://github.com/pingcap/tidb/pull/30830) + - Fix wrong result of greatest/least Function. [#30791](https://github.com/pingcap/tidb/pull/30791) + - Fix the bug that sql got cancel if including json column joins char column. [#30778](https://github.com/pingcap/tidb/pull/30778) + - Fix the data inconsistency caused by incorrect usage of lazy existence check and untouch key optimization. [#30533](https://github.com/pingcap/tidb/pull/30533) + - Fix the problem that window function may return different results when using transaction or not. [#30389](https://github.com/pingcap/tidb/pull/30389) + - Fix wrong flen for CastAsString funtion [#30055](https://github.com/pingcap/tidb/pull/30055) + - ```release-note [#30049](https://github.com/pingcap/tidb/pull/30049) + - expression: Fix the issue that length information is wrong when converting Decimal to String [#30014](https://github.com/pingcap/tidb/pull/30014) + - expression: fix different results for greatest when vectorized is off. [#29917](https://github.com/pingcap/tidb/pull/29917) + - planner: fix the issue that planner may cache invalid plans for joins in some cases [#28445](https://github.com/pingcap/tidb/pull/28445) + - Keep the original join schema in predicate pushdown [#28295](https://github.com/pingcap/tidb/pull/28295) + + ++ PingCAP/TiFlash + + - Align unix_timestamp behavior with TiDB and mysql when input is earlier than 1970-01-01 00:00:01 UTC [#3622](https://github.com/pingcap/tics/pull/3622) + - fix the issue that comparison between Decimal may cause overflow and report `Can't compare`. [#3366](https://github.com/pingcap/tics/pull/3366) + - Fix the issue of unexpected error that `3rd arguments of function substringUTF8 must be constants.` [#3266](https://github.com/pingcap/tics/pull/3266) + - Fix the issue that TiFlash fails to start up under platform without library `nsl` [#3205](https://github.com/pingcap/tics/pull/3205) + - ```release-note [#2701](https://github.com/pingcap/tics/pull/2701) + - Fix problem that TiDB Dashboard can not display disk information of TiFlash correctly in some situations. [#2397](https://github.com/pingcap/tics/pull/2397) + + ++ PD + + - Fix panic issue after TiKV node scales in [#4379](https://github.com/tikv/pd/pull/4379) + - Fix the issue that operator can get blocked due to down store [#4367](https://github.com/tikv/pd/pull/4367) + - Fix the issue that PD may not elect leader as soon as leader step down [#4218](https://github.com/tikv/pd/pull/4218) + - `evict-leader-scheduler` supports schedule the regions with unhealthy peers. [#4130](https://github.com/tikv/pd/pull/4130) + + From d69b3fe3e22c09e6e91a9f3a5cbc271535bd60c4 Mon Sep 17 00:00:00 2001 From: shichun-0415 Date: Tue, 21 Dec 2021 19:37:50 +0800 Subject: [PATCH 02/51] Add tidb 5.0.6 release notes --- TOC.md | 1 + ...ase-5.0.6-19-16-27.md => release-5.0.6.md} | 21 ++++++------------- releases/release-notes.md | 1 + releases/release-timeline.md | 1 + 4 files changed, 9 insertions(+), 15 deletions(-) rename releases/{release-5.0.6-19-16-27.md => release-5.0.6.md} (99%) diff --git a/TOC.md b/TOC.md index 2fab0b13c7d9a..5968b84174cfc 100644 --- a/TOC.md +++ b/TOC.md @@ -589,6 +589,7 @@ - [5.1.1](/releases/release-5.1.1.md) - [5.1.0](/releases/release-5.1.0.md) - v5.0 + - [5.0.6](/releases/release-5.0.6.md) - [5.0.5](/releases/release-5.0.5.md) - [5.0.4](/releases/release-5.0.4.md) - [5.0.3](/releases/release-5.0.3.md) diff --git a/releases/release-5.0.6-19-16-27.md b/releases/release-5.0.6.md similarity index 99% rename from releases/release-5.0.6-19-16-27.md rename to releases/release-5.0.6.md index 197db410ebc1c..59e1f5eb8db59 100644 --- a/releases/release-5.0.6-19-16-27.md +++ b/releases/release-5.0.6.md @@ -3,14 +3,16 @@ title: TiDB 5.0.6 Release Notes category: Releases --- - - # TiDB 5.0.6 Release Notes -Release Date: December 21, 2021 +Release date: December 28, 2021 TiDB version: 5.0.6 +## Compatibility Changes + +## Improvements + ## __unsorted + PingCAP/TiDB @@ -34,7 +36,6 @@ TiDB version: 5.0.6 - Fix a bug that TiDB may crash when TiFlash is shutting down. [#28138](https://github.com/pingcap/tidb/pull/28138) - None. [#27927](https://github.com/pingcap/tidb/pull/27927) - + TiKV/TiKV - Fix resolved ts lag increased after stoping a tikv [#11538](https://github.com/tikv/tikv/pull/11538) @@ -57,7 +58,6 @@ TiDB version: 5.0.6 - ```release-note [#10361](https://github.com/tikv/tikv/pull/10361) - copr cast invalid utf8 string to real bug fix [#9871](https://github.com/tikv/tikv/pull/9871) - + PingCAP/TiFlash - Fix potential data inconsistency when widen pk column type if pk is handle [#3572](https://github.com/pingcap/tics/pull/3572) @@ -66,7 +66,6 @@ TiDB version: 5.0.6 - Fix the issue of unexpected error that `Unexpected type of column: Nullable(Nothing)` [#3376](https://github.com/pingcap/tics/pull/3376) - [#2349](https://github.com/pingcap/tics/pull/2349) - + PD - fix the problem that the hot cache cannot be emptied when the interval is less than 60 [#4432](https://github.com/tikv/pd/pull/4432) @@ -74,7 +73,6 @@ TiDB version: 5.0.6 - speed scheduler exit [#4201](https://github.com/tikv/pd/pull/4201) - allow empty region to be scheduled and use a sperate tolerance config in scatter range scheduler [#4116](https://github.com/tikv/pd/pull/4116) - + Tools + PingCAP/BR @@ -84,12 +82,10 @@ TiDB version: 5.0.6 - Expression index and index depending on virtual generated columns are now valid. Previously these indices are broken when importing through Lightning local or importer backend. [#1419](https://github.com/pingcap/br/pull/1419) - fix the bug that the average speed isn't accurate in backup and restore [#1411](https://github.com/pingcap/br/pull/1411) - + PingCAP/Dumpling - fix the bug that dumpling gets very slow when dumping composite primary/unique key tables. [#399](https://github.com/pingcap/dumpling/pull/399) - + PingCAP/TiCDC - None (not released yet) [#4000](https://github.com/pingcap/tiflow/pull/4000) @@ -134,7 +130,6 @@ Highly available model and core modules refactoring.(ref: https://github.com/pin - Fixed a bug in DDL handling when the owner restarts. [#2610](https://github.com/pingcap/tiflow/pull/2610) - Fix the bug that table is not replicated when it changes from ineligible to eligible by DDL [#1488](https://github.com/pingcap/tiflow/pull/1488) - ## Bug Fixes + PingCAP/TiDB @@ -153,7 +148,6 @@ Highly available model and core modules refactoring.(ref: https://github.com/pin - planner: fix the issue that planner may cache invalid plans for joins in some cases [#28445](https://github.com/pingcap/tidb/pull/28445) - Keep the original join schema in predicate pushdown [#28295](https://github.com/pingcap/tidb/pull/28295) - + PingCAP/TiFlash - Align unix_timestamp behavior with TiDB and mysql when input is earlier than 1970-01-01 00:00:01 UTC [#3622](https://github.com/pingcap/tics/pull/3622) @@ -163,12 +157,9 @@ Highly available model and core modules refactoring.(ref: https://github.com/pin - ```release-note [#2701](https://github.com/pingcap/tics/pull/2701) - Fix problem that TiDB Dashboard can not display disk information of TiFlash correctly in some situations. [#2397](https://github.com/pingcap/tics/pull/2397) - + PD - Fix panic issue after TiKV node scales in [#4379](https://github.com/tikv/pd/pull/4379) - Fix the issue that operator can get blocked due to down store [#4367](https://github.com/tikv/pd/pull/4367) - Fix the issue that PD may not elect leader as soon as leader step down [#4218](https://github.com/tikv/pd/pull/4218) - - `evict-leader-scheduler` supports schedule the regions with unhealthy peers. [#4130](https://github.com/tikv/pd/pull/4130) - - + - `evict-leader-scheduler` supports schedule the regions with unhealthy peers. [#4130](https://github.com/tikv/pd/pull/4130) \ No newline at end of file diff --git a/releases/release-notes.md b/releases/release-notes.md index bdfac3356a316..ac4c150223097 100644 --- a/releases/release-notes.md +++ b/releases/release-notes.md @@ -24,6 +24,7 @@ title: Release Notes ## 5.0 +- [5.0.6](/releases/release-5.0.6.md) - [5.0.5](/releases/release-5.0.5.md) - [5.0.4](/releases/release-5.0.4.md) - [5.0.3](/releases/release-5.0.3.md) diff --git a/releases/release-timeline.md b/releases/release-timeline.md index ff2cbab98d646..2940fb86233b1 100644 --- a/releases/release-timeline.md +++ b/releases/release-timeline.md @@ -9,6 +9,7 @@ This document shows all the released TiDB versions in reverse chronological orde | Version | Release Date | | :--- | :--- | +| [5.0.6](/releases/release-5.0.6.md) | 2021-12-28 | | [4.0.16](/releases/release-4.0.16.md) | 2021-12-17 | | [5.1.3](/releases/release-5.1.3.md) | 2021-12-03 | | [5.0.5](/releases/release-5.0.5.md) | 2021-12-03 | From fc6fdcd7987ce902d840e6904f54632ab5cd3abb Mon Sep 17 00:00:00 2001 From: TomShawn <41534398+TomShawn@users.noreply.github.com> Date: Tue, 21 Dec 2021 19:41:28 +0800 Subject: [PATCH 03/51] Update release-5.0.6.md --- releases/release-5.0.6.md | 8 ++++++-- 1 file changed, 6 insertions(+), 2 deletions(-) diff --git a/releases/release-5.0.6.md b/releases/release-5.0.6.md index 59e1f5eb8db59..13f5412ba0e09 100644 --- a/releases/release-5.0.6.md +++ b/releases/release-5.0.6.md @@ -9,10 +9,14 @@ Release date: December 28, 2021 TiDB version: 5.0.6 -## Compatibility Changes +## Compatibility changes + +## Feature enhancements ## Improvements +## Bug fixes + ## __unsorted + PingCAP/TiDB @@ -162,4 +166,4 @@ Highly available model and core modules refactoring.(ref: https://github.com/pin - Fix panic issue after TiKV node scales in [#4379](https://github.com/tikv/pd/pull/4379) - Fix the issue that operator can get blocked due to down store [#4367](https://github.com/tikv/pd/pull/4367) - Fix the issue that PD may not elect leader as soon as leader step down [#4218](https://github.com/tikv/pd/pull/4218) - - `evict-leader-scheduler` supports schedule the regions with unhealthy peers. [#4130](https://github.com/tikv/pd/pull/4130) \ No newline at end of file + - `evict-leader-scheduler` supports schedule the regions with unhealthy peers. [#4130](https://github.com/tikv/pd/pull/4130) From 5fc502ae270e2a515b5d04421646f46ea58f7a38 Mon Sep 17 00:00:00 2001 From: shichun-0415 Date: Thu, 23 Dec 2021 11:28:53 +0800 Subject: [PATCH 04/51] Update release-5.0.6.md --- releases/release-5.0.6.md | 268 +++++++++++++++++++------------------- 1 file changed, 135 insertions(+), 133 deletions(-) diff --git a/releases/release-5.0.6.md b/releases/release-5.0.6.md index 13f5412ba0e09..f4c10ac75388f 100644 --- a/releases/release-5.0.6.md +++ b/releases/release-5.0.6.md @@ -11,159 +11,161 @@ TiDB version: 5.0.6 ## Compatibility changes ++ Tools + + + TiCDC + + - Output the cdc server cmd error from stdout to stderr. [#3875](https://github.com/pingcap/tiflow/pull/3875) + ## Feature enhancements ++ TiDB + + - Prevent conflicted optimistic transactions from locking each other [#29776](https://github.com/pingcap/tidb/pull/29776) + - Avoid confusing error log like `invalid cop task execution summaries length` when running MPP query [#28262](https://github.com/pingcap/tidb/pull/28262) + - The debug log on coprocessor doesn't print out the statement when encountering a lock, which makes it difficult to know what statement was affected by the lock. This fix tries to add the statement.[#27927](https://github.com/pingcap/tidb/pull/27927) + ++ TiKV + + - Move verify_checksum to import-thread from apply-thread. [#11257](https://github.com/tikv/tikv/pull/11257) + - Add metrics for raft log garbage-collect to locate performance problem. [#11381](https://github.com/tikv/tikv/pull/11381) + - Hide untouched storage commands' metrics in grafana dashboard [#11001](https://github.com/tikv/tikv/pull/11001) + ## Improvements ++ PD + + - Speed scheduler exit after transfer PD leader [#4201](https://github.com/tikv/pd/pull/4201) + - Make scatter range scheduler work better by allowing empty region schedule and fix config [#4116](https://github.com/tikv/pd/pull/4116) + ++ Tools + + + TiCDC + - Optimize the rate limit control when TiKV reloads. [#3132](https://github.com/pingcap/tiflow/pull/3132) + - Reduce lock competition in sink module. [#2760](https://github.com/pingcap/tiflow/pull/2760) + - Extend creating service gc safepoint ttl to 1 hour to support creating changefeeds that needs long initialization time. [#2852](https://github.com/pingcap/tiflow/pull/2852) + - Changefeed supports fast fail when occur ErrGCTTLExceeded error. [#3135](https://github.com/pingcap/tiflow/pull/3135) + - Add rate limiter to limit EtcdWorker tick frequency. [#3268](https://github.com/pingcap/tiflow/pull/3268) + - Support batch messages to reduce EtcdWorker tick. [#3391](https://github.com/pingcap/tiflow/pull/3391) + - Support unified sorter cgroup aware. [#3441](https://github.com/pingcap/tiflow/pull/3441) + - Add Kafka sink default configuration config.Metadata.Timeout. [#3670](https://github.com/pingcap/tiflow/pull/3670) + - Change Kafka sink default `MaxMessageBytes` to 1MB. [#3107](https://github.com/pingcap/tiflow/pull/3107) + - Add more monitor metric and alert, including "no owner alert" [#3834](https://github.com/pingcap/tiflow/pull/3834), "mounter row" [#2830](https://github.com/pingcap/tiflow/pull/2830), "table sink total row" [#2830](https://github.com/pingcap/tiflow/pull/2830), "buffer sink total row" [#2830](https://github.com/pingcap/tiflow/pull/2830), "go gc" [#2998](https://github.com/pingcap/tiflow/pull/2998), "go_max_procs" [#2998](https://github.com/pingcap/tiflow/pull/2998), "cached region" [#2733](https://github.com/pingcap/tiflow/pull/2733). + + + (Backup & Restore) BR + + - Retry pd request and TiKV IO timeout error [#1436](https://github.com/pingcap/br/pull/1436) + ## Bug fixes -## __unsorted - -+ PingCAP/TiDB - - - This is a fix for grant global level case in v4.0 and v5.0 [#30161](https://github.com/pingcap/tidb/pull/30161) - - Fix an issue that adding index panics by chance. [#30125](https://github.com/pingcap/tidb/pull/30125) - - fix wrong result type for greatest/least [#29912](https://github.com/pingcap/tidb/pull/29912) - - Prevent conflicted optimistic transactions from locking each other. [#29776](https://github.com/pingcap/tidb/pull/29776) - - config: fix the bug that enforce-mpp *config item* is useless in v5.0.4 [#29637](https://github.com/pingcap/tidb/pull/29637) - - Fix panic for caseWhen function with enum type [#29509](https://github.com/pingcap/tidb/pull/29509) - - Fix wrong result of microsecond function in vectorized [#29385](https://github.com/pingcap/tidb/pull/29385) - - Fix incomplete log information about auto analyze. [#29228](https://github.com/pingcap/tidb/pull/29228) - - Fix wrong result of hour function in vectorized expression [#28871](https://github.com/pingcap/tidb/pull/28871) - - Fix unexpected error like `tidb_cast to Int32 is not supported` when unsupported cast is pushed down to TiFlash [#28651](https://github.com/pingcap/tidb/pull/28651) - - Fix bug that mpp node availability detect does not work in some corner cases [#28287](https://github.com/pingcap/tidb/pull/28287) - - sessionctx: fix data-race bug when alloc task id [#28284](https://github.com/pingcap/tidb/pull/28284) - - Fix index out of bound bug when empty dual table is remove for mpp query [#28278](https://github.com/pingcap/tidb/pull/28278) - - Avoid false positive error log about `invalid cop task execution summaries length` when running MPP query. [#28262](https://github.com/pingcap/tidb/pull/28262) - - Fixed a bug that causes TiDB panic when inserting invalid date value concurrently. [#28198](https://github.com/pingcap/tidb/pull/28198) - - Fix `can not found column in Schema column` error for mpp queries [#28147](https://github.com/pingcap/tidb/pull/28147) - - Fix a bug that TiDB may crash when TiFlash is shutting down. [#28138](https://github.com/pingcap/tidb/pull/28138) - - None. [#27927](https://github.com/pingcap/tidb/pull/27927) - -+ TiKV/TiKV - - - Fix resolved ts lag increased after stoping a tikv [#11538](https://github.com/tikv/tikv/pull/11538) - - Fix connection abort when too many raft entries are batched into one messages [#11532](https://github.com/tikv/tikv/pull/11532) ++ TiDB + + - Fix the problem that error is raised when a grant/revoke SQL contains global level identifier [#30161](https://github.com/pingcap/tidb/pull/30161) + - Fix the problem that adding index panics by chance [#30125](https://github.com/pingcap/tidb/pull/30125) + - Fix the problem that the `enforce-mpp` config item is useless in v5.0.4 [#29637](https://github.com/pingcap/tidb/pull/29637) + - Fix the panic when the `case-when` function meets enum type input argument [#29509](https://github.com/pingcap/tidb/pull/29509) + - Fix the problem that result of the `microsecond` function is wrong in vectorized evaluation [#29385](https://github.com/pingcap/tidb/pull/29385) + - Fix the problem that the log lose the SQL text when auto analyze fails [#29228](https://github.com/pingcap/tidb/pull/29228) + - Fix the problem that result of the `hour` function is wrong in vectorized evaluation [#28871](https://github.com/pingcap/tidb/pull/28871) + - Fix the problem that unexpected error like `tidb_cast to Int32 is not supported` is raised when executing a MPP query [#28651](https://github.com/pingcap/tidb/pull/28651) + - Fix the problem that MPP node availability detection does not work in some corner cases [#28287](https://github.com/pingcap/tidb/pull/28287) + - Fix the problem that data-race may happen when alloc MPP task id [#28284](https://github.com/pingcap/tidb/pull/28284) + - Fix the problem that `index out of range [-1]` error is raised when a SQL contains `Union` and is running in MPP mode [#28278](https://github.com/pingcap/tidb/pull/28278) + - Fix the problem that TiDB panicks when inserting invalid date values concurrently [#28198](https://github.com/pingcap/tidb/pull/28198) + - Fix the problem that the error like `can not found column in Schema column` is raised unexpectedly for mpp queries [#28147](https://github.com/pingcap/tidb/pull/28147) + - Fix the problem that TiDB may crash when TiFlash shut down [#28138](https://github.com/pingcap/tidb/pull/28138) + - Fix the problem that the `index out of range` error is raised unexpectly when the planner doing join reorder [#30881](https://github.com/pingcap/tidb/pull/30881). + - Fix the problem that the results of `if`,`case-when`,`elt` functions are wrong when the input arguments if of type enum [#30857](https://github.com/pingcap/tidb/pull/30857) + - Fix the problem the `concat(ifnull(time(3))` returns wrong result [#30830](https://github.com/pingcap/tidb/pull/30830) + - Fix the problem that `greatest/least(unsigned)` returns wrong result [#30791](https://github.com/pingcap/tidb/pull/30791) + - Fix the problem that SQL is cancelled when including json column joins char column [#30778](https://github.com/pingcap/tidb/pull/30778) + - Fix the data inconsistency caused by incorrect usage of lazy existence check and untouch key optimization [#30533](https://github.com/pingcap/tidb/pull/30533) + - Fix the problem that window function may return different results when using transaction or not [#30389](https://github.com/pingcap/tidb/pull/30389) + - Fix the problem that `cast(integer as char) union string` returns wrong result[#30055](https://github.com/pingcap/tidb/pull/30055) + - Fix the problem that `concat(decimal_col)` returns wrong result [#30014](https://github.com/pingcap/tidb/pull/30014) + - Fix the problem that the error `Column 'col_name' in field list is ambiguous` is raised unexpectedly when a SQL contains natural join [#30049](https://github.com/pingcap/tidb/pull/30049) + - Fix the problem that `greatest` returns different results when `tidb_enable_vectorized_expression` is on or not [#29917](https://github.com/pingcap/tidb/pull/29917) + - Fix the problem that planner may cache invalid plans for joins in some cases [#28445](https://github.com/pingcap/tidb/pull/28445) + - Fix the problem that the error `index out of range [1] with length 1` is raised when a SQL tries to evaluates an aggregation result on the result of join in some cases [#28295](https://github.com/pingcap/tidb/pull/28295) + ++ TiKV + + - Fix resolved timestamp lag increased after stoping a tikv [#11538](https://github.com/tikv/tikv/pull/11538) + - Fix connection abort when too many small logs are batched into one messages [#11532](https://github.com/tikv/tikv/pull/11532) - Fix panic in rare conditions when merge, conf change and snapshot happen at the same time [#11510](https://github.com/tikv/tikv/pull/11510) - Fix the issue that reverse scan can't detect memory locks and may read stale data. [#11453](https://github.com/tikv/tikv/pull/11453) - - Fix GC scan effectiveness to avoid OOM [#11419](https://github.com/tikv/tikv/pull/11419) - - None. [#11381](https://github.com/tikv/tikv/pull/11381) - - fix negative sign when decimal divide to zero [#11333](https://github.com/tikv/tikv/pull/11333) - - Fix incorrect by-instance gRPC average duration. [#11327](https://github.com/tikv/tikv/pull/11327) - - move verify_checksum to import-thread from apply-thread. [#11257](https://github.com/tikv/tikv/pull/11257) - - Fix label leaking of thread metrics [#11201](https://github.com/tikv/tikv/pull/11201) + - Fix negative sign when decimal divide to zero [#11333](https://github.com/tikv/tikv/pull/11333) + - Avoid possible OOM due to the accumulation of GC tasks [#11419](https://github.com/tikv/tikv/pull/11419) + - Fix incorrect metrics "gRPC average duration by-instance". [#11327](https://github.com/tikv/tikv/pull/11327) + - Fix bug of reporting metrics about destroyed threads to Prometheus. [#11201](https://github.com/tikv/tikv/pull/11201) - Fix CDC panic due to missing downstream. [#11136](https://github.com/tikv/tikv/pull/11136) - Fix frequent CDC incremental scan retry due to `Congest` error. [#11090](https://github.com/tikv/tikv/pull/11090) - - fix channel full could break the raft connection [#11070](https://github.com/tikv/tikv/pull/11070) - - Hide untouched storage commands' metrics in grafana dashboard [#11001](https://github.com/tikv/tikv/pull/11001) - - Do not delete import files during Lightning import. [#10740](https://github.com/tikv/tikv/pull/10740) + - Fix channel full could break the raft connection [#11070](https://github.com/tikv/tikv/pull/11070) + - Fix panic caused by SST NotFound, which is ingested by Lightning import. [#10740](https://github.com/tikv/tikv/pull/10740) - copr: fix Max/Min bug when comparing signed and unsigned int64 [#10617](https://github.com/tikv/tikv/pull/10617) - - - fix follower meta corruption in rare cases with more than 4 replicas [#10500](https://github.com/tikv/tikv/pull/10500) - - ```release-note [#10361](https://github.com/tikv/tikv/pull/10361) + - Fix follower meta corruption in rare cases with more than 4 replicas [#10500](https://github.com/tikv/tikv/pull/10500) + - Fix backup threads leak [#10361](https://github.com/tikv/tikv/pull/10361) - copr cast invalid utf8 string to real bug fix [#9871](https://github.com/tikv/tikv/pull/9871) -+ PingCAP/TiFlash ++ PD + + - Fix panic issue after TiKV node scales in with some corner cases [#4379](https://github.com/tikv/pd/pull/4379) + - Fix the issue that operator can get blocked due to down store [#4367](https://github.com/tikv/pd/pull/4367) + - Fix the issue that PD may not elect leader as soon as leader step down [#4218](https://github.com/tikv/pd/pull/4218) + - Fix the issue that `evict-leader-scheduler` cannot schedule the regions with unhealthy peers. [#4130](https://github.com/tikv/pd/pull/4130) + - Fix the issue that there is the store limit of remove peer of the down store [#4097](https://github.com/tikv/pd/pull/4097) + - Fix the issue that the hot cache cannot be cleared when the heartbeat interval is less than 60 [#4432](https://github.com/tikv/pd/pull/4432) + ++ TiFlash - Fix potential data inconsistency when widen pk column type if pk is handle [#3572](https://github.com/pingcap/tics/pull/3572) - - Fix the bug that results of `where ` is wrong because it will be converted to int type. [#3477](https://github.com/pingcap/tics/pull/3477) + - Fix Tiflash arm build when include `libnsl.so`. Try copy `libnsl.so` to `INSTALL_DIR` [#3205](https://github.com/pingcap/tics/pull/3205) + - Fix store size on `tiflash metrics` is not consistent.Decrease the size of checkpoint file when removing it [#3187](https://github.com/pingcap/tics/pull/3187) + - Fix exception: `GC` removed normal file which just created [#3226](https://github.com/pingcap/tics/pull/3226) + - Fix sync schema exception when user upgrade the TiFlash version. [#2701](https://github.com/pingcap/tics/pull/2701) - Fix tiflash randomly crash when a mpp query is killed. [#3448](https://github.com/pingcap/tics/pull/3448) + - Fix throw not constants exception in `substringUTF8` [#3266](https://github.com/pingcap/tics/pull/3266) + - Fix decode DAG request failed.Add retry when decode DAG request failed. [#3678](https://github.com/pingcap/tics/pull/3678) + - Fix the bug that results of `where ` is wrong because it will be converted to int type. [#3477](https://github.com/pingcap/tics/pull/3477) + - Fix `main_capacity_quota_` check [#3425](https://github.com/pingcap/tics/pull/3425) + - Fix the inconsistent behavior of `CastStringAsDecimal` between tiflash and tidb/tikv. [#3674](https://github.com/pingcap/tics/pull/3674) + - Fix exception: `expected Nullable(Int64), got Int64`. Sending schemas in exchangeSender to avoid schema mismatch. [#3369](https://github.com/pingcap/tics/pull/3369) - Fix the issue of unexpected error that `Unexpected type of column: Nullable(Nothing)` [#3376](https://github.com/pingcap/tics/pull/3376) - - [#2349](https://github.com/pingcap/tics/pull/2349) - -+ PD - - - fix the problem that the hot cache cannot be emptied when the interval is less than 60 [#4432](https://github.com/tikv/pd/pull/4432) - - None. [#4288](https://github.com/tikv/pd/pull/4288) - - speed scheduler exit [#4201](https://github.com/tikv/pd/pull/4201) - - allow empty region to be scheduled and use a sperate tolerance config in scatter range scheduler [#4116](https://github.com/tikv/pd/pull/4116) + - Fix the issue that comparison between Decimal may cause overflow and report Can't compare. [#3097](https://github.com/pingcap/tics/pull/3097) + Tools - + PingCAP/BR - - - Increase the robustness for restoring. [#1438](https://github.com/pingcap/br/pull/1438) - - ```release-note [#1436](https://github.com/pingcap/br/pull/1436) - - Expression index and index depending on virtual generated columns are now valid. Previously these indices are broken when importing through Lightning local or importer backend. [#1419](https://github.com/pingcap/br/pull/1419) - - fix the bug that the average speed isn't accurate in backup and restore [#1411](https://github.com/pingcap/br/pull/1411) - - + PingCAP/Dumpling - - - fix the bug that dumpling gets very slow when dumping composite primary/unique key tables. [#399](https://github.com/pingcap/dumpling/pull/399) - - + PingCAP/TiCDC - - - None (not released yet) [#4000](https://github.com/pingcap/tiflow/pull/4000) - - ```release-note [#3922](https://github.com/pingcap/tiflow/pull/3922) - - Fix timezone related error that cause cdc server can't run in some RHEL release version (6.8, 6.9 etc). [#3908](https://github.com/pingcap/tiflow/pull/3908) - - Fix mounter default date value not support [#3856](https://github.com/pingcap/tiflow/pull/3856) - - Reduce log "synchronize is taking too long, report a bug" in some cases. [#3797](https://github.com/pingcap/tiflow/pull/3797) - - Fix the problem that old value is not forced on automatically in Canal and Maxwell protocols [#3780](https://github.com/pingcap/tiflow/pull/3780) - - `None`. [#3762](https://github.com/pingcap/tiflow/pull/3762) - - The Avro sink was updated to handle JSON columns [#3651](https://github.com/pingcap/tiflow/pull/3651) - - Please add a release note. -If you don't think this PR needs a release note then fill it with `None`. [#3566](https://github.com/pingcap/tiflow/pull/3566) - - fix changefeed checkpoint lag negative value error [#3533](https://github.com/pingcap/tiflow/pull/3533) - - Fix OOM in container environments. [#3441](https://github.com/pingcap/tiflow/pull/3441) - - Please add a release note. -If you don't think this PR needs a release note then fill it with `None`. [#3391](https://github.com/pingcap/tiflow/pull/3391) - - Show changefeed checkepoint catch-up ETA in metrics. [#3314](https://github.com/pingcap/tiflow/pull/3314) - - Fix a bug that TiCDC could meet replication interruption when multiple TiKVs crash or forcing restart. [#3291](https://github.com/pingcap/tiflow/pull/3291) - - Fix memory leak after processing DDLs. [#3275](https://github.com/pingcap/tiflow/pull/3275) - - Please add a release note. -If you don't think this PR needs a release note then fill it with `None`. [#3268](https://github.com/pingcap/tiflow/pull/3268) - - `None`. [#3211](https://github.com/pingcap/tiflow/pull/3211) - - Please add a release note. -If you don't think this PR needs a release note then fill it with `None`. [#3177](https://github.com/pingcap/tiflow/pull/3177) - - bugfix: fix changefeed does not fast fail when occur ErrGCTTLExceeded error. [#3135](https://github.com/pingcap/tiflow/pull/3135) - - Optimize the rate limit control when TiKV reloads and fix the congestion in gPRC, which may cause slow initialization phase. [#3132](https://github.com/pingcap/tiflow/pull/3132) - - change Kafka sink default `MaxMessageBytes` to 1MB. [#3107](https://github.com/pingcap/tiflow/pull/3107) - - fix the bug that fallback resolvedTs event will block the progress of resolve lock when occur region merging [#3100](https://github.com/pingcap/tiflow/pull/3100) - - Close gPRC stream and re-create it when meeting `ErrPrewriteNotMatch` to avoid duplicated request error [#3091](https://github.com/pingcap/tiflow/pull/3091) - - fix kafka sink can not send message due to constraint by `max-message-size` option. [#3047](https://github.com/pingcap/tiflow/pull/3047) - - Nond [#3043](https://github.com/pingcap/tiflow/pull/3043) - - Add metrics to observe incremental scan remaining time [#3033](https://github.com/pingcap/tiflow/pull/3033) + + TiCDC + + - Fix table is not replicated when adding partition about partition table without valid index. [#2864](https://github.com/pingcap/tiflow/pull/2864) + - Fix cdc cli silently truncated user parameters when receiving unexpected parameters, causing the user input parameters to be lost. [#2888](https://github.com/pingcap/tiflow/pull/2888) + - Fix cdc scheduling tables too early. [#2633](https://github.com/pingcap/tiflow/pull/2633) + - Fix Kafka_producer deadlock when an error occurs in asyncClient. [#3016](https://github.com/pingcap/tiflow/pull/3016) + - Fix MQ sink don't support non binary json string encoding. [#2782](https://github.com/pingcap/tiflow/pull/2782) + - Fix Kafka sink can not send message due to constraint by `max-message-size` option. [#3047](https://github.com/pingcap/tiflow/pull/3047) + - Fix fallback resolvedTs event block the progress of resolve lock when meet region merging. [#3100](https://github.com/pingcap/tiflow/pull/3100) + - Fix unexpected duplicate region request stream issue. [#3091](https://github.com/pingcap/tiflow/pull/3091) + - Fix changefeed region loss when multiple TiKVs crash or forcing restart. [#3291](https://github.com/pingcap/tiflow/pull/3291) + - Fix changefeed checkpoint lag metric negative value error. [#3533](https://github.com/pingcap/tiflow/pull/3533) + - Fix MySQL sink deadlock warning too frequently. [#3797](https://github.com/pingcap/tiflow/pull/3797) + - Fix Avro sink don't support json type column. [#3651](https://github.com/pingcap/tiflow/pull/3651) + - Fix read error schema snapshot from TiKV when owner restart. [#2610](https://github.com/pingcap/tiflow/pull/2610) + - Fix schema GC not work correctly and OOM issue when processing too many DDL. [#3275](https://github.com/pingcap/tiflow/pull/3275) + - Fix old value enabled is not forced on Canal and Maxwell protocols automatically. [#3780](https://github.com/pingcap/tiflow/pull/3780) + - Fix timezone related error that cause cdc server can't run in some RHEL release version (6.8, 6.9 etc). [#3908](https://github.com/pingcap/tiflow/pull/3908) + - Fix txn_batch_size metric inaccurate issue for Kafka sink. [#3820](https://github.com/pingcap/tiflow/pull/3820) + - Fix Kafka partition count not check when auto-create-topic is disabled by the user. [#3566](https://github.com/pingcap/tiflow/pull/3566) + - Fix Kafka message too large for broker. [#3566](https://github.com/pingcap/tiflow/pull/3566) + - Fix EtcdWorker row metric error. [#4000](https://github.com/pingcap/tiflow/pull/4000) - Fix tikv_cdc_min_resolved_ts_no_change_for_1m keep firing when there is no changefeed. [#3024](https://github.com/pingcap/tiflow/pull/3024) - - Fix possible deadlocking when Kafka producer reports an error. [#3016](https://github.com/pingcap/tiflow/pull/3016) - - Release new owner and processor implementation to release-5.0. -Highly available model and core modules refactoring.(ref: https://github.com/pingcap/ticdc/pull/1927) [#2946](https://github.com/pingcap/tiflow/pull/2946) - - `None`. [#2918](https://github.com/pingcap/tiflow/pull/2918) - - ignore the global flag for changefeed update command. [#2876](https://github.com/pingcap/tiflow/pull/2876) - - Fix dml is not replicated after adding partition in partition table without valid index [#2864](https://github.com/pingcap/tiflow/pull/2864) - - Extend creating service gc safepoint ttl to 1 hr to support creating changefeeds that needs long initialization time. [#2852](https://github.com/pingcap/tiflow/pull/2852) - - Fix json encoding could panic when processing a string type value in some cases. [#2782](https://github.com/pingcap/tiflow/pull/2782) - - Fixed a bug in DDL handling when the owner restarts. [#2610](https://github.com/pingcap/tiflow/pull/2610) - - Fix the bug that table is not replicated when it changes from ineligible to eligible by DDL [#1488](https://github.com/pingcap/tiflow/pull/1488) - -## Bug Fixes - -+ PingCAP/TiDB - - - ```release-note [#30881](https://github.com/pingcap/tidb/pull/30881) - - Fix wrong result for control function with enum type. [#30857](https://github.com/pingcap/tidb/pull/30857) - - bugfix: concat(ifnull(time(3)) returns different results from MySQL [#30830](https://github.com/pingcap/tidb/pull/30830) - - Fix wrong result of greatest/least Function. [#30791](https://github.com/pingcap/tidb/pull/30791) - - Fix the bug that sql got cancel if including json column joins char column. [#30778](https://github.com/pingcap/tidb/pull/30778) - - Fix the data inconsistency caused by incorrect usage of lazy existence check and untouch key optimization. [#30533](https://github.com/pingcap/tidb/pull/30533) - - Fix the problem that window function may return different results when using transaction or not. [#30389](https://github.com/pingcap/tidb/pull/30389) - - Fix wrong flen for CastAsString funtion [#30055](https://github.com/pingcap/tidb/pull/30055) - - ```release-note [#30049](https://github.com/pingcap/tidb/pull/30049) - - expression: Fix the issue that length information is wrong when converting Decimal to String [#30014](https://github.com/pingcap/tidb/pull/30014) - - expression: fix different results for greatest when vectorized is off. [#29917](https://github.com/pingcap/tidb/pull/29917) - - planner: fix the issue that planner may cache invalid plans for joins in some cases [#28445](https://github.com/pingcap/tidb/pull/28445) - - Keep the original join schema in predicate pushdown [#28295](https://github.com/pingcap/tidb/pull/28295) - -+ PingCAP/TiFlash - - - Align unix_timestamp behavior with TiDB and mysql when input is earlier than 1970-01-01 00:00:01 UTC [#3622](https://github.com/pingcap/tics/pull/3622) - - fix the issue that comparison between Decimal may cause overflow and report `Can't compare`. [#3366](https://github.com/pingcap/tics/pull/3366) - - Fix the issue of unexpected error that `3rd arguments of function substringUTF8 must be constants.` [#3266](https://github.com/pingcap/tics/pull/3266) - - Fix the issue that TiFlash fails to start up under platform without library `nsl` [#3205](https://github.com/pingcap/tics/pull/3205) - - ```release-note [#2701](https://github.com/pingcap/tics/pull/2701) - - Fix problem that TiDB Dashboard can not display disk information of TiFlash correctly in some situations. [#2397](https://github.com/pingcap/tics/pull/2397) + - Fix the congestion in gPRC, which may cause slow initialization phase. [#3132](https://github.com/pingcap/tiflow/pull/3132) -+ PD + + (Backup & Restore) BR - - Fix panic issue after TiKV node scales in [#4379](https://github.com/tikv/pd/pull/4379) - - Fix the issue that operator can get blocked due to down store [#4367](https://github.com/tikv/pd/pull/4367) - - Fix the issue that PD may not elect leader as soon as leader step down [#4218](https://github.com/tikv/pd/pull/4218) - - `evict-leader-scheduler` supports schedule the regions with unhealthy peers. [#4130](https://github.com/tikv/pd/pull/4130) + - Fix failed to retry grpc errors. [#1438](https://github.com/pingcap/br/pull/1438) + - Fix failed after importing table with expression index using local backend. [#1419](https://github.com/pingcap/br/pull/1419) + - Fix the average speed isn't accurate in backup and restore [#1411](https://github.com/pingcap/br/pull/1411) + + + Dumpling + + - Fix the bug that dumpling gets very slow when dumping composite primary/unique key tables. [#399](https://github.com/pingcap/dumpling/pull/399) \ No newline at end of file From 922dcc4e1ec99f5eb694fdbefc10294c62081607 Mon Sep 17 00:00:00 2001 From: shichun-0415 Date: Thu, 23 Dec 2021 12:04:13 +0800 Subject: [PATCH 05/51] Delete the feature enhancements section --- releases/release-5.0.6.md | 4 +--- 1 file changed, 1 insertion(+), 3 deletions(-) diff --git a/releases/release-5.0.6.md b/releases/release-5.0.6.md index f4c10ac75388f..1b0037fb4a4eb 100644 --- a/releases/release-5.0.6.md +++ b/releases/release-5.0.6.md @@ -17,7 +17,7 @@ TiDB version: 5.0.6 - Output the cdc server cmd error from stdout to stderr. [#3875](https://github.com/pingcap/tiflow/pull/3875) -## Feature enhancements +## Improvements + TiDB @@ -31,8 +31,6 @@ TiDB version: 5.0.6 - Add metrics for raft log garbage-collect to locate performance problem. [#11381](https://github.com/tikv/tikv/pull/11381) - Hide untouched storage commands' metrics in grafana dashboard [#11001](https://github.com/tikv/tikv/pull/11001) -## Improvements - + PD - Speed scheduler exit after transfer PD leader [#4201](https://github.com/tikv/pd/pull/4201) From 782279fc31d1929301cf3fd0359632c2fd6ae990 Mon Sep 17 00:00:00 2001 From: shichun-0415 Date: Thu, 23 Dec 2021 13:16:15 +0800 Subject: [PATCH 06/51] Replace PR with issue number --- releases/release-5.0.6.md | 156 +++++++++++++++++++------------------- 1 file changed, 78 insertions(+), 78 deletions(-) diff --git a/releases/release-5.0.6.md b/releases/release-5.0.6.md index 1b0037fb4a4eb..1bfcd932abbbc 100644 --- a/releases/release-5.0.6.md +++ b/releases/release-5.0.6.md @@ -21,33 +21,33 @@ TiDB version: 5.0.6 + TiDB - - Prevent conflicted optimistic transactions from locking each other [#29776](https://github.com/pingcap/tidb/pull/29776) + - Prevent conflicted optimistic transactions from locking each other [#11148](https://github.com/tikv/tikv/issues/11148) - Avoid confusing error log like `invalid cop task execution summaries length` when running MPP query [#28262](https://github.com/pingcap/tidb/pull/28262) - - The debug log on coprocessor doesn't print out the statement when encountering a lock, which makes it difficult to know what statement was affected by the lock. This fix tries to add the statement.[#27927](https://github.com/pingcap/tidb/pull/27927) + - The debug log on coprocessor doesn't print out the statement when encountering a lock, which makes it difficult to know what statement was affected by the lock. This fix tries to add the statement.[#27718](https://github.com/pingcap/tidb/issues/27718) + TiKV - - Move verify_checksum to import-thread from apply-thread. [#11257](https://github.com/tikv/tikv/pull/11257) - - Add metrics for raft log garbage-collect to locate performance problem. [#11381](https://github.com/tikv/tikv/pull/11381) + - Move verify_checksum to import-thread from apply-thread. [#11239](https://github.com/tikv/tikv/issues/11239) + - Add metrics for raft log garbage-collect to locate performance problem. [#11374](https://github.com/tikv/tikv/issues/11374) - Hide untouched storage commands' metrics in grafana dashboard [#11001](https://github.com/tikv/tikv/pull/11001) + PD - - Speed scheduler exit after transfer PD leader [#4201](https://github.com/tikv/pd/pull/4201) + - Speed scheduler exit after transfer PD leader [#4146](https://github.com/tikv/pd/issues/4146) - Make scatter range scheduler work better by allowing empty region schedule and fix config [#4116](https://github.com/tikv/pd/pull/4116) + Tools + TiCDC - - Optimize the rate limit control when TiKV reloads. [#3132](https://github.com/pingcap/tiflow/pull/3132) + - Optimize the rate limit control when TiKV reloads. [#3110](https://github.com/pingcap/tiflow/issues/3110) - Reduce lock competition in sink module. [#2760](https://github.com/pingcap/tiflow/pull/2760) - - Extend creating service gc safepoint ttl to 1 hour to support creating changefeeds that needs long initialization time. [#2852](https://github.com/pingcap/tiflow/pull/2852) - - Changefeed supports fast fail when occur ErrGCTTLExceeded error. [#3135](https://github.com/pingcap/tiflow/pull/3135) + - Extend creating service gc safepoint ttl to 1 hour to support creating changefeeds that needs long initialization time. [#2470](https://github.com/pingcap/tiflow/issues/2470) + - Changefeed supports fast fail when occur ErrGCTTLExceeded error. [#3111](https://github.com/pingcap/tiflow/issues/3111) - Add rate limiter to limit EtcdWorker tick frequency. [#3268](https://github.com/pingcap/tiflow/pull/3268) - - Support batch messages to reduce EtcdWorker tick. [#3391](https://github.com/pingcap/tiflow/pull/3391) + - Support batch messages to reduce EtcdWorker tick. [#3848](https://github.com/pingcap/tiflow/pull/3848) - Support unified sorter cgroup aware. [#3441](https://github.com/pingcap/tiflow/pull/3441) - - Add Kafka sink default configuration config.Metadata.Timeout. [#3670](https://github.com/pingcap/tiflow/pull/3670) - - Change Kafka sink default `MaxMessageBytes` to 1MB. [#3107](https://github.com/pingcap/tiflow/pull/3107) + - Add Kafka sink default configuration config.Metadata.Timeout. [#3539](https://github.com/pingcap/tiflow/pull/3539) + - Change Kafka sink default `MaxMessageBytes` to 1MB. [#3081](https://github.com/pingcap/tiflow/issues/3081) - Add more monitor metric and alert, including "no owner alert" [#3834](https://github.com/pingcap/tiflow/pull/3834), "mounter row" [#2830](https://github.com/pingcap/tiflow/pull/2830), "table sink total row" [#2830](https://github.com/pingcap/tiflow/pull/2830), "buffer sink total row" [#2830](https://github.com/pingcap/tiflow/pull/2830), "go gc" [#2998](https://github.com/pingcap/tiflow/pull/2998), "go_max_procs" [#2998](https://github.com/pingcap/tiflow/pull/2998), "cached region" [#2733](https://github.com/pingcap/tiflow/pull/2733). + (Backup & Restore) BR @@ -58,61 +58,61 @@ TiDB version: 5.0.6 + TiDB - - Fix the problem that error is raised when a grant/revoke SQL contains global level identifier [#30161](https://github.com/pingcap/tidb/pull/30161) - - Fix the problem that adding index panics by chance [#30125](https://github.com/pingcap/tidb/pull/30125) - - Fix the problem that the `enforce-mpp` config item is useless in v5.0.4 [#29637](https://github.com/pingcap/tidb/pull/29637) - - Fix the panic when the `case-when` function meets enum type input argument [#29509](https://github.com/pingcap/tidb/pull/29509) - - Fix the problem that result of the `microsecond` function is wrong in vectorized evaluation [#29385](https://github.com/pingcap/tidb/pull/29385) - - Fix the problem that the log lose the SQL text when auto analyze fails [#29228](https://github.com/pingcap/tidb/pull/29228) - - Fix the problem that result of the `hour` function is wrong in vectorized evaluation [#28871](https://github.com/pingcap/tidb/pull/28871) - - Fix the problem that unexpected error like `tidb_cast to Int32 is not supported` is raised when executing a MPP query [#28651](https://github.com/pingcap/tidb/pull/28651) - - Fix the problem that MPP node availability detection does not work in some corner cases [#28287](https://github.com/pingcap/tidb/pull/28287) - - Fix the problem that data-race may happen when alloc MPP task id [#28284](https://github.com/pingcap/tidb/pull/28284) - - Fix the problem that `index out of range [-1]` error is raised when a SQL contains `Union` and is running in MPP mode [#28278](https://github.com/pingcap/tidb/pull/28278) - - Fix the problem that TiDB panicks when inserting invalid date values concurrently [#28198](https://github.com/pingcap/tidb/pull/28198) + - Fix the problem that error is raised when a grant/revoke SQL contains global level identifier [#29675](https://github.com/pingcap/tidb/issues/29675) + - Fix the problem that adding index panics by chance [#27687](https://github.com/pingcap/tidb/issues/27687) + - Fix the problem that the `enforce-mpp` config item is useless in v5.0.4 [#29252](https://github.com/pingcap/tidb/issues/29252) + - Fix the panic when the `case-when` function meets enum type input argument [#29357](https://github.com/pingcap/tidb/issues/29357) + - Fix the problem that result of the `microsecond` function is wrong in vectorized evaluation [#29244](https://github.com/pingcap/tidb/issues/29244) + - Fix the problem that the log lose the SQL text when auto analyze fails [#29188](https://github.com/pingcap/tidb/issues/29188) + - Fix the problem that result of the `hour` function is wrong in vectorized evaluation [#28643](https://github.com/pingcap/tidb/issues/28643) + - Fix the problem that unexpected error like `tidb_cast to Int32 is not supported` is raised when executing a MPP query [#23907](https://github.com/pingcap/tidb/issues/23907) + - Fix the problem that MPP node availability detection does not work in some corner cases [#3118](https://github.com/pingcap/tics/issues/3118) + - Fix the problem that data-race may happen when alloc MPP task id [#27952](https://github.com/pingcap/tidb/issues/27952) + - Fix the problem that `index out of range [-1]` error is raised when a SQL contains `Union` and is running in MPP mode [#28250](https://github.com/pingcap/tidb/issues/28250) + - Fix the problem that TiDB panicks when inserting invalid date values concurrently [#25393](https://github.com/pingcap/tidb/issues/25393) - Fix the problem that the error like `can not found column in Schema column` is raised unexpectedly for mpp queries [#28147](https://github.com/pingcap/tidb/pull/28147) - - Fix the problem that TiDB may crash when TiFlash shut down [#28138](https://github.com/pingcap/tidb/pull/28138) - - Fix the problem that the `index out of range` error is raised unexpectly when the planner doing join reorder [#30881](https://github.com/pingcap/tidb/pull/30881). - - Fix the problem that the results of `if`,`case-when`,`elt` functions are wrong when the input arguments if of type enum [#30857](https://github.com/pingcap/tidb/pull/30857) - - Fix the problem the `concat(ifnull(time(3))` returns wrong result [#30830](https://github.com/pingcap/tidb/pull/30830) - - Fix the problem that `greatest/least(unsigned)` returns wrong result [#30791](https://github.com/pingcap/tidb/pull/30791) - - Fix the problem that SQL is cancelled when including json column joins char column [#30778](https://github.com/pingcap/tidb/pull/30778) - - Fix the data inconsistency caused by incorrect usage of lazy existence check and untouch key optimization [#30533](https://github.com/pingcap/tidb/pull/30533) - - Fix the problem that window function may return different results when using transaction or not [#30389](https://github.com/pingcap/tidb/pull/30389) - - Fix the problem that `cast(integer as char) union string` returns wrong result[#30055](https://github.com/pingcap/tidb/pull/30055) - - Fix the problem that `concat(decimal_col)` returns wrong result [#30014](https://github.com/pingcap/tidb/pull/30014) - - Fix the problem that the error `Column 'col_name' in field list is ambiguous` is raised unexpectedly when a SQL contains natural join [#30049](https://github.com/pingcap/tidb/pull/30049) - - Fix the problem that `greatest` returns different results when `tidb_enable_vectorized_expression` is on or not [#29917](https://github.com/pingcap/tidb/pull/29917) - - Fix the problem that planner may cache invalid plans for joins in some cases [#28445](https://github.com/pingcap/tidb/pull/28445) - - Fix the problem that the error `index out of range [1] with length 1` is raised when a SQL tries to evaluates an aggregation result on the result of join in some cases [#28295](https://github.com/pingcap/tidb/pull/28295) + - Fix the problem that TiDB may crash when TiFlash shut down [#28096](https://github.com/pingcap/tidb/issues/28096) + - Fix the problem that the `index out of range` error is raised unexpectly when the planner doing join reorder [#24095](https://github.com/pingcap/tidb/issues/24095). + - Fix the problem that the results of `if`,`case-when`,`elt` functions are wrong when the input arguments if of type enum [#23114](https://github.com/pingcap/tidb/issues/23114) + - Fix the problem the `concat(ifnull(time(3))` returns wrong result [#29498](https://github.com/pingcap/tidb/issues/29498) + - Fix the problem that `greatest/least(unsigned)` returns wrong result [#30101](https://github.com/pingcap/tidb/issues/30101) + - Fix the problem that SQL is cancelled when including json column joins char column [#29401](https://github.com/pingcap/tidb/issues/29401) + - Fix the data inconsistency caused by incorrect usage of lazy existence check and untouch key optimization [#30410](https://github.com/pingcap/tidb/issues/30410) + - Fix the problem that window function may return different results when using transaction or not [#29947](https://github.com/pingcap/tidb/issues/29947) + - Fix the problem that `cast(integer as char) union string` returns wrong result[#29513](https://github.com/pingcap/tidb/issues/29513) + - Fix the problem that `concat(decimal_col)` returns wrong result [#29417](https://github.com/pingcap/tidb/issues/29417) + - Fix the problem that the error `Column 'col_name' in field list is ambiguous` is raised unexpectedly when a SQL contains natural join [#25041](https://github.com/pingcap/tidb/issues/25041) + - Fix the problem that `greatest` returns different results when `tidb_enable_vectorized_expression` is on or not [#29434](https://github.com/pingcap/tidb/issues/29434) + - Fix the problem that planner may cache invalid plans for joins in some cases [#28087](https://github.com/pingcap/tidb/issues/28087) + - Fix the problem that the error `index out of range [1] with length 1` is raised when a SQL tries to evaluates an aggregation result on the result of join in some cases [#1978](https://github.com/pingcap/tics/issues/1978) + TiKV - - Fix resolved timestamp lag increased after stoping a tikv [#11538](https://github.com/tikv/tikv/pull/11538) - - Fix connection abort when too many small logs are batched into one messages [#11532](https://github.com/tikv/tikv/pull/11532) - - Fix panic in rare conditions when merge, conf change and snapshot happen at the same time [#11510](https://github.com/tikv/tikv/pull/11510) - - Fix the issue that reverse scan can't detect memory locks and may read stale data. [#11453](https://github.com/tikv/tikv/pull/11453) - - Fix negative sign when decimal divide to zero [#11333](https://github.com/tikv/tikv/pull/11333) - - Avoid possible OOM due to the accumulation of GC tasks [#11419](https://github.com/tikv/tikv/pull/11419) - - Fix incorrect metrics "gRPC average duration by-instance". [#11327](https://github.com/tikv/tikv/pull/11327) - - Fix bug of reporting metrics about destroyed threads to Prometheus. [#11201](https://github.com/tikv/tikv/pull/11201) - - Fix CDC panic due to missing downstream. [#11136](https://github.com/tikv/tikv/pull/11136) - - Fix frequent CDC incremental scan retry due to `Congest` error. [#11090](https://github.com/tikv/tikv/pull/11090) - - Fix channel full could break the raft connection [#11070](https://github.com/tikv/tikv/pull/11070) - - Fix panic caused by SST NotFound, which is ingested by Lightning import. [#10740](https://github.com/tikv/tikv/pull/10740) - - copr: fix Max/Min bug when comparing signed and unsigned int64 [#10617](https://github.com/tikv/tikv/pull/10617) - - Fix follower meta corruption in rare cases with more than 4 replicas [#10500](https://github.com/tikv/tikv/pull/10500) - - Fix backup threads leak [#10361](https://github.com/tikv/tikv/pull/10361) - - copr cast invalid utf8 string to real bug fix [#9871](https://github.com/tikv/tikv/pull/9871) + - Fix resolved timestamp lag increased after stoping a tikv [#11351](https://github.com/tikv/tikv/issues/11351) + - Fix connection abort when too many small logs are batched into one messages [#9714](https://github.com/tikv/tikv/issues/9714) + - Fix panic in rare conditions when merge, conf change and snapshot happen at the same time [#11475](https://github.com/tikv/tikv/issues/11475) + - Fix the issue that reverse scan can't detect memory locks and may read stale data. [#11440](https://github.com/tikv/tikv/issues/11440) + - Fix negative sign when decimal divide to zero [#29586](https://github.com/pingcap/tidb/issues/29586) + - Avoid possible OOM due to the accumulation of GC tasks [#11410](https://github.com/tikv/tikv/issues/11410) + - Fix incorrect metrics "gRPC average duration by-instance". [#11299](https://github.com/tikv/tikv/issues/11299) + - Fix bug of reporting metrics about destroyed threads to Prometheus. [#11195](https://github.com/tikv/tikv/issues/11195) + - Fix CDC panic due to missing downstream. [#11123](https://github.com/tikv/tikv/issues/11123) + - Fix frequent CDC incremental scan retry due to `Congest` error. [#11082](https://github.com/tikv/tikv/issues/11082) + - Fix channel full could break the raft connection [#11047](https://github.com/tikv/tikv/issues/11047) + - Fix panic caused by SST NotFound, which is ingested by Lightning import. [#10438](https://github.com/tikv/tikv/issues/10438) + - copr: fix Max/Min bug when comparing signed and unsigned int64 [#10158](https://github.com/tikv/tikv/issues/10158) + - Fix follower meta corruption in rare cases with more than 4 replicas [#10225](https://github.com/tikv/tikv/issues/10225) + - Fix backup threads leak [#10287](https://github.com/tikv/tikv/issues/10287) + - copr cast invalid utf8 string to real bug fix [#23322](https://github.com/pingcap/tidb/issues/23322) + PD - - Fix panic issue after TiKV node scales in with some corner cases [#4379](https://github.com/tikv/pd/pull/4379) - - Fix the issue that operator can get blocked due to down store [#4367](https://github.com/tikv/pd/pull/4367) - - Fix the issue that PD may not elect leader as soon as leader step down [#4218](https://github.com/tikv/pd/pull/4218) - - Fix the issue that `evict-leader-scheduler` cannot schedule the regions with unhealthy peers. [#4130](https://github.com/tikv/pd/pull/4130) - - Fix the issue that there is the store limit of remove peer of the down store [#4097](https://github.com/tikv/pd/pull/4097) - - Fix the issue that the hot cache cannot be cleared when the heartbeat interval is less than 60 [#4432](https://github.com/tikv/pd/pull/4432) + - Fix panic issue after TiKV node scales in with some corner cases [#4344](https://github.com/tikv/pd/issues/4344) + - Fix the issue that operator can get blocked due to down store [#3353](https://github.com/tikv/pd/issues/3353) + - Fix the issue that PD may not elect leader as soon as leader step down [#3936](https://github.com/tikv/pd/issues/3936) + - Fix the issue that `evict-leader-scheduler` cannot schedule the regions with unhealthy peers. [#4093](https://github.com/tikv/pd/issues/4093) + - Fix the issue that there is the store limit of remove peer of the down store [#4090](https://github.com/tikv/pd/issues/4090) + - Fix the issue that the hot cache cannot be cleared when the heartbeat interval is less than 60 [#4390](https://github.com/tikv/pd/issues/4390) + TiFlash @@ -137,33 +137,33 @@ TiDB version: 5.0.6 - Fix table is not replicated when adding partition about partition table without valid index. [#2864](https://github.com/pingcap/tiflow/pull/2864) - Fix cdc cli silently truncated user parameters when receiving unexpected parameters, causing the user input parameters to be lost. [#2888](https://github.com/pingcap/tiflow/pull/2888) - - Fix cdc scheduling tables too early. [#2633](https://github.com/pingcap/tiflow/pull/2633) + - Fix cdc scheduling tables too early. [#2625](https://github.com/pingcap/tiflow/issues/2625) - Fix Kafka_producer deadlock when an error occurs in asyncClient. [#3016](https://github.com/pingcap/tiflow/pull/3016) - - Fix MQ sink don't support non binary json string encoding. [#2782](https://github.com/pingcap/tiflow/pull/2782) - - Fix Kafka sink can not send message due to constraint by `max-message-size` option. [#3047](https://github.com/pingcap/tiflow/pull/3047) - - Fix fallback resolvedTs event block the progress of resolve lock when meet region merging. [#3100](https://github.com/pingcap/tiflow/pull/3100) - - Fix unexpected duplicate region request stream issue. [#3091](https://github.com/pingcap/tiflow/pull/3091) - - Fix changefeed region loss when multiple TiKVs crash or forcing restart. [#3291](https://github.com/pingcap/tiflow/pull/3291) - - Fix changefeed checkpoint lag metric negative value error. [#3533](https://github.com/pingcap/tiflow/pull/3533) - - Fix MySQL sink deadlock warning too frequently. [#3797](https://github.com/pingcap/tiflow/pull/3797) - - Fix Avro sink don't support json type column. [#3651](https://github.com/pingcap/tiflow/pull/3651) - - Fix read error schema snapshot from TiKV when owner restart. [#2610](https://github.com/pingcap/tiflow/pull/2610) + - Fix MQ sink don't support non binary json string encoding. [#2758](https://github.com/pingcap/tiflow/issues/2758) + - Fix Kafka sink can not send message due to constraint by `max-message-size` option. [#2962](https://github.com/pingcap/tiflow/issues/2962) + - Fix fallback resolvedTs event block the progress of resolve lock when meet region merging. [#3061](https://github.com/pingcap/tiflow/issues/3061) + - Fix unexpected duplicate region request stream issue. [#2386](https://github.com/pingcap/tiflow/issues/2386) + - Fix changefeed region loss when multiple TiKVs crash or forcing restart. [#3288](https://github.com/pingcap/tiflow/issues/3288) + - Fix changefeed checkpoint lag metric negative value error. [#3010](https://github.com/pingcap/tiflow/issues/3010) + - Fix MySQL sink deadlock warning too frequently. [#2706](https://github.com/pingcap/tiflow/issues/2706) + - Fix Avro sink don't support json type column. [#3624](https://github.com/pingcap/tiflow/issues/3624) + - Fix read error schema snapshot from TiKV when owner restart. [#2603](https://github.com/pingcap/tiflow/issues/2603) - Fix schema GC not work correctly and OOM issue when processing too many DDL. [#3275](https://github.com/pingcap/tiflow/pull/3275) - - Fix old value enabled is not forced on Canal and Maxwell protocols automatically. [#3780](https://github.com/pingcap/tiflow/pull/3780) - - Fix timezone related error that cause cdc server can't run in some RHEL release version (6.8, 6.9 etc). [#3908](https://github.com/pingcap/tiflow/pull/3908) + - Fix old value enabled is not forced on Canal and Maxwell protocols automatically. [#3676](https://github.com/pingcap/tiflow/issues/3676) + - Fix timezone related error that cause cdc server can't run in some RHEL release version (6.8, 6.9 etc). [#3584](https://github.com/pingcap/tiflow/issues/3584) - Fix txn_batch_size metric inaccurate issue for Kafka sink. [#3820](https://github.com/pingcap/tiflow/pull/3820) - - Fix Kafka partition count not check when auto-create-topic is disabled by the user. [#3566](https://github.com/pingcap/tiflow/pull/3566) - - Fix Kafka message too large for broker. [#3566](https://github.com/pingcap/tiflow/pull/3566) + - Fix Kafka partition count not check when auto-create-topic is disabled by the user. [#3337](https://github.com/pingcap/tiflow/issues/3337) + - Fix Kafka message too large for broker. [#3337](https://github.com/pingcap/tiflow/issues/3337) - Fix EtcdWorker row metric error. [#4000](https://github.com/pingcap/tiflow/pull/4000) - - Fix tikv_cdc_min_resolved_ts_no_change_for_1m keep firing when there is no changefeed. [#3024](https://github.com/pingcap/tiflow/pull/3024) - - Fix the congestion in gPRC, which may cause slow initialization phase. [#3132](https://github.com/pingcap/tiflow/pull/3132) + - Fix tikv_cdc_min_resolved_ts_no_change_for_1m keep firing when there is no changefeed. [#11017](https://github.com/tikv/tikv/issues/11017) + - Fix the congestion in gPRC, which may cause slow initialization phase. [#3110](https://github.com/pingcap/tiflow/issues/3110) + (Backup & Restore) BR - Fix failed to retry grpc errors. [#1438](https://github.com/pingcap/br/pull/1438) - - Fix failed after importing table with expression index using local backend. [#1419](https://github.com/pingcap/br/pull/1419) - - Fix the average speed isn't accurate in backup and restore [#1411](https://github.com/pingcap/br/pull/1411) + - Fix failed after importing table with expression index using local backend. [#1404](https://github.com/pingcap/br/issues/1404) + - Fix the average speed isn't accurate in backup and restore [#1405](https://github.com/pingcap/br/issues/1405) + Dumpling - - Fix the bug that dumpling gets very slow when dumping composite primary/unique key tables. [#399](https://github.com/pingcap/dumpling/pull/399) \ No newline at end of file + - Fix the bug that dumpling gets very slow when dumping composite primary/unique key tables. [#29386](https://github.com/pingcap/tidb/issues/29386) \ No newline at end of file From fd28cdb6952bda422248a029893a8616a729efc7 Mon Sep 17 00:00:00 2001 From: shichun-0415 Date: Thu, 23 Dec 2021 13:23:25 +0800 Subject: [PATCH 07/51] Remove TiFlash PR --- releases/release-5.0.6.md | 28 ++++++++++++++-------------- 1 file changed, 14 insertions(+), 14 deletions(-) diff --git a/releases/release-5.0.6.md b/releases/release-5.0.6.md index 1bfcd932abbbc..66c67ea8854a4 100644 --- a/releases/release-5.0.6.md +++ b/releases/release-5.0.6.md @@ -116,20 +116,20 @@ TiDB version: 5.0.6 + TiFlash - - Fix potential data inconsistency when widen pk column type if pk is handle [#3572](https://github.com/pingcap/tics/pull/3572) - - Fix Tiflash arm build when include `libnsl.so`. Try copy `libnsl.so` to `INSTALL_DIR` [#3205](https://github.com/pingcap/tics/pull/3205) - - Fix store size on `tiflash metrics` is not consistent.Decrease the size of checkpoint file when removing it [#3187](https://github.com/pingcap/tics/pull/3187) - - Fix exception: `GC` removed normal file which just created [#3226](https://github.com/pingcap/tics/pull/3226) - - Fix sync schema exception when user upgrade the TiFlash version. [#2701](https://github.com/pingcap/tics/pull/2701) - - Fix tiflash randomly crash when a mpp query is killed. [#3448](https://github.com/pingcap/tics/pull/3448) - - Fix throw not constants exception in `substringUTF8` [#3266](https://github.com/pingcap/tics/pull/3266) - - Fix decode DAG request failed.Add retry when decode DAG request failed. [#3678](https://github.com/pingcap/tics/pull/3678) - - Fix the bug that results of `where ` is wrong because it will be converted to int type. [#3477](https://github.com/pingcap/tics/pull/3477) - - Fix `main_capacity_quota_` check [#3425](https://github.com/pingcap/tics/pull/3425) - - Fix the inconsistent behavior of `CastStringAsDecimal` between tiflash and tidb/tikv. [#3674](https://github.com/pingcap/tics/pull/3674) - - Fix exception: `expected Nullable(Int64), got Int64`. Sending schemas in exchangeSender to avoid schema mismatch. [#3369](https://github.com/pingcap/tics/pull/3369) - - Fix the issue of unexpected error that `Unexpected type of column: Nullable(Nothing)` [#3376](https://github.com/pingcap/tics/pull/3376) - - Fix the issue that comparison between Decimal may cause overflow and report Can't compare. [#3097](https://github.com/pingcap/tics/pull/3097) + - Fix potential data inconsistency when widen pk column type if pk is handle + - Fix Tiflash arm build when include `libnsl.so`. Try copy `libnsl.so` to `INSTALL_DIR` + - Fix store size on `tiflash metrics` is not consistent.Decrease the size of checkpoint file when removing it + - Fix exception: `GC` removed normal file which just created + - Fix sync schema exception when user upgrade the TiFlash version + - Fix tiflash randomly crash when a mpp query is killed + - Fix throw not constants exception in `substringUTF8` + - Fix decode DAG request failed.Add retry when decode DAG request failed + - Fix the bug that results of `where ` is wrong because it will be converted to int type + - Fix `main_capacity_quota_` check + - Fix the inconsistent behavior of `CastStringAsDecimal` between tiflash and tidb/tikv + - Fix exception: `expected Nullable(Int64), got Int64`. Sending schemas in exchangeSender to avoid schema mismatch + - Fix the issue of unexpected error that `Unexpected type of column: Nullable(Nothing)` + - Fix the issue that comparison between Decimal may cause overflow and report Can't compare + Tools From c01123224aea253115952d0108f751f34ccf2575 Mon Sep 17 00:00:00 2001 From: shichun-0415 Date: Thu, 23 Dec 2021 15:06:35 +0800 Subject: [PATCH 08/51] Replace PR with issue [2] --- releases/release-5.0.6.md | 28 ++++++++++++++-------------- 1 file changed, 14 insertions(+), 14 deletions(-) diff --git a/releases/release-5.0.6.md b/releases/release-5.0.6.md index 66c67ea8854a4..2f2d91a9dae49 100644 --- a/releases/release-5.0.6.md +++ b/releases/release-5.0.6.md @@ -15,21 +15,21 @@ TiDB version: 5.0.6 + TiCDC - - Output the cdc server cmd error from stdout to stderr. [#3875](https://github.com/pingcap/tiflow/pull/3875) + - Output the cdc server cmd error from stdout to stderr. [#3133](https://github.com/pingcap/tiflow/issues/3133) ## Improvements + TiDB - Prevent conflicted optimistic transactions from locking each other [#11148](https://github.com/tikv/tikv/issues/11148) - - Avoid confusing error log like `invalid cop task execution summaries length` when running MPP query [#28262](https://github.com/pingcap/tidb/pull/28262) + - Avoid confusing error log like `invalid cop task execution summaries length` when running MPP query [#1791](https://github.com/pingcap/tics/issues/1791) - The debug log on coprocessor doesn't print out the statement when encountering a lock, which makes it difficult to know what statement was affected by the lock. This fix tries to add the statement.[#27718](https://github.com/pingcap/tidb/issues/27718) + TiKV - Move verify_checksum to import-thread from apply-thread. [#11239](https://github.com/tikv/tikv/issues/11239) - Add metrics for raft log garbage-collect to locate performance problem. [#11374](https://github.com/tikv/tikv/issues/11374) - - Hide untouched storage commands' metrics in grafana dashboard [#11001](https://github.com/tikv/tikv/pull/11001) + - Hide untouched storage commands' metrics in grafana dashboard [#11681](https://github.com/tikv/tikv/issues/11681) + PD @@ -43,16 +43,16 @@ TiDB version: 5.0.6 - Reduce lock competition in sink module. [#2760](https://github.com/pingcap/tiflow/pull/2760) - Extend creating service gc safepoint ttl to 1 hour to support creating changefeeds that needs long initialization time. [#2470](https://github.com/pingcap/tiflow/issues/2470) - Changefeed supports fast fail when occur ErrGCTTLExceeded error. [#3111](https://github.com/pingcap/tiflow/issues/3111) - - Add rate limiter to limit EtcdWorker tick frequency. [#3268](https://github.com/pingcap/tiflow/pull/3268) - - Support batch messages to reduce EtcdWorker tick. [#3848](https://github.com/pingcap/tiflow/pull/3848) - - Support unified sorter cgroup aware. [#3441](https://github.com/pingcap/tiflow/pull/3441) - - Add Kafka sink default configuration config.Metadata.Timeout. [#3539](https://github.com/pingcap/tiflow/pull/3539) + - Add rate limiter to limit EtcdWorker tick frequency. [#3112](https://github.com/pingcap/tiflow/issues/3112) + - Support batch messages to reduce EtcdWorker tick. [#3391](https://github.com/pingcap/tiflow/pull/3391) + - Support unified sorter cgroup aware. [#1798](https://github.com/pingcap/tiflow/issues/1798) + - Add Kafka sink default configuration config.Metadata.Timeout. [#3352](https://github.com/pingcap/tiflow/issues/3352) - Change Kafka sink default `MaxMessageBytes` to 1MB. [#3081](https://github.com/pingcap/tiflow/issues/3081) - Add more monitor metric and alert, including "no owner alert" [#3834](https://github.com/pingcap/tiflow/pull/3834), "mounter row" [#2830](https://github.com/pingcap/tiflow/pull/2830), "table sink total row" [#2830](https://github.com/pingcap/tiflow/pull/2830), "buffer sink total row" [#2830](https://github.com/pingcap/tiflow/pull/2830), "go gc" [#2998](https://github.com/pingcap/tiflow/pull/2998), "go_max_procs" [#2998](https://github.com/pingcap/tiflow/pull/2998), "cached region" [#2733](https://github.com/pingcap/tiflow/pull/2733). + (Backup & Restore) BR - - Retry pd request and TiKV IO timeout error [#1436](https://github.com/pingcap/br/pull/1436) + - Retry pd request and TiKV IO timeout error [#27787](https://github.com/pingcap/tidb/issues/27787) ## Bug fixes @@ -135,10 +135,10 @@ TiDB version: 5.0.6 + TiCDC - - Fix table is not replicated when adding partition about partition table without valid index. [#2864](https://github.com/pingcap/tiflow/pull/2864) - - Fix cdc cli silently truncated user parameters when receiving unexpected parameters, causing the user input parameters to be lost. [#2888](https://github.com/pingcap/tiflow/pull/2888) + - Fix table is not replicated when adding partition about partition table without valid index. [#2834](https://github.com/pingcap/tiflow/issues/2834) + - Fix cdc cli silently truncated user parameters when receiving unexpected parameters, causing the user input parameters to be lost. [#2303](https://github.com/pingcap/tiflow/issues/2303) - Fix cdc scheduling tables too early. [#2625](https://github.com/pingcap/tiflow/issues/2625) - - Fix Kafka_producer deadlock when an error occurs in asyncClient. [#3016](https://github.com/pingcap/tiflow/pull/3016) + - Fix Kafka_producer deadlock when an error occurs in asyncClient. [#2978](https://github.com/pingcap/tiflow/issues/2978) - Fix MQ sink don't support non binary json string encoding. [#2758](https://github.com/pingcap/tiflow/issues/2758) - Fix Kafka sink can not send message due to constraint by `max-message-size` option. [#2962](https://github.com/pingcap/tiflow/issues/2962) - Fix fallback resolvedTs event block the progress of resolve lock when meet region merging. [#3061](https://github.com/pingcap/tiflow/issues/3061) @@ -148,10 +148,10 @@ TiDB version: 5.0.6 - Fix MySQL sink deadlock warning too frequently. [#2706](https://github.com/pingcap/tiflow/issues/2706) - Fix Avro sink don't support json type column. [#3624](https://github.com/pingcap/tiflow/issues/3624) - Fix read error schema snapshot from TiKV when owner restart. [#2603](https://github.com/pingcap/tiflow/issues/2603) - - Fix schema GC not work correctly and OOM issue when processing too many DDL. [#3275](https://github.com/pingcap/tiflow/pull/3275) + - Fix schema GC not work correctly and OOM issue when processing too many DDL. [#3174](https://github.com/pingcap/tiflow/issues/3174) - Fix old value enabled is not forced on Canal and Maxwell protocols automatically. [#3676](https://github.com/pingcap/tiflow/issues/3676) - Fix timezone related error that cause cdc server can't run in some RHEL release version (6.8, 6.9 etc). [#3584](https://github.com/pingcap/tiflow/issues/3584) - - Fix txn_batch_size metric inaccurate issue for Kafka sink. [#3820](https://github.com/pingcap/tiflow/pull/3820) + - Fix txn_batch_size metric inaccurate issue for Kafka sink. [#3431](https://github.com/pingcap/tiflow/issues/3431) - Fix Kafka partition count not check when auto-create-topic is disabled by the user. [#3337](https://github.com/pingcap/tiflow/issues/3337) - Fix Kafka message too large for broker. [#3337](https://github.com/pingcap/tiflow/issues/3337) - Fix EtcdWorker row metric error. [#4000](https://github.com/pingcap/tiflow/pull/4000) @@ -160,7 +160,7 @@ TiDB version: 5.0.6 + (Backup & Restore) BR - - Fix failed to retry grpc errors. [#1438](https://github.com/pingcap/br/pull/1438) + - Fix failed to retry grpc errors. [#27421](https://github.com/pingcap/tidb/issues/27421) - Fix failed after importing table with expression index using local backend. [#1404](https://github.com/pingcap/br/issues/1404) - Fix the average speed isn't accurate in backup and restore [#1405](https://github.com/pingcap/br/issues/1405) From 9ef3dc1eaceb7bc76838516113b03af017dafd82 Mon Sep 17 00:00:00 2001 From: shichun-0415 <89768198+shichun-0415@users.noreply.github.com> Date: Thu, 23 Dec 2021 15:34:14 +0800 Subject: [PATCH 09/51] Apply suggestions from code review Co-authored-by: maxshuang --- releases/release-5.0.6.md | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git a/releases/release-5.0.6.md b/releases/release-5.0.6.md index 2f2d91a9dae49..57e71ac716612 100644 --- a/releases/release-5.0.6.md +++ b/releases/release-5.0.6.md @@ -44,11 +44,11 @@ TiDB version: 5.0.6 - Extend creating service gc safepoint ttl to 1 hour to support creating changefeeds that needs long initialization time. [#2470](https://github.com/pingcap/tiflow/issues/2470) - Changefeed supports fast fail when occur ErrGCTTLExceeded error. [#3111](https://github.com/pingcap/tiflow/issues/3111) - Add rate limiter to limit EtcdWorker tick frequency. [#3112](https://github.com/pingcap/tiflow/issues/3112) - - Support batch messages to reduce EtcdWorker tick. [#3391](https://github.com/pingcap/tiflow/pull/3391) + - Support batch messages to reduce EtcdWorker tick. [3112](https://github.com/pingcap/tiflow/issues/3112) - Support unified sorter cgroup aware. [#1798](https://github.com/pingcap/tiflow/issues/1798) - Add Kafka sink default configuration config.Metadata.Timeout. [#3352](https://github.com/pingcap/tiflow/issues/3352) - Change Kafka sink default `MaxMessageBytes` to 1MB. [#3081](https://github.com/pingcap/tiflow/issues/3081) - - Add more monitor metric and alert, including "no owner alert" [#3834](https://github.com/pingcap/tiflow/pull/3834), "mounter row" [#2830](https://github.com/pingcap/tiflow/pull/2830), "table sink total row" [#2830](https://github.com/pingcap/tiflow/pull/2830), "buffer sink total row" [#2830](https://github.com/pingcap/tiflow/pull/2830), "go gc" [#2998](https://github.com/pingcap/tiflow/pull/2998), "go_max_procs" [#2998](https://github.com/pingcap/tiflow/pull/2998), "cached region" [#2733](https://github.com/pingcap/tiflow/pull/2733). + - Add more monitor metric and alert, including "no owner alert" [#3834](https://github.com/pingcap/tiflow/pull/3834), "mounter row" , "table sink total row" , "buffer sink total row" [#1606](https://github.com/pingcap/tiflow/issues/1606), "go gc" , "go_max_procs" [#2998](https://github.com/pingcap/tiflow/pull/2998), "cached region" [#2733](https://github.com/pingcap/tiflow/pull/2733). + (Backup & Restore) BR From 0522f901001b721363c403e934a52d0b78180bc0 Mon Sep 17 00:00:00 2001 From: TomShawn <41534398+TomShawn@users.noreply.github.com> Date: Thu, 23 Dec 2021 15:45:17 +0800 Subject: [PATCH 10/51] get duplicated notes --- releases/release-5.0.6.md | 34 +++++++++++++++++----------------- 1 file changed, 17 insertions(+), 17 deletions(-) diff --git a/releases/release-5.0.6.md b/releases/release-5.0.6.md index 57e71ac716612..e0f591c37a2a9 100644 --- a/releases/release-5.0.6.md +++ b/releases/release-5.0.6.md @@ -21,7 +21,7 @@ TiDB version: 5.0.6 + TiDB - - Prevent conflicted optimistic transactions from locking each other [#11148](https://github.com/tikv/tikv/issues/11148) + (dup) - Fix the issue that optimistic transaction conflicts might cause transactions to block each other [#11148](https://github.com/tikv/tikv/issues/11148) - Avoid confusing error log like `invalid cop task execution summaries length` when running MPP query [#1791](https://github.com/pingcap/tics/issues/1791) - The debug log on coprocessor doesn't print out the statement when encountering a lock, which makes it difficult to know what statement was affected by the lock. This fix tries to add the statement.[#27718](https://github.com/pingcap/tidb/issues/27718) @@ -39,13 +39,13 @@ TiDB version: 5.0.6 + Tools + TiCDC - - Optimize the rate limit control when TiKV reloads. [#3110](https://github.com/pingcap/tiflow/issues/3110) + (dup) - Optimize rate limiting control on TiKV reloads to reduce gPRC congestion during changefeed initialization [#3110](https://github.com/pingcap/ticdc/issues/3110) - Reduce lock competition in sink module. [#2760](https://github.com/pingcap/tiflow/pull/2760) - - Extend creating service gc safepoint ttl to 1 hour to support creating changefeeds that needs long initialization time. [#2470](https://github.com/pingcap/tiflow/issues/2470) - - Changefeed supports fast fail when occur ErrGCTTLExceeded error. [#3111](https://github.com/pingcap/tiflow/issues/3111) - - Add rate limiter to limit EtcdWorker tick frequency. [#3112](https://github.com/pingcap/tiflow/issues/3112) + (dup) - Fix the issue that scanning stock data might fail due to TiKV performing GC when scanning stock data takes too long [#2470](https://github.com/pingcap/ticdc/issues/2470) + (dup) - Fix the issue that changefeed does not fail fast enough when the ErrGCTTLExceeded error occurs [#3111](https://github.com/pingcap/ticdc/issues/3111) + (dup) - Add a tick frequency limit to EtcdWorker to prevent frequent etcd writes from affecting PD services [#3112](https://github.com/pingcap/ticdc/issues/3112) - Support batch messages to reduce EtcdWorker tick. [3112](https://github.com/pingcap/tiflow/issues/3112) - - Support unified sorter cgroup aware. [#1798](https://github.com/pingcap/tiflow/issues/1798) + (dup) - Fix OOM in container environments [#1798](https://github.com/pingcap/ticdc/issues/1798) - Add Kafka sink default configuration config.Metadata.Timeout. [#3352](https://github.com/pingcap/tiflow/issues/3352) - Change Kafka sink default `MaxMessageBytes` to 1MB. [#3081](https://github.com/pingcap/tiflow/issues/3081) - Add more monitor metric and alert, including "no owner alert" [#3834](https://github.com/pingcap/tiflow/pull/3834), "mounter row" , "table sink total row" , "buffer sink total row" [#1606](https://github.com/pingcap/tiflow/issues/1606), "go gc" , "go_max_procs" [#2998](https://github.com/pingcap/tiflow/pull/2998), "cached region" [#2733](https://github.com/pingcap/tiflow/pull/2733). @@ -58,13 +58,13 @@ TiDB version: 5.0.6 + TiDB - - Fix the problem that error is raised when a grant/revoke SQL contains global level identifier [#29675](https://github.com/pingcap/tidb/issues/29675) + (dup) - Fix the `privilege check fail` error when performing the `grant` and `revoke` operations to grant and revoke global level privileges [#29675](https://github.com/pingcap/tidb/issues/29675) - Fix the problem that adding index panics by chance [#27687](https://github.com/pingcap/tidb/issues/27687) - Fix the problem that the `enforce-mpp` config item is useless in v5.0.4 [#29252](https://github.com/pingcap/tidb/issues/29252) - - Fix the panic when the `case-when` function meets enum type input argument [#29357](https://github.com/pingcap/tidb/issues/29357) - - Fix the problem that result of the `microsecond` function is wrong in vectorized evaluation [#29244](https://github.com/pingcap/tidb/issues/29244) - - Fix the problem that the log lose the SQL text when auto analyze fails [#29188](https://github.com/pingcap/tidb/issues/29188) - - Fix the problem that result of the `hour` function is wrong in vectorized evaluation [#28643](https://github.com/pingcap/tidb/issues/28643) + (dup) - Fix the panic when using the `CASE WHEN` function on the `ENUM` data type [#29357](https://github.com/pingcap/tidb/issues/29357) + (dup) - Fix wrong results of the `microsecond` function in vectorized expressions [#29244](https://github.com/pingcap/tidb/issues/29244) + (dup) - Fix the issue of incomplete log information from the `auto analyze` result [#29188](https://github.com/pingcap/tidb/issues/29188) + (dup) - Fix wrong results of the `hour` function in vectorized expression [#28643](https://github.com/pingcap/tidb/issues/28643) - Fix the problem that unexpected error like `tidb_cast to Int32 is not supported` is raised when executing a MPP query [#23907](https://github.com/pingcap/tidb/issues/23907) - Fix the problem that MPP node availability detection does not work in some corner cases [#3118](https://github.com/pingcap/tics/issues/3118) - Fix the problem that data-race may happen when alloc MPP task id [#27952](https://github.com/pingcap/tidb/issues/27952) @@ -73,24 +73,24 @@ TiDB version: 5.0.6 - Fix the problem that the error like `can not found column in Schema column` is raised unexpectedly for mpp queries [#28147](https://github.com/pingcap/tidb/pull/28147) - Fix the problem that TiDB may crash when TiFlash shut down [#28096](https://github.com/pingcap/tidb/issues/28096) - Fix the problem that the `index out of range` error is raised unexpectly when the planner doing join reorder [#24095](https://github.com/pingcap/tidb/issues/24095). - - Fix the problem that the results of `if`,`case-when`,`elt` functions are wrong when the input arguments if of type enum [#23114](https://github.com/pingcap/tidb/issues/23114) + (dup) - Fix wrong results of the control functions (such as `IF` and `CASE WHEN`) when using the `ENUM` type data as parameters of such functions [#23114](https://github.com/pingcap/tidb/issues/23114) - Fix the problem the `concat(ifnull(time(3))` returns wrong result [#29498](https://github.com/pingcap/tidb/issues/29498) - Fix the problem that `greatest/least(unsigned)` returns wrong result [#30101](https://github.com/pingcap/tidb/issues/30101) - Fix the problem that SQL is cancelled when including json column joins char column [#29401](https://github.com/pingcap/tidb/issues/29401) - Fix the data inconsistency caused by incorrect usage of lazy existence check and untouch key optimization [#30410](https://github.com/pingcap/tidb/issues/30410) - Fix the problem that window function may return different results when using transaction or not [#29947](https://github.com/pingcap/tidb/issues/29947) - Fix the problem that `cast(integer as char) union string` returns wrong result[#29513](https://github.com/pingcap/tidb/issues/29513) - - Fix the problem that `concat(decimal_col)` returns wrong result [#29417](https://github.com/pingcap/tidb/issues/29417) + (dup) - Fix the issue that the length information is wrong when converting `Decimal` to `String` [#29417](https://github.com/pingcap/tidb/issues/29417) - Fix the problem that the error `Column 'col_name' in field list is ambiguous` is raised unexpectedly when a SQL contains natural join [#25041](https://github.com/pingcap/tidb/issues/25041) - - Fix the problem that `greatest` returns different results when `tidb_enable_vectorized_expression` is on or not [#29434](https://github.com/pingcap/tidb/issues/29434) - - Fix the problem that planner may cache invalid plans for joins in some cases [#28087](https://github.com/pingcap/tidb/issues/28087) + (dup) - Fix the issue that the `GREATEST` function returns inconsistent results due to different values of `tidb_enable_vectorized_expression` (`on` or `off`) [#29434](https://github.com/pingcap/tidb/issues/29434) + (dup) - Fix the issue that planner might cache invalid plans for `join` in some cases [#28087](https://github.com/pingcap/tidb/issues/28087) - Fix the problem that the error `index out of range [1] with length 1` is raised when a SQL tries to evaluates an aggregation result on the result of join in some cases [#1978](https://github.com/pingcap/tics/issues/1978) + TiKV - Fix resolved timestamp lag increased after stoping a tikv [#11351](https://github.com/tikv/tikv/issues/11351) - Fix connection abort when too many small logs are batched into one messages [#9714](https://github.com/tikv/tikv/issues/9714) - - Fix panic in rare conditions when merge, conf change and snapshot happen at the same time [#11475](https://github.com/tikv/tikv/issues/11475) + (dup) - Fix a panic issue that occurs when Region merge, ConfChange, and Snapshot happen at the same time in extreme conditions [#11475](https://github.com/tikv/tikv/issues/11475) - Fix the issue that reverse scan can't detect memory locks and may read stale data. [#11440](https://github.com/tikv/tikv/issues/11440) - Fix negative sign when decimal divide to zero [#29586](https://github.com/pingcap/tidb/issues/29586) - Avoid possible OOM due to the accumulation of GC tasks [#11410](https://github.com/tikv/tikv/issues/11410) @@ -166,4 +166,4 @@ TiDB version: 5.0.6 + Dumpling - - Fix the bug that dumpling gets very slow when dumping composite primary/unique key tables. [#29386](https://github.com/pingcap/tidb/issues/29386) \ No newline at end of file + - Fix the bug that dumpling gets very slow when dumping composite primary/unique key tables. [#29386](https://github.com/pingcap/tidb/issues/29386) From 76121df731b167e6c32f13c3c28065b33b7f1700 Mon Sep 17 00:00:00 2001 From: TomShawn <41534398+TomShawn@users.noreply.github.com> Date: Thu, 23 Dec 2021 15:49:55 +0800 Subject: [PATCH 11/51] mark duplicated notes --- releases/release-5.0.6.md | 46 +++++++++++++++++++-------------------- 1 file changed, 23 insertions(+), 23 deletions(-) diff --git a/releases/release-5.0.6.md b/releases/release-5.0.6.md index e0f591c37a2a9..ce5d9aefd6c93 100644 --- a/releases/release-5.0.6.md +++ b/releases/release-5.0.6.md @@ -92,25 +92,25 @@ TiDB version: 5.0.6 - Fix connection abort when too many small logs are batched into one messages [#9714](https://github.com/tikv/tikv/issues/9714) (dup) - Fix a panic issue that occurs when Region merge, ConfChange, and Snapshot happen at the same time in extreme conditions [#11475](https://github.com/tikv/tikv/issues/11475) - Fix the issue that reverse scan can't detect memory locks and may read stale data. [#11440](https://github.com/tikv/tikv/issues/11440) - - Fix negative sign when decimal divide to zero [#29586](https://github.com/pingcap/tidb/issues/29586) + (dup) - Fix the issue of negative sign when the decimal divide result is zero [#29586](https://github.com/pingcap/tidb/issues/29586) - Avoid possible OOM due to the accumulation of GC tasks [#11410](https://github.com/tikv/tikv/issues/11410) - - Fix incorrect metrics "gRPC average duration by-instance". [#11299](https://github.com/tikv/tikv/issues/11299) + (dup) - Fix the issue that the average latency of the by-instance gRPC requests is inaccurate in TiKV metrics [#11299](https://github.com/tikv/tikv/issues/11299) - Fix bug of reporting metrics about destroyed threads to Prometheus. [#11195](https://github.com/tikv/tikv/issues/11195) - - Fix CDC panic due to missing downstream. [#11123](https://github.com/tikv/tikv/issues/11123) - - Fix frequent CDC incremental scan retry due to `Congest` error. [#11082](https://github.com/tikv/tikv/issues/11082) - - Fix channel full could break the raft connection [#11047](https://github.com/tikv/tikv/issues/11047) + (dup) - Fix the issue of TiCDC panic that occurs when the downstream database is missing [#11123](https://github.com/tikv/tikv/issues/11123) + (dup) - Fix the issue that CDC adds scan retries frequently due to the Congest error [#11082](https://github.com/tikv/tikv/issues/11082) + (dup) - Fix the issue that the Raft connection is broken when the channel is full [#11047](https://github.com/tikv/tikv/issues/11047) - Fix panic caused by SST NotFound, which is ingested by Lightning import. [#10438](https://github.com/tikv/tikv/issues/10438) - - copr: fix Max/Min bug when comparing signed and unsigned int64 [#10158](https://github.com/tikv/tikv/issues/10158) + (dup) - Fix the issue that TiDB cannot correctly identify whether the `Int64` types in `Max`/`Min` functions are a signed integer or not, which causes the wrong calculation result of `Max`/`Min` [#10158](https://github.com/tikv/tikv/issues/10158) - Fix follower meta corruption in rare cases with more than 4 replicas [#10225](https://github.com/tikv/tikv/issues/10225) - Fix backup threads leak [#10287](https://github.com/tikv/tikv/issues/10287) - copr cast invalid utf8 string to real bug fix [#23322](https://github.com/pingcap/tidb/issues/23322) + PD - - Fix panic issue after TiKV node scales in with some corner cases [#4344](https://github.com/tikv/pd/issues/4344) + (dup) - Fix a panic issue that occurs after the TiKV node is removed [#4344](https://github.com/tikv/pd/issues/4344) - Fix the issue that operator can get blocked due to down store [#3353](https://github.com/tikv/pd/issues/3353) - - Fix the issue that PD may not elect leader as soon as leader step down [#3936](https://github.com/tikv/pd/issues/3936) - - Fix the issue that `evict-leader-scheduler` cannot schedule the regions with unhealthy peers. [#4093](https://github.com/tikv/pd/issues/4093) + (dup) - Fix slow leader election caused by stucked region syncer [#3936](https://github.com/tikv/pd/issues/3936) + (dup) - Support that the evict leader scheduler can schedule regions with unhealthy peers [#4093](https://github.com/tikv/pd/issues/4093) - Fix the issue that there is the store limit of remove peer of the down store [#4090](https://github.com/tikv/pd/issues/4090) - Fix the issue that the hot cache cannot be cleared when the heartbeat interval is less than 60 [#4390](https://github.com/tikv/pd/issues/4390) @@ -135,32 +135,32 @@ TiDB version: 5.0.6 + TiCDC - - Fix table is not replicated when adding partition about partition table without valid index. [#2834](https://github.com/pingcap/tiflow/issues/2834) + (dup) - Fix the issue that some partitioned tables without valid indexes might be ignored when `force-replicate` is enabled [#2834](https://github.com/pingcap/ticdc/issues/2834) - Fix cdc cli silently truncated user parameters when receiving unexpected parameters, causing the user input parameters to be lost. [#2303](https://github.com/pingcap/tiflow/issues/2303) - Fix cdc scheduling tables too early. [#2625](https://github.com/pingcap/tiflow/issues/2625) - - Fix Kafka_producer deadlock when an error occurs in asyncClient. [#2978](https://github.com/pingcap/tiflow/issues/2978) + (dup) - Fix the issue that TiCDC sync task might pause when an error occurs during writing a Kafka message [#2978](https://github.com/pingcap/ticdc/issues/2978) - Fix MQ sink don't support non binary json string encoding. [#2758](https://github.com/pingcap/tiflow/issues/2758) - - Fix Kafka sink can not send message due to constraint by `max-message-size` option. [#2962](https://github.com/pingcap/tiflow/issues/2962) - - Fix fallback resolvedTs event block the progress of resolve lock when meet region merging. [#3061](https://github.com/pingcap/tiflow/issues/3061) - - Fix unexpected duplicate region request stream issue. [#2386](https://github.com/pingcap/tiflow/issues/2386) - - Fix changefeed region loss when multiple TiKVs crash or forcing restart. [#3288](https://github.com/pingcap/tiflow/issues/3288) - - Fix changefeed checkpoint lag metric negative value error. [#3010](https://github.com/pingcap/tiflow/issues/3010) + (dup) (dup) - Fix the issue that the volume of Kafka messages generated by TiCDC is not constrained by `max-message-size` [#2962](https://github.com/pingcap/ticdc/issues/2962) + (dup) - Fix the issue that TiCDC replication task might terminate when the upstream TiDB instance unexpectedly exits [#3061](https://github.com/pingcap/ticdc/issues/3061) + (dup) - Fix the issue that TiCDC process might panic when TiKV sends duplicate requests to the same Region [#2386](https://github.com/pingcap/ticdc/issues/2386) + (dup) - Fix the TiCDC replication interruption issue when multiple TiKVs crash or during a forced restart [#3288](https://github.com/pingcap/ticdc/issues/3288) + (dup) - Fix the negative value error in the changefeed checkpoint lag [#3010](https://github.com/pingcap/ticdc/issues/3010) - Fix MySQL sink deadlock warning too frequently. [#2706](https://github.com/pingcap/tiflow/issues/2706) - Fix Avro sink don't support json type column. [#3624](https://github.com/pingcap/tiflow/issues/3624) - Fix read error schema snapshot from TiKV when owner restart. [#2603](https://github.com/pingcap/tiflow/issues/2603) - - Fix schema GC not work correctly and OOM issue when processing too many DDL. [#3174](https://github.com/pingcap/tiflow/issues/3174) + (dup) - Fix the memory leak issue after processing DDLs [#3174](https://github.com/pingcap/ticdc/issues/3174) - Fix old value enabled is not forced on Canal and Maxwell protocols automatically. [#3676](https://github.com/pingcap/tiflow/issues/3676) - - Fix timezone related error that cause cdc server can't run in some RHEL release version (6.8, 6.9 etc). [#3584](https://github.com/pingcap/tiflow/issues/3584) + - Fix timezone related error that cause cdc server can't run in some RHEL release version (6.8, 6.9 etc). [#3584](https://github.com/pingcap/tiflow/issues/3584) - Fix txn_batch_size metric inaccurate issue for Kafka sink. [#3431](https://github.com/pingcap/tiflow/issues/3431) - - Fix Kafka partition count not check when auto-create-topic is disabled by the user. [#3337](https://github.com/pingcap/tiflow/issues/3337) - - Fix Kafka message too large for broker. [#3337](https://github.com/pingcap/tiflow/issues/3337) + (dup) - Change the default value of Kafka Sink `partition-num` to 3 so that TiCDC distributes messages across Kafka partitions more evenly [#3337](https://github.com/pingcap/ticdc/issues/3337) + (dup) - Change the default value of Kafka Sink `partition-num` to 3 so that TiCDC distributes messages across Kafka partitions more evenly [#3337](https://github.com/pingcap/ticdc/issues/3337) - Fix EtcdWorker row metric error. [#4000](https://github.com/pingcap/tiflow/pull/4000) - - Fix tikv_cdc_min_resolved_ts_no_change_for_1m keep firing when there is no changefeed. [#11017](https://github.com/tikv/tikv/issues/11017) - - Fix the congestion in gPRC, which may cause slow initialization phase. [#3110](https://github.com/pingcap/tiflow/issues/3110) + (dup) - Fix the issue that `tikv_cdc_min_resolved_ts_no_change_for_1m` keeps alerting when there is no changefeed [#11017](https://github.com/tikv/tikv/issues/11017) + (dup) - Optimize rate limiting control on TiKV reloads to reduce gPRC congestion during changefeed initialization [#3110](https://github.com/pingcap/ticdc/issues/3110) + (Backup & Restore) BR - - Fix failed to retry grpc errors. [#27421](https://github.com/pingcap/tidb/issues/27421) + (dup) - Improve the robustness of restoring [#27421](https://github.com/pingcap/tidb/issues/27421) - Fix failed after importing table with expression index using local backend. [#1404](https://github.com/pingcap/br/issues/1404) - Fix the average speed isn't accurate in backup and restore [#1405](https://github.com/pingcap/br/issues/1405) From 66a65643a5cc86789180cae35d69cd131b509dac Mon Sep 17 00:00:00 2001 From: TomShawn <41534398+TomShawn@users.noreply.github.com> Date: Thu, 23 Dec 2021 15:53:34 +0800 Subject: [PATCH 12/51] more dup --- releases/release-5.0.6.md | 26 ++++++++++++++------------ 1 file changed, 14 insertions(+), 12 deletions(-) diff --git a/releases/release-5.0.6.md b/releases/release-5.0.6.md index ce5d9aefd6c93..9f01db0cd290e 100644 --- a/releases/release-5.0.6.md +++ b/releases/release-5.0.6.md @@ -22,8 +22,8 @@ TiDB version: 5.0.6 + TiDB (dup) - Fix the issue that optimistic transaction conflicts might cause transactions to block each other [#11148](https://github.com/tikv/tikv/issues/11148) - - Avoid confusing error log like `invalid cop task execution summaries length` when running MPP query [#1791](https://github.com/pingcap/tics/issues/1791) - - The debug log on coprocessor doesn't print out the statement when encountering a lock, which makes it difficult to know what statement was affected by the lock. This fix tries to add the statement.[#27718](https://github.com/pingcap/tidb/issues/27718) + (dup) - Fix the issue of false positive error log `invalid cop task execution summaries length` for MPP queries [#1791](https://github.com/pingcap/tics/issues/1791) + (dup) - Show the affected SQL statements in the debug log when the coprocessor encounters a lock, which is helpful in diagnosing problems [#27718](https://github.com/pingcap/tidb/issues/27718) + TiKV @@ -33,7 +33,7 @@ TiDB version: 5.0.6 + PD - - Speed scheduler exit after transfer PD leader [#4146](https://github.com/tikv/pd/issues/4146) + (dup) - Speed up the exit process of schedulers [#4146](https://github.com/tikv/pd/issues/4146) - Make scatter range scheduler work better by allowing empty region schedule and fix config [#4116](https://github.com/tikv/pd/pull/4116) + Tools @@ -41,7 +41,7 @@ TiDB version: 5.0.6 + TiCDC (dup) - Optimize rate limiting control on TiKV reloads to reduce gPRC congestion during changefeed initialization [#3110](https://github.com/pingcap/ticdc/issues/3110) - Reduce lock competition in sink module. [#2760](https://github.com/pingcap/tiflow/pull/2760) - (dup) - Fix the issue that scanning stock data might fail due to TiKV performing GC when scanning stock data takes too long [#2470](https://github.com/pingcap/ticdc/issues/2470) + (dup) - Fix the issue that scanning stock data might fail due to TiKV performing GC when scanning stock data takes too long [#2470](https://github.com/pingcap/tiflow/issues/2470) (dup) - Fix the issue that changefeed does not fail fast enough when the ErrGCTTLExceeded error occurs [#3111](https://github.com/pingcap/ticdc/issues/3111) (dup) - Add a tick frequency limit to EtcdWorker to prevent frequent etcd writes from affecting PD services [#3112](https://github.com/pingcap/ticdc/issues/3112) - Support batch messages to reduce EtcdWorker tick. [3112](https://github.com/pingcap/tiflow/issues/3112) @@ -65,13 +65,13 @@ TiDB version: 5.0.6 (dup) - Fix wrong results of the `microsecond` function in vectorized expressions [#29244](https://github.com/pingcap/tidb/issues/29244) (dup) - Fix the issue of incomplete log information from the `auto analyze` result [#29188](https://github.com/pingcap/tidb/issues/29188) (dup) - Fix wrong results of the `hour` function in vectorized expression [#28643](https://github.com/pingcap/tidb/issues/28643) - - Fix the problem that unexpected error like `tidb_cast to Int32 is not supported` is raised when executing a MPP query [#23907](https://github.com/pingcap/tidb/issues/23907) - - Fix the problem that MPP node availability detection does not work in some corner cases [#3118](https://github.com/pingcap/tics/issues/3118) - - Fix the problem that data-race may happen when alloc MPP task id [#27952](https://github.com/pingcap/tidb/issues/27952) - - Fix the problem that `index out of range [-1]` error is raised when a SQL contains `Union` and is running in MPP mode [#28250](https://github.com/pingcap/tidb/issues/28250) + (dup) - Fix the unexpected error like `tidb_cast to Int32 is not supported` when the unsupported `cast` is pushed down to TiFlash [#23907](https://github.com/pingcap/tidb/issues/23907) + (dup) - Fix a bug that the availability detection of MPP node does not work in some corner cases [#3118](https://github.com/pingcap/tics/issues/3118) + (dup) - Fix the `DATA RACE` issue when assigning `MPP task ID` [#27952](https://github.com/pingcap/tidb/issues/27952) + (dup) - Fix the `INDEX OUT OF RANGE` error for a MPP query after deleting an empty `dual table` [#28250](https://github.com/pingcap/tidb/issues/28250) - Fix the problem that TiDB panicks when inserting invalid date values concurrently [#25393](https://github.com/pingcap/tidb/issues/25393) - Fix the problem that the error like `can not found column in Schema column` is raised unexpectedly for mpp queries [#28147](https://github.com/pingcap/tidb/pull/28147) - - Fix the problem that TiDB may crash when TiFlash shut down [#28096](https://github.com/pingcap/tidb/issues/28096) + (dup) - Fix the issue that TiDB might panic when TiFlash is shuting down [#28096](https://github.com/pingcap/tidb/issues/28096) - Fix the problem that the `index out of range` error is raised unexpectly when the planner doing join reorder [#24095](https://github.com/pingcap/tidb/issues/24095). (dup) - Fix wrong results of the control functions (such as `IF` and `CASE WHEN`) when using the `ENUM` type data as parameters of such functions [#23114](https://github.com/pingcap/tidb/issues/23114) - Fix the problem the `concat(ifnull(time(3))` returns wrong result [#29498](https://github.com/pingcap/tidb/issues/29498) @@ -83,13 +83,15 @@ TiDB version: 5.0.6 (dup) - Fix the issue that the length information is wrong when converting `Decimal` to `String` [#29417](https://github.com/pingcap/tidb/issues/29417) - Fix the problem that the error `Column 'col_name' in field list is ambiguous` is raised unexpectedly when a SQL contains natural join [#25041](https://github.com/pingcap/tidb/issues/25041) (dup) - Fix the issue that the `GREATEST` function returns inconsistent results due to different values of `tidb_enable_vectorized_expression` (`on` or `off`) [#29434](https://github.com/pingcap/tidb/issues/29434) - (dup) - Fix the issue that planner might cache invalid plans for `join` in some cases [#28087](https://github.com/pingcap/tidb/issues/28087) + (dup) (dup) - Fix the issue that planner might cache invalid plans for `join` in some cases [#28087](https://github.com/pingcap/tidb/issues/28087) - Fix the problem that the error `index out of range [1] with length 1` is raised when a SQL tries to evaluates an aggregation result on the result of join in some cases [#1978](https://github.com/pingcap/tics/issues/1978) + TiKV - Fix resolved timestamp lag increased after stoping a tikv [#11351](https://github.com/tikv/tikv/issues/11351) - - Fix connection abort when too many small logs are batched into one messages [#9714](https://github.com/tikv/tikv/issues/9714) + (dup) - Fix the issue that batch messages are too large in Raft client implementation [#9714](https://github.com/tikv/tikv/issues/9714) + (dup) - Fix a panic issue that occurs when Region merge, ConfChange, and Snapshot happen at the same time in extreme conditions [#11475](https://github.com/tikv/tikv/issues/11475) + - Fix the issue that reverse scan can't detect memory locks and may read stale data. [#11440](https://github.com/tikv/tikv/issues/11440) (dup) - Fix a panic issue that occurs when Region merge, ConfChange, and Snapshot happen at the same time in extreme conditions [#11475](https://github.com/tikv/tikv/issues/11475) - Fix the issue that reverse scan can't detect memory locks and may read stale data. [#11440](https://github.com/tikv/tikv/issues/11440) (dup) - Fix the issue of negative sign when the decimal divide result is zero [#29586](https://github.com/pingcap/tidb/issues/29586) @@ -166,4 +168,4 @@ TiDB version: 5.0.6 + Dumpling - - Fix the bug that dumpling gets very slow when dumping composite primary/unique key tables. [#29386](https://github.com/pingcap/tidb/issues/29386) + - Fix the bug that dumpling gets very slow when dumping composite primary/unique key tables. [#29386](https://github.com/pingcap/tidb/issues/29386) \ No newline at end of file From 2d112fb41bf9bf47f2c4ad48d89d5d3cff5cb9d9 Mon Sep 17 00:00:00 2001 From: TomShawn <41534398+TomShawn@users.noreply.github.com> Date: Thu, 23 Dec 2021 15:58:05 +0800 Subject: [PATCH 13/51] more dups --- releases/release-5.0.6.md | 18 +++++++++--------- 1 file changed, 9 insertions(+), 9 deletions(-) diff --git a/releases/release-5.0.6.md b/releases/release-5.0.6.md index 9f01db0cd290e..df241f903c717 100644 --- a/releases/release-5.0.6.md +++ b/releases/release-5.0.6.md @@ -97,7 +97,7 @@ TiDB version: 5.0.6 (dup) - Fix the issue of negative sign when the decimal divide result is zero [#29586](https://github.com/pingcap/tidb/issues/29586) - Avoid possible OOM due to the accumulation of GC tasks [#11410](https://github.com/tikv/tikv/issues/11410) (dup) - Fix the issue that the average latency of the by-instance gRPC requests is inaccurate in TiKV metrics [#11299](https://github.com/tikv/tikv/issues/11299) - - Fix bug of reporting metrics about destroyed threads to Prometheus. [#11195](https://github.com/tikv/tikv/issues/11195) + (dup) - Fix a memory leak caused by monitoring data of statistics threads [#11195](https://github.com/tikv/tikv/issues/11195) (dup) - Fix the issue of TiCDC panic that occurs when the downstream database is missing [#11123](https://github.com/tikv/tikv/issues/11123) (dup) - Fix the issue that CDC adds scan retries frequently due to the Congest error [#11082](https://github.com/tikv/tikv/issues/11082) (dup) - Fix the issue that the Raft connection is broken when the channel is full [#11047](https://github.com/tikv/tikv/issues/11047) @@ -111,8 +111,8 @@ TiDB version: 5.0.6 (dup) - Fix a panic issue that occurs after the TiKV node is removed [#4344](https://github.com/tikv/pd/issues/4344) - Fix the issue that operator can get blocked due to down store [#3353](https://github.com/tikv/pd/issues/3353) - (dup) - Fix slow leader election caused by stucked region syncer [#3936](https://github.com/tikv/pd/issues/3936) - (dup) - Support that the evict leader scheduler can schedule regions with unhealthy peers [#4093](https://github.com/tikv/pd/issues/4093) + (dup) - Fix slow leader election caused by stucked Region syncer [#3936](https://github.com/tikv/pd/issues/3936) + (dup) - Support that the evict leader scheduler can schedule Regions with unhealthy peers [#4093](https://github.com/tikv/pd/issues/4093) - Fix the issue that there is the store limit of remove peer of the down store [#4090](https://github.com/tikv/pd/issues/4090) - Fix the issue that the hot cache cannot be cleared when the heartbeat interval is less than 60 [#4390](https://github.com/tikv/pd/issues/4390) @@ -137,14 +137,14 @@ TiDB version: 5.0.6 + TiCDC - (dup) - Fix the issue that some partitioned tables without valid indexes might be ignored when `force-replicate` is enabled [#2834](https://github.com/pingcap/ticdc/issues/2834) + (dup) - Fix the issue that some partitioned tables without valid indexes might be ignored when `force-replicate` is enabled [#2834](https://github.com/pingcap/tiflow/issues/2834) - Fix cdc cli silently truncated user parameters when receiving unexpected parameters, causing the user input parameters to be lost. [#2303](https://github.com/pingcap/tiflow/issues/2303) - Fix cdc scheduling tables too early. [#2625](https://github.com/pingcap/tiflow/issues/2625) - (dup) - Fix the issue that TiCDC sync task might pause when an error occurs during writing a Kafka message [#2978](https://github.com/pingcap/ticdc/issues/2978) - - Fix MQ sink don't support non binary json string encoding. [#2758](https://github.com/pingcap/tiflow/issues/2758) - (dup) (dup) - Fix the issue that the volume of Kafka messages generated by TiCDC is not constrained by `max-message-size` [#2962](https://github.com/pingcap/ticdc/issues/2962) - (dup) - Fix the issue that TiCDC replication task might terminate when the upstream TiDB instance unexpectedly exits [#3061](https://github.com/pingcap/ticdc/issues/3061) - (dup) - Fix the issue that TiCDC process might panic when TiKV sends duplicate requests to the same Region [#2386](https://github.com/pingcap/ticdc/issues/2386) + (dup) - Fix the issue that TiCDC sync task might pause when an error occurs during writing a Kafka message [#2978](https://github.com/pingcap/tiflow/issues/2978) + (dup) - Fix a possible panic issue when encoding some types of columns into Open Protocol format [#2758](https://github.com/pingcap/tiflow/issues/2758) + (dup) - Fix the issue that the volume of Kafka messages generated by TiCDC is not constrained by `max-message-size` [#2962](https://github.com/pingcap/tiflow/issues/2962) + (dup) - Fix the issue that TiCDC replication task might terminate when the upstream TiDB instance unexpectedly exits [#3061](https://github.com/pingcap/tiflow/issues/3061) + (dup) - Fix the issue that TiCDC process might panic when TiKV sends duplicate requests to the same Region [#2386](https://github.com/pingcap/tiflow/issues/2386) (dup) - Fix the TiCDC replication interruption issue when multiple TiKVs crash or during a forced restart [#3288](https://github.com/pingcap/ticdc/issues/3288) (dup) - Fix the negative value error in the changefeed checkpoint lag [#3010](https://github.com/pingcap/ticdc/issues/3010) - Fix MySQL sink deadlock warning too frequently. [#2706](https://github.com/pingcap/tiflow/issues/2706) From bf52699298867b125431e4c964f5870a304dc00b Mon Sep 17 00:00:00 2001 From: TomShawn <41534398+TomShawn@users.noreply.github.com> Date: Thu, 23 Dec 2021 15:58:56 +0800 Subject: [PATCH 14/51] Update releases/release-5.0.6.md --- releases/release-5.0.6.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/releases/release-5.0.6.md b/releases/release-5.0.6.md index df241f903c717..7711771806dcf 100644 --- a/releases/release-5.0.6.md +++ b/releases/release-5.0.6.md @@ -83,7 +83,7 @@ TiDB version: 5.0.6 (dup) - Fix the issue that the length information is wrong when converting `Decimal` to `String` [#29417](https://github.com/pingcap/tidb/issues/29417) - Fix the problem that the error `Column 'col_name' in field list is ambiguous` is raised unexpectedly when a SQL contains natural join [#25041](https://github.com/pingcap/tidb/issues/25041) (dup) - Fix the issue that the `GREATEST` function returns inconsistent results due to different values of `tidb_enable_vectorized_expression` (`on` or `off`) [#29434](https://github.com/pingcap/tidb/issues/29434) - (dup) (dup) - Fix the issue that planner might cache invalid plans for `join` in some cases [#28087](https://github.com/pingcap/tidb/issues/28087) + (dup) - Fix the issue that planner might cache invalid plans for `join` in some cases [#28087](https://github.com/pingcap/tidb/issues/28087) - Fix the problem that the error `index out of range [1] with length 1` is raised when a SQL tries to evaluates an aggregation result on the result of join in some cases [#1978](https://github.com/pingcap/tics/issues/1978) + TiKV From 306e75d4993d9c1c85a01b4fa247712970acd1aa Mon Sep 17 00:00:00 2001 From: Flowyi Date: Fri, 24 Dec 2021 12:37:58 +0800 Subject: [PATCH 15/51] Update releases/release-5.0.6.md --- releases/release-5.0.6.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/releases/release-5.0.6.md b/releases/release-5.0.6.md index 7711771806dcf..2480f978ed436 100644 --- a/releases/release-5.0.6.md +++ b/releases/release-5.0.6.md @@ -118,7 +118,7 @@ TiDB version: 5.0.6 + TiFlash - - Fix potential data inconsistency when widen pk column type if pk is handle + - Fix potential data inconsistency after widening the integer primary key of a table - Fix Tiflash arm build when include `libnsl.so`. Try copy `libnsl.so` to `INSTALL_DIR` - Fix store size on `tiflash metrics` is not consistent.Decrease the size of checkpoint file when removing it - Fix exception: `GC` removed normal file which just created From ce47cd8f09580fa8e7286d2f94395a94fe9ea511 Mon Sep 17 00:00:00 2001 From: Flowyi Date: Fri, 24 Dec 2021 12:38:50 +0800 Subject: [PATCH 16/51] Update releases/release-5.0.6.md --- releases/release-5.0.6.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/releases/release-5.0.6.md b/releases/release-5.0.6.md index 2480f978ed436..fd8df93bb1572 100644 --- a/releases/release-5.0.6.md +++ b/releases/release-5.0.6.md @@ -124,7 +124,7 @@ TiDB version: 5.0.6 - Fix exception: `GC` removed normal file which just created - Fix sync schema exception when user upgrade the TiFlash version - Fix tiflash randomly crash when a mpp query is killed - - Fix throw not constants exception in `substringUTF8` + - Fix the issue of unexpected error that "3rd arguments of function substringUTF8 must be constants" - Fix decode DAG request failed.Add retry when decode DAG request failed - Fix the bug that results of `where ` is wrong because it will be converted to int type - Fix `main_capacity_quota_` check From 8ed0367b56399edf2ed3f028552668d54a5f4c85 Mon Sep 17 00:00:00 2001 From: Flowyi Date: Fri, 24 Dec 2021 12:39:01 +0800 Subject: [PATCH 17/51] Update releases/release-5.0.6.md --- releases/release-5.0.6.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/releases/release-5.0.6.md b/releases/release-5.0.6.md index fd8df93bb1572..f84cb291f6e03 100644 --- a/releases/release-5.0.6.md +++ b/releases/release-5.0.6.md @@ -130,7 +130,7 @@ TiDB version: 5.0.6 - Fix `main_capacity_quota_` check - Fix the inconsistent behavior of `CastStringAsDecimal` between tiflash and tidb/tikv - Fix exception: `expected Nullable(Int64), got Int64`. Sending schemas in exchangeSender to avoid schema mismatch - - Fix the issue of unexpected error that `Unexpected type of column: Nullable(Nothing)` + - Fix the error "Unexpected type of column: Nullable(Nothing)" which cases query failure - Fix the issue that comparison between Decimal may cause overflow and report Can't compare + Tools From 2bb92f12267cef9275ceac1e277266582d155d0f Mon Sep 17 00:00:00 2001 From: Flowyi Date: Fri, 24 Dec 2021 12:39:41 +0800 Subject: [PATCH 18/51] Update releases/release-5.0.6.md --- releases/release-5.0.6.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/releases/release-5.0.6.md b/releases/release-5.0.6.md index f84cb291f6e03..9d32ff7f8ec2f 100644 --- a/releases/release-5.0.6.md +++ b/releases/release-5.0.6.md @@ -129,7 +129,7 @@ TiDB version: 5.0.6 - Fix the bug that results of `where ` is wrong because it will be converted to int type - Fix `main_capacity_quota_` check - Fix the inconsistent behavior of `CastStringAsDecimal` between tiflash and tidb/tikv - - Fix exception: `expected Nullable(Int64), got Int64`. Sending schemas in exchangeSender to avoid schema mismatch + - Fix the error "different types: expected Nullable(Int64), got Int64" which causes query failure - Fix the error "Unexpected type of column: Nullable(Nothing)" which cases query failure - Fix the issue that comparison between Decimal may cause overflow and report Can't compare From 489e1f933fc55e74a5717a1a281bf8ef5e5e28ff Mon Sep 17 00:00:00 2001 From: Flowyi Date: Fri, 24 Dec 2021 12:46:56 +0800 Subject: [PATCH 19/51] Update releases/release-5.0.6.md --- releases/release-5.0.6.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/releases/release-5.0.6.md b/releases/release-5.0.6.md index 9d32ff7f8ec2f..a1c9860d57083 100644 --- a/releases/release-5.0.6.md +++ b/releases/release-5.0.6.md @@ -131,7 +131,7 @@ TiDB version: 5.0.6 - Fix the inconsistent behavior of `CastStringAsDecimal` between tiflash and tidb/tikv - Fix the error "different types: expected Nullable(Int64), got Int64" which causes query failure - Fix the error "Unexpected type of column: Nullable(Nothing)" which cases query failure - - Fix the issue that comparison between Decimal may cause overflow and report Can't compare + - Fix the issue that comparison between Decimal may cause overflow, which result in query failure + Tools From cb9a063dae853d52490c0cbb89368144f6c20476 Mon Sep 17 00:00:00 2001 From: Flowyi Date: Fri, 24 Dec 2021 12:47:23 +0800 Subject: [PATCH 20/51] Update releases/release-5.0.6.md --- releases/release-5.0.6.md | 1 - 1 file changed, 1 deletion(-) diff --git a/releases/release-5.0.6.md b/releases/release-5.0.6.md index a1c9860d57083..43ed9a4ca289b 100644 --- a/releases/release-5.0.6.md +++ b/releases/release-5.0.6.md @@ -127,7 +127,6 @@ TiDB version: 5.0.6 - Fix the issue of unexpected error that "3rd arguments of function substringUTF8 must be constants" - Fix decode DAG request failed.Add retry when decode DAG request failed - Fix the bug that results of `where ` is wrong because it will be converted to int type - - Fix `main_capacity_quota_` check - Fix the inconsistent behavior of `CastStringAsDecimal` between tiflash and tidb/tikv - Fix the error "different types: expected Nullable(Int64), got Int64" which causes query failure - Fix the error "Unexpected type of column: Nullable(Nothing)" which cases query failure From 65f16eb9de9534099c64fac240d2afc57ac1f92c Mon Sep 17 00:00:00 2001 From: Flowyi Date: Fri, 24 Dec 2021 12:47:33 +0800 Subject: [PATCH 21/51] Update releases/release-5.0.6.md --- releases/release-5.0.6.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/releases/release-5.0.6.md b/releases/release-5.0.6.md index 43ed9a4ca289b..b7f7b0e34b3ce 100644 --- a/releases/release-5.0.6.md +++ b/releases/release-5.0.6.md @@ -126,7 +126,7 @@ TiDB version: 5.0.6 - Fix tiflash randomly crash when a mpp query is killed - Fix the issue of unexpected error that "3rd arguments of function substringUTF8 must be constants" - Fix decode DAG request failed.Add retry when decode DAG request failed - - Fix the bug that results of `where ` is wrong because it will be converted to int type + - Fix the bug that results of `where ` is wrong - Fix the inconsistent behavior of `CastStringAsDecimal` between tiflash and tidb/tikv - Fix the error "different types: expected Nullable(Int64), got Int64" which causes query failure - Fix the error "Unexpected type of column: Nullable(Nothing)" which cases query failure From 81507b9a33149fa44c71bd9828b2e307bcb16cb7 Mon Sep 17 00:00:00 2001 From: Flowyi Date: Fri, 24 Dec 2021 12:48:24 +0800 Subject: [PATCH 22/51] Update releases/release-5.0.6.md --- releases/release-5.0.6.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/releases/release-5.0.6.md b/releases/release-5.0.6.md index b7f7b0e34b3ce..5442e32f249e3 100644 --- a/releases/release-5.0.6.md +++ b/releases/release-5.0.6.md @@ -125,7 +125,7 @@ TiDB version: 5.0.6 - Fix sync schema exception when user upgrade the TiFlash version - Fix tiflash randomly crash when a mpp query is killed - Fix the issue of unexpected error that "3rd arguments of function substringUTF8 must be constants" - - Fix decode DAG request failed.Add retry when decode DAG request failed + - Increase the max supported depth of expression/plan tree in dag request from 100 to 200. - Fix the bug that results of `where ` is wrong - Fix the inconsistent behavior of `CastStringAsDecimal` between tiflash and tidb/tikv - Fix the error "different types: expected Nullable(Int64), got Int64" which causes query failure From cd0a065c449de03e0f1f3869e77149a731508638 Mon Sep 17 00:00:00 2001 From: Flowyi Date: Fri, 24 Dec 2021 12:48:45 +0800 Subject: [PATCH 23/51] Update releases/release-5.0.6.md --- releases/release-5.0.6.md | 1 - 1 file changed, 1 deletion(-) diff --git a/releases/release-5.0.6.md b/releases/release-5.0.6.md index 5442e32f249e3..642879c9c983d 100644 --- a/releases/release-5.0.6.md +++ b/releases/release-5.0.6.md @@ -122,7 +122,6 @@ TiDB version: 5.0.6 - Fix Tiflash arm build when include `libnsl.so`. Try copy `libnsl.so` to `INSTALL_DIR` - Fix store size on `tiflash metrics` is not consistent.Decrease the size of checkpoint file when removing it - Fix exception: `GC` removed normal file which just created - - Fix sync schema exception when user upgrade the TiFlash version - Fix tiflash randomly crash when a mpp query is killed - Fix the issue of unexpected error that "3rd arguments of function substringUTF8 must be constants" - Increase the max supported depth of expression/plan tree in dag request from 100 to 200. From 4821724989e77503f6309d852f2ce758514cd988 Mon Sep 17 00:00:00 2001 From: Flowyi Date: Fri, 24 Dec 2021 12:48:54 +0800 Subject: [PATCH 24/51] Update releases/release-5.0.6.md --- releases/release-5.0.6.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/releases/release-5.0.6.md b/releases/release-5.0.6.md index 642879c9c983d..77e9d77139cb2 100644 --- a/releases/release-5.0.6.md +++ b/releases/release-5.0.6.md @@ -121,7 +121,7 @@ TiDB version: 5.0.6 - Fix potential data inconsistency after widening the integer primary key of a table - Fix Tiflash arm build when include `libnsl.so`. Try copy `libnsl.so` to `INSTALL_DIR` - Fix store size on `tiflash metrics` is not consistent.Decrease the size of checkpoint file when removing it - - Fix exception: `GC` removed normal file which just created + - Fix an issue that causes TiFlash crashing by "Cannot open file". - Fix tiflash randomly crash when a mpp query is killed - Fix the issue of unexpected error that "3rd arguments of function substringUTF8 must be constants" - Increase the max supported depth of expression/plan tree in dag request from 100 to 200. From 218e2916f4e1940af1cb0b4368341bc5103af168 Mon Sep 17 00:00:00 2001 From: Flowyi Date: Fri, 24 Dec 2021 12:49:03 +0800 Subject: [PATCH 25/51] Update releases/release-5.0.6.md --- releases/release-5.0.6.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/releases/release-5.0.6.md b/releases/release-5.0.6.md index 77e9d77139cb2..549b74f412e48 100644 --- a/releases/release-5.0.6.md +++ b/releases/release-5.0.6.md @@ -120,7 +120,7 @@ TiDB version: 5.0.6 - Fix potential data inconsistency after widening the integer primary key of a table - Fix Tiflash arm build when include `libnsl.so`. Try copy `libnsl.so` to `INSTALL_DIR` - - Fix store size on `tiflash metrics` is not consistent.Decrease the size of checkpoint file when removing it + - Fix the issue that "Store size" metric does not match the actual data size on disk - Fix an issue that causes TiFlash crashing by "Cannot open file". - Fix tiflash randomly crash when a mpp query is killed - Fix the issue of unexpected error that "3rd arguments of function substringUTF8 must be constants" From 1a992e6114729ac042d6d97b38a4b7057476b193 Mon Sep 17 00:00:00 2001 From: Flowyi Date: Fri, 24 Dec 2021 12:49:10 +0800 Subject: [PATCH 26/51] Update releases/release-5.0.6.md --- releases/release-5.0.6.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/releases/release-5.0.6.md b/releases/release-5.0.6.md index 549b74f412e48..754ed01cbe8bd 100644 --- a/releases/release-5.0.6.md +++ b/releases/release-5.0.6.md @@ -119,7 +119,7 @@ TiDB version: 5.0.6 + TiFlash - Fix potential data inconsistency after widening the integer primary key of a table - - Fix Tiflash arm build when include `libnsl.so`. Try copy `libnsl.so` to `INSTALL_DIR` + - Fix the issue that a TiFlash fails to start up on platforms without library "libnsl.so", like on ARM - Fix the issue that "Store size" metric does not match the actual data size on disk - Fix an issue that causes TiFlash crashing by "Cannot open file". - Fix tiflash randomly crash when a mpp query is killed From 657d53e3d73e9a73470083b5138b6b12ee0ccf6a Mon Sep 17 00:00:00 2001 From: Grace Cai Date: Fri, 24 Dec 2021 18:28:47 +0800 Subject: [PATCH 27/51] Apply suggestions from code review --- releases/release-5.0.6.md | 14 +++++++------- 1 file changed, 7 insertions(+), 7 deletions(-) diff --git a/releases/release-5.0.6.md b/releases/release-5.0.6.md index 754ed01cbe8bd..b44f24958cd29 100644 --- a/releases/release-5.0.6.md +++ b/releases/release-5.0.6.md @@ -59,8 +59,8 @@ TiDB version: 5.0.6 + TiDB (dup) - Fix the `privilege check fail` error when performing the `grant` and `revoke` operations to grant and revoke global level privileges [#29675](https://github.com/pingcap/tidb/issues/29675) - - Fix the problem that adding index panics by chance [#27687](https://github.com/pingcap/tidb/issues/27687) - - Fix the problem that the `enforce-mpp` config item is useless in v5.0.4 [#29252](https://github.com/pingcap/tidb/issues/29252) + - Fix the TiDB panic when executing the `ALTER TABLE.. ADD INDEX` statement in some cases [#27687](https://github.com/pingcap/tidb/issues/27687) + - Fix the issue that the `enforce-mpp` configuration does not take effect in v5.0.4 [#29252](https://github.com/pingcap/tidb/issues/29252) (dup) - Fix the panic when using the `CASE WHEN` function on the `ENUM` data type [#29357](https://github.com/pingcap/tidb/issues/29357) (dup) - Fix wrong results of the `microsecond` function in vectorized expressions [#29244](https://github.com/pingcap/tidb/issues/29244) (dup) - Fix the issue of incomplete log information from the `auto analyze` result [#29188](https://github.com/pingcap/tidb/issues/29188) @@ -69,13 +69,13 @@ TiDB version: 5.0.6 (dup) - Fix a bug that the availability detection of MPP node does not work in some corner cases [#3118](https://github.com/pingcap/tics/issues/3118) (dup) - Fix the `DATA RACE` issue when assigning `MPP task ID` [#27952](https://github.com/pingcap/tidb/issues/27952) (dup) - Fix the `INDEX OUT OF RANGE` error for a MPP query after deleting an empty `dual table` [#28250](https://github.com/pingcap/tidb/issues/28250) - - Fix the problem that TiDB panicks when inserting invalid date values concurrently [#25393](https://github.com/pingcap/tidb/issues/25393) - - Fix the problem that the error like `can not found column in Schema column` is raised unexpectedly for mpp queries [#28147](https://github.com/pingcap/tidb/pull/28147) + - Fix the TiDB panic when inserting invalid date values concurrently [#25393](https://github.com/pingcap/tidb/issues/25393) + - Fix the unexpected `can not found column in Schema column` error for queries in the MPP mode [#28147](https://github.com/pingcap/tidb/pull/28147) (dup) - Fix the issue that TiDB might panic when TiFlash is shuting down [#28096](https://github.com/pingcap/tidb/issues/28096) - - Fix the problem that the `index out of range` error is raised unexpectly when the planner doing join reorder [#24095](https://github.com/pingcap/tidb/issues/24095). + - Fix the unexpected `index out of range` error when the planner is doing join reorder [#24095](https://github.com/pingcap/tidb/issues/24095) (dup) - Fix wrong results of the control functions (such as `IF` and `CASE WHEN`) when using the `ENUM` type data as parameters of such functions [#23114](https://github.com/pingcap/tidb/issues/23114) - - Fix the problem the `concat(ifnull(time(3))` returns wrong result [#29498](https://github.com/pingcap/tidb/issues/29498) - - Fix the problem that `greatest/least(unsigned)` returns wrong result [#30101](https://github.com/pingcap/tidb/issues/30101) + - Fix the wrong result of `CONCAT(IFNULL(TIME(3))` [#29498](https://github.com/pingcap/tidb/issues/29498) + - Fix the wrong results of `GREATEST` and `LEAST` when passing in unsigned `BIGINT` arguments [#30101](https://github.com/pingcap/tidb/issues/30101) - Fix the problem that SQL is cancelled when including json column joins char column [#29401](https://github.com/pingcap/tidb/issues/29401) - Fix the data inconsistency caused by incorrect usage of lazy existence check and untouch key optimization [#30410](https://github.com/pingcap/tidb/issues/30410) - Fix the problem that window function may return different results when using transaction or not [#29947](https://github.com/pingcap/tidb/issues/29947) From d1b8da0c8155e375e66a2c250d0e53ee8f753c0a Mon Sep 17 00:00:00 2001 From: shichun-0415 <89768198+shichun-0415@users.noreply.github.com> Date: Sat, 25 Dec 2021 16:31:32 +0800 Subject: [PATCH 28/51] Apply suggestions from code review --- releases/release-5.0.6.md | 6 +++--- 1 file changed, 3 insertions(+), 3 deletions(-) diff --git a/releases/release-5.0.6.md b/releases/release-5.0.6.md index b44f24958cd29..22a0469a09cf0 100644 --- a/releases/release-5.0.6.md +++ b/releases/release-5.0.6.md @@ -34,7 +34,7 @@ TiDB version: 5.0.6 + PD (dup) - Speed up the exit process of schedulers [#4146](https://github.com/tikv/pd/issues/4146) - - Make scatter range scheduler work better by allowing empty region schedule and fix config [#4116](https://github.com/tikv/pd/pull/4116) + - Make scatter range scheduler work better by allowing empty region schedule and fix config [#4497](https://github.com/tikv/pd/issues/4497) + Tools @@ -48,7 +48,7 @@ TiDB version: 5.0.6 (dup) - Fix OOM in container environments [#1798](https://github.com/pingcap/ticdc/issues/1798) - Add Kafka sink default configuration config.Metadata.Timeout. [#3352](https://github.com/pingcap/tiflow/issues/3352) - Change Kafka sink default `MaxMessageBytes` to 1MB. [#3081](https://github.com/pingcap/tiflow/issues/3081) - - Add more monitor metric and alert, including "no owner alert" [#3834](https://github.com/pingcap/tiflow/pull/3834), "mounter row" , "table sink total row" , "buffer sink total row" [#1606](https://github.com/pingcap/tiflow/issues/1606), "go gc" , "go_max_procs" [#2998](https://github.com/pingcap/tiflow/pull/2998), "cached region" [#2733](https://github.com/pingcap/tiflow/pull/2733). + - Add more monitor metric and alert, including "no owner alert" [#4054](https://github.com/pingcap/tiflow/issues/4054), "mounter row" , "table sink total row" , "buffer sink total row" [#1606](https://github.com/pingcap/tiflow/issues/1606) + (Backup & Restore) BR @@ -70,7 +70,7 @@ TiDB version: 5.0.6 (dup) - Fix the `DATA RACE` issue when assigning `MPP task ID` [#27952](https://github.com/pingcap/tidb/issues/27952) (dup) - Fix the `INDEX OUT OF RANGE` error for a MPP query after deleting an empty `dual table` [#28250](https://github.com/pingcap/tidb/issues/28250) - Fix the TiDB panic when inserting invalid date values concurrently [#25393](https://github.com/pingcap/tidb/issues/25393) - - Fix the unexpected `can not found column in Schema column` error for queries in the MPP mode [#28147](https://github.com/pingcap/tidb/pull/28147) + - Fix the unexpected `can not found column in Schema column` error for queries in the MPP mode [#30980](https://github.com/pingcap/tidb/issues/30980) (dup) - Fix the issue that TiDB might panic when TiFlash is shuting down [#28096](https://github.com/pingcap/tidb/issues/28096) - Fix the unexpected `index out of range` error when the planner is doing join reorder [#24095](https://github.com/pingcap/tidb/issues/24095) (dup) - Fix wrong results of the control functions (such as `IF` and `CASE WHEN`) when using the `ENUM` type data as parameters of such functions [#23114](https://github.com/pingcap/tidb/issues/23114) From b1ef48ed4625fe84c34b200f15225b0b7ac872f6 Mon Sep 17 00:00:00 2001 From: shichun-0415 <89768198+shichun-0415@users.noreply.github.com> Date: Sat, 25 Dec 2021 16:44:59 +0800 Subject: [PATCH 29/51] Apply suggestions from code review --- releases/release-5.0.6.md | 1 - 1 file changed, 1 deletion(-) diff --git a/releases/release-5.0.6.md b/releases/release-5.0.6.md index 22a0469a09cf0..96a851d101ec5 100644 --- a/releases/release-5.0.6.md +++ b/releases/release-5.0.6.md @@ -154,7 +154,6 @@ TiDB version: 5.0.6 - Fix txn_batch_size metric inaccurate issue for Kafka sink. [#3431](https://github.com/pingcap/tiflow/issues/3431) (dup) - Change the default value of Kafka Sink `partition-num` to 3 so that TiCDC distributes messages across Kafka partitions more evenly [#3337](https://github.com/pingcap/ticdc/issues/3337) (dup) - Change the default value of Kafka Sink `partition-num` to 3 so that TiCDC distributes messages across Kafka partitions more evenly [#3337](https://github.com/pingcap/ticdc/issues/3337) - - Fix EtcdWorker row metric error. [#4000](https://github.com/pingcap/tiflow/pull/4000) (dup) - Fix the issue that `tikv_cdc_min_resolved_ts_no_change_for_1m` keeps alerting when there is no changefeed [#11017](https://github.com/tikv/tikv/issues/11017) (dup) - Optimize rate limiting control on TiKV reloads to reduce gPRC congestion during changefeed initialization [#3110](https://github.com/pingcap/ticdc/issues/3110) From b00509869b575a400402c95c42b8d7e07a6a40b2 Mon Sep 17 00:00:00 2001 From: shichun-0415 <89768198+shichun-0415@users.noreply.github.com> Date: Mon, 27 Dec 2021 14:05:04 +0800 Subject: [PATCH 30/51] Update releases/release-5.0.6.md --- releases/release-5.0.6.md | 1 - 1 file changed, 1 deletion(-) diff --git a/releases/release-5.0.6.md b/releases/release-5.0.6.md index 96a851d101ec5..1f92bb3da5167 100644 --- a/releases/release-5.0.6.md +++ b/releases/release-5.0.6.md @@ -40,7 +40,6 @@ TiDB version: 5.0.6 + TiCDC (dup) - Optimize rate limiting control on TiKV reloads to reduce gPRC congestion during changefeed initialization [#3110](https://github.com/pingcap/ticdc/issues/3110) - - Reduce lock competition in sink module. [#2760](https://github.com/pingcap/tiflow/pull/2760) (dup) - Fix the issue that scanning stock data might fail due to TiKV performing GC when scanning stock data takes too long [#2470](https://github.com/pingcap/tiflow/issues/2470) (dup) - Fix the issue that changefeed does not fail fast enough when the ErrGCTTLExceeded error occurs [#3111](https://github.com/pingcap/ticdc/issues/3111) (dup) - Add a tick frequency limit to EtcdWorker to prevent frequent etcd writes from affecting PD services [#3112](https://github.com/pingcap/ticdc/issues/3112) From b52e0a219e7a7cd60ee48ea5f0edc0dbd4bb6775 Mon Sep 17 00:00:00 2001 From: Grace Cai Date: Tue, 28 Dec 2021 14:44:36 +0800 Subject: [PATCH 31/51] Update releases/release-5.0.6.md Co-authored-by: shichun-0415 <89768198+shichun-0415@users.noreply.github.com> --- releases/release-5.0.6.md | 1 + 1 file changed, 1 insertion(+) diff --git a/releases/release-5.0.6.md b/releases/release-5.0.6.md index 1f92bb3da5167..13e7107ff80df 100644 --- a/releases/release-5.0.6.md +++ b/releases/release-5.0.6.md @@ -57,6 +57,7 @@ TiDB version: 5.0.6 + TiDB + - Fix the panic that might occur when DML and DDL statements are executed concurrently [#30940](https://github.com/pingcap/tidb/issues/30940) (dup) - Fix the `privilege check fail` error when performing the `grant` and `revoke` operations to grant and revoke global level privileges [#29675](https://github.com/pingcap/tidb/issues/29675) - Fix the TiDB panic when executing the `ALTER TABLE.. ADD INDEX` statement in some cases [#27687](https://github.com/pingcap/tidb/issues/27687) - Fix the issue that the `enforce-mpp` configuration does not take effect in v5.0.4 [#29252](https://github.com/pingcap/tidb/issues/29252) From cee006023ed73bc5bb96445ea772446e3cb5621e Mon Sep 17 00:00:00 2001 From: shichun-0415 <89768198+shichun-0415@users.noreply.github.com> Date: Tue, 28 Dec 2021 16:00:05 +0800 Subject: [PATCH 32/51] Update releases/release-5.0.6.md --- releases/release-5.0.6.md | 22 +++++++++++----------- 1 file changed, 11 insertions(+), 11 deletions(-) diff --git a/releases/release-5.0.6.md b/releases/release-5.0.6.md index 13e7107ff80df..14786c4c4aebf 100644 --- a/releases/release-5.0.6.md +++ b/releases/release-5.0.6.md @@ -118,18 +118,18 @@ TiDB version: 5.0.6 + TiFlash - - Fix potential data inconsistency after widening the integer primary key of a table - - Fix the issue that a TiFlash fails to start up on platforms without library "libnsl.so", like on ARM - - Fix the issue that "Store size" metric does not match the actual data size on disk - - Fix an issue that causes TiFlash crashing by "Cannot open file". - - Fix tiflash randomly crash when a mpp query is killed - - Fix the issue of unexpected error that "3rd arguments of function substringUTF8 must be constants" - - Increase the max supported depth of expression/plan tree in dag request from 100 to 200. + - Fix potential data inconsistency after widening the column type of an integer primary key + - Fix the issue that TiFlash fails to start up on some platforms, such as ARM, due to the absence of library "libnsl.so" + - Fix the issue that the "Store size" metric does not match the actual data size on a disk + - Fix the issue that TiFlash crashes due to a "Cannot open file" error + - Fix occasional crashes of TiFlash when an MPP query is killed + - Fix the unexpected error "3rd arguments of function substringUTF8 must be constants" + - Fix query failures caused by excessive `OR` conditions - Fix the bug that results of `where ` is wrong - - Fix the inconsistent behavior of `CastStringAsDecimal` between tiflash and tidb/tikv - - Fix the error "different types: expected Nullable(Int64), got Int64" which causes query failure - - Fix the error "Unexpected type of column: Nullable(Nothing)" which cases query failure - - Fix the issue that comparison between Decimal may cause overflow, which result in query failure + - Fix inconsistent behaviors of `CastStringAsDecimal` between TiFlash and TiDB/TiKV + - Fix query failures caused by the error "different types: expected Nullable(Int64), got Int64" + - Fix query failures caused by the error "Unexpected type of column: Nullable(Nothing)" + - Fix query failures caused by overflow following Decimal comparison + Tools From b1c4a61a5674bfff4105b7b95ad5a9319906cca1 Mon Sep 17 00:00:00 2001 From: Enwei Date: Tue, 28 Dec 2021 09:17:57 +0100 Subject: [PATCH 33/51] Apply suggestions from code review --- releases/release-5.0.6.md | 12 ++++++------ 1 file changed, 6 insertions(+), 6 deletions(-) diff --git a/releases/release-5.0.6.md b/releases/release-5.0.6.md index 14786c4c4aebf..54ad44dce8661 100644 --- a/releases/release-5.0.6.md +++ b/releases/release-5.0.6.md @@ -27,14 +27,14 @@ TiDB version: 5.0.6 + TiKV - - Move verify_checksum to import-thread from apply-thread. [#11239](https://github.com/tikv/tikv/issues/11239) - - Add metrics for raft log garbage-collect to locate performance problem. [#11374](https://github.com/tikv/tikv/issues/11374) - - Hide untouched storage commands' metrics in grafana dashboard [#11681](https://github.com/tikv/tikv/issues/11681) + - Increase the speed of inserting SST files by moving the verification process to import thread pool from apply thread pool [#11239](https://github.com/tikv/tikv/issues/11239) + - Add metrics for the garbage collection module of Raft logs to locate performance problems in this module [#11374](https://github.com/tikv/tikv/issues/11374) + - Collapse some uncommon metrics related to storage in Grafana dashboard [#11681](https://github.com/tikv/tikv/issues/11681) + PD (dup) - Speed up the exit process of schedulers [#4146](https://github.com/tikv/pd/issues/4146) - - Make scatter range scheduler work better by allowing empty region schedule and fix config [#4497](https://github.com/tikv/pd/issues/4497) + - Make the `scatter-range-scheduler` scheduler work better by allowing to schedule empty regions and fix configurations [#4497](https://github.com/tikv/pd/issues/4497) + Tools @@ -113,8 +113,8 @@ TiDB version: 5.0.6 - Fix the issue that operator can get blocked due to down store [#3353](https://github.com/tikv/pd/issues/3353) (dup) - Fix slow leader election caused by stucked Region syncer [#3936](https://github.com/tikv/pd/issues/3936) (dup) - Support that the evict leader scheduler can schedule Regions with unhealthy peers [#4093](https://github.com/tikv/pd/issues/4093) - - Fix the issue that there is the store limit of remove peer of the down store [#4090](https://github.com/tikv/pd/issues/4090) - - Fix the issue that the hot cache cannot be cleared when the heartbeat interval is less than 60 [#4390](https://github.com/tikv/pd/issues/4390) + - Fix the issue that the speed of removing peers is limited when repairing the down nodes [#4090](https://github.com/tikv/pd/issues/4090) + - Fix the issue that the hotspot Cache cannot be cleared when the Region heartbeat is less than 60 seconds [#4390](https://github.com/tikv/pd/issues/4390) + TiFlash From e932c46c88da5419b9b77fef3f7ce026f0403a2a Mon Sep 17 00:00:00 2001 From: Ran Date: Tue, 28 Dec 2021 18:19:16 +0800 Subject: [PATCH 34/51] address comments for the last 10 notes of tools bug fix Co-authored-by: maxshuang --- releases/release-5.0.6.md | 21 +++++++++++---------- 1 file changed, 11 insertions(+), 10 deletions(-) diff --git a/releases/release-5.0.6.md b/releases/release-5.0.6.md index 54ad44dce8661..3974fee9b53c4 100644 --- a/releases/release-5.0.6.md +++ b/releases/release-5.0.6.md @@ -145,24 +145,25 @@ TiDB version: 5.0.6 (dup) - Fix the issue that TiCDC process might panic when TiKV sends duplicate requests to the same Region [#2386](https://github.com/pingcap/tiflow/issues/2386) (dup) - Fix the TiCDC replication interruption issue when multiple TiKVs crash or during a forced restart [#3288](https://github.com/pingcap/ticdc/issues/3288) (dup) - Fix the negative value error in the changefeed checkpoint lag [#3010](https://github.com/pingcap/ticdc/issues/3010) - - Fix MySQL sink deadlock warning too frequently. [#2706](https://github.com/pingcap/tiflow/issues/2706) - - Fix Avro sink don't support json type column. [#3624](https://github.com/pingcap/tiflow/issues/3624) - - Fix read error schema snapshot from TiKV when owner restart. [#2603](https://github.com/pingcap/tiflow/issues/2603) + - Fix the issue of overly frequent warnings caused by MySQL sink deadlock [#2706](https://github.com/pingcap/tiflow/issues/2706) + - Fix the issue that Avro sink does not support parsing JSON type columns [#3624](https://github.com/pingcap/tiflow/issues/3624) + - Fix the bug that TiCDC reads the incorrect schema snapshot from TiKV when the TiKV owner restarts [#2603](https://github.com/pingcap/tiflow/issues/2603) (dup) - Fix the memory leak issue after processing DDLs [#3174](https://github.com/pingcap/ticdc/issues/3174) - - Fix old value enabled is not forced on Canal and Maxwell protocols automatically. [#3676](https://github.com/pingcap/tiflow/issues/3676) - - Fix timezone related error that cause cdc server can't run in some RHEL release version (6.8, 6.9 etc). [#3584](https://github.com/pingcap/tiflow/issues/3584) - - Fix txn_batch_size metric inaccurate issue for Kafka sink. [#3431](https://github.com/pingcap/tiflow/issues/3431) + - Fix the bug that the `enable-old-value` configuration item is not automatically set to `true` on Canal and Maxwell protocols [#3676](https://github.com/pingcap/tiflow/issues/3676) + - Fix the timezone error that occurs when the `cdc server` command runs on some Red Hat Enterprise Linux releases (such as 6.8 and 6.9) [#3584](https://github.com/pingcap/tiflow/issues/3584) + - Fix the issue of the inaccurate `txn_batch_size` monitoring metric for Kafka sink [#3431](https://github.com/pingcap/tiflow/issues/3431) (dup) - Change the default value of Kafka Sink `partition-num` to 3 so that TiCDC distributes messages across Kafka partitions more evenly [#3337](https://github.com/pingcap/ticdc/issues/3337) (dup) - Change the default value of Kafka Sink `partition-num` to 3 so that TiCDC distributes messages across Kafka partitions more evenly [#3337](https://github.com/pingcap/ticdc/issues/3337) (dup) - Fix the issue that `tikv_cdc_min_resolved_ts_no_change_for_1m` keeps alerting when there is no changefeed [#11017](https://github.com/tikv/tikv/issues/11017) (dup) - Optimize rate limiting control on TiKV reloads to reduce gPRC congestion during changefeed initialization [#3110](https://github.com/pingcap/ticdc/issues/3110) + - Fix the TiCDC panic issue that occurs when manually cleaning the task status in etcd [#2980](https://github.com/pingcap/tiflow/issues/2980) - + (Backup & Restore) BR + + Backup & Restore (BR) (dup) - Improve the robustness of restoring [#27421](https://github.com/pingcap/tidb/issues/27421) - - Fix failed after importing table with expression index using local backend. [#1404](https://github.com/pingcap/br/issues/1404) - - Fix the average speed isn't accurate in backup and restore [#1405](https://github.com/pingcap/br/issues/1405) + - Fix the error that occurs when TiDB Lightning imports a table with expression index in the Local-backend mode [#1404](https://github.com/pingcap/br/issues/1404) + - Fix the issue of inaccurate average speed in BR [#1405](https://github.com/pingcap/br/issues/1405) + Dumpling - - Fix the bug that dumpling gets very slow when dumping composite primary/unique key tables. [#29386](https://github.com/pingcap/tidb/issues/29386) \ No newline at end of file + - Fix the bug that Dumpling becomes very slow when dumping tables with the composite primary key or unique key [#29386](https://github.com/pingcap/tidb/issues/29386) \ No newline at end of file From b57ed852d5accb2fde00d4f99459db5dd37e3718 Mon Sep 17 00:00:00 2001 From: TomShawn <41534398+TomShawn@users.noreply.github.com> Date: Tue, 28 Dec 2021 18:55:12 +0800 Subject: [PATCH 35/51] Apply suggestions from code review --- releases/release-5.0.6.md | 12 ++++++------ 1 file changed, 6 insertions(+), 6 deletions(-) diff --git a/releases/release-5.0.6.md b/releases/release-5.0.6.md index 3974fee9b53c4..79071ea961db8 100644 --- a/releases/release-5.0.6.md +++ b/releases/release-5.0.6.md @@ -76,15 +76,15 @@ TiDB version: 5.0.6 (dup) - Fix wrong results of the control functions (such as `IF` and `CASE WHEN`) when using the `ENUM` type data as parameters of such functions [#23114](https://github.com/pingcap/tidb/issues/23114) - Fix the wrong result of `CONCAT(IFNULL(TIME(3))` [#29498](https://github.com/pingcap/tidb/issues/29498) - Fix the wrong results of `GREATEST` and `LEAST` when passing in unsigned `BIGINT` arguments [#30101](https://github.com/pingcap/tidb/issues/30101) - - Fix the problem that SQL is cancelled when including json column joins char column [#29401](https://github.com/pingcap/tidb/issues/29401) - - Fix the data inconsistency caused by incorrect usage of lazy existence check and untouch key optimization [#30410](https://github.com/pingcap/tidb/issues/30410) - - Fix the problem that window function may return different results when using transaction or not [#29947](https://github.com/pingcap/tidb/issues/29947) - - Fix the problem that `cast(integer as char) union string` returns wrong result[#29513](https://github.com/pingcap/tidb/issues/29513) + - Fix the issue that a SQL operation is canceled when its JSON type column joins its `CHAR` type column [#29401](https://github.com/pingcap/tidb/issues/29401) + - Fix the data inconsistency issue caused by incorrect usage of lazy existence check and untouched key optimization [#30410](https://github.com/pingcap/tidb/issues/30410) + - Fix the issue that window functions might return different results when using a transaction or not [#29947](https://github.com/pingcap/tidb/issues/29947) + - Fix the issue that SQL statements that contain `cast(integer as char) union string` return wrong result [#29513](https://github.com/pingcap/tidb/issues/29513) (dup) - Fix the issue that the length information is wrong when converting `Decimal` to `String` [#29417](https://github.com/pingcap/tidb/issues/29417) - - Fix the problem that the error `Column 'col_name' in field list is ambiguous` is raised unexpectedly when a SQL contains natural join [#25041](https://github.com/pingcap/tidb/issues/25041) + - Fix the issue that the `Column 'col_name' in field list is ambiguous` error is raised unexpectedly when a SQL statement contains natural join [#25041](https://github.com/pingcap/tidb/issues/25041) (dup) - Fix the issue that the `GREATEST` function returns inconsistent results due to different values of `tidb_enable_vectorized_expression` (`on` or `off`) [#29434](https://github.com/pingcap/tidb/issues/29434) (dup) - Fix the issue that planner might cache invalid plans for `join` in some cases [#28087](https://github.com/pingcap/tidb/issues/28087) - - Fix the problem that the error `index out of range [1] with length 1` is raised when a SQL tries to evaluates an aggregation result on the result of join in some cases [#1978](https://github.com/pingcap/tics/issues/1978) + - Fix the issue that the `index out of range [1] with length 1` error is raised when a SQL statement tries to evaluate an aggregation result on the result of join in some cases [#1978](https://github.com/pingcap/tics/issues/1978) + TiKV From 321a431c4595b24ec352146d00be3c308844690a Mon Sep 17 00:00:00 2001 From: Enwei Date: Tue, 28 Dec 2021 12:55:36 +0100 Subject: [PATCH 36/51] udpate TiKV & PD in ## Improvements --- releases/release-5.0.6.md | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git a/releases/release-5.0.6.md b/releases/release-5.0.6.md index 79071ea961db8..55b643d7b99ef 100644 --- a/releases/release-5.0.6.md +++ b/releases/release-5.0.6.md @@ -29,12 +29,12 @@ TiDB version: 5.0.6 - Increase the speed of inserting SST files by moving the verification process to import thread pool from apply thread pool [#11239](https://github.com/tikv/tikv/issues/11239) - Add metrics for the garbage collection module of Raft logs to locate performance problems in this module [#11374](https://github.com/tikv/tikv/issues/11374) - - Collapse some uncommon metrics related to storage in Grafana dashboard [#11681](https://github.com/tikv/tikv/issues/11681) + - Collapse some uncommon metrics related to the storage module in Grafana dashboard [#11681](https://github.com/tikv/tikv/issues/11681) + PD (dup) - Speed up the exit process of schedulers [#4146](https://github.com/tikv/pd/issues/4146) - - Make the `scatter-range-scheduler` scheduler work better by allowing to schedule empty regions and fix configurations [#4497](https://github.com/tikv/pd/issues/4497) + - Make the scheduling results of `scatter-range-scheduler` scheduler are more even by allowing the scheduler to schedule empty Regions and fix the configurations of the scheduler [#4497](https://github.com/tikv/pd/issues/4497) + Tools From 704212cb170b99403518d19415dd1f6c33614f50 Mon Sep 17 00:00:00 2001 From: Enwei Date: Wed, 29 Dec 2021 00:52:15 +0100 Subject: [PATCH 37/51] revise TiKV and PD parts in ## Bug fixes --- releases/release-5.0.6.md | 22 ++++++++++------------ 1 file changed, 10 insertions(+), 12 deletions(-) diff --git a/releases/release-5.0.6.md b/releases/release-5.0.6.md index 55b643d7b99ef..73d5ada6c09e7 100644 --- a/releases/release-5.0.6.md +++ b/releases/release-5.0.6.md @@ -28,8 +28,8 @@ TiDB version: 5.0.6 + TiKV - Increase the speed of inserting SST files by moving the verification process to import thread pool from apply thread pool [#11239](https://github.com/tikv/tikv/issues/11239) - - Add metrics for the garbage collection module of Raft logs to locate performance problems in this module [#11374](https://github.com/tikv/tikv/issues/11374) - - Collapse some uncommon metrics related to the storage module in Grafana dashboard [#11681](https://github.com/tikv/tikv/issues/11681) + - Add metrics for the garbage collection module of Raft logs to locate performance problems in the module [#11374](https://github.com/tikv/tikv/issues/11374) + - Collapse some uncommon storage-related metrics in Grafana dashboard [#11681](https://github.com/tikv/tikv/issues/11681) + PD @@ -88,24 +88,22 @@ TiDB version: 5.0.6 + TiKV - - Fix resolved timestamp lag increased after stoping a tikv [#11351](https://github.com/tikv/tikv/issues/11351) + - Fix the issue that a downed TiKV node causes the resolved timestamp to lag behind [#11351](https://github.com/tikv/tikv/issues/11351) (dup) - Fix the issue that batch messages are too large in Raft client implementation [#9714](https://github.com/tikv/tikv/issues/9714) (dup) - Fix a panic issue that occurs when Region merge, ConfChange, and Snapshot happen at the same time in extreme conditions [#11475](https://github.com/tikv/tikv/issues/11475) - - Fix the issue that reverse scan can't detect memory locks and may read stale data. [#11440](https://github.com/tikv/tikv/issues/11440) - (dup) - Fix a panic issue that occurs when Region merge, ConfChange, and Snapshot happen at the same time in extreme conditions [#11475](https://github.com/tikv/tikv/issues/11475) - - Fix the issue that reverse scan can't detect memory locks and may read stale data. [#11440](https://github.com/tikv/tikv/issues/11440) + - Fix the issue that TiKV cannot detect the memory lock when `TableScan` is in descending order [#11440](https://github.com/tikv/tikv/issues/11440) (dup) - Fix the issue of negative sign when the decimal divide result is zero [#29586](https://github.com/pingcap/tidb/issues/29586) - - Avoid possible OOM due to the accumulation of GC tasks [#11410](https://github.com/tikv/tikv/issues/11410) + - Fix the issue that the accumulation of GC tasks might cause TiKV to be OOM (out of memory) [#11410](https://github.com/tikv/tikv/issues/11410) (dup) - Fix the issue that the average latency of the by-instance gRPC requests is inaccurate in TiKV metrics [#11299](https://github.com/tikv/tikv/issues/11299) (dup) - Fix a memory leak caused by monitoring data of statistics threads [#11195](https://github.com/tikv/tikv/issues/11195) (dup) - Fix the issue of TiCDC panic that occurs when the downstream database is missing [#11123](https://github.com/tikv/tikv/issues/11123) (dup) - Fix the issue that CDC adds scan retries frequently due to the Congest error [#11082](https://github.com/tikv/tikv/issues/11082) (dup) - Fix the issue that the Raft connection is broken when the channel is full [#11047](https://github.com/tikv/tikv/issues/11047) - - Fix panic caused by SST NotFound, which is ingested by Lightning import. [#10438](https://github.com/tikv/tikv/issues/10438) + - Fix the issue of TiKV panic that occurs when the files do not exist when Lightning importing data [#10438](https://github.com/tikv/tikv/issues/10438) (dup) - Fix the issue that TiDB cannot correctly identify whether the `Int64` types in `Max`/`Min` functions are a signed integer or not, which causes the wrong calculation result of `Max`/`Min` [#10158](https://github.com/tikv/tikv/issues/10158) - - Fix follower meta corruption in rare cases with more than 4 replicas [#10225](https://github.com/tikv/tikv/issues/10225) - - Fix backup threads leak [#10287](https://github.com/tikv/tikv/issues/10287) - - copr cast invalid utf8 string to real bug fix [#23322](https://github.com/pingcap/tidb/issues/23322) + - Fix the issue that the nodes of a TiKV replica are down after the nodes get snapshots because TiKV cannot modify the meta information accurately [#10225](https://github.com/tikv/tikv/issues/10225) + - Fix the issue that the backup thread pool leaks [#10287](https://github.com/tikv/tikv/issues/10287) + - Fix the issue of converting illegal strings into floating-point arithmetic [#23322](https://github.com/pingcap/tidb/issues/23322) + PD @@ -114,7 +112,7 @@ TiDB version: 5.0.6 (dup) - Fix slow leader election caused by stucked Region syncer [#3936](https://github.com/tikv/pd/issues/3936) (dup) - Support that the evict leader scheduler can schedule Regions with unhealthy peers [#4093](https://github.com/tikv/pd/issues/4093) - Fix the issue that the speed of removing peers is limited when repairing the down nodes [#4090](https://github.com/tikv/pd/issues/4090) - - Fix the issue that the hotspot Cache cannot be cleared when the Region heartbeat is less than 60 seconds [#4390](https://github.com/tikv/pd/issues/4390) + - Fix the issue that the hotspot cache cannot be cleared when the Region heartbeat is less than 60 seconds [#4390](https://github.com/tikv/pd/issues/4390) + TiFlash From a813e9876d7d0906077e8a60dedba316d61a35bb Mon Sep 17 00:00:00 2001 From: shichun-0415 <89768198+shichun-0415@users.noreply.github.com> Date: Wed, 29 Dec 2021 14:38:53 +0800 Subject: [PATCH 38/51] Apply suggestions from code review Co-authored-by: xixirangrang Co-authored-by: maxshuang Co-authored-by: Grace Cai --- releases/release-5.0.6.md | 25 +++++++++++++------------ 1 file changed, 13 insertions(+), 12 deletions(-) diff --git a/releases/release-5.0.6.md b/releases/release-5.0.6.md index 73d5ada6c09e7..8b7acd5d634a7 100644 --- a/releases/release-5.0.6.md +++ b/releases/release-5.0.6.md @@ -15,7 +15,7 @@ TiDB version: 5.0.6 + TiCDC - - Output the cdc server cmd error from stdout to stderr. [#3133](https://github.com/pingcap/tiflow/issues/3133) + - Set the default value of Kafka sink `max-message-bytes` to `10M` [#3081](https://github.com/pingcap/tiflow/issues/3081) ## Improvements @@ -43,10 +43,11 @@ TiDB version: 5.0.6 (dup) - Fix the issue that scanning stock data might fail due to TiKV performing GC when scanning stock data takes too long [#2470](https://github.com/pingcap/tiflow/issues/2470) (dup) - Fix the issue that changefeed does not fail fast enough when the ErrGCTTLExceeded error occurs [#3111](https://github.com/pingcap/ticdc/issues/3111) (dup) - Add a tick frequency limit to EtcdWorker to prevent frequent etcd writes from affecting PD services [#3112](https://github.com/pingcap/ticdc/issues/3112) - - Support batch messages to reduce EtcdWorker tick. [3112](https://github.com/pingcap/tiflow/issues/3112) + - Add a tick frequency limit to EtcdWorker to prevent frequent etcd writes from affecting PD services + [3112](https://github.com/pingcap/tiflow/issues/3112) (dup) - Fix OOM in container environments [#1798](https://github.com/pingcap/ticdc/issues/1798) - Add Kafka sink default configuration config.Metadata.Timeout. [#3352](https://github.com/pingcap/tiflow/issues/3352) - - Change Kafka sink default `MaxMessageBytes` to 1MB. [#3081](https://github.com/pingcap/tiflow/issues/3081) + - Set the default value of `max-message-bytes` to `10M`, to reduce the probability that Kafka messages cannot be sent [#3081](https://github.com/pingcap/tiflow/issues/3081) - Add more monitor metric and alert, including "no owner alert" [#4054](https://github.com/pingcap/tiflow/issues/4054), "mounter row" , "table sink total row" , "buffer sink total row" [#1606](https://github.com/pingcap/tiflow/issues/1606) + (Backup & Restore) BR @@ -116,18 +117,18 @@ TiDB version: 5.0.6 + TiFlash - - Fix potential data inconsistency after widening the column type of an integer primary key - - Fix the issue that TiFlash fails to start up on some platforms, such as ARM, due to the absence of library "libnsl.so" - - Fix the issue that the "Store size" metric does not match the actual data size on a disk - - Fix the issue that TiFlash crashes due to a "Cannot open file" error + - Fix potential data inconsistency after altering a primary key column to a larger int data type + - Fix the issue that TiFlash fails to start up on some platforms, such as ARM, due to the absence of the `libnsl.so` library + - Fix the issue that the `Store size` metric does not match the actual data size on a disk + - Fix the issue that TiFlash crashes due to a `Cannot open file` error - Fix occasional crashes of TiFlash when an MPP query is killed - - Fix the unexpected error "3rd arguments of function substringUTF8 must be constants" + - Fix the unexpected error `3rd arguments of function substringUTF8 must be constants` - Fix query failures caused by excessive `OR` conditions - - Fix the bug that results of `where ` is wrong + - Fix the bug that results of `where ` are wrong - Fix inconsistent behaviors of `CastStringAsDecimal` between TiFlash and TiDB/TiKV - - Fix query failures caused by the error "different types: expected Nullable(Int64), got Int64" - - Fix query failures caused by the error "Unexpected type of column: Nullable(Nothing)" - - Fix query failures caused by overflow following Decimal comparison + - Fix query failures caused by the error `different types: expected Nullable(Int64), got Int64` + - Fix query failures caused by the error `Unexpected type of column: Nullable(Nothing)` + - Fix query failures caused by overflow when comparing data in the `DECIMAL` data type + Tools From c431597c0715db9fcd0511268b78286556a156ce Mon Sep 17 00:00:00 2001 From: shichun-0415 <89768198+shichun-0415@users.noreply.github.com> Date: Wed, 29 Dec 2021 14:41:47 +0800 Subject: [PATCH 39/51] Update releases/release-5.0.6.md --- releases/release-5.0.6.md | 1 + 1 file changed, 1 insertion(+) diff --git a/releases/release-5.0.6.md b/releases/release-5.0.6.md index 8b7acd5d634a7..b79e4ee36fbd8 100644 --- a/releases/release-5.0.6.md +++ b/releases/release-5.0.6.md @@ -15,6 +15,7 @@ TiDB version: 5.0.6 + TiCDC + - Change the output of the `cdc server` command error from stdout to stderr [#3133](https://github.com/pingcap/tiflow/issues/3133) - Set the default value of Kafka sink `max-message-bytes` to `10M` [#3081](https://github.com/pingcap/tiflow/issues/3081) ## Improvements From 7f138d83380037769dfe3e24969e73ab7f10d0e9 Mon Sep 17 00:00:00 2001 From: xixirangrang Date: Wed, 29 Dec 2021 16:28:31 +0800 Subject: [PATCH 40/51] Apply suggestions from code review --- releases/release-5.0.6.md | 9 ++++----- 1 file changed, 4 insertions(+), 5 deletions(-) diff --git a/releases/release-5.0.6.md b/releases/release-5.0.6.md index b79e4ee36fbd8..6d6fd4f41d2c6 100644 --- a/releases/release-5.0.6.md +++ b/releases/release-5.0.6.md @@ -47,13 +47,13 @@ TiDB version: 5.0.6 - Add a tick frequency limit to EtcdWorker to prevent frequent etcd writes from affecting PD services [3112](https://github.com/pingcap/tiflow/issues/3112) (dup) - Fix OOM in container environments [#1798](https://github.com/pingcap/ticdc/issues/1798) - - Add Kafka sink default configuration config.Metadata.Timeout. [#3352](https://github.com/pingcap/tiflow/issues/3352) + - Add the default configuration for `config.Metadata.Timeout` in Kafka sink [#3352](https://github.com/pingcap/tiflow/issues/3352) - Set the default value of `max-message-bytes` to `10M`, to reduce the probability that Kafka messages cannot be sent [#3081](https://github.com/pingcap/tiflow/issues/3081) - - Add more monitor metric and alert, including "no owner alert" [#4054](https://github.com/pingcap/tiflow/issues/4054), "mounter row" , "table sink total row" , "buffer sink total row" [#1606](https://github.com/pingcap/tiflow/issues/1606) + - Add more monitoring metrics and alerts, including "no owner alert", "mounter row" , "table sink total row", and "buffer sink total row" [#4054](https://github.com/pingcap/tiflow/issues/4054) [#1606](https://github.com/pingcap/tiflow/issues/1606) + (Backup & Restore) BR - - Retry pd request and TiKV IO timeout error [#27787](https://github.com/pingcap/tidb/issues/27787) + - Support retry after the PD request error and the TiKV I/O timeout error occur [#27787](https://github.com/pingcap/tidb/issues/27787) ## Bug fixes @@ -136,8 +136,7 @@ TiDB version: 5.0.6 + TiCDC (dup) - Fix the issue that some partitioned tables without valid indexes might be ignored when `force-replicate` is enabled [#2834](https://github.com/pingcap/tiflow/issues/2834) - - Fix cdc cli silently truncated user parameters when receiving unexpected parameters, causing the user input parameters to be lost. [#2303](https://github.com/pingcap/tiflow/issues/2303) - - Fix cdc scheduling tables too early. [#2625](https://github.com/pingcap/tiflow/issues/2625) + - Fix the issue that `cdc cli` silently truncates user parameters when receiving unexpected parameters, causing the user input parameters to be lost [#2303](https://github.com/pingcap/tiflow/issues/2303) (dup) - Fix the issue that TiCDC sync task might pause when an error occurs during writing a Kafka message [#2978](https://github.com/pingcap/tiflow/issues/2978) (dup) - Fix a possible panic issue when encoding some types of columns into Open Protocol format [#2758](https://github.com/pingcap/tiflow/issues/2758) (dup) - Fix the issue that the volume of Kafka messages generated by TiCDC is not constrained by `max-message-size` [#2962](https://github.com/pingcap/tiflow/issues/2962) From 93e787a431edb6f221a90b8a0fffb6d09d060575 Mon Sep 17 00:00:00 2001 From: shichun-0415 <89768198+shichun-0415@users.noreply.github.com> Date: Thu, 30 Dec 2021 09:56:32 +0800 Subject: [PATCH 41/51] Update releases/release-5.0.6.md --- releases/release-5.0.6.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/releases/release-5.0.6.md b/releases/release-5.0.6.md index 6d6fd4f41d2c6..f82e651cd84b0 100644 --- a/releases/release-5.0.6.md +++ b/releases/release-5.0.6.md @@ -77,7 +77,7 @@ TiDB version: 5.0.6 - Fix the unexpected `index out of range` error when the planner is doing join reorder [#24095](https://github.com/pingcap/tidb/issues/24095) (dup) - Fix wrong results of the control functions (such as `IF` and `CASE WHEN`) when using the `ENUM` type data as parameters of such functions [#23114](https://github.com/pingcap/tidb/issues/23114) - Fix the wrong result of `CONCAT(IFNULL(TIME(3))` [#29498](https://github.com/pingcap/tidb/issues/29498) - - Fix the wrong results of `GREATEST` and `LEAST` when passing in unsigned `BIGINT` arguments [#30101](https://github.com/pingcap/tidb/issues/30101) + - Fix wrong results of `GREATEST` and `LEAST` when passing in unsigned `BIGINT` arguments [#30101](https://github.com/pingcap/tidb/issues/30101) - Fix the issue that a SQL operation is canceled when its JSON type column joins its `CHAR` type column [#29401](https://github.com/pingcap/tidb/issues/29401) - Fix the data inconsistency issue caused by incorrect usage of lazy existence check and untouched key optimization [#30410](https://github.com/pingcap/tidb/issues/30410) - Fix the issue that window functions might return different results when using a transaction or not [#29947](https://github.com/pingcap/tidb/issues/29947) From 1233305c48fcbe9237caa2b2b1fbe49c81850f6a Mon Sep 17 00:00:00 2001 From: shichun-0415 <89768198+shichun-0415@users.noreply.github.com> Date: Thu, 30 Dec 2021 11:33:39 +0800 Subject: [PATCH 42/51] Apply suggestions from code review Co-authored-by: Ran --- releases/release-5.0.6.md | 18 +++++++++--------- releases/release-timeline.md | 2 +- 2 files changed, 10 insertions(+), 10 deletions(-) diff --git a/releases/release-5.0.6.md b/releases/release-5.0.6.md index f82e651cd84b0..589fba80af76f 100644 --- a/releases/release-5.0.6.md +++ b/releases/release-5.0.6.md @@ -5,7 +5,7 @@ category: Releases # TiDB 5.0.6 Release Notes -Release date: December 28, 2021 +Release date: December 31, 2021 TiDB version: 5.0.6 @@ -40,21 +40,23 @@ TiDB version: 5.0.6 + Tools + TiCDC + (dup) - Optimize rate limiting control on TiKV reloads to reduce gPRC congestion during changefeed initialization [#3110](https://github.com/pingcap/ticdc/issues/3110) (dup) - Fix the issue that scanning stock data might fail due to TiKV performing GC when scanning stock data takes too long [#2470](https://github.com/pingcap/tiflow/issues/2470) (dup) - Fix the issue that changefeed does not fail fast enough when the ErrGCTTLExceeded error occurs [#3111](https://github.com/pingcap/ticdc/issues/3111) (dup) - Add a tick frequency limit to EtcdWorker to prevent frequent etcd writes from affecting PD services [#3112](https://github.com/pingcap/ticdc/issues/3112) - - Add a tick frequency limit to EtcdWorker to prevent frequent etcd writes from affecting PD services - [3112](https://github.com/pingcap/tiflow/issues/3112) (dup) - Fix OOM in container environments [#1798](https://github.com/pingcap/ticdc/issues/1798) - Add the default configuration for `config.Metadata.Timeout` in Kafka sink [#3352](https://github.com/pingcap/tiflow/issues/3352) - Set the default value of `max-message-bytes` to `10M`, to reduce the probability that Kafka messages cannot be sent [#3081](https://github.com/pingcap/tiflow/issues/3081) - - Add more monitoring metrics and alerts, including "no owner alert", "mounter row" , "table sink total row", and "buffer sink total row" [#4054](https://github.com/pingcap/tiflow/issues/4054) [#1606](https://github.com/pingcap/tiflow/issues/1606) + - Add more Promethous and Grafana monitoring metrics and alerts, including `no owner alert`, `mounter row`, `table sink total row`, and `buffer sink total row` [#4054](https://github.com/pingcap/tiflow/issues/4054) [#1606](https://github.com/pingcap/tiflow/issues/1606) + + + Backup & Restore (BR) - + (Backup & Restore) BR + - Retry BR tasks when encountering the PD request error or the TiKV I/O timeout error [#27787](https://github.com/pingcap/tidb/issues/27787) - - Support retry after the PD request error and the TiKV I/O timeout error occur [#27787](https://github.com/pingcap/tidb/issues/27787) + + TiDB Lightning + - Support importing data into tables that have expression index or the index that depends on virtual generated columns [#1404](https://github.com/pingcap/br/issues/1404) ## Bug fixes + TiDB @@ -152,7 +154,6 @@ TiDB version: 5.0.6 - Fix the timezone error that occurs when the `cdc server` command runs on some Red Hat Enterprise Linux releases (such as 6.8 and 6.9) [#3584](https://github.com/pingcap/tiflow/issues/3584) - Fix the issue of the inaccurate `txn_batch_size` monitoring metric for Kafka sink [#3431](https://github.com/pingcap/tiflow/issues/3431) (dup) - Change the default value of Kafka Sink `partition-num` to 3 so that TiCDC distributes messages across Kafka partitions more evenly [#3337](https://github.com/pingcap/ticdc/issues/3337) - (dup) - Change the default value of Kafka Sink `partition-num` to 3 so that TiCDC distributes messages across Kafka partitions more evenly [#3337](https://github.com/pingcap/ticdc/issues/3337) (dup) - Fix the issue that `tikv_cdc_min_resolved_ts_no_change_for_1m` keeps alerting when there is no changefeed [#11017](https://github.com/tikv/tikv/issues/11017) (dup) - Optimize rate limiting control on TiKV reloads to reduce gPRC congestion during changefeed initialization [#3110](https://github.com/pingcap/ticdc/issues/3110) - Fix the TiCDC panic issue that occurs when manually cleaning the task status in etcd [#2980](https://github.com/pingcap/tiflow/issues/2980) @@ -160,8 +161,7 @@ TiDB version: 5.0.6 + Backup & Restore (BR) (dup) - Improve the robustness of restoring [#27421](https://github.com/pingcap/tidb/issues/27421) - - Fix the error that occurs when TiDB Lightning imports a table with expression index in the Local-backend mode [#1404](https://github.com/pingcap/br/issues/1404) - - Fix the issue of inaccurate average speed in BR [#1405](https://github.com/pingcap/br/issues/1405) + - Fix a bug that the average speed is inaccurately calculated for backup and restore [#1405](https://github.com/pingcap/br/issues/1405) + Dumpling diff --git a/releases/release-timeline.md b/releases/release-timeline.md index 2940fb86233b1..e1ef19e83a511 100644 --- a/releases/release-timeline.md +++ b/releases/release-timeline.md @@ -9,7 +9,7 @@ This document shows all the released TiDB versions in reverse chronological orde | Version | Release Date | | :--- | :--- | -| [5.0.6](/releases/release-5.0.6.md) | 2021-12-28 | +| [5.0.6](/releases/release-5.0.6.md) | 2021-12-31 | | [4.0.16](/releases/release-4.0.16.md) | 2021-12-17 | | [5.1.3](/releases/release-5.1.3.md) | 2021-12-03 | | [5.0.5](/releases/release-5.0.5.md) | 2021-12-03 | From 4ee06e59b8f9279f62f487887ba0430ee83ed6a0 Mon Sep 17 00:00:00 2001 From: Enwei Date: Thu, 30 Dec 2021 07:37:49 +0100 Subject: [PATCH 43/51] update TiKV and PD Co-authored-by: TomShawn <41534398+TomShawn@users.noreply.github.com> --- releases/release-5.0.6.md | 16 ++++++++-------- 1 file changed, 8 insertions(+), 8 deletions(-) diff --git a/releases/release-5.0.6.md b/releases/release-5.0.6.md index 589fba80af76f..360b073bc438d 100644 --- a/releases/release-5.0.6.md +++ b/releases/release-5.0.6.md @@ -28,8 +28,8 @@ TiDB version: 5.0.6 + TiKV - - Increase the speed of inserting SST files by moving the verification process to import thread pool from apply thread pool [#11239](https://github.com/tikv/tikv/issues/11239) - - Add metrics for the garbage collection module of Raft logs to locate performance problems in the module [#11374](https://github.com/tikv/tikv/issues/11374) + - Increase the speed of inserting SST files by moving the verification process to the `Import` thread pool from the `Apply` thread pool [#11239](https://github.com/tikv/tikv/issues/11239) + - Add more metrics for the garbage collection module of Raft logs to locate performance problems in the module [#11374](https://github.com/tikv/tikv/issues/11374) - Collapse some uncommon storage-related metrics in Grafana dashboard [#11681](https://github.com/tikv/tikv/issues/11681) + PD @@ -95,19 +95,19 @@ TiDB version: 5.0.6 - Fix the issue that a downed TiKV node causes the resolved timestamp to lag behind [#11351](https://github.com/tikv/tikv/issues/11351) (dup) - Fix the issue that batch messages are too large in Raft client implementation [#9714](https://github.com/tikv/tikv/issues/9714) (dup) - Fix a panic issue that occurs when Region merge, ConfChange, and Snapshot happen at the same time in extreme conditions [#11475](https://github.com/tikv/tikv/issues/11475) - - Fix the issue that TiKV cannot detect the memory lock when `TableScan` is in descending order [#11440](https://github.com/tikv/tikv/issues/11440) + - Fix the issue that TiKV cannot detect the memory lock when TiKV perform a reverse table scan [#11440](https://github.com/tikv/tikv/issues/11440) (dup) - Fix the issue of negative sign when the decimal divide result is zero [#29586](https://github.com/pingcap/tidb/issues/29586) - Fix the issue that the accumulation of GC tasks might cause TiKV to be OOM (out of memory) [#11410](https://github.com/tikv/tikv/issues/11410) (dup) - Fix the issue that the average latency of the by-instance gRPC requests is inaccurate in TiKV metrics [#11299](https://github.com/tikv/tikv/issues/11299) (dup) - Fix a memory leak caused by monitoring data of statistics threads [#11195](https://github.com/tikv/tikv/issues/11195) (dup) - Fix the issue of TiCDC panic that occurs when the downstream database is missing [#11123](https://github.com/tikv/tikv/issues/11123) - (dup) - Fix the issue that CDC adds scan retries frequently due to the Congest error [#11082](https://github.com/tikv/tikv/issues/11082) + (dup) - Fix the issue that TiCDC adds scan retries frequently due to the Congest error [#11082](https://github.com/tikv/tikv/issues/11082) (dup) - Fix the issue that the Raft connection is broken when the channel is full [#11047](https://github.com/tikv/tikv/issues/11047) - - Fix the issue of TiKV panic that occurs when the files do not exist when Lightning importing data [#10438](https://github.com/tikv/tikv/issues/10438) + - Fix the issue of TiKV panic that occurs when the files do not exist when TiDB Lightning imports data [#10438](https://github.com/tikv/tikv/issues/10438) (dup) - Fix the issue that TiDB cannot correctly identify whether the `Int64` types in `Max`/`Min` functions are a signed integer or not, which causes the wrong calculation result of `Max`/`Min` [#10158](https://github.com/tikv/tikv/issues/10158) - - Fix the issue that the nodes of a TiKV replica are down after the nodes get snapshots because TiKV cannot modify the meta information accurately [#10225](https://github.com/tikv/tikv/issues/10225) - - Fix the issue that the backup thread pool leaks [#10287](https://github.com/tikv/tikv/issues/10287) - - Fix the issue of converting illegal strings into floating-point arithmetic [#23322](https://github.com/pingcap/tidb/issues/23322) + - Fix the issue that the node of a TiKV replica is down after the node gets snapshots because TiKV cannot modify the metadata accurately [#10225](https://github.com/tikv/tikv/issues/10225) + - Fix the leak issue of the backup thread pool [#10287](https://github.com/tikv/tikv/issues/10287) + - Fix the issue of casting illegal strings into floating-point numbers [#23322](https://github.com/pingcap/tidb/issues/23322) + PD From c1e759aa0a250417e682f953b6fb548338837420 Mon Sep 17 00:00:00 2001 From: Enwei Date: Thu, 30 Dec 2021 07:43:58 +0100 Subject: [PATCH 44/51] update TiKV Co-authored-by: TomShawn <41534398+TomShawn@users.noreply.github.com> --- releases/release-5.0.6.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/releases/release-5.0.6.md b/releases/release-5.0.6.md index 360b073bc438d..0e69715628748 100644 --- a/releases/release-5.0.6.md +++ b/releases/release-5.0.6.md @@ -92,7 +92,7 @@ TiDB version: 5.0.6 + TiKV - - Fix the issue that a downed TiKV node causes the resolved timestamp to lag behind [#11351](https://github.com/tikv/tikv/issues/11351) + - Fix the issue that a down TiKV node causes the resolved timestamp to lag [#11351](https://github.com/tikv/tikv/issues/11351) (dup) - Fix the issue that batch messages are too large in Raft client implementation [#9714](https://github.com/tikv/tikv/issues/9714) (dup) - Fix a panic issue that occurs when Region merge, ConfChange, and Snapshot happen at the same time in extreme conditions [#11475](https://github.com/tikv/tikv/issues/11475) - Fix the issue that TiKV cannot detect the memory lock when TiKV perform a reverse table scan [#11440](https://github.com/tikv/tikv/issues/11440) From 6ab1d85a01232adb2a249427d498f636b87fd1c1 Mon Sep 17 00:00:00 2001 From: TomShawn <41534398+TomShawn@users.noreply.github.com> Date: Thu, 30 Dec 2021 14:55:26 +0800 Subject: [PATCH 45/51] Update releases/release-5.0.6.md Co-authored-by: Enwei --- releases/release-5.0.6.md | 12 ++++++------ 1 file changed, 6 insertions(+), 6 deletions(-) diff --git a/releases/release-5.0.6.md b/releases/release-5.0.6.md index 0e69715628748..cea68497adab5 100644 --- a/releases/release-5.0.6.md +++ b/releases/release-5.0.6.md @@ -83,12 +83,12 @@ TiDB version: 5.0.6 - Fix the issue that a SQL operation is canceled when its JSON type column joins its `CHAR` type column [#29401](https://github.com/pingcap/tidb/issues/29401) - Fix the data inconsistency issue caused by incorrect usage of lazy existence check and untouched key optimization [#30410](https://github.com/pingcap/tidb/issues/30410) - Fix the issue that window functions might return different results when using a transaction or not [#29947](https://github.com/pingcap/tidb/issues/29947) - - Fix the issue that SQL statements that contain `cast(integer as char) union string` return wrong result [#29513](https://github.com/pingcap/tidb/issues/29513) - (dup) - Fix the issue that the length information is wrong when converting `Decimal` to `String` [#29417](https://github.com/pingcap/tidb/issues/29417) - - Fix the issue that the `Column 'col_name' in field list is ambiguous` error is raised unexpectedly when a SQL statement contains natural join [#25041](https://github.com/pingcap/tidb/issues/25041) - (dup) - Fix the issue that the `GREATEST` function returns inconsistent results due to different values of `tidb_enable_vectorized_expression` (`on` or `off`) [#29434](https://github.com/pingcap/tidb/issues/29434) - (dup) - Fix the issue that planner might cache invalid plans for `join` in some cases [#28087](https://github.com/pingcap/tidb/issues/28087) - - Fix the issue that the `index out of range [1] with length 1` error is raised when a SQL statement tries to evaluate an aggregation result on the result of join in some cases [#1978](https://github.com/pingcap/tics/issues/1978) + - Fix the issue that the SQL statements that contain `cast(integer as char) union string` return wrong results [#29513](https://github.com/pingcap/tidb/issues/29513) + (dup) - Fix the issue that the length information is wrong when casting `Decimal` to `String` [#29417](https://github.com/pingcap/tidb/issues/29417) + - Fix the issue that the `Column 'col_name' in field list is ambiguous` error is reported unexpectedly when a SQL statement contains natural join [#25041](https://github.com/pingcap/tidb/issues/25041) + (dup) - Fix the issue that the `GREATEST` function returns inconsistent results due to different values of `tidb_enable_vectorized_expression` (set to `on` or `off`) [#29434](https://github.com/pingcap/tidb/issues/29434) + (dup) - Fix the issue that the planner might cache invalid plans for `join` in some cases [#28087](https://github.com/pingcap/tidb/issues/28087) + - Fix the issue that the `index out of range [1] with length 1` error is reported when a SQL statement evaluates an aggregation result on the result of join in some cases [#1978](https://github.com/pingcap/tics/issues/1978) + TiKV From e6e876cd1c5e2cc216df15063177fa1d8949f8ab Mon Sep 17 00:00:00 2001 From: TomShawn <41534398+TomShawn@users.noreply.github.com> Date: Thu, 30 Dec 2021 15:01:25 +0800 Subject: [PATCH 46/51] Update releases/release-5.0.6.md --- releases/release-5.0.6.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/releases/release-5.0.6.md b/releases/release-5.0.6.md index cea68497adab5..70542305fe605 100644 --- a/releases/release-5.0.6.md +++ b/releases/release-5.0.6.md @@ -35,7 +35,7 @@ TiDB version: 5.0.6 + PD (dup) - Speed up the exit process of schedulers [#4146](https://github.com/tikv/pd/issues/4146) - - Make the scheduling results of `scatter-range-scheduler` scheduler are more even by allowing the scheduler to schedule empty Regions and fix the configurations of the scheduler [#4497](https://github.com/tikv/pd/issues/4497) + - Make the scheduling results of the `scatter-range-scheduler` scheduler more even by allowing the scheduler to schedule empty Regions and fix the configurations of the scheduler [#4497](https://github.com/tikv/pd/issues/4497) + Tools From ec6b29cd530e0ac575526917bdfd006cc2058d5a Mon Sep 17 00:00:00 2001 From: Ran Date: Thu, 30 Dec 2021 15:44:50 +0800 Subject: [PATCH 47/51] Update releases/release-5.0.6.md --- releases/release-5.0.6.md | 1 + 1 file changed, 1 insertion(+) diff --git a/releases/release-5.0.6.md b/releases/release-5.0.6.md index 70542305fe605..b6046b453f4bd 100644 --- a/releases/release-5.0.6.md +++ b/releases/release-5.0.6.md @@ -57,6 +57,7 @@ TiDB version: 5.0.6 + TiDB Lightning - Support importing data into tables that have expression index or the index that depends on virtual generated columns [#1404](https://github.com/pingcap/br/issues/1404) + ## Bug fixes + TiDB From e31f9790583a0d6f8a21c9651b80de799ddfc09e Mon Sep 17 00:00:00 2001 From: shichun-0415 Date: Fri, 31 Dec 2021 10:05:40 +0800 Subject: [PATCH 48/51] Remove the dup label --- releases/release-5.0.6.md | 99 +++++++++++++++++++-------------------- 1 file changed, 49 insertions(+), 50 deletions(-) diff --git a/releases/release-5.0.6.md b/releases/release-5.0.6.md index b6046b453f4bd..21f7346f930d7 100644 --- a/releases/release-5.0.6.md +++ b/releases/release-5.0.6.md @@ -22,9 +22,9 @@ TiDB version: 5.0.6 + TiDB - (dup) - Fix the issue that optimistic transaction conflicts might cause transactions to block each other [#11148](https://github.com/tikv/tikv/issues/11148) - (dup) - Fix the issue of false positive error log `invalid cop task execution summaries length` for MPP queries [#1791](https://github.com/pingcap/tics/issues/1791) - (dup) - Show the affected SQL statements in the debug log when the coprocessor encounters a lock, which is helpful in diagnosing problems [#27718](https://github.com/pingcap/tidb/issues/27718) + - Fix the issue that optimistic transaction conflicts might cause transactions to block each other [#11148](https://github.com/tikv/tikv/issues/11148) + - Fix the issue of false positive error log `invalid cop task execution summaries length` for MPP queries [#1791](https://github.com/pingcap/tics/issues/1791) + - Show the affected SQL statements in the debug log when the coprocessor encounters a lock, which is helpful in diagnosing problems [#27718](https://github.com/pingcap/tidb/issues/27718) + TiKV @@ -34,18 +34,18 @@ TiDB version: 5.0.6 + PD - (dup) - Speed up the exit process of schedulers [#4146](https://github.com/tikv/pd/issues/4146) + - Speed up the exit process of schedulers [#4146](https://github.com/tikv/pd/issues/4146) - Make the scheduling results of the `scatter-range-scheduler` scheduler more even by allowing the scheduler to schedule empty Regions and fix the configurations of the scheduler [#4497](https://github.com/tikv/pd/issues/4497) + Tools + TiCDC - (dup) - Optimize rate limiting control on TiKV reloads to reduce gPRC congestion during changefeed initialization [#3110](https://github.com/pingcap/ticdc/issues/3110) - (dup) - Fix the issue that scanning stock data might fail due to TiKV performing GC when scanning stock data takes too long [#2470](https://github.com/pingcap/tiflow/issues/2470) - (dup) - Fix the issue that changefeed does not fail fast enough when the ErrGCTTLExceeded error occurs [#3111](https://github.com/pingcap/ticdc/issues/3111) - (dup) - Add a tick frequency limit to EtcdWorker to prevent frequent etcd writes from affecting PD services [#3112](https://github.com/pingcap/ticdc/issues/3112) - (dup) - Fix OOM in container environments [#1798](https://github.com/pingcap/ticdc/issues/1798) + - Optimize rate limiting control on TiKV reloads to reduce gPRC congestion during changefeed initialization [#3110](https://github.com/pingcap/ticdc/issues/3110) + - Fix the issue that scanning stock data might fail due to TiKV performing GC when scanning stock data takes too long [#2470](https://github.com/pingcap/tiflow/issues/2470) + - Fix the issue that changefeed does not fail fast enough when the ErrGCTTLExceeded error occurs [#3111](https://github.com/pingcap/ticdc/issues/3111) + - Add a tick frequency limit to EtcdWorker to prevent frequent etcd writes from affecting PD services [#3112](https://github.com/pingcap/ticdc/issues/3112) + - Fix OOM in container environments [#1798](https://github.com/pingcap/ticdc/issues/1798) - Add the default configuration for `config.Metadata.Timeout` in Kafka sink [#3352](https://github.com/pingcap/tiflow/issues/3352) - Set the default value of `max-message-bytes` to `10M`, to reduce the probability that Kafka messages cannot be sent [#3081](https://github.com/pingcap/tiflow/issues/3081) - Add more Promethous and Grafana monitoring metrics and alerts, including `no owner alert`, `mounter row`, `table sink total row`, and `buffer sink total row` [#4054](https://github.com/pingcap/tiflow/issues/4054) [#1606](https://github.com/pingcap/tiflow/issues/1606) @@ -63,66 +63,66 @@ TiDB version: 5.0.6 + TiDB - Fix the panic that might occur when DML and DDL statements are executed concurrently [#30940](https://github.com/pingcap/tidb/issues/30940) - (dup) - Fix the `privilege check fail` error when performing the `grant` and `revoke` operations to grant and revoke global level privileges [#29675](https://github.com/pingcap/tidb/issues/29675) + - Fix the `privilege check fail` error when performing the `grant` and `revoke` operations to grant and revoke global level privileges [#29675](https://github.com/pingcap/tidb/issues/29675) - Fix the TiDB panic when executing the `ALTER TABLE.. ADD INDEX` statement in some cases [#27687](https://github.com/pingcap/tidb/issues/27687) - Fix the issue that the `enforce-mpp` configuration does not take effect in v5.0.4 [#29252](https://github.com/pingcap/tidb/issues/29252) - (dup) - Fix the panic when using the `CASE WHEN` function on the `ENUM` data type [#29357](https://github.com/pingcap/tidb/issues/29357) - (dup) - Fix wrong results of the `microsecond` function in vectorized expressions [#29244](https://github.com/pingcap/tidb/issues/29244) - (dup) - Fix the issue of incomplete log information from the `auto analyze` result [#29188](https://github.com/pingcap/tidb/issues/29188) - (dup) - Fix wrong results of the `hour` function in vectorized expression [#28643](https://github.com/pingcap/tidb/issues/28643) - (dup) - Fix the unexpected error like `tidb_cast to Int32 is not supported` when the unsupported `cast` is pushed down to TiFlash [#23907](https://github.com/pingcap/tidb/issues/23907) - (dup) - Fix a bug that the availability detection of MPP node does not work in some corner cases [#3118](https://github.com/pingcap/tics/issues/3118) - (dup) - Fix the `DATA RACE` issue when assigning `MPP task ID` [#27952](https://github.com/pingcap/tidb/issues/27952) - (dup) - Fix the `INDEX OUT OF RANGE` error for a MPP query after deleting an empty `dual table` [#28250](https://github.com/pingcap/tidb/issues/28250) + - Fix the panic when using the `CASE WHEN` function on the `ENUM` data type [#29357](https://github.com/pingcap/tidb/issues/29357) + - Fix wrong results of the `microsecond` function in vectorized expressions [#29244](https://github.com/pingcap/tidb/issues/29244) + - Fix the issue of incomplete log information from the `auto analyze` result [#29188](https://github.com/pingcap/tidb/issues/29188) + - Fix wrong results of the `hour` function in vectorized expression [#28643](https://github.com/pingcap/tidb/issues/28643) + - Fix the unexpected error like `tidb_cast to Int32 is not supported` when the unsupported `cast` is pushed down to TiFlash [#23907](https://github.com/pingcap/tidb/issues/23907) + - Fix a bug that the availability detection of MPP node does not work in some corner cases [#3118](https://github.com/pingcap/tics/issues/3118) + - Fix the `DATA RACE` issue when assigning `MPP task ID` [#27952](https://github.com/pingcap/tidb/issues/27952) + - Fix the `INDEX OUT OF RANGE` error for a MPP query after deleting an empty `dual table` [#28250](https://github.com/pingcap/tidb/issues/28250) - Fix the TiDB panic when inserting invalid date values concurrently [#25393](https://github.com/pingcap/tidb/issues/25393) - Fix the unexpected `can not found column in Schema column` error for queries in the MPP mode [#30980](https://github.com/pingcap/tidb/issues/30980) - (dup) - Fix the issue that TiDB might panic when TiFlash is shuting down [#28096](https://github.com/pingcap/tidb/issues/28096) + - Fix the issue that TiDB might panic when TiFlash is shuting down [#28096](https://github.com/pingcap/tidb/issues/28096) - Fix the unexpected `index out of range` error when the planner is doing join reorder [#24095](https://github.com/pingcap/tidb/issues/24095) - (dup) - Fix wrong results of the control functions (such as `IF` and `CASE WHEN`) when using the `ENUM` type data as parameters of such functions [#23114](https://github.com/pingcap/tidb/issues/23114) + - Fix wrong results of the control functions (such as `IF` and `CASE WHEN`) when using the `ENUM` type data as parameters of such functions [#23114](https://github.com/pingcap/tidb/issues/23114) - Fix the wrong result of `CONCAT(IFNULL(TIME(3))` [#29498](https://github.com/pingcap/tidb/issues/29498) - Fix wrong results of `GREATEST` and `LEAST` when passing in unsigned `BIGINT` arguments [#30101](https://github.com/pingcap/tidb/issues/30101) - Fix the issue that a SQL operation is canceled when its JSON type column joins its `CHAR` type column [#29401](https://github.com/pingcap/tidb/issues/29401) - Fix the data inconsistency issue caused by incorrect usage of lazy existence check and untouched key optimization [#30410](https://github.com/pingcap/tidb/issues/30410) - Fix the issue that window functions might return different results when using a transaction or not [#29947](https://github.com/pingcap/tidb/issues/29947) - Fix the issue that the SQL statements that contain `cast(integer as char) union string` return wrong results [#29513](https://github.com/pingcap/tidb/issues/29513) - (dup) - Fix the issue that the length information is wrong when casting `Decimal` to `String` [#29417](https://github.com/pingcap/tidb/issues/29417) + - Fix the issue that the length information is wrong when casting `Decimal` to `String` [#29417](https://github.com/pingcap/tidb/issues/29417) - Fix the issue that the `Column 'col_name' in field list is ambiguous` error is reported unexpectedly when a SQL statement contains natural join [#25041](https://github.com/pingcap/tidb/issues/25041) - (dup) - Fix the issue that the `GREATEST` function returns inconsistent results due to different values of `tidb_enable_vectorized_expression` (set to `on` or `off`) [#29434](https://github.com/pingcap/tidb/issues/29434) - (dup) - Fix the issue that the planner might cache invalid plans for `join` in some cases [#28087](https://github.com/pingcap/tidb/issues/28087) + - Fix the issue that the `GREATEST` function returns inconsistent results due to different values of `tidb_enable_vectorized_expression` (set to `on` or `off`) [#29434](https://github.com/pingcap/tidb/issues/29434) + - Fix the issue that the planner might cache invalid plans for `join` in some cases [#28087](https://github.com/pingcap/tidb/issues/28087) - Fix the issue that the `index out of range [1] with length 1` error is reported when a SQL statement evaluates an aggregation result on the result of join in some cases [#1978](https://github.com/pingcap/tics/issues/1978) + TiKV - Fix the issue that a down TiKV node causes the resolved timestamp to lag [#11351](https://github.com/tikv/tikv/issues/11351) - (dup) - Fix the issue that batch messages are too large in Raft client implementation [#9714](https://github.com/tikv/tikv/issues/9714) - (dup) - Fix a panic issue that occurs when Region merge, ConfChange, and Snapshot happen at the same time in extreme conditions [#11475](https://github.com/tikv/tikv/issues/11475) + - Fix the issue that batch messages are too large in Raft client implementation [#9714](https://github.com/tikv/tikv/issues/9714) + - Fix a panic issue that occurs when Region merge, ConfChange, and Snapshot happen at the same time in extreme conditions [#11475](https://github.com/tikv/tikv/issues/11475) - Fix the issue that TiKV cannot detect the memory lock when TiKV perform a reverse table scan [#11440](https://github.com/tikv/tikv/issues/11440) - (dup) - Fix the issue of negative sign when the decimal divide result is zero [#29586](https://github.com/pingcap/tidb/issues/29586) + - Fix the issue of negative sign when the decimal divide result is zero [#29586](https://github.com/pingcap/tidb/issues/29586) - Fix the issue that the accumulation of GC tasks might cause TiKV to be OOM (out of memory) [#11410](https://github.com/tikv/tikv/issues/11410) - (dup) - Fix the issue that the average latency of the by-instance gRPC requests is inaccurate in TiKV metrics [#11299](https://github.com/tikv/tikv/issues/11299) - (dup) - Fix a memory leak caused by monitoring data of statistics threads [#11195](https://github.com/tikv/tikv/issues/11195) - (dup) - Fix the issue of TiCDC panic that occurs when the downstream database is missing [#11123](https://github.com/tikv/tikv/issues/11123) - (dup) - Fix the issue that TiCDC adds scan retries frequently due to the Congest error [#11082](https://github.com/tikv/tikv/issues/11082) - (dup) - Fix the issue that the Raft connection is broken when the channel is full [#11047](https://github.com/tikv/tikv/issues/11047) + - Fix the issue that the average latency of the by-instance gRPC requests is inaccurate in TiKV metrics [#11299](https://github.com/tikv/tikv/issues/11299) + - Fix a memory leak caused by monitoring data of statistics threads [#11195](https://github.com/tikv/tikv/issues/11195) + - Fix the issue of TiCDC panic that occurs when the downstream database is missing [#11123](https://github.com/tikv/tikv/issues/11123) + - Fix the issue that TiCDC adds scan retries frequently due to the Congest error [#11082](https://github.com/tikv/tikv/issues/11082) + - Fix the issue that the Raft connection is broken when the channel is full [#11047](https://github.com/tikv/tikv/issues/11047) - Fix the issue of TiKV panic that occurs when the files do not exist when TiDB Lightning imports data [#10438](https://github.com/tikv/tikv/issues/10438) - (dup) - Fix the issue that TiDB cannot correctly identify whether the `Int64` types in `Max`/`Min` functions are a signed integer or not, which causes the wrong calculation result of `Max`/`Min` [#10158](https://github.com/tikv/tikv/issues/10158) + - Fix the issue that TiDB cannot correctly identify whether the `Int64` types in `Max`/`Min` functions are a signed integer or not, which causes the wrong calculation result of `Max`/`Min` [#10158](https://github.com/tikv/tikv/issues/10158) - Fix the issue that the node of a TiKV replica is down after the node gets snapshots because TiKV cannot modify the metadata accurately [#10225](https://github.com/tikv/tikv/issues/10225) - Fix the leak issue of the backup thread pool [#10287](https://github.com/tikv/tikv/issues/10287) - Fix the issue of casting illegal strings into floating-point numbers [#23322](https://github.com/pingcap/tidb/issues/23322) + PD - (dup) - Fix a panic issue that occurs after the TiKV node is removed [#4344](https://github.com/tikv/pd/issues/4344) + - Fix a panic issue that occurs after the TiKV node is removed [#4344](https://github.com/tikv/pd/issues/4344) - Fix the issue that operator can get blocked due to down store [#3353](https://github.com/tikv/pd/issues/3353) - (dup) - Fix slow leader election caused by stucked Region syncer [#3936](https://github.com/tikv/pd/issues/3936) - (dup) - Support that the evict leader scheduler can schedule Regions with unhealthy peers [#4093](https://github.com/tikv/pd/issues/4093) + - Fix slow leader election caused by stucked Region syncer [#3936](https://github.com/tikv/pd/issues/3936) + - Support that the evict leader scheduler can schedule Regions with unhealthy peers [#4093](https://github.com/tikv/pd/issues/4093) - Fix the issue that the speed of removing peers is limited when repairing the down nodes [#4090](https://github.com/tikv/pd/issues/4090) - Fix the issue that the hotspot cache cannot be cleared when the Region heartbeat is less than 60 seconds [#4390](https://github.com/tikv/pd/issues/4390) + TiFlash - Fix potential data inconsistency after altering a primary key column to a larger int data type - - Fix the issue that TiFlash fails to start up on some platforms, such as ARM, due to the absence of the `libnsl.so` library + - Fix the issue that TiFlash fails to start up on some platforms, such as ARM, due to the absence of the `libnsl.so` library - Fix the issue that the `Store size` metric does not match the actual data size on a disk - Fix the issue that TiFlash crashes due to a `Cannot open file` error - Fix occasional crashes of TiFlash when an MPP query is killed @@ -138,30 +138,29 @@ TiDB version: 5.0.6 + TiCDC - (dup) - Fix the issue that some partitioned tables without valid indexes might be ignored when `force-replicate` is enabled [#2834](https://github.com/pingcap/tiflow/issues/2834) - - Fix the issue that `cdc cli` silently truncates user parameters when receiving unexpected parameters, causing the user input parameters to be lost [#2303](https://github.com/pingcap/tiflow/issues/2303) - (dup) - Fix the issue that TiCDC sync task might pause when an error occurs during writing a Kafka message [#2978](https://github.com/pingcap/tiflow/issues/2978) - (dup) - Fix a possible panic issue when encoding some types of columns into Open Protocol format [#2758](https://github.com/pingcap/tiflow/issues/2758) - (dup) - Fix the issue that the volume of Kafka messages generated by TiCDC is not constrained by `max-message-size` [#2962](https://github.com/pingcap/tiflow/issues/2962) - (dup) - Fix the issue that TiCDC replication task might terminate when the upstream TiDB instance unexpectedly exits [#3061](https://github.com/pingcap/tiflow/issues/3061) - (dup) - Fix the issue that TiCDC process might panic when TiKV sends duplicate requests to the same Region [#2386](https://github.com/pingcap/tiflow/issues/2386) - (dup) - Fix the TiCDC replication interruption issue when multiple TiKVs crash or during a forced restart [#3288](https://github.com/pingcap/ticdc/issues/3288) - (dup) - Fix the negative value error in the changefeed checkpoint lag [#3010](https://github.com/pingcap/ticdc/issues/3010) + - Fix the issue that some partitioned tables without valid indexes might be ignored when `force-replicate` is enabled [#2834](https://github.com/pingcap/tiflow/issues/2834) + - Fix the issue that `cdc cli` silently truncates user parameters when receiving unexpected parameters, causing the user input parameters to be lost [#2303](https://github.com/pingcap/tiflow/issues/2303) + - Fix the issue that TiCDC sync task might pause when an error occurs during writing a Kafka message [#2978](https://github.com/pingcap/tiflow/issues/2978) + - Fix a possible panic issue when encoding some types of columns into Open Protocol format [#2758](https://github.com/pingcap/tiflow/issues/2758) + - Fix the issue that the volume of Kafka messages generated by TiCDC is not constrained by `max-message-size` [#2962](https://github.com/pingcap/tiflow/issues/2962) + - Fix the issue that TiCDC replication task might terminate when the upstream TiDB instance unexpectedly exits [#3061](https://github.com/pingcap/tiflow/issues/3061) + - Fix the issue that TiCDC process might panic when TiKV sends duplicate requests to the same Region [#2386](https://github.com/pingcap/tiflow/issues/2386) + - Fix the TiCDC replication interruption issue when multiple TiKVs crash or during a forced restart [#3288](https://github.com/pingcap/ticdc/issues/3288) + - Fix the negative value error in the changefeed checkpoint lag [#3010](https://github.com/pingcap/ticdc/issues/3010) - Fix the issue of overly frequent warnings caused by MySQL sink deadlock [#2706](https://github.com/pingcap/tiflow/issues/2706) - Fix the issue that Avro sink does not support parsing JSON type columns [#3624](https://github.com/pingcap/tiflow/issues/3624) - Fix the bug that TiCDC reads the incorrect schema snapshot from TiKV when the TiKV owner restarts [#2603](https://github.com/pingcap/tiflow/issues/2603) - (dup) - Fix the memory leak issue after processing DDLs [#3174](https://github.com/pingcap/ticdc/issues/3174) + - Fix the memory leak issue after processing DDLs [#3174](https://github.com/pingcap/ticdc/issues/3174) - Fix the bug that the `enable-old-value` configuration item is not automatically set to `true` on Canal and Maxwell protocols [#3676](https://github.com/pingcap/tiflow/issues/3676) - Fix the timezone error that occurs when the `cdc server` command runs on some Red Hat Enterprise Linux releases (such as 6.8 and 6.9) [#3584](https://github.com/pingcap/tiflow/issues/3584) - Fix the issue of the inaccurate `txn_batch_size` monitoring metric for Kafka sink [#3431](https://github.com/pingcap/tiflow/issues/3431) - (dup) - Change the default value of Kafka Sink `partition-num` to 3 so that TiCDC distributes messages across Kafka partitions more evenly [#3337](https://github.com/pingcap/ticdc/issues/3337) - (dup) - Fix the issue that `tikv_cdc_min_resolved_ts_no_change_for_1m` keeps alerting when there is no changefeed [#11017](https://github.com/tikv/tikv/issues/11017) - (dup) - Optimize rate limiting control on TiKV reloads to reduce gPRC congestion during changefeed initialization [#3110](https://github.com/pingcap/ticdc/issues/3110) + - Change the default value of Kafka Sink `partition-num` to 3 so that TiCDC distributes messages across Kafka partitions more evenly [#3337](https://github.com/pingcap/ticdc/issues/3337) + - Fix the issue that `tikv_cdc_min_resolved_ts_no_change_for_1m` keeps alerting when there is no changefeed [#11017](https://github.com/tikv/tikv/issues/11017) - Fix the TiCDC panic issue that occurs when manually cleaning the task status in etcd [#2980](https://github.com/pingcap/tiflow/issues/2980) + Backup & Restore (BR) - (dup) - Improve the robustness of restoring [#27421](https://github.com/pingcap/tidb/issues/27421) + - Improve the robustness of restoring [#27421](https://github.com/pingcap/tidb/issues/27421) - Fix a bug that the average speed is inaccurately calculated for backup and restore [#1405](https://github.com/pingcap/br/issues/1405) + Dumpling From b3b6b48aff3430ad34e9e3c84aa5de0004a2f819 Mon Sep 17 00:00:00 2001 From: shichun-0415 Date: Fri, 31 Dec 2021 14:52:18 +0800 Subject: [PATCH 49/51] Correct the position of two TiDB notes --- releases/release-5.0.6.md | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git a/releases/release-5.0.6.md b/releases/release-5.0.6.md index 21f7346f930d7..357301e95d920 100644 --- a/releases/release-5.0.6.md +++ b/releases/release-5.0.6.md @@ -22,8 +22,6 @@ TiDB version: 5.0.6 + TiDB - - Fix the issue that optimistic transaction conflicts might cause transactions to block each other [#11148](https://github.com/tikv/tikv/issues/11148) - - Fix the issue of false positive error log `invalid cop task execution summaries length` for MPP queries [#1791](https://github.com/pingcap/tics/issues/1791) - Show the affected SQL statements in the debug log when the coprocessor encounters a lock, which is helpful in diagnosing problems [#27718](https://github.com/pingcap/tidb/issues/27718) + TiKV @@ -62,6 +60,8 @@ TiDB version: 5.0.6 + TiDB + - Fix the issue that optimistic transaction conflicts might cause transactions to block each other [#11148](https://github.com/tikv/tikv/issues/11148) + - Fix the issue of false positive error log `invalid cop task execution summaries length` for MPP queries [#1791](https://github.com/pingcap/tics/issues/1791) - Fix the panic that might occur when DML and DDL statements are executed concurrently [#30940](https://github.com/pingcap/tidb/issues/30940) - Fix the `privilege check fail` error when performing the `grant` and `revoke` operations to grant and revoke global level privileges [#29675](https://github.com/pingcap/tidb/issues/29675) - Fix the TiDB panic when executing the `ALTER TABLE.. ADD INDEX` statement in some cases [#27687](https://github.com/pingcap/tidb/issues/27687) From 7337ac0deaf520f4a46f3fa1e190ca5c9a6bf5ff Mon Sep 17 00:00:00 2001 From: shichun-0415 Date: Fri, 31 Dec 2021 15:28:04 +0800 Subject: [PATCH 50/51] Correct the position of more notes --- releases/release-5.0.6.md | 12 ++++++------ 1 file changed, 6 insertions(+), 6 deletions(-) diff --git a/releases/release-5.0.6.md b/releases/release-5.0.6.md index 357301e95d920..ca324ee3c45f0 100644 --- a/releases/release-5.0.6.md +++ b/releases/release-5.0.6.md @@ -17,6 +17,7 @@ TiDB version: 5.0.6 - Change the output of the `cdc server` command error from stdout to stderr [#3133](https://github.com/pingcap/tiflow/issues/3133) - Set the default value of Kafka sink `max-message-bytes` to `10M` [#3081](https://github.com/pingcap/tiflow/issues/3081) + - Change the default value of Kafka Sink `partition-num` to 3 so that TiCDC distributes messages across Kafka partitions more evenly [#3337](https://github.com/pingcap/ticdc/issues/3337) ## Improvements @@ -34,16 +35,14 @@ TiDB version: 5.0.6 - Speed up the exit process of schedulers [#4146](https://github.com/tikv/pd/issues/4146) - Make the scheduling results of the `scatter-range-scheduler` scheduler more even by allowing the scheduler to schedule empty Regions and fix the configurations of the scheduler [#4497](https://github.com/tikv/pd/issues/4497) + - Support that the evict leader scheduler can schedule Regions with unhealthy peers [#4093](https://github.com/tikv/pd/issues/4093) + Tools + TiCDC - Optimize rate limiting control on TiKV reloads to reduce gPRC congestion during changefeed initialization [#3110](https://github.com/pingcap/ticdc/issues/3110) - - Fix the issue that scanning stock data might fail due to TiKV performing GC when scanning stock data takes too long [#2470](https://github.com/pingcap/tiflow/issues/2470) - - Fix the issue that changefeed does not fail fast enough when the ErrGCTTLExceeded error occurs [#3111](https://github.com/pingcap/ticdc/issues/3111) - Add a tick frequency limit to EtcdWorker to prevent frequent etcd writes from affecting PD services [#3112](https://github.com/pingcap/ticdc/issues/3112) - - Fix OOM in container environments [#1798](https://github.com/pingcap/ticdc/issues/1798) - Add the default configuration for `config.Metadata.Timeout` in Kafka sink [#3352](https://github.com/pingcap/tiflow/issues/3352) - Set the default value of `max-message-bytes` to `10M`, to reduce the probability that Kafka messages cannot be sent [#3081](https://github.com/pingcap/tiflow/issues/3081) - Add more Promethous and Grafana monitoring metrics and alerts, including `no owner alert`, `mounter row`, `table sink total row`, and `buffer sink total row` [#4054](https://github.com/pingcap/tiflow/issues/4054) [#1606](https://github.com/pingcap/tiflow/issues/1606) @@ -51,6 +50,7 @@ TiDB version: 5.0.6 + Backup & Restore (BR) - Retry BR tasks when encountering the PD request error or the TiKV I/O timeout error [#27787](https://github.com/pingcap/tidb/issues/27787) + - Improve the robustness of restoring [#27421](https://github.com/pingcap/tidb/issues/27421) + TiDB Lightning @@ -115,7 +115,6 @@ TiDB version: 5.0.6 - Fix a panic issue that occurs after the TiKV node is removed [#4344](https://github.com/tikv/pd/issues/4344) - Fix the issue that operator can get blocked due to down store [#3353](https://github.com/tikv/pd/issues/3353) - Fix slow leader election caused by stucked Region syncer [#3936](https://github.com/tikv/pd/issues/3936) - - Support that the evict leader scheduler can schedule Regions with unhealthy peers [#4093](https://github.com/tikv/pd/issues/4093) - Fix the issue that the speed of removing peers is limited when repairing the down nodes [#4090](https://github.com/tikv/pd/issues/4090) - Fix the issue that the hotspot cache cannot be cleared when the Region heartbeat is less than 60 seconds [#4390](https://github.com/tikv/pd/issues/4390) @@ -154,13 +153,14 @@ TiDB version: 5.0.6 - Fix the bug that the `enable-old-value` configuration item is not automatically set to `true` on Canal and Maxwell protocols [#3676](https://github.com/pingcap/tiflow/issues/3676) - Fix the timezone error that occurs when the `cdc server` command runs on some Red Hat Enterprise Linux releases (such as 6.8 and 6.9) [#3584](https://github.com/pingcap/tiflow/issues/3584) - Fix the issue of the inaccurate `txn_batch_size` monitoring metric for Kafka sink [#3431](https://github.com/pingcap/tiflow/issues/3431) - - Change the default value of Kafka Sink `partition-num` to 3 so that TiCDC distributes messages across Kafka partitions more evenly [#3337](https://github.com/pingcap/ticdc/issues/3337) - Fix the issue that `tikv_cdc_min_resolved_ts_no_change_for_1m` keeps alerting when there is no changefeed [#11017](https://github.com/tikv/tikv/issues/11017) - Fix the TiCDC panic issue that occurs when manually cleaning the task status in etcd [#2980](https://github.com/pingcap/tiflow/issues/2980) + - Fix the issue that changefeed does not fail fast enough when the ErrGCTTLExceeded error occurs [#3111](https://github.com/pingcap/ticdc/issues/3111) + - Fix the issue that scanning stock data might fail due to TiKV performing GC when scanning stock data takes too long [#2470](https://github.com/pingcap/tiflow/issues/2470) + - Fix OOM in container environments [#1798](https://github.com/pingcap/ticdc/issues/1798) + Backup & Restore (BR) - - Improve the robustness of restoring [#27421](https://github.com/pingcap/tidb/issues/27421) - Fix a bug that the average speed is inaccurately calculated for backup and restore [#1405](https://github.com/pingcap/br/issues/1405) + Dumpling From 2beaafaa30508dc5db37450acd98f89401c2c27b Mon Sep 17 00:00:00 2001 From: shichun-0415 Date: Fri, 31 Dec 2021 16:35:12 +0800 Subject: [PATCH 51/51] Fix note 3081 --- releases/release-5.0.6.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/releases/release-5.0.6.md b/releases/release-5.0.6.md index ca324ee3c45f0..6e04ed183a46e 100644 --- a/releases/release-5.0.6.md +++ b/releases/release-5.0.6.md @@ -141,7 +141,7 @@ TiDB version: 5.0.6 - Fix the issue that `cdc cli` silently truncates user parameters when receiving unexpected parameters, causing the user input parameters to be lost [#2303](https://github.com/pingcap/tiflow/issues/2303) - Fix the issue that TiCDC sync task might pause when an error occurs during writing a Kafka message [#2978](https://github.com/pingcap/tiflow/issues/2978) - Fix a possible panic issue when encoding some types of columns into Open Protocol format [#2758](https://github.com/pingcap/tiflow/issues/2758) - - Fix the issue that the volume of Kafka messages generated by TiCDC is not constrained by `max-message-size` [#2962](https://github.com/pingcap/tiflow/issues/2962) + - Fix the issue that Kafka may send excessively large messages by setting the default value of `max-message-bytes` to `10M` [#3081](https://github.com/pingcap/tiflow/issues/3081) - Fix the issue that TiCDC replication task might terminate when the upstream TiDB instance unexpectedly exits [#3061](https://github.com/pingcap/tiflow/issues/3061) - Fix the issue that TiCDC process might panic when TiKV sends duplicate requests to the same Region [#2386](https://github.com/pingcap/tiflow/issues/2386) - Fix the TiCDC replication interruption issue when multiple TiKVs crash or during a forced restart [#3288](https://github.com/pingcap/ticdc/issues/3288)