Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

resolved ts stucks when running redo log changefeed with pd/cdc/tikv failure #9926

Closed
fubinzh opened this issue Oct 18, 2023 · 6 comments
Closed

resolved ts stucks when running redo log changefeed with pd/cdc/tikv failure #9926

fubinzh opened this issue Oct 18, 2023 · 6 comments
Assignees
@CharlesCheung96
Labels
affects-7.1 affects-7.5 area/ticdc Issues or PRs related to TiCDC. severity/critical type/bug The issue is confirmed as a bug.

Comments

@fubinzh
Copy link

fubinzh commented Oct 18, 2023

What did you do?

  1. Create TiDB sync changefeed with redo log enabled
  2. Run workload
  3. Inject PD/CDC/tikv failure

What did you expect to see?

CDC checkpoint should not stucks

What did you see instead?

Resolved TS and Checkpoint TS stucks.

image

Versions of the cluster

[release-version=v7.1.2]
[git-hash=64790caa64ec27714b6a6cbb7ed7e3d18f2c8d2c]
@fubinzh fubinzh added area/ticdc Issues or PRs related to TiCDC. type/bug The issue is confirmed as a bug. labels Oct 18, 2023
@fubinzh
Copy link
Author

fubinzh commented Oct 18, 2023

/label affects-7.1

@fubinzh
Copy link
Author

fubinzh commented Oct 18, 2023

/severity critical

@fubinzh
Copy link
Author

fubinzh commented Oct 18, 2023

/assign @CharlesCheung96

@CharlesCheung96 CharlesCheung96 mentioned this issue Oct 19, 2023
Merged
@nongfushanquan
Copy link
Contributor

/remove-label affects-6.5

@ti-chi-bot ti-chi-bot bot removed the affects-6.5 label Oct 19, 2023
ti-chi-bot bot pushed a commit that referenced this issue Oct 19, 2023
@CharlesCheung96
Revert bef3924 in release 7.1 (#9932)
6ba0aec 
ref #9926
@CharlesCheung96 CharlesCheung96 mentioned this issue Oct 25, 2023
Merged
ti-chi-bot bot pushed a commit that referenced this issue Oct 26, 2023
@CharlesCheung96
scheduler(ticdc): revert 3b8d55 and do not return error when resolved…
0c29040 
…Ts less than checkpoint (#9953)

ref #9830, ref #9926
This was referenced Oct 26, 2023
Closed
Closed
Merged
CharlesCheung96 added a commit to ti-chi-bot/tiflow that referenced this issue Oct 27, 2023
@CharlesCheung96
scheduler(ticdc): revert 3b8d55 and do not return error when resolved…
81f029e 
…Ts less than checkpoint (pingcap#9953)

ref pingcap#9830, ref pingcap#9926
ti-chi-bot bot pushed a commit that referenced this issue Oct 30, 2023
@ti-chi-bot
scheduler(ticdc): revert 3b8d55 and do not return error when resolved…
4f5f3eb 
…Ts less than checkpoint (#9953) (#9958)

ref #9830, ref #9926
@nongfushanquan
Copy link
Contributor

This issue is caused by a pr which has been reverted ,so close it
/close

@ti-chi-bot ti-chi-bot bot closed this as completed Oct 31, 2023
@ti-chi-bot
Copy link
Contributor

ti-chi-bot bot commented Oct 31, 2023

@nongfushanquan: Closing this issue.

In response to this:

This issue is caused by a pr which has been reverted ,so close it
/close

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@CharlesCheung96 CharlesCheung96

Labels
affects-7.1 affects-7.5 area/ticdc Issues or PRs related to TiCDC. severity/critical type/bug The issue is confirmed as a bug.
Projects
Question and Bug Reports
Status: Done
Milestone
No milestone
Development

No branches or pull requests
3 participants
@fubinzh @CharlesCheung96 @nongfushanquan