Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Operator leadership should trigger full reconciliation #71

Closed
thedodd opened this issue Aug 18, 2021 · 0 comments · Fixed by #73
Closed

Operator leadership should trigger full reconciliation #71

thedodd opened this issue Aug 18, 2021 · 0 comments · Fixed by #73
Labels
A-operator Hadron Kubernetes operator T-bug Something isn't working
Projects
Main

Comments

@thedodd
Copy link
Collaborator

thedodd commented Aug 18, 2021

When an operator instance becomes leader, perform full reconciliation of all managed objects. This is to account for cases where a leader was down for some period of time, and the actions which should have been taken will now be skipped due standby operator replicas not taking any actions as followers.
@thedodd thedodd created this issue from a note in Main (In progress) Aug 18, 2021
@thedodd thedodd added T-bug Something isn't working A-operator Hadron Kubernetes operator labels Aug 18, 2021
thedodd added a commit that referenced this issue Aug 20, 2021
@thedodd
Perform full data reconciliation on leadership change
3a41ae7 
Operator has been updated to mitigate stale data due to subtleties in
leadership changes and the conditions thereof. In cases where a leader
died and effectively missed reconciliation events, the standby replicas
will not be able to take any action given that they are followers. Once
a node becomes a leader, it will perform a full reconciliation over the
current state of the cluster in order to ensure the system is in the
needed state.

closes #71
@thedodd thedodd mentioned this issue Aug 20, 2021
Merged
Main automation moved this from In progress to Done Aug 20, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
A-operator Hadron Kubernetes operator T-bug Something isn't working
Projects
Main
Done
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Perform full data reconciliation on leadership change hadron-project/hadron
1 participant
@thedodd