Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Define live backup/restore workflow for Harbor. #15975

Closed
reasonerjt opened this issue Nov 9, 2021 · 4 comments
Closed

Define live backup/restore workflow for Harbor. #15975

reasonerjt opened this issue Nov 9, 2021 · 4 comments

Comments

@reasonerjt
Copy link
Contributor

reasonerjt commented Nov 9, 2021

We need a solution to backup/restore Harbor without having to shut down Harbor instance.

  1. We need a reliable approach to quiesc Harbor, or check if it's in a state that is ready to backup. Currently there is a readonly API but after the API is called there may be jobs running in the backend making updates to the storage such as tag retention, replication, GC. And new records of accesslog may be inserted to DB when user pulls artifacts. If that's not possible, we may need to define a "rerequisite" state only in which Harbor can be backed up.
  2. We need to clarify the scope of data that will be backed up and restored. For example, the data in redis may be ignored, it may be OK to lose some records in accesslog that are not backed up during this process.
  3. We need to define a test process to check the consistency of the data to verify the solution.
@Jeremy-boo
Copy link

Will the backup and restore of harbor data be put on the agenda in version 2.5? Now more and more users have requirements in this regard

@reasonerjt
Copy link
Contributor Author

reasonerjt commented Jan 17, 2022

@Jeremy-boo Currently the flow has to be shut down Harbor, copy all data, and start.

We are still investigating to provide a more reliable way to quiesc Harbor. considering there can be backend jobs running to clean up/replicating data, we still need more understanding regarding what impact such inconsistency may cause.

I'm removing this from 2.5 as we will not provide a very concrete solution per the timeline.

@ywk253100 ywk253100 self-assigned this Apr 12, 2022
@github-actions
Copy link

github-actions bot commented Jul 5, 2022

This issue is being marked stale due to a period of inactivity. If this issue is still relevant, please comment or remove the stale label. Otherwise, this issue will close in 30 days.

@github-actions github-actions bot added the Stale label Jul 5, 2022
@github-actions
Copy link

github-actions bot commented Aug 5, 2022

This issue was closed because it has been stalled for 30 days with no activity. If this issue is still relevant, please re-open a new issue.

@github-actions github-actions bot closed this as completed Aug 5, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

3 participants