Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Run OOO compaction after restart if there is OOO data from WBL #320

Merged
merged 1 commit into from
Aug 22, 2022

Conversation

codesome
Copy link
Member

If there was some OOO data on disk (in WBL or mmap chunks) that got replayed while OOO being disabled during a restart, we were not compacting that data. Hence never cleaning up the chunks_head directory of old files because those OOO mmap chunks share the chunks_head. This caused the disk to fill up after disabling OOO.

This PR fixes it by setting db.oooWasEnabled to true if some OOO data was replayed. db.oooWasEnabled is a way to signal that compaction needs to run on OOO data.

Signed-off-by: Ganesh Vernekar <ganeshvern@gmail.com>
Copy link
Member

@jesusvazquez jesusvazquez left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nice find @codesome !

@codesome codesome merged commit 4aa6d56 into main Aug 22, 2022
@jesusvazquez jesusvazquez deleted the codesome/diskfilling branch August 22, 2022 14:07
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants