Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix SnapshotStatusApisIT #56859

Merged
merged 1 commit into from
May 16, 2020
Merged

Conversation

original-brownbear
Copy link
Member

In the unlikely event that the data nodes started snapshotting the
shards already (and hence got blocked on the data blobs) before the
master has applied the cluster state to its own SnapshotsService on
the CS applier thread, we can get a SnapshotMissingException here which
breaks the busy assert loop so we have to deal with it explicitly.

(this became a possibility now that the snapshot INIT state is gone via #55918)

Closes #56858

In the unlikely event that the data nodes started snapshotting the
shards already (and hence got blocked on the data blobs) before the
master has applied the cluster state to its own `SnapshotsService` on
the CS applier thread, we can get a `SnapshotMissingException` here which
breaks the busy assert loop so we have to deal with it explicitly.

Closes elastic#56858
@original-brownbear original-brownbear added >test Issues or PRs that are addressing/adding tests :Distributed/Snapshot/Restore Anything directly related to the `_snapshot/*` APIs v8.0.0 v7.9.0 labels May 16, 2020
@elasticmachine
Copy link
Collaborator

Pinging @elastic/es-distributed (:Distributed/Snapshot/Restore)

Copy link
Member

@nik9000 nik9000 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Lgtm

@original-brownbear
Copy link
Member Author

Thanks Nik!

@original-brownbear original-brownbear merged commit 8541ef4 into elastic:master May 16, 2020
@original-brownbear original-brownbear deleted the 56858 branch May 16, 2020 17:30
original-brownbear added a commit to original-brownbear/elasticsearch that referenced this pull request May 16, 2020
In the unlikely event that the data nodes started snapshotting the
shards already (and hence got blocked on the data blobs) before the
master has applied the cluster state to its own `SnapshotsService` on
the CS applier thread, we can get a `SnapshotMissingException` here which
breaks the busy assert loop so we have to deal with it explicitly.

Closes elastic#56858
original-brownbear added a commit that referenced this pull request May 16, 2020
In the unlikely event that the data nodes started snapshotting the
shards already (and hence got blocked on the data blobs) before the
master has applied the cluster state to its own `SnapshotsService` on
the CS applier thread, we can get a `SnapshotMissingException` here which
breaks the busy assert loop so we have to deal with it explicitly.

Closes #56858
@original-brownbear original-brownbear restored the 56858 branch August 6, 2020 18:32
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
:Distributed/Snapshot/Restore Anything directly related to the `_snapshot/*` APIs Team:Distributed Meta label for distributed team >test Issues or PRs that are addressing/adding tests v7.9.0 v8.0.0-alpha1
Projects
None yet
Development

Successfully merging this pull request may close these issues.

SnapshotStatusApisIT#testStatusAPICallInProgressSnapshot fails rarely and unreproducibly
4 participants