Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Feat: autohttps readinessProbe for quicker validated startup and shutdown #1633

Merged

Conversation

consideRatio
Copy link
Member

When the autohttps deployment is updating, it keeps existing connections
open for a while before it shuts down, but it closes itself for new
connections.

After it has closed itself for new connections, it is still considered
ready by the service that delegates traffic, so that makes the pod
continue to receive traffic that will crash.

With this change, it will stop receiving traffic, which is preferred as
it isn't actually doing its job to receive it as it should any more at
this stage.

When the autohttps deployment is updating, it keeps existing connections 
open for a while before it shuts down, but it closes itself for new 
connections.

After it has closed itself for new connections, it is still considered 
ready by the service that delegates traffic, so that makes the pod 
continue to receive traffic that will crash.

With this change, it will stop receiving traffic, which is preferred as 
it isn't actually doing its job to receive it as it should any more at 
this stage.
@consideRatio
Copy link
Member Author

Note that CircleCI fails due to warnings turned into errors - and the warnings showed up in Sphinx 3. Something to be fixed by another PR.

@consideRatio
Copy link
Member Author

I've tested this locally and it works great, reducing the disruptions of service during upgrades from ~30 seconds of flakyness down to just a few seconds.

@consideRatio consideRatio merged commit 20b2412 into jupyterhub:master Apr 19, 2020
@consideRatio consideRatio changed the title Feat: autohttps readinessProbe for quicker shutdowns Feat: autohttps readinessProbe for quicker validated startup and shutdown May 23, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant