Scale the configurable-http-proxy to handle 1000 connections

[mainak24]

Hi team,

We have a use case where we have 1000+ concurrent connections to the proxy from the hub. How to add multiple configurable-http-proxy and have a Load Balancer to load balance connections to multiple proxy server

[welcome]

Thank you for opening your first issue in this project! Engagement like this is essential for open source projects! 🤗

If you haven't done so already, check out Jupyter's Code of Conduct. Also, please try to follow the issue template as it helps other other community members to contribute more effectively.

You can meet the other Jovyans by joining our Discourse forum. There is also an intro thread there where you can stop by and say Hi! 👋

Welcome to the Jupyter community! 🎉

[consideRatio]

The routing is controlled by JupyterHub via a REST API, which only influences one instance - due to that, you can't have multiple replicas setup setup easily. This relates to a larger issue of making jupyterhub support being run in a "highly available" mode. See jupyterhub/jupyterhub#1932 for more information.

Note that this is a community supported open source project where github issues in the jupyterhub github organization typically is meant to focus on representing actionable items, and https://discourse.jupyter.org is meant for most other questions etc.

I'll go for a close here since I see no direct action point we can take here for this long standing challenge of making JupyterHub and associated proxies HA. I think work in jupyterhub/traefik-proxy may be what makes us accomplish a HA setup in the end rather than here in this project.