Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Acess to web too slow #18

Open
fwynyk opened this issue Oct 30, 2017 · 1 comment
Open

Acess to web too slow #18

fwynyk opened this issue Oct 30, 2017 · 1 comment

Comments

@fwynyk
Copy link

fwynyk commented Oct 30, 2017

I ran the airflow.all.yaml in my kubernetes cluster but when I try to access the web interface, it takes too long. Some minutes after, I can navigate, but it also takes too long.

The cluster is full of resources (CPU/memory). No errors were found in any pod, just these warnings in 'web':

[2017-10-30 13:51:17,936] [53] {models.py:167} INFO - Filling up the DagBag from /usr/local/airflow/dags
[2017-10-30 13:51:18 +0000] [32] [INFO] Handling signal: ttou
[2017-10-30 13:51:47 +0000] [49] [INFO] Worker exiting (pid: 49)
[2017-10-30 13:52:17 +0000] [32] [INFO] Handling signal: ttin
[2017-10-30 13:52:17 +0000] [54] [INFO] Booting worker with pid: 54
/usr/local/lib/python2.7/dist-packages/flask/exthook.py:71: ExtDeprecationWarning: Importing flask.ext.cache is deprecated, use flask_cache instead.
  .format(x=modname), ExtDeprecationWarning
[2017-10-30 13:52:17,995] [54] {models.py:167} INFO - Filling up the DagBag from /usr/local/airflow/dags
[2017-10-30 13:52:18 +0000] [32] [INFO] Handling signal: ttou
[2017-10-30 13:52:18 +0000] [50] [INFO] Worker exiting (pid: 50)
[2017-10-30 13:52:49 +0000] [32] [INFO] Handling signal: ttin
[2017-10-30 13:52:49 +0000] [55] [INFO] Booting worker with pid: 55
/usr/local/lib/python2.7/dist-packages/flask/exthook.py:71: ExtDeprecationWarning: Importing flask.ext.cache is deprecated, use flask_cache instead.
  .format(x=modname), ExtDeprecationWarning

Do you have any idea? Does anyone tried to run it on a real Kubernetes cluster?

@chribsen
Copy link
Contributor

chribsen commented Jan 9, 2018

I'm using Airflow on k8s in preproduction - overall it works fine, but the web pod seems to halt after some time. However, I managed to fix this with a health check (the health check regularly pings the web page and restarts the pod if it doesn't respond).
Does this problem occur immediately after deploying kube-airflow?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants