Running Airflow on Kubenates, git sync cannot pull remote GitLab. Can Airflow be kept working properly? #41181
Unanswered
y528663036
asked this question in
Q&A
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Our airflow runs on Kubenates and is deployed through a helm chart. Dags uses GitSync synchronization. We found that when the GitSync container of Airflow cannot access GitLab, both GitSync and Airflow scheduler containers will restart and remain in a state of restart failure because they cannot connect to GitLab.
We consider that after the first git sync int, both the airflow scheduler and airflow worker containers already have local DAG repos. If git sync cannot connect to GitLab, can we use the latest successful git sync to pull down the DAG repo and keep the airflow scheduler and workers running without stopping.
当git停止时,容器重启状态
git-sync容器日志是这样的
我的gitSync 配置是这样的:
Beta Was this translation helpful? Give feedback.
All reactions