You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Hi all,
I have a repo on GitLab regarding Dags.
I tried to load those dags into my airflow application deployed by helm, but I saw an application restart on both of the following cases:
Loading dags with repo, airflow restarts itself after a new version is pulled.
Loading dags using a containerized version of dags. From the same repo, if a tag is created a pipeline will trigger the creation of a new dags docker image tagged with the same source tag. After amending the tag version in the values.yaml file, airflow restarts itself again.
My question is: how to load dags from my repository without triggering an application restart?
I also used another way of loading dags using extraVolumes and extraVolumesMount attaching a PVC created ah hoc for that. When a new code is tagged into the repo a pipeline will trigger a Job Pod that will clone the repository into the PVC. In that case the app is creating dags into /opt/bitnami/airflow/dags/dags and for that reason some imports are failing.
Thanks in advance to who will help me.
Kind regards
reacted with thumbs up emoji reacted with thumbs down emoji reacted with laugh emoji reacted with hooray emoji reacted with confused emoji reacted with heart emoji reacted with rocket emoji reacted with eyes emoji
-
Hi all,
I have a repo on GitLab regarding Dags.
I tried to load those dags into my airflow application deployed by helm, but I saw an application restart on both of the following cases:
My question is: how to load dags from my repository without triggering an application restart?
I also used another way of loading dags using extraVolumes and extraVolumesMount attaching a PVC created ah hoc for that. When a new code is tagged into the repo a pipeline will trigger a Job Pod that will clone the repository into the PVC. In that case the app is creating dags into /opt/bitnami/airflow/dags/dags and for that reason some imports are failing.
Thanks in advance to who will help me.
Kind regards
Daniele
Beta Was this translation helpful? Give feedback.
All reactions