Schedule a continually airflow DAG run
Asked Answered
D

2

7

Is there a way to run airflow DAG in a loop? When trying to create a cycle (connecting the last component to the upstream of the last one) I got "Cycle detected in DAG. Faulty task: ..." Generally, I have a short flow of 3 BashOperator components which i want to run continually (without any input-output pass from the last component to the first). Thanks!

Dumond answered 24/12, 2017 at 8:12 Comment(1)
You're aware DAG means Directed Acyclic Graph right ? What's your UseCase ? Maybe Airflow is not the right tool for this taskStearin
K
9

You should be able to use the TriggerDagRunOperator to rerun the DAG after the last task is finished. Just put it after the last operator and make it trigger the same DAG.

Kidderminster answered 24/12, 2017 at 9:0 Comment(0)
N
1

Check out the @continuous cron preset in the airflow version 2.7.3

Nickerson answered 16/12, 2023 at 11:43 Comment(0)

© 2022 - 2024 — McMap. All rights reserved.