airflow-taskflow Questions
3
I am trying to write unittests for some of the tasks built with Airflow TaskFlow API. I tried multiple approaches for example, by creating a dagrun or only running the task function but nothing is ...
Abate asked 13/7, 2022 at 22:52
2
Solved
I'm currently accessing an Airflow variable as follows:
from airflow.models import Variable
s3_bucket = Variable.get('bucket_name')
It works but I'm being asked to not use the Variable module and...
Erhart asked 5/4, 2022 at 15:19
1
Solved
I recently started using Apache airflow. In am using Taskflow API with one decorated task with id Get_payload and SimpleHttpOperator. Task Get_payload gets data from database, does some data manipu...
Suzetta asked 28/8, 2021 at 18:58
1
Solved
Wanted to try the new taskflow API I came to the point where I need to have 2 parallels task.
With Airflow v1 I was use to do something like
task_1 >> [task_2, task_3]
[task_2, task_3] >&g...
Semifinal asked 24/4, 2021 at 7:19
1
© 2022 - 2024 — McMap. All rights reserved.