airflow-taskflow Questions

3

I am trying to write unittests for some of the tasks built with Airflow TaskFlow API. I tried multiple approaches for example, by creating a dagrun or only running the task function but nothing is ...
Abate asked 13/7, 2022 at 22:52

2

Solved

I'm currently accessing an Airflow variable as follows: from airflow.models import Variable s3_bucket = Variable.get('bucket_name') It works but I'm being asked to not use the Variable module and...
Erhart asked 5/4, 2022 at 15:19

1

Solved

I recently started using Apache airflow. In am using Taskflow API with one decorated task with id Get_payload and SimpleHttpOperator. Task Get_payload gets data from database, does some data manipu...
Suzetta asked 28/8, 2021 at 18:58

1

Solved

Wanted to try the new taskflow API I came to the point where I need to have 2 parallels task. With Airflow v1 I was use to do something like task_1 >> [task_2, task_3] [task_2, task_3] >&g...
Semifinal asked 24/4, 2021 at 7:19
1

© 2022 - 2024 — McMap. All rights reserved.