Skip to content
This repository was archived by the owner on Apr 3, 2024. It is now read-only.

pass along the backfill command pool to the task instance#62

Open
kimyen wants to merge 1 commit intogh-2.0.2from
backfillpool
Open

pass along the backfill command pool to the task instance#62
kimyen wants to merge 1 commit intogh-2.0.2from
backfillpool

Conversation

@kimyen
Copy link

@kimyen kimyen commented Jul 14, 2022

To be used together with adding new pool for backfill in airflow-sources and prevent task instance from being assigned to a pool by its operator.

@whitleykeith
Copy link

@kimyen I looked into where the task instance get's assigned the pool in airlfow-sources, and I think we can check the dag_run_id of the task and assign it there so we don't need to touch our fork

https://github.com/github/airflow-sources/blob/master/airflow_local_settings.py#L53 <-- This is where we override the pool for the task instance.

We can change the logic in the called function to inspect the dag run id.

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants