Skip to content

Add apache-datafusion provider skelton #64998

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
gopidesupavan wants to merge 4 commits into
base: main
Choose a base branch
from
Open

Add apache-datafusion provider skelton #64998

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
4 commits
Select commit Hold shift + click to select a range
f25c6a2
Add apache-datafusion provider
gopidesupavan Apr 10, 2026
567bfb4
Fixup stastic checks
gopidesupavan Apr 11, 2026
44bf751
Resolve comments
gopidesupavan Jun 20, 2026
667c31e
Fix test
gopidesupavan Jun 20, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1 change: 1 addition & 0 deletions .github/ISSUE_TEMPLATE/1-airflow_bug_report.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -117,6 +117,7 @@ body:
- amazon
- apache-beam
- apache-cassandra
- apache-datafusion
- apache-drill
- apache-druid
- apache-flink
Expand Down
3 changes: 3 additions & 0 deletions .github/boring-cyborg.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -36,6 +36,9 @@ labelPRBasedOnFilePath:
provider:apache-cassandra:
- providers/apache/cassandra/**

provider:apache-datafusion:
- providers/apache/datafusion/**

provider:apache-drill:
- providers/apache/drill/**

Expand Down
2 changes: 2 additions & 0 deletions airflow-core/docs/extra-packages-ref.rst
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -194,6 +194,8 @@ custom bash/python providers).
+---------------------+-----------------------------------------------------+------------------------------------------------+
| apache-cassandra | ``pip install 'apache-airflow[apache-cassandra]'`` | Cassandra related operators & hooks |
+---------------------+-----------------------------------------------------+------------------------------------------------+
| apache-datafusion | ``pip install 'apache-airflow[apache-datafusion]'`` | Apache DataFusion provider package |
+---------------------+-----------------------------------------------------+------------------------------------------------+
| apache-drill | ``pip install 'apache-airflow[apache-drill]'`` | Drill related operators & hooks |
+---------------------+-----------------------------------------------------+------------------------------------------------+
| apache-druid | ``pip install 'apache-airflow[apache-druid]'`` | Druid related operators & hooks |
Expand Down
22 changes: 11 additions & 11 deletions dev/breeze/doc/images/output_build-docs.svg
View file
Open in desktop
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
2 changes: 1 addition & 1 deletion dev/breeze/doc/images/output_build-docs.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1 +1 @@
de29604dc4d7031b9a26a1e0350d7806
3b60fc61bfa1058da1123aa6f146cc85
22 changes: 11 additions & 11 deletions dev/breeze/doc/images/output_release-management_add-back-references.svg
View file
Open in desktop
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
2 changes: 1 addition & 1 deletion dev/breeze/doc/images/output_release-management_add-back-references.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1 +1 @@
4b44b7c52911adf1c1bdfb87e10e873b
98f2cbb52affbfea2d87e28881f47f65
22 changes: 11 additions & 11 deletions dev/breeze/doc/images/output_release-management_classify-provider-changes.svg
View file
Open in desktop
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
2 changes: 1 addition & 1 deletion dev/breeze/doc/images/output_release-management_classify-provider-changes.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1 +1 @@
57466e5cb9470b0d4398724fda2a1825
d6f78774069055cce998b7523a4af756
22 changes: 11 additions & 11 deletions ...reeze/doc/images/output_release-management_generate-issue-content-providers.svg
View file
Open in desktop
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
2 changes: 1 addition & 1 deletion dev/breeze/doc/images/output_release-management_generate-issue-content-providers.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1 +1 @@
e2d5118e3339b53ce6e87dc6be6ae053
8bce09eb48da1b7c1762bc4ef6556bab
50 changes: 27 additions & 23 deletions dev/breeze/doc/images/output_release-management_generate-providers-metadata.svg
View file
Open in desktop
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
2 changes: 1 addition & 1 deletion dev/breeze/doc/images/output_release-management_generate-providers-metadata.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1 +1 @@
93f9b27ce19f188a7d7b70cfcabf8c2b
c89eaff49ab3074ea6a9d3235d472b95
22 changes: 11 additions & 11 deletions dev/breeze/doc/images/output_release-management_prepare-provider-distributions.svg
View file
Open in desktop
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
2 changes: 1 addition & 1 deletion dev/breeze/doc/images/output_release-management_prepare-provider-distributions.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1 +1 @@
3581abc65c55d4b8a096005c312df783
a936d98a919fde245162ac6dfa1d2fd8
22 changes: 11 additions & 11 deletions dev/breeze/doc/images/output_release-management_prepare-provider-documentation.svg
View file
Open in desktop
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
2 changes: 1 addition & 1 deletion dev/breeze/doc/images/output_release-management_prepare-provider-documentation.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1 +1 @@
0a45b898de7677eed8aa19c7e4f07345
fe23cecf7c7e8773f3f7822f2cd601cb
22 changes: 11 additions & 11 deletions dev/breeze/doc/images/output_release-management_publish-docs.svg
View file
Open in desktop
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
2 changes: 1 addition & 1 deletion dev/breeze/doc/images/output_release-management_publish-docs.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1 +1 @@
30b0621c66436e215e0d34ec9bfd407b
98c8722ad7c25e8fe4224c96b8724039
10 changes: 5 additions & 5 deletions dev/breeze/doc/images/output_sbom_generate-providers-requirements.svg
View file
Open in desktop
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
2 changes: 1 addition & 1 deletion dev/breeze/doc/images/output_sbom_generate-providers-requirements.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1 +1 @@
4e0a8dab83f1d257bce1cb90b778b009
aa7444b5a26f060a76a2a67486e4764e
Loading
Loading