Registry / workflow / airflow-provider-fivetran-async

airflow-provider-fivetran-async

JSON →
library2.4.0pypypi✓ verified 85d ago

The `airflow-provider-fivetran-async` library provides asynchronous operators, sensors, and hooks for integrating Fivetran with Apache Airflow. It leverages Airflow's deferrable tasks to efficiently orchestrate Fivetran data synchronization jobs, freeing up worker slots during I/O-bound waiting periods. This provider is actively maintained by Astronomer and Fivetran, with the current stable version being 2.3.0 and regular releases, including alpha versions for upcoming features and breaking changes.

pip install airflow-provider-fivetran-async
INSTALL
IMPORT
SIG · AIRFLOW-PROVIDER-F
A
airflow-provider-fivetran-async
workflowpythonv2.4.0
Install
25.6s avg
Import
5903ms
Disk
265MB
Pass rate
9/ 10
Env Coverage9 / 10
glibc
3.93.13
musl
3.93.13
Install & Compatibility
Where this runs
tested against v2.4.0 · pip install
no network on importno background threads
Install × environment matrix
Each cell = how many times install + import succeeded across repeated harness runs. Partial = flaky.
glibc = Debian/Ubuntu slim · musl = Alpine Linux
musl
glibc
py 3.10
✓ —
✓ 28.15s
py 3.11
✓ —
✓ 25.98s
py 3.12
✓ —
✓ 19.85s
py 3.13
✓ —
✓ 20.28s
py 3.9
✕ build_error
✓ 33.6s
265MB installed
● package 265MB
Code
Verified usage

Verified import paths — ran on the pinned version, not inferred.

FivetranOperatorAsync
from fivetran_provider_async.operators import FivetranOperator
Although the class is named `FivetranOperator` in the source, documentation and common usage refer to it as `FivetranOperatorAsync` to distinguish it from the synchronous operator in the legacy provider and emphasize its deferrable nature. It defaults to deferrable mode (async).
FivetranSensorAsync
from fivetran_provider_async.sensors import FivetranSensor
Similar to the operator, the class is `FivetranSensor` in the source but is commonly referred to as `FivetranSensorAsync` in documentation for clarity regarding its deferrable functionality.
ResyncOperator
from fivetran_provider_async.operators.resync import ResyncOperator
Introduced in version 2.2.0, this operator specifically handles Fivetran resynchronization tasks.

This quickstart demonstrates how to create a simple Airflow DAG using the `FivetranOperator` (referred to as `FivetranOperatorAsync` in docs) to trigger and monitor a Fivetran sync. Before running, configure an Airflow connection named `fivetran_default` with your Fivetran API Key and Secret.

import os from datetime import datetime from airflow.decorators import dag from fivetran_provider_async.operators import FivetranOperator FIVETRAN_API_KEY = os.environ.get('FIVETRAN_API_KEY', 'your_fivetran_api_key') FIVETRAN_API_SECRET = os.environ.get('FIVETRAN_API_SECRET', 'your_fivetran_api_secret') FIVETRAN_CONNECTOR_ID = os.environ.get('FIVETRAN_CONNECTOR_ID', 'your_connector_id') @dag( dag_id='fivetran_async_sync_example', start_date=datetime(2023, 1, 1), schedule=None, catchup=False, tags=['fivetran', 'async', 'etl'] ) def fivetran_async_dag(): # Configure Fivetran connection in Airflow UI (Admin -> Connections) # Conn Id: fivetran_default # Conn Type: Fivetran # Login (API Key): FIVETRAN_API_KEY # Password (API Secret): FIVETRAN_API_SECRET start_fivetran_sync = FivetranOperator( task_id='start_fivetran_sync', fivetran_conn_id='fivetran_default', connector_id=FIVETRAN_CONNECTOR_ID, deferrable=True, # This is the default behavior wait_for_completion=True # This is the default behavior ) fivetran_async_dag()
Debug
Known issues
breakingVersion 2.3.0 dropped support for Python 3.9. Users on Python 3.9 must upgrade their Python environment or use an older provider version.
fix
Upgrade Python to 3.10 or higher.
affects: >=2.3.0
breakingUpcoming version 2.4.0a1 drops support for Apache Airflow versions older than 2.9. Users running older Airflow versions will need to upgrade.
fix
Upgrade Apache Airflow to version 2.9 or higher.
affects: >=2.4.0a1
breakingVersion 2.2.0 dropped support for Apache Airflow 2.2 and 2.3.
fix
Upgrade Apache Airflow to version 2.4 or higher (and ideally to >=2.9 for future compatibility).
affects: >=2.2.0
gotchaThe `FivetranOperator` (async provider) may fail if a Fivetran connector goes into a 'RESCHEDULED' state, rather than handling it gracefully. This is a known bug (GitHub Issue #107).
fix
Monitor GitHub issues for resolution or implement custom retry logic for 'RESCHEDULED' states.
affects: All versions
deprecatedThis `airflow-provider-fivetran-async` provider is the recommended successor to the older, synchronous `airflow-provider-fivetran`. The legacy provider is deprecated in favor of this asynchronous version.
fix
Migrate from `airflow-provider-fivetran` to `airflow-provider-fivetran-async`, replacing `FivetranOperator` and `FivetranSensor` with their async counterparts (or the combined `FivetranOperator` from this async provider).
affects: All versions of `airflow-provider-fivetran-async` vs. `airflow-provider-fivetran`
gotchaThe `FivetranOperator` in this async provider is designed to both trigger a Fivetran sync and asynchronously monitor its completion. In most cases, a separate `FivetranSensor` is no longer needed downstream, which was common practice with the legacy synchronous provider. Using both unnecessarily consumes resources.
fix
Prefer using `FivetranOperator` (deferrable) with `wait_for_completion=True` (default) to handle both triggering and monitoring within a single task. Only use `FivetranSensor` if you need to monitor a Fivetran sync initiated outside of Airflow, or if the `FivetranOperator` has `wait_for_completion=False`.
affects: All versions
Errors
Common errors & fixes
ModuleNotFoundError: No module named 'airflow_provider_fivetran_async'
The 'airflow-provider-fivetran-async' package is not installed in the Python environment.
fix
Install the package using pip: 'pip install airflow-provider-fivetran-async'.
ImportError: cannot import name 'FivetranOperator' from 'fivetran_provider_async.operators'
The import statement is incorrect due to a typo in the module path.
fix
Use the correct import statement: 'from airflow_provider_fivetran_async.operators import FivetranOperator'.
AttributeError: module 'airflow_provider_fivetran_async.operators' has no attribute 'FivetranOperator'
The 'FivetranOperator' class is not present in the specified module, possibly due to a version mismatch or incorrect installation.
fix
Ensure that the 'airflow-provider-fivetran-async' package is installed and up to date: 'pip install --upgrade airflow-provider-fivetran-async'.
ValueError: Invalid 'conn_id' provided for Fivetran connection
The 'conn_id' specified does not match any configured Fivetran connections in Airflow.
fix
Verify that the 'conn_id' matches the one configured in the Airflow UI under Connections, and that it is set up correctly with the Fivetran API Key and Secret.
TypeError: 'NoneType' object is not subscriptable
A variable expected to be a dictionary or list is 'None', possibly due to a missing or incorrect configuration.
fix
Check the configuration settings and ensure all required parameters are provided and correctly set.
Upgrade
Version history
2.4.0latest on PyPI · released Apr 17, 2026
Audit
Dependencies
apache-airflowrequiredCore dependency for any Airflow provider.
openlineage-airflowoptionalOptional for OpenLineage integration for data lineage metadata.
Agent activity
52 hits · last 30 days
node
44
OpenAI (training)
1
Resources
airflow-provider-fivetran-async — pip install airflow-provider-fivetran-async · libregistry