flowetl

library1.34.0pypypiunverified

FlowETL is a collection of Apache Airflow operators and sensors designed for use with FlowKit, a platform for analysing CDR data. The library provides ETL operators specific to FlowDB and FlowMachine. Current version: 1.34.0. Release cadence: irregular, tied to FlowKit releases.

workflow data devops

pip install flowetl

github ↗package ↗homepage ↗

INSTALL

IMPORT

SIG · FLOWETL

flowetl

workflowpythonv1.34.0

harness data pending

Install & Compatibility

Where this runs

No compatibility data collected yet for this library.

Code

Verified usage

Verified import paths — ran on the pinned version, not inferred.

CSVToFlowDBOperator

✓ from flowetl import CSVToFlowDBOperator

✗ from flowetl.operators import CSVToFlowDBOperator

A minimal DAG using FlowETL's CSVToFlowDBOperator to load a CSV into FlowDB, then a FlowETLSensor to wait for the data to be available.

from flowetl.operators import CSVToFlowDBOperator from flowetl.sensors import FlowETLSensor # Example DAG (requires Airflow environment) with DAG('flowetl_example', start_date=datetime(2023,1,1), schedule_interval=None) as dag: ingest = CSVToFlowDBOperator( task_id='ingest_csv', conn_id='flowdb_default', csv_path='/data/sample.csv', table_name='events.cdr' ) wait = FlowETLSensor( task_id='wait_for_data', table_name='events.cdr', poke_interval=60 ) ingest >> wait

Debug

Known issues

breakingFlowETL 1.33.0+ requires Airflow 2.10.5. 'airflow.providers.postgres.operators.postgres.PostgresOperator' is deprecated; use 'airflow.providers.postgres.operators.postgres.PostgresOperator' replaced by 'airflow.providers.common.sql.operators.sql.SQLExecuteQueryOperator'.

fix

Update Airflow to 2.10.5 and replace deprecated operators with their new equivalents.

affects: >=1.33.0

gotchaFlowETL operators expect a specific connection id (e.g., 'flowdb_default') configured in Airflow. If not set, tasks fail with 'Connection not found'.

fix

Define the Airflow connection (e.g., via UI or environment variable) matching the conn_id used in the operator.

affects: all

deprecatedFlowETL 1.30.0+ requires Python >=3.11. Older versions of Python are no longer supported.

fix

Upgrade Python environment to 3.11 or later.

affects: >=1.30.0

Upgrade

Version history

1.34.0latest on PyPI · released Oct 15, 2025

Audit

Dependencies

apache-airflowrequiredFlowETL is an Airflow plugin providing operators and sensors; requires Airflow >=2.x.

flowdboptionalMany operators interact with FlowDB (a PostgreSQL-based CDR database).

Agent activity

25 hits · last 30 days

node

Amazon

OpenAI (training)

Resources

githubhttp://github.com/Flowminder/FlowKit ↗

packagehttps://pypi.org/project/flowetl/ ↗

homepagehttps://flowkit.xyz ↗