Registry / data / apache-airflow-providers-common-messaging

apache-airflow-providers-common-messaging

library2.0.4pypypiunverified

This package provides common messaging utilities for Apache Airflow, including components for building event-driven workflows and integrating with messaging systems like Kafka. Version 2.0.3 supports Python >=3.10. Release cadence is periodic, aligned with Airflow provider releases.

data workflow aws gcp azure

pip install apache-airflow-providers-common-messaging

github ↗package ↗homepage ↗docs ↗changelog ↗

INSTALL

IMPORT

SIG · APACHE-AIRFLOW-PRO

apache-airflow-providers-common-messaging

datapythonv2.0.4

Install

23.0s avg

Import

—

Disk

250MB

Pass rate

10/ 10

Env Coverage10 / 10

glibc

3.9–3.13

musl

3.9–3.13

Install & Compatibility

Where this runs

tested against v2.0.4 · pip install

no network on importno background threads

Install × environment matrix

Each cell = how many times install + import succeeded across repeated harness runs. Partial = flaky.
glibc = Debian/Ubuntu slim · musl = Alpine Linux

musl

py 3.10–3.95 runs

installs and imports cleanly · install 0.0s · import 0.000s · 250.7MB

glibc

py 3.10–3.95 runs

installs and imports cleanly · install 23.0s · import 0.000s · 248MB

250MB installed

● package 250MB

Code

Verified usage

Verified import paths — ran on the pinned version, not inferred.

EventDrivenScheduler

✓ from airflow.providers.common.messaging.scheduler import EventDrivenScheduler

✗ from airflow.providers.common.messaging.scheduler import EventDrivenScheduler

Creates an event-driven DAG that listens to a Kafka topic and processes events.

import os from airflow import DAG from airflow.operators.python import PythonOperator from airflow.providers.common.messaging.scheduler import EventDrivenScheduler from datetime import datetime # Define a simple event-driven DAG with DAG( dag_id='event_driven_dag', start_date=datetime(2024, 1, 1), schedule_interval=None, catchup=False, ) as dag: scheduler = EventDrivenScheduler( task_id='listen_for_event', trigger='kafka', broker=os.environ.get('KAFKA_BROKER', 'localhost:9092'), topic='example_topic', ) def process_event(event): print(f"Received event: {event}") process = PythonOperator( task_id='process_event', python_callable=process_event, op_args=[scheduler.output], ) scheduler >> process

Debug

Known issues

breakingPackage renamed from `apache-airflow-providers-messaging` (previously in Airflow 2.9.x) to `apache-airflow-providers-common-messaging` in Airflow 2.10.0.

fix

Update your install command to `pip install apache-airflow-providers-common-messaging` and adjust imports to use `airflow.providers.common.messaging` instead of `airflow.providers.messaging`.

affects: >=2.10.0

deprecatedThe `EventDrivenScheduler` class may be deprecated in future versions in favor of the new `DAGSchedule` with event-driven triggers.

fix

Monitor Airflow changelog. For now, use `EventDrivenScheduler` as documented.

affects: >=2.0.0

gotchaThe trigger type must match a registered trigger class; common mistakes: using 'kafka' instead of 'apache_kafka' for the trigger.

fix

Check the list of available triggers in the provider documentation. For Kafka, use trigger='kafka' or provide the full module path.

affects: all

Upgrade

Version history

2.0.4latest on PyPI · released Jun 7, 2026

Audit

Dependencies

apache-airflowrequiredRequires Airflow core version 2.10.0 or higher.

Agent activity

54 hits · last 30 days

node

Resources

githubhttps://github.com/apache/airflow ↗

packagehttps://pypi.org/project/apache-airflow-providers-common-messaging/ ↗

homepagehttps://airflow.apache.org ↗

docshttps://airflow.apache.org/docs/apache-airflow-providers-common-messaging/2.0.3 ↗

changeloghttps://airflow.apache.org/docs/apache-airflow-providers-common-messaging/2.0.3/changelog.html ↗