airflow-metaplane

library0.0.6pypypiunverified

Metaplane Airflow Provider integrates Metaplane monitoring into Apache Airflow, enabling automatic data observability checks (field health, volume, freshness) as part of DAG runs. Current version 0.0.6 (alpha), with an unstable API and sparse documentation. Release cadence is irregular.

workflow data aws gcp azure

pip install airflow-metaplane

package ↗homepage ↗

Install & Compatibility

Where this runs

No compatibility data collected yet for this library.

Code

Verified usage

Verified import paths — ran on the pinned version, not inferred.

MetaplaneOperator

✓ from airflow_metaplane import MetaplaneOperator

✗ from airflow_metaplane.operators.metaplane import MetaplaneOperator

Minimal DAG that runs Metaplane checks using the operator. Replace connection_id and checks as needed. Set METAPLANE_API_KEY and METAPLANE_API_SECRET environment variables.

import os from datetime import datetime, timedelta from airflow import DAG from airflow_metaplane.operators.metaplane import MetaplaneOperator default_args = { 'owner': 'airflow', 'depends_on_past': False, 'email_on_failure': False, 'email_on_retry': False, 'retries': 1, 'retry_delay': timedelta(minutes=5), } with DAG( 'metaplane_dag', default_args=default_args, description='A simple Metaplane DAG', schedule_interval=timedelta(days=1), start_date=datetime(2021, 1, 1), catchup=False, tags=['example'], ) as dag: check = MetaplaneOperator( task_id='metaplane_check', metaplane_api_key=os.environ.get('METAPLANE_API_KEY', ''), metaplane_api_secret=os.environ.get('METAPLANE_API_SECRET', ''), connection_id=123, checks='["field_health", "row_count"]', )

Debug

Known issues

breakingOperator parameters may change without notice. The operator currently accepts `metaplane_api_key`, `metaplane_api_secret`, `connection_id`, `checks`, `timeout`, and `retry`. No stable release yet.

fix

Pin to exact version and test after upgrades.

affects: <1.0.0

deprecatedThe `checks` parameter expects a JSON string (list) but some users pass a Python list. This is not backward compatible.

fix

Always pass a JSON string, e.g., `checks='["field_health", "row_count"]'`.

affects: 0.0.x

gotchaPackage name is `airflow-metaplane` but imports use `airflow_metaplane` (underscore). Confusion with underscore/hyphen is common.

fix

Install `pip install airflow-metaplane`, import `from airflow_metaplane`.

affects: all

Upgrade

Version history

0.0.6latest on PyPI

Audit

Dependencies

No dependency data recorded yet.

Agent activity

82 hits · last 30 days

node

ahrefsbot

petalbot

amazonbot

Resources

packagehttps://pypi.org/project/airflow-metaplane/ ↗

homepagehttps://www.metaplane.dev ↗