Registry / workflow / apache-airflow-providers-weaviate

apache-airflow-providers-weaviate

JSON →
library3.3.4pypypi✓ verified 83d ago

This is the Apache Airflow provider package for integrating with Weaviate vector database. It enables Airflow DAGs to interact with Weaviate for vector search, import/export of objects, and schema management. Current version 3.3.3, compatible with Airflow >=2.10.0 and Python >=3.10. Released roughly quarterly.

pip install apache-airflow-providers-weaviate
INSTALL
IMPORT
SIG · APACHE-AIRFLOW-PRO
A
apache-airflow-providers-weaviate
workflowpythonv3.3.4
Install
30.7s avg
Import
7609ms
Disk
407MB
Pass rate
10/ 10
Env Coverage10 / 10
glibc
3.93.13
musl
3.93.13
Install & Compatibility
Where this runs
tested against v3.3.4 · pip install
no network on importno background threads
Install × environment matrix
Each cell = how many times install + import succeeded across repeated harness runs. Partial = flaky.
glibc = Debian/Ubuntu slim · musl = Alpine Linux
musl
py 3.103.910 runs
installs and imports cleanly · install 0.0s · import 8.214s · 405.5MB
glibc
py 3.103.910 runs
installs and imports cleanly · install 30.7s · import 7.003s · 395MB
407MB installed
● package 407MB
Code
Verified usage

Verified import paths — ran on the pinned version, not inferred.

WeaviateHook
from airflow.providers.weaviate.hooks.weaviate import WeaviateHook
from airflow.hooks.weaviate import WeaviateHook
Old provider structure; imports changed to providers namespace.
WeaviateIngestOperator
from airflow.providers.weaviate.operators.weaviate import WeaviateIngestOperator
WeaviateDocumentParser
from airflow.providers.weaviate.hooks.hooks import WeaviateDocumentParser

Minimal DAG to test Weaviate connection using the provider hook.

from datetime import datetime from airflow import DAG from airflow.operators.python import PythonOperator from airflow.providers.weaviate.hooks.weaviate import WeaviateHook def test_connection(): hook = WeaviateHook(weaviate_conn_id='weaviate_default') client = hook.get_client() print(client.is_ready()) with DAG( dag_id='weaviate_test', start_date=datetime(2023,1,1), schedule=None, catchup=False, ) as dag: task = PythonOperator( task_id='test_conn', python_callable=test_connection )
airflow --version
Debug
Known issues
breakingIn version 3.0.0, the hook import path changed from `airflow.providers.weaviate.hooks.weaviate_hook` to `airflow.providers.weaviate.hooks.weaviate`. Old imports will break.
fix
Update import to `from airflow.providers.weaviate.hooks.weaviate import WeaviateHook`.
affects: >=3.0.0
deprecatedThe `WeaviateHook` method `get_conn` is deprecated; use `get_client` instead.
fix
Replace `hook.get_conn()` with `hook.get_client()`.
affects: >=2.5.0
gotchaThe Weaviate connection must use the 'weaviate' connection type in Airflow, not 'http' or 'generic'. Setting the wrong conn_type will cause silent fallback or errors.
fix
Create a connection with conn_type='weaviate', host as the Weaviate URL, and optionally login/password for API key.
affects: all
gotchaWhen using `WeaviateIngestOperator`, the `class_name` must already exist in the Weaviate schema. The operator does NOT automatically create the class; it only ingests objects.
fix
First run a schema creation operation (e.g., using `WeaviateCreateSchemaOperator` or direct client call) before ingestion.
affects: all
Errors
Common errors & fixes
ModuleNotFoundError: No module named 'airflow.hooks.weaviate'
Trying to import hook from old deprecated path.
fix
Use `from airflow.providers.weaviate.hooks.weaviate import WeaviateHook`.
AttributeError: 'WeaviateHook' object has no attribute 'get_conn'
Using deprecated method after provider update.
fix
Replace `hook.get_conn()` with `hook.get_client()`.
weaviate.exceptions.WeaviateClosedError: the client is closed
Reusing a closed client or not properly managing hook lifecycle.
fix
Ensure each task uses the hook to obtain a fresh client; do not share clients across tasks without reopening.
Upgrade
Version history
3.3.4latest on PyPI · released May 23, 2026
Audit
Dependencies
apache-airflowrequiredCore dependency; requires >=2.10.0
weaviate-clientrequiredWeaviate Python client for API calls
apache-airflow-providers-common-sqloptionalUsed for SQL-like hooks and operators
Agent activity
80 hits · last 30 days
node
70
Perplexity
1
OpenAI (training)
1
Resources
apache-airflow-providers-weaviate — pip install apache-airflow-providers-weaviate · libregistry