Apache Airflow Core (part of the main `apache-airflow` distribution) provides the foundational components for the Apache Airflow platform, a powerful tool for programmatically authoring, scheduling, and monitoring data workflows. It includes the scheduler, API server, DAG file processor, and triggerer. Workflows, known as Directed Acyclic Graphs (DAGs), are defined as Python code, making them maintainable, versionable, and collaborative. Airflow follows semantic versioning, with minor releases typically every 2-3 months and patch releases as needed. Major versions, such as 3.x, introduce backwards-incompatible changes and are released on an irregular schedule. The current version of `apache-airflow` is 3.2.0.
pip install "apache-airflow[standard]==3.2.0" --constraint "https://raw.githubusercontent.com/apache/airflow/constraints-3.2.0/constraints-3.10.txt"Verified import paths — ran on the pinned version, not inferred.
This quickstart defines a simple 'Hello World' DAG. To run it locally, first install Apache Airflow (see 'install' section). Then, initialize the database and start Airflow components using `airflow standalone`. Place this Python file in your configured `AIRFLOW_HOME/dags` directory, then access the Airflow UI at `localhost:8080`, log in (admin/admin by default for `standalone`), and unpause the `hello_world_dag`.
Refactor DAGs and custom operators to use the Airflow REST API or the Task Execution API for runtime interactions (state transitions, heartbeats, XComs, resource fetching). Utilize the Airflow Python Client where appropriate.
Migrate existing SubDAGs to use `TaskGroups` for grouping tasks, or explore Assets and Data Aware Scheduling for alternative architectural patterns.
Update any integrations or custom tools that interact with the Airflow REST API to use the `/api/v2` endpoints. Refer to the Airflow API v2 documentation.
Explicitly set `catchup=True` in your DAG definition if you intend for it to run for past missed schedules. Review existing DAGs to ensure the desired catchup behavior is maintained.
Plan and execute an upgrade to Airflow 3.x. Utilize tools like Ruff with AIR rules (version 0.13.1 or later) to check DAG compatibility and automate parts of the migration.
Always use the official constraint files for reproducible Airflow installations. Example: `pip install "apache-airflow[EXTRAS]==AIRFLOW_VERSION" --constraint "https://raw.githubusercontent.com/apache/airflow/constraints-AIRFLOW_VERSION/constraints-PYTHON_VERSION.txt"`.
No dependency data recorded yet.