ControlNet Auxiliary Models (controlnet-aux) provides a PyPI installable package of lllyasviel's ControlNet Annotators. It offers various preprocessors (e.g., Canny, OpenPose, Midas) for generating hint images like edges, depth maps, and poses, which are used to guide image generation with ControlNet models. The library is currently at version 0.0.10, released on May 8, 2025, with an irregular release cadence primarily driven by upstream ControlNet updates.
pip install -U controlnet-auxVerified import paths — ran on the pinned version, not inferred.
This quickstart demonstrates how to use the unified `Processor` class to load and apply a ControlNet annotator (e.g., OpenPose) to an input image. The `Processor` dynamically loads the necessary models based on the `processor_id` you specify.
Install `easy-dwpose` (which uses ONNX models) and ensure your environment is configured for ONNXRuntime or PyTorch with GPU (e.g., CUDA) for faster inference. Refer to documentation for specific setup instructions.
Resize your input images or adjust `detect_resolution` and `image_resolution` parameters to be multiples of 64. PIL's `resize` method can be used for this.
If using ComfyUI, ensure that `comfyui_controlnet_preprocessors` is completely removed before installing `controlnet-aux` based custom nodes. Always follow the installation instructions specific to your ComfyUI custom node setup.