Registry / devops / hydra-joblib-launcher

hydra-joblib-launcher

library1.2.0pypypi✓ verified 83d ago

Provides a Joblib-based launcher for Hydra applications, enabling parallel execution of joblib tasks (e.g., using loky or threading backend). Current version 1.2.0 is compatible with Hydra 1.1 and 1.2. Low release cadence; last updated 2021.

devops workflow

pip install hydra-joblib-launcher

github ↗package ↗

INSTALL

IMPORT

SIG · HYDRA-JOBLIB-LAUNC

hydra-joblib-launcher

devopspythonv1.2.0

Install

2.3s avg

Import

572ms

Disk

26MB

Pass rate

10/ 10

Env Coverage10 / 10

glibc

3.9–3.13

musl

3.9–3.13

Install & Compatibility

Where this runs

tested against v1.2.0 · pip install

no network on importno background threads

Install × environment matrix

Each cell = how many times install + import succeeded across repeated harness runs. Partial = flaky.
glibc = Debian/Ubuntu slim · musl = Alpine Linux

musl

py 3.10–3.95 runs

installs and imports cleanly · install 0.0s · import 0.588s · 26.4MB

glibc

py 3.10–3.95 runs

installs and imports cleanly · install 2.3s · import 0.556s · 28MB

26MB installed

● package 26MB

Code

Verified usage

Verified import paths — ran on the pinned version, not inferred.

JoblibLauncher

✓ from hydra_plugins.hydra_joblib_launcher.joblib_launcher import JoblibLauncher

✗ from hydra_joblib_launcher import JoblibLauncher

Module lives under hydra_plugins namespace.

Example Hydra app using joblib launcher (launcher config set in YAML).

import hydra from omegaconf import DictConfig @hydra.main(config_name="config", config_path=".", version_base=None) def my_app(cfg: DictConfig): # joblib launcher is specified in config print(f"Working on {cfg.job_id}") if __name__ == "__main__": my_app()

Debug

Known issues

breakingHydra 1.3 changed the launcher API; hydra-joblib-launcher 1.2.0 is not compatible with Hydra 1.3.

fix

Stay on hydra-core<1.3 or use the built-in Hydra joblib launcher (experimental) from Hydra 1.3.

affects: hydra-core>=1.3

gotchaThe plugin must be installed and the config key 'hydra.joblib' must be set in your Hydra config to activate the launcher, else it defaults to the SequentialLauncher.

fix

Add `hydra.joblib: {backend: 'loky', n_jobs: 4}` to your config.

affects: all

gotchaJoblibLauncher does not support dynamic n_jobs changes; n_jobs must be set before the job starts.

fix

Configure n_jobs in the config YAML, not at runtime.

affects: all

Errors

Common errors & fixes

ModuleNotFoundError: No module named 'hydra_joblib_launcher'

Incorrect import path; using 'hydra_joblib_launcher' instead of 'hydra_plugins.hydra_joblib_launcher'.

fix

Use `from hydra_plugins.hydra_joblib_launcher.joblib_launcher import JoblibLauncher`.

KeyError: 'hydra.joblib'

Missing or misconfigured joblib launcher config in your Hydra configuration.

fix

Add `- joblib` to your defaults list or set `hydra.joblib.backend: loky` in your config.

AttributeError: 'NoneType' object has no attribute 'backend'

The launcher is not activated because the config key `hydra.joblib` is not defined.

fix

Ensure your config includes `hydra.joblib.backend` and `hydra.joblib.n_jobs`.

Upgrade

Version history

1.2.0latest on PyPI · released May 17, 2022

Audit

Dependencies

hydra-corerequiredCore Hydra framework required.

Agent activity

26 hits · last 30 days

node

OpenAI (training)

Resources

githubhttps://github.com/facebookresearch/hydra ↗

packagehttps://pypi.org/project/hydra-joblib-launcher/ ↗