Registry / devops / benchmark-runner

benchmark-runner

library1.0.1014pypypi✓ verified 84d ago

A CLI tool for running and managing performance benchmarks across multiple platforms including HammerDB, VDbench, and fio. Current version 1.0.986, requires Python >=3.10, released under Red Hat Performance. Active development with frequent releases.

devops testing

pip install benchmark-runner

github ↗package ↗

INSTALL

IMPORT

SIG · BENCHMARK-RUNNER

benchmark-runner

devopspythonv1.0.1014

Install

27.2s avg

Import

—

Disk

860MB

Pass rate

10/ 10

Env Coverage10 / 10

glibc

3.9–3.13

musl

3.9–3.13

Install & Compatibility

Where this runs

tested against v1.0.1014 · pip install

no network on importno background threads

Install × environment matrix

Each cell = how many times install + import succeeded across repeated harness runs. Partial = flaky.
glibc = Debian/Ubuntu slim · musl = Alpine Linux

musl

py 3.10–3.95 runs

installs and imports cleanly · install 0.1s · import 0.000s · 849.7MB

glibc

py 3.10–3.95 runs

installs and imports cleanly · install 54.4s · import 0.000s · 822MB

860MB installed

● package 860MB

Code

Verified usage

Verified import paths — ran on the pinned version, not inferred.

benchmark_runner

✓ import benchmark_runner

Basic usage of benchmark-runner library to execute a fio read benchmark.

import benchmark_runner # Run a benchmark (example with fio) benchmark_runner.run( benchmark_type='fio', workload='read', output_dir='/tmp/results', metadata={'user': 'test'} )

benchmark-runner --version

Debug

Known issues

gotchaThe library is primarily a CLI tool; Python import usage may not be fully documented. Use the command-line interface for reliable operation.

fix

Prefer running 'benchmark-runner <command>' from terminal instead of importing in Python.

affects: all

breakingVersion 1.0.894 changed default database versions for HammerDB (MSSQL 2019→2022, PostgreSQL 10→13, MariaDB 10.3→10.5) and VDbench base OS (CentOS Stream 8→9). Existing configurations relying on old defaults may break.

fix

Update benchmark configurations to specify exact versions if needed, or adjust to new defaults.

affects: >=1.0.894

deprecatedPython 3.10 is the minimum supported version. Older Python versions (3.9 and below) are no longer supported as of recent releases.

fix

Upgrade to Python 3.10 or higher.

affects: >=1.0.894

Errors

Common errors & fixes

ModuleNotFoundError: No module named 'benchmark_runner'

The library might not be installed or the Python environment is incorrect.

fix

Run 'pip install benchmark-runner' and ensure you are using the correct Python environment (Python >=3.10).

benchmark-runner: command not found

The pip install location is not in PATH, or the package was not installed globally.

fix

Use 'python -m benchmark_runner' or add the pip scripts directory to your PATH.

ValueError: Unsupported benchmark type 'xyz'

The benchmark type specified is not recognized. Supported types: hammerdb, vdbench, fio, etc.

fix

Check the benchmark type string (e.g., 'fio' instead of 'io') and consult the documentation for supported types.

Upgrade

Version history

1.0.1014latest on PyPI · released Jun 16, 2026

Audit

Dependencies

No dependency data recorded yet.

Agent activity

18 hits · last 30 days

node

OpenAI (training)

Resources

githubhttps://github.com/redhat-performance/benchmark-runner ↗

packagehttps://pypi.org/project/benchmark-runner/ ↗