ir-measures

library0.4.3pypypi✓ verified 80d ago

A Python package providing a common interface to many Information Retrieval (IR) evaluation measures. Current version 0.4.3, release cadence irregular.

pip install ir-measures

github ↗homepage ↗

INSTALL

IMPORT

SIG · IR-MEASURES

ir-measures

searchpythonv0.4.3

harness data pending

Install & Compatibility

Where this runs

No compatibility data collected yet for this library.

Code

Verified usage

Verified import paths — ran on the pinned version, not inferred.

✓ from ir_measures import AP

✗ from ir_measures import compute_measures

nDCG

✓ from ir_measures import nDCG

✗ from ir_measures import compute_measures

✓ from ir_measures import RR

✗ from ir_measures import compute_measures

Compute nDCG@10 from qrels and a run.

from ir_measures import compute_measures, nDCG from ir_measures import Qrel qrels = [Qrel('q1', 'doc1', 1), Qrel('q1', 'doc2', 0)] run = [('q1', 'doc1', 0.9), ('q1', 'doc2', 0.1)] results = compute_measures(qrels, run, {'nDCG@10': nDCG@10}) print(results)

Debug

Known issues

gotchaThe measure string format 'nDCG@10' requires that the @k suffix is present for measures like nDCG; otherwise defaults vary or may raise error.

fix

Always specify k, e.g., 'nDCG@10' or use the class with cutoff parameter: nDCG(cutoff=10).

affects: >=0.3.0

gotchaQrel tuple order is (query_id, doc_id, relevance). Relevance must be integer; 0 for not relevant, positive for relevant.

fix

Ensure qrels are list of Qrel objects with correct fields.

affects: all

Upgrade

Version history

0.4.3latest on PyPI · released Nov 25, 2025

Audit

Dependencies

No dependency data recorded yet.

Agent activity

41 hits · last 30 days

node

OpenAI (training)

Resources

githubhttps://github.com/terrierteam/ir_measures ↗

homepagehttps://github.com/terrierteam/ir_measures ↗