Registry / llm-agents / strands-agents-evals

strands-agents-evals

JSON →
library0.1.16pypypiunverified

Evaluation framework for Strands agents. Current version 0.1.16, pre-1.0 rapid development; new releases weekly.

llm-agentsai-mltesting
pip install strands-agents-evals
package ↗
INSTALL
IMPORT
SIG · STRANDS-AGENTS-EVA
S
strands-agents-evals
llm-agentspythonv0.1.16
harness data pending
Install & Compatibility
Where this runs

No compatibility data collected yet for this library.

Code
Verified usage

Verified import paths — ran on the pinned version, not inferred.

Evaluation
✓ from strands_evals import Evaluation
✗ from strands_agents_evals import Evaluation

Runs an evaluation using the default configuration.

from strands_agents_evals import Evaluation result = Evaluation.run( agent_name="my_agent", dataset=["test input"], metrics=["accuracy"] ) print(result)
Debug
Known issues
breakingIn v0.1.10, the Evaluation.run() signature changed: `dataset` is now required (previously optional).
fix
Always provide a `dataset` argument.
affects: >=0.1.10
deprecatedThe `score` parameter in metrics is deprecated since v0.1.12; use `scoring_fn` instead.
fix
Replace `score=...` with `scoring_fn=...` in metric definitions.
affects: >=0.1.12
gotchaPackage name uses hyphens ('strands-agents-evals'), but Python imports use underscores ('strands_agents_evals'). Many users mistakenly import the hyphenated name.
fix
Use `from strands_agents_evals import ...` (underscores).
affects: all
Upgrade
Version history
0.1.16latest on PyPI · released Apr 30, 2026
Audit
Dependencies

No dependency data recorded yet.

Agent activity
27 hits · last 30 days
node
24
OpenAI (training)
1
Resources
packagehttps://pypi.org/project/strands-agents-evals/ ↗
strands-agents-evals — pip install strands-agents-evals · libregistry