judgeval

library1.0.5pypypi✓ verified 80d ago

judgeval is the open-source post-building layer for Agent Behavior Monitoring. It provides tools for evaluating, tracing, and monitoring AI agent behavior. The current version is 1.0.5, requiring Python >=3.10. Release cadence is active with frequent patches.

llm-agents ai-ml observability

pip install judgeval

github ↗package ↗homepage ↗

INSTALL

IMPORT

SIG · JUDGEVAL

judgeval

llm-agentspythonv1.0.5

harness data pending

Install & Compatibility

Where this runs

No compatibility data collected yet for this library.

Code

Verified usage

Verified import paths — ran on the pinned version, not inferred.

Judgeval

✓ from judgeval import Judgeval

✗ from judgeval import JudgmentClient

Initialize the client and run a simple judgment with a scorer.

from judgeval import JudgmentClient client = JudgmentClient(api_key=os.environ.get('JUDGEVAL_API_KEY', '')) # Example: create a judgment result = client.judge( input="What is the capital of France?", output="Paris", scorers=["answer_relevancy"] ) print(result)

judgeval --version

Debug

Known issues

breakingIn v1.0.0, the client API was overhauled. The old 'judgeval.JudgmentClient' now requires an api_key argument. If you were using an older version without api_key, your code will break.

fix

Update to: client = JudgmentClient(api_key='your_key')

affects: <1.0.0

breakingThe 'judgment' decorator signature changed in v1.0.0. It no longer accepts positional arguments for scorers; use keyword arguments.

fix

@judgment(scorers=['hallucination']) instead of @judgment('hallucination')

affects: <1.0.0

gotchaThe package requires Python >=3.10. Using it with Python 3.9 or earlier will fail to install.

fix

Upgrade your Python environment to 3.10 or later.

affects: all

Upgrade

Version history

1.0.5latest on PyPI · released Apr 9, 2026

Audit

Dependencies

No dependency data recorded yet.

Agent activity

19 hits · last 30 days

node

OpenAI (training)

Amazon

Resources

githubhttps://github.com/JudgmentLabs/judgeval ↗

packagehttps://pypi.org/project/judgeval/ ↗

homepagehttps://judgeval.com ↗