Install & Compatibility
Where this runs
tested against v0.3.30 · pip install
no network on importno background threads
Install × environment matrix
Each cell = how many times install + import succeeded across repeated harness runs. Partial = flaky.
glibc = Debian/Ubuntu slim · musl = Alpine Linux
py 3.9
✕ build_error
✕ build_error
271MB installed
● package 271MB
Code
Verified usage
Verified import paths — ran on the pinned version, not inferred.
AccountInfo
✓ from eval_protocol import AccountInfo
✗ from eval_protocol import Episode
EvaluateResult
✓ from eval_protocol import EvaluateResult
EvaluationRow
✓ from eval_protocol import EvaluationRow
Creates an eval, logs an episode, runs the eval, and prints the result.
from eval_protocol import EvalClient, Episode, Result
import os
api_key = os.environ.get('EVAL_PROTOCOL_API_KEY', '')
client = EvalClient(api_key=api_key)
eval_id = client.create_eval(name='My Quick Eval')
episode = Episode(input='What is 2+2?', expected='4')
client.log_episode(eval_id=eval_id, episode=episode)
result = client.run_eval(eval_id=eval_id)
print(result)
eval-protocol --version
Upgrade
Version history
0.3.30latest on PyPI · released May 30, 2026
Audit
Dependencies
pydanticrequiredUsed for data models (Episode, Result, etc.)
httpxrequiredHTTP client for API calls