Registry / llm-agents / agenteval-cli

agenteval-cli

JSON →
library0.8.14jsnpmunverified

Linter, benchmarker, and CI gate for AI coding instruction files (CLAUDE.md, AGENTS.md, .cursorrules, etc.). Current stable version is v0.8.14, released with weekly cadence. Automatically detects dead references, token bloat, contradictions, stale instructions, broken links, and invalid skill metadata. Ships as a lightweight npm wrapper (~3 KB) that downloads a prebuilt native binary on first run; no Node runtime needed at execution time. Differentiators: zero-config startup, GitHub Action support, multi-format support (Claude, Copilot, Cursor, OpenAI), and built-in CI gating with regression detection.

llm-agentsdevopstesting
npm install agenteval-cli
github ↗package ↗homepage ↗
INSTALL
IMPORT
SIG · AGENTEVAL-CLI
A
agenteval-cli
llm-agentsjavascriptv0.8.14
harness data pending
Install & Compatibility
Where this runs

No compatibility data collected yet for this library.

Code
Verified usage

Verified import paths — ran on the pinned version, not inferred.

agenteval CLI
✓ npx agenteval-cli lint
✗ npx agenteval lint
The package name is 'agenteval-cli', not 'agenteval'. Use npx agenteval-cli or npm install -g agenteval-cli.
agenteval CLI (installed globally)
✓ npm install -g agenteval-cli
✗ npm install -g agenteval
The package is published as 'agenteval-cli' on npm. Do not install 'agenteval' as it's a different package.
GitHub Action
✓ uses: lukasmetzler/agenteval@v0
✗ uses: agenteval/agenteval@v0
The GitHub Action is hosted under the 'lukasmetzler/agenteval' repository, not a separate 'agenteval' org.

Initializes, lints, and CI-gates AI instruction files using the CLI with common flags.

npx agenteval-cli init # create default agenteval.yaml # Lint instruction files npx agenteval-cli lint # Lint with explanations npx agenteval-cli lint --explain # Run CI gate with score threshold npx agenteval-cli ci --min-score 0.7 --max-regression 0.05 # Watch mode for continuous linting npx agenteval-cli watch # Auto-fix filler phrases npx agenteval-cli lint --fix
agenteval --version
Debug
Known issues
gotchaPackage name is 'agenteval-cli', not 'agenteval'. Running 'npx agenteval' will invoke a different package.
fix
Use 'npx agenteval-cli' or 'npm install -g agenteval-cli'.
affects: >=0
breakingPrebuilt binary download requires internet access on first run; offline or air-gapped environments fail.
fix
Download the binary manually from GitHub Releases and place it in your PATH, or use the Homebrew/curl install methods.
affects: >=0.8.0
deprecatedIn version 0.8.x, the 'agenteval harvest' command is experimental and may change without notice.
fix
Use 'agenteval harvest --dry-run' for preview, but expect potential breaking changes in future versions.
affects: >=0.8.0 <0.9.0
gotchaThe 'agenteval ci' command's --min-score and --max-regression flags are parsed as decimals; integer values cause parse errors.
fix
Always pass decimal values, e.g., '--min-score 0.7' not '--min-score 1'.
affects: >=0.8.0
gotchaThe 'agenteval watch' command may cause file descriptor leaks on macOS if interrupted abruptly (v0.8.13 fix partially addresses this).
fix
Update to v0.8.13 or later, or manually kill the process with SIGTERM instead of closing terminal.
affects: >=0.8.6 <0.8.13
Errors
Common errors & fixes
npx: command not found: agenteval
Typo: user typed 'agenteval' instead of 'agenteval-cli'.
fix
Use 'npx agenteval-cli' or install globally with 'npm install -g agenteval-cli'.
Error: Failed to download binary - could not reach GitHub CDN
Network restrictions or corporate proxy blocking the binary download.
fix
Set HTTP_PROXY/HTTPS_PROXY environment variables, or download binary manually from GitHub Releases and place it in PATH.
Error: Unsupported platform
Running on Windows or Linux ARM64 (aarch64), which are not supported.
fix
Use WSL on Windows, or use the experimental RISC-V build. Check GitHub Releases for platform availability.
agenteval: command not found
CLI not found after global install; PATH may not include npm global binaries.
fix
Ensure npm global bin directory is in PATH. Run 'npm bin -g' to locate it.
Upgrade
Version history
0.8.14latest on npm
Audit
Dependencies

No dependency data recorded yet.

Agent activity
56 hits · last 30 days
node
50
Perplexity
1
OpenAI (training)
1
Resources
githubhttps://github.com/lukasmetzler/agenteval ↗
packagehttps://www.npmjs.com/package/agenteval-cli ↗
homepagehttps://agenteval.cli ↗
agenteval-cli — npm install agenteval-cli · libregistry