Get started

Install

Install the ageval CLI from PyPI with uv.

Install

uv tool install ageval-cli
ageval -V
  • CPython 3.12+ (uv prepares the interpreter itself)
  • A real coding-agent path needs a host ACP entry and credentials. ageval lock does not.
  • Upgrade: uv tool upgrade ageval-cli

Once installed, datasets come from the Hub by registry ref (<dataset_id>@<version>), or point at any local dataset root. The CLI defaults to the public Hub at https://ageval.zjureal.com — you do not need AGEVAL_REGISTRY_URL first. Override it (or --registry-url) for self-host / compose.

Optional extras

Optional backends ship as extras. Install on demand; rerunning the same command upgrades in place (uv caches, so this is cheap):

uv tool install 'ageval-cli[all]'   # every CLI extra
ExtraFor
e2be2b cloud sandbox environment
daytonaDaytona sandbox environment
nooa / dsh / minisweThe matching external agent-runtime plugins

terminus-2 has no CLI extra. Install it with ageval plugin install plugins/terminus-2. OpenHands installs with ageval plugin install plugins/openhands. Its SDK runs inside the attempt environment.

[all] is those CLI extras, not a self-hosted Hub. To run the Registry service from a checkout: uv sync --extra registry.

Missing extras or credentials fail lock/run. The error names the install command.

Develop from source (contributors)

Clone only when changing ageval itself or running the in-repo examples:

git clone https://github.com/ZJU-REAL/ageval.git
cd ageval
uv sync --frozen --all-packages
uv run ageval -V

Skills

Install the repo skills into your local coding agent:

npx skills add ZJU-REAL/ageval                      # all skills
npx skills add ZJU-REAL/ageval --skill ageval-cli   # one skill
SkillUse
ageval-platformBoundaries and doc routing
ageval-cliCLI
ageval-pluginageval.plugin/1
ageval-config-packagedataset / task
ageval-sdk-harnessrun.py / SDK

On this page