Install
Install the ageval CLI from PyPI with uv.
Install
uv tool install ageval-cli
ageval -V- CPython 3.12+ (
uvprepares the interpreter itself) - A real coding-agent path needs a host ACP entry and credentials.
ageval lockdoes not. - Upgrade:
uv tool upgrade ageval-cli
Once installed, datasets come from the Hub by registry ref (<dataset_id>@<version>), or point at any local dataset root. The CLI defaults to the public Hub at https://ageval.zjureal.com — you do not need AGEVAL_REGISTRY_URL first. Override it (or --registry-url) for self-host / compose.
Optional extras
Optional backends ship as extras. Install on demand; rerunning the same command upgrades in place (uv caches, so this is cheap):
uv tool install 'ageval-cli[all]' # every CLI extra| Extra | For |
|---|---|
e2b | e2b cloud sandbox environment |
daytona | Daytona sandbox environment |
nooa / dsh / miniswe | The matching external agent-runtime plugins |
terminus-2 has no CLI extra. Install it with ageval plugin install plugins/terminus-2. OpenHands installs with ageval plugin install plugins/openhands. Its SDK runs inside the attempt environment.
[all] is those CLI extras, not a self-hosted Hub. To run the Registry service from a checkout: uv sync --extra registry.
Missing extras or credentials fail lock/run. The error names the install command.
Develop from source (contributors)
Clone only when changing ageval itself or running the in-repo examples:
git clone https://github.com/ZJU-REAL/ageval.git
cd ageval
uv sync --frozen --all-packages
uv run ageval -VSkills
Install the repo skills into your local coding agent:
npx skills add ZJU-REAL/ageval # all skills
npx skills add ZJU-REAL/ageval --skill ageval-cli # one skill| Skill | Use |
|---|---|
ageval-platform | Boundaries and doc routing |
ageval-cli | CLI |
ageval-plugin | ageval.plugin/1 |
ageval-config-package | dataset / task |
ageval-sdk-harness | run.py / SDK |