| smoke_config | smoke_test.yaml |
|---|
Tabletop manipulation benchmark (MuJoCo/robosuite). 4 standard suites + extensions. Paper | GitHub
Docker image: ghcr.io/allenai/vla-evaluation-harness/libero:latest
| File | Description | Tasks | Episodes/task |
|---|---|---|---|
all.yaml |
All 4 suites (Spatial + Object + Goal + Long) | 40 | 50 |
spatial.yaml |
LIBERO-Spatial suite | 10 | 50 |
object.yaml |
LIBERO-Object suite | 10 | 50 |
goal.yaml |
LIBERO-Goal suite | 10 | 50 |
long.yaml |
LIBERO-Long (90-step horizon) | 10 | 50 |
10.yaml |
LIBERO-10 (10-task subset) | 10 | 50 |
smoke_test.yaml |
Quick validation (1 task, 2 episodes) | 1 | 2 |
See also: LIBERO-Pro, LIBERO-Plus, LIBERO-Mem.