| smoke_config | eval.yaml |
|---|
Multi-modal evaluation for robotic manipulation (MuJoCo/robosuite). Paper | GitHub
Docker image: ghcr.io/allenai/vla-evaluation-harness/robomme:latest
| File | Description | Suites |
|---|---|---|
eval.yaml |
All 4 suites combined | 4 |
counting.yaml |
Counting suite only | 1 |
imitation.yaml |
Imitation suite only | 1 |
permanence.yaml |
Permanence suite only | 1 |
reference.yaml |
Reference suite only | 1 |