-
Notifications
You must be signed in to change notification settings - Fork 4k
Open
Labels
enhancementSuggestions for new features or improvementsSuggestions for new features or improvementsevaluationFor issues or PRs related to environment evaluation, and benchmarks.For issues or PRs related to environment evaluation, and benchmarks.
Description
Ticket Type
💡 Feature Request / Improvement
Environment & System Info
Description
MolmoSpaces is a new, broad benchmark from Allen AI for robotics-relevant evaluation.
It would be great to expand our supported evaluations with this new benchmark.
Context & Reproduction
No response
Relevant logs or stack trace
Checklist
- I have searched existing tickets to ensure this isn't a duplicate.
- I am using the latest version of the
mainbranch. - I have verified this is not an environment-specific problem.
Additional Info / Workarounds
No response
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
enhancementSuggestions for new features or improvementsSuggestions for new features or improvementsevaluationFor issues or PRs related to environment evaluation, and benchmarks.For issues or PRs related to environment evaluation, and benchmarks.