Skip to content

URML robotics-integration cold knock (pending OpenAI's public robotics surface) #2737

@idoco2003

Description

@idoco2003

Hi,

Filing this as an honest cold knock. URML is an open spec I work on for substrate-neutral robot intent (Apache 2.0, urml.dev). The Move #2 outreach program has filed proposals against every major US AI lab with substantive robotics work: Anthropic (MCP plus Agent Skills), Google DeepMind (via the OXE consortium), Meta FAIR (V-JEPA 2), NVIDIA (Isaac Lab, GR00T, Cosmos-Reason1, Cosmos-Predict), Allen Institute (MolmoAct), TRI (LBM, Drake), Physical Intelligence (openpi), Hugging Face (LeRobot), Stanford (ALOHA). OpenAI's robotics team restarted in February 2025 but the work is intentionally non-public to date. This proposal is here for symmetry and to put URML on the radar when the robotics work goes public.

URML's primitive vocabulary (move_to, grasp, release, measure, wait_for, report, plus profile-specific extensions for industrial, drone, mobile, humanoid) sits above ROS 2, PX4, Isaac, MuJoCo, AUTOSAR Adaptive, OPC UA Robotics. The integration patterns documented for other targets:

  • Wrapper around a policy's action method (LeRobot, openpi, MolmoAct, TRI LBM)
  • Constrained decoding over a reasoning model (Cosmos-Reason1)
  • Predictive-safety lane against a world model (V-JEPA 2, Cosmos-Predict)

When OpenAI publishes a robotics SDK, model, or API, URML's integration follows whichever shape fits. URML's reference/llm-bridge/ already supports OpenAI's general LLM API; the robotics-specific extension is the piece this is forward-declaring.

Full write-up:
https://github.com/URML-MARS/URML/blob/main/docs/rfcs/0058-openai-robotics.md

Asks (low expectation of immediate answer):

  1. Current or planned public surface where URML's proposal could be reviewed by the robotics team directly?
  2. Expected shape of the first public robotics artifact: SDK, model release, hosted API, something else?
  3. Openness to URML being a documented integration target when the team is ready to publish?
  4. Right outreach channel for this kind of cold-knock proposal?

No expectation of substantive reply on this thread. Filing for the record.

Ido
greenvh@gmail.com

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions