Skip to content

Add Pi0.5 with RTC pipeline in Robotic AI Suites#2201

Open
baihe-liu wants to merge 5 commits intoopen-edge-platform:mainfrom
baihe-liu:baihe/add-pi05-pipeline
Open

Add Pi0.5 with RTC pipeline in Robotic AI Suites#2201
baihe-liu wants to merge 5 commits intoopen-edge-platform:mainfrom
baihe-liu:baihe/add-pi05-pipeline

Conversation

@baihe-liu
Copy link

Description

This pull request adds a new sample pipeline for the Pi0.5 Vision-Language-Action (VLA) model with Real-Time Chunking (RTC) optimized for the OpenVINO toolkit, targeting robotics applications. The integration includes documentation, usage instructions, benchmarking, and evaluation scripts, as well as the addition of the lerobot submodule for model support.

Key changes:

New Pipeline Integration and Documentation

  • Introduced a new sample pipeline, "Pi0.5 with Real-Time Chunking (OpenVINO Toolkit)", to the Robotics AI Suite. This includes a detailed overview of the Pi0.5 model architecture, the RTC inference strategy, and the synergy between the two for high-frequency, low-latency robotic control. The documentation covers setup, model conversion, benchmarking, and both simulation and real-robot deployment instructions.
  • Added the pipeline to the main list of available pipelines in README.md, providing a brief description and links for further details.
  • Included the new pipeline in the sample pipelines index for the documentation.

Any Newly Introduced Dependencies

Submodule Addition

  • Added the lerobot submodule at robotics-ai-suite/pipelines/pi05-rtc-ov/lerobot, referencing the Hugging Face repository, to provide the necessary model codebase and facilitate OpenVINO integration and RTC support. The license of lerobot is apache-2.0.

How Has This Been Tested?

The modification has passed coverity scan, bandit scan and functional validation.

Checklist:

  • I agree to use the APACHE-2.0 license for my code changes.
  • I have not introduced any 3rd party components incompatible with APACHE-2.0.
  • I have not included any company confidential information, trade secret, password or security token.
  • I have performed a self-review of my code.

@baihe-liu baihe-liu force-pushed the baihe/add-pi05-pipeline branch 2 times, most recently from e65a100 to 7c0026b Compare March 18, 2026 06:16
@baihe-liu baihe-liu marked this pull request as ready for review March 18, 2026 06:23
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants