Add Pi0.5 with RTC pipeline in Robotic AI Suites#2201
Open
baihe-liu wants to merge 5 commits intoopen-edge-platform:mainfrom
Open
Add Pi0.5 with RTC pipeline in Robotic AI Suites#2201baihe-liu wants to merge 5 commits intoopen-edge-platform:mainfrom
baihe-liu wants to merge 5 commits intoopen-edge-platform:mainfrom
Conversation
1. Update command arguments description 2. Update command example and notes.
e65a100 to
7c0026b
Compare
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Description
This pull request adds a new sample pipeline for the Pi0.5 Vision-Language-Action (VLA) model with Real-Time Chunking (RTC) optimized for the OpenVINO toolkit, targeting robotics applications. The integration includes documentation, usage instructions, benchmarking, and evaluation scripts, as well as the addition of the
lerobotsubmodule for model support.Key changes:
New Pipeline Integration and Documentation
README.md, providing a brief description and links for further details.Any Newly Introduced Dependencies
Submodule Addition
lerobotsubmodule atrobotics-ai-suite/pipelines/pi05-rtc-ov/lerobot, referencing the Hugging Face repository, to provide the necessary model codebase and facilitate OpenVINO integration and RTC support. The license oflerobotis apache-2.0.How Has This Been Tested?
The modification has passed coverity scan, bandit scan and functional validation.
Checklist: