-
Notifications
You must be signed in to change notification settings - Fork 4.2k
[Feature Request] LeRobot + Gemma + Unitree G1: Integrating Gemma 4 as a VLA model #3298
Copy link
Copy link
Open
Labels
bugSomething isn’t working correctlySomething isn’t working correctlydocumentationImprovements or fixes to the project’s docsImprovements or fixes to the project’s docsenhancementSuggestions for new features or improvementsSuggestions for new features or improvementspoliciesItems related to robot policiesItems related to robot policiestestsProblems with test coverage, failures, or improvements to testingProblems with test coverage, failures, or improvements to testingtrainingIssues related at training timeIssues related at training time
Metadata
Metadata
Assignees
Labels
bugSomething isn’t working correctlySomething isn’t working correctlydocumentationImprovements or fixes to the project’s docsImprovements or fixes to the project’s docsenhancementSuggestions for new features or improvementsSuggestions for new features or improvementspoliciesItems related to robot policiesItems related to robot policiestestsProblems with test coverage, failures, or improvements to testingProblems with test coverage, failures, or improvements to testingtrainingIssues related at training timeIssues related at training time
Type
Fields
Give feedbackNo fields configured for issues without a type.
Ticket Type
Feature Request / Improvement
Environment & System Info
Description
Hi LeRobot team,
I'm currently building a humanoid VLA system with the above setup, and I'd love to see Gemma 4 integrated into LeRobot to make this happen.
My Goal:
The first milestone is a physical "Hello World" — teaching the G1 to do a handshake via imitation learning. I plan to collect teleoperation data and train Gemma as the core VLA model to control the G1.
The Request:
Since I'm more on the hardware/engineering side, wiring up Gemma with LeRobot for the G1 from scratch is a tough for me right now. Could you consider adding native support, a recipe, or a tutorial for using Gemma as a VLA model to control the Unitree G1? I genuinely think this Gemma + G1 combo running on LeRobot could be a killer use case for the open-source robotics community.
Regards.
Context & Reproduction
No response
Relevant logs or stack trace
Checklist
mainbranch.Additional Info / Workarounds
No response