Commit 3bbabca
Adds OpenArm environments (isaac-sim#4089)
# Description
<!--
Thank you for your interest in sending a pull request. Please make sure
to check the contribution guidelines.
Link:
https://isaac-sim.github.io/IsaacLab/main/source/refs/contributing.html
💡 Please try to keep PRs small and focused. Large PRs are harder to
review and merge.
-->
> **Notice: The OpenArm USD files are currently under review and have
not yet been officially registered.
Therefore, the current setup loads the USD assets from a separate
repository. Once the assets are formally registered in Isaac Sim, the
loading route will be updated accordingly. This implementation detail
was prepared in consultation with Kei Kase from NVIDIA Japan.**
* Added the OpenArm assets to
`IsaacLab/source/isaaclab_assets/isaaclab_assets/robots`.
These assets include configurations for the OpenArm unimanual and
bimanual models.
* Added the following four environments to
`IsaacLab/source/isaaclab_tasks/isaaclab_tasks/manager_based/manipulation`:
* OpenArm bimanual reach task
* OpenArm unimanual reach task
* OpenArm unimanual lift-a-cube task
* OpenArm unimanual open-a-drawer task
* Added the changelog entry for the OpenArm environments and updated
`extension.toml` under
`IsaacLab/source/isaaclab_tasks/docs`.
* Added the OpenArm environments to
`IsaacLab/docs/source/overview/environments.rst`.
The unit tests are as follows:
```bash
# Assuming the environment is set up for Isaac Lab v2.3.0.
# Clone the repository to load the USD assets.
git clone https://github.com/enactic/openarm_isaac_lab
# Add the path and navigate to the Isaac Lab repository.
export PYTHONPATH=$PYTHONPATH:~/openarm_isaac_lab
cd IsaacLab
# Run training.
python ./scripts/reinforcement_learning/rl_games/train.py --task Isaac-Reach-OpenArm-Bi-v0 --headless
# Run the test.
python ./scripts/reinforcement_learning/rl_games/play.py --task Isaac-Reach-OpenArm-Bi-v0 --num_envs 4
```
You can run different tasks and policies.
| Task Description | Task Name | Policy Name |
| ----------------------- | ------------------------------ |
----------------------------------- |
| Reach target position (Bimanual) | `Isaac-Reach-OpenArm-Bi-v0` |
`rsl_rl`, `rl_games` |
| Reach target position | `Isaac-Reach-OpenArm-v0` | `rsl_rl`,
`rl_games`, `skrl` |
| Lift a cube | `Isaac-Lift-Cube-OpenArm-v0` | `rsl_rl`, `rl_games` |
| Open a cabinet's drawer | `Isaac-Open-Drawer-OpenArm-v0` | `rsl_rl`,
`rl_games` |
<!-- As a practice, it is recommended to open an issue to have
discussions on the proposed pull request.
This makes it easier for the community to keep track of what is being
developed or added, and if a given feature
is demanded by more than one party. -->
## Type of change
<!-- As you go through the list, delete the ones that are not
applicable. -->
- New feature (non-breaking change which adds functionality)
- Documentation update
## Screenshots
<!--
Example:
| Before | After |
| ------ | ----- |
| _gif/png before_ | _gif/png after_ |
To upload images to a PR -- simply drag and drop an image while in edit
mode and it should upload the image directly. You can then paste that
source into the above before/after sections.
-->
### Reach target position (Bimanual, rsl_rl)
- Screenshot

- Reward function
<img width="2734" height="925" alt="Screenshot from 2025-11-27 15-40-46"
src="https://github.com/user-attachments/assets/e4e95786-be33-47de-a8c1-4637ae918e35"
/>
<img width="1568" height="487" alt="Screenshot from 2025-11-27 15-40-54"
src="https://github.com/user-attachments/assets/7f50a1e5-2c28-4e70-b8de-1a9bb52b53a4"
/>
- Video
[Screencast from 11-27-2025 03:54:44
PM.webm](https://github.com/user-attachments/assets/e9394734-6d72-42c1-979b-a559ffea0b4d)
### Reach target position (Bimanual, rl_games)
- Reward function
<img width="2791" height="780" alt="Screenshot from 2025-12-11 23-19-12"
src="https://github.com/user-attachments/assets/3f9d6743-954f-478c-a595-06f4b2919851"
/>
<img width="937" height="389" alt="Screenshot from 2025-12-11 23-19-23"
src="https://github.com/user-attachments/assets/d8e3ff51-12dc-4517-ae30-c42afc193b8b"
/>
- Video
[rl_games_reach_bi.webm](https://github.com/user-attachments/assets/6f379883-1b43-45f0-b649-82b4f913cb4b)
### Reach target position (rsl_rl)
- Screenshot

- Reward function
<img width="1567" height="497" alt="Screenshot from 2025-11-27 15-46-03"
src="https://github.com/user-attachments/assets/8f2714ef-8b3d-49ff-9974-a955357dc77a"
/>
- Video
[Screencast from 11-27-2025 03:51:36
PM.webm](https://github.com/user-attachments/assets/53867929-8905-416a-8892-24c328b7ee56)
### Reach target position (rl_games)
- Reward function
<img width="937" height="389" alt="Screenshot from 2025-12-11 23-24-38"
src="https://github.com/user-attachments/assets/df24c50a-07ac-4607-9cde-d1b49944b4f3"
/>
- Video
[rl_games_reach.webm](https://github.com/user-attachments/assets/ba52e2cb-783a-4724-a679-b248ce766748)
### Reach target position (skrl)
- Reward function
<img width="1007" height="728" alt="Screenshot from 2025-12-11 23-25-55"
src="https://github.com/user-attachments/assets/4aa05128-b18b-400f-9b03-bde32f19f71c"
/>
- Video
[skrl_reach.webm](https://github.com/user-attachments/assets/dfab0dec-d59a-4343-85e0-09307d26f227)
### Lift a cube (rsl_rl)
- Screenshot

- Reward function
<img width="2364" height="487" alt="Screenshot from 2025-11-27 15-44-08"
src="https://github.com/user-attachments/assets/6014c5e6-3cf9-4a80-be55-5fe1d842351b"
/>
<img width="1568" height="487" alt="Screenshot from 2025-11-27 15-43-57"
src="https://github.com/user-attachments/assets/52edfb2d-1dcb-4020-a802-2f8d1676bb5b"
/>
- Video
[Screencast from 11-27-2025 03:53:04
PM.webm](https://github.com/user-attachments/assets/85387631-3530-47a7-8c5d-e843ca39ce31)
### Lift a cube (rl_games)
- Reward function
<img width="1008" height="389" alt="Screenshot from 2025-12-11 23-26-51"
src="https://github.com/user-attachments/assets/6faab135-57b0-441d-81ce-8ac59032ecbf"
/>
- Video
[rl_games_lift.webm](https://github.com/user-attachments/assets/4a7d1284-fbb3-4f08-adaf-5a89627bdc06)
### Open a cabinet's drawer (rsl_rl)
- Screenshot

- Reward function
<img width="2739" height="913" alt="Screenshot from 2025-11-27 15-45-26"
src="https://github.com/user-attachments/assets/2a409853-e10c-48f4-be3d-2f86b1a2ede0"
/>
<img width="1567" height="497" alt="Screenshot from 2025-11-27 15-45-34"
src="https://github.com/user-attachments/assets/f9bbb9f1-c566-40e8-ae25-98d083dc8b54"
/>
- Video
[Screencast from 11-27-2025 03:53:54
PM.webm](https://github.com/user-attachments/assets/7f2181e7-4784-4933-a8a7-ef5e45b0d96b)
### Open a cabinet's drawer (rl_games)
- Reward function
<img width="1008" height="389" alt="Screenshot from 2025-12-11 23-27-27"
src="https://github.com/user-attachments/assets/c03d5d27-e52a-45ad-a675-7cc56bcfbed6"
/>
- Video
[rl_games_drawer.webm](https://github.com/user-attachments/assets/957915ca-2cf6-4c32-968d-1f27fcfdc99d)
## Checklist
- [x] I have read and understood the [contribution
guidelines](https://isaac-sim.github.io/IsaacLab/main/source/refs/contributing.html)
- [x] I have run the [`pre-commit` checks](https://pre-commit.com/) with
`./isaaclab.sh --format`
- [x] I have made corresponding changes to the documentation
- [x] My changes generate no new warnings
- [x] I have added tests that prove my fix is effective or that my
feature works
- [x] I have updated the changelog and the corresponding version in the
extension's `config/extension.toml` file
- [x] I have added my name to the `CONTRIBUTORS.md` or my name already
exists there
<!--
As you go through the checklist above, you can mark something as done by
putting an x character in it
For example,
- [x] I have done this task
- [ ] I have not done this task
-->
---------
Signed-off-by: Antoine RICHARD <[email protected]>
Co-authored-by: ooctipus <[email protected]>
Co-authored-by: Antoine RICHARD <[email protected]>
Co-authored-by: Kelly Guo <[email protected]>1 parent bde0bca commit 3bbabca
File tree
36 files changed
+2433
-1
lines changed- docs/source
- _static/tasks/manipulation
- overview
- source
- isaaclab_assets
- config
- docs
- isaaclab_assets/robots
- isaaclab_tasks
- docs
- isaaclab_tasks/manager_based/manipulation
- cabinet/config/openarm
- agents
- lift/config/openarm
- agents
- reach/config/openarm
- bimanual
- agents
- unimanual
- agents
36 files changed
+2433
-1
lines changed| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
88 | 88 | | |
89 | 89 | | |
90 | 90 | | |
| 91 | + | |
91 | 92 | | |
92 | 93 | | |
93 | 94 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
163 | 163 | | |
164 | 164 | | |
165 | 165 | | |
| 166 | + | |
| 167 | + | |
| 168 | + | |
| 169 | + | |
| 170 | + | |
| 171 | + | |
| 172 | + | |
| 173 | + | |
166 | 174 | | |
167 | 175 | | |
168 | 176 | | |
| |||
183 | 191 | | |
184 | 192 | | |
185 | 193 | | |
| 194 | + | |
| 195 | + | |
| 196 | + | |
| 197 | + | |
186 | 198 | | |
187 | 199 | | |
188 | 200 | | |
| |||
212 | 224 | | |
213 | 225 | | |
214 | 226 | | |
| 227 | + | |
| 228 | + | |
| 229 | + | |
| 230 | + | |
215 | 231 | | |
216 | 232 | | |
217 | 233 | | |
| |||
1135 | 1151 | | |
1136 | 1152 | | |
1137 | 1153 | | |
| 1154 | + | |
| 1155 | + | |
| 1156 | + | |
| 1157 | + | |
| 1158 | + | |
| 1159 | + | |
| 1160 | + | |
| 1161 | + | |
| 1162 | + | |
| 1163 | + | |
| 1164 | + | |
| 1165 | + | |
| 1166 | + | |
| 1167 | + | |
| 1168 | + | |
| 1169 | + | |
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
1 | 1 | | |
2 | 2 | | |
3 | | - | |
| 3 | + | |
4 | 4 | | |
5 | 5 | | |
6 | 6 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
1 | 1 | | |
2 | 2 | | |
3 | 3 | | |
| 4 | + | |
| 5 | + | |
| 6 | + | |
| 7 | + | |
| 8 | + | |
| 9 | + | |
| 10 | + | |
| 11 | + | |
4 | 12 | | |
5 | 13 | | |
6 | 14 | | |
| |||
Lines changed: 173 additions & 0 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
| 1 | + | |
| 2 | + | |
| 3 | + | |
| 4 | + | |
| 5 | + | |
| 6 | + | |
| 7 | + | |
| 8 | + | |
| 9 | + | |
| 10 | + | |
| 11 | + | |
| 12 | + | |
| 13 | + | |
| 14 | + | |
| 15 | + | |
| 16 | + | |
| 17 | + | |
| 18 | + | |
| 19 | + | |
| 20 | + | |
| 21 | + | |
| 22 | + | |
| 23 | + | |
| 24 | + | |
| 25 | + | |
| 26 | + | |
| 27 | + | |
| 28 | + | |
| 29 | + | |
| 30 | + | |
| 31 | + | |
| 32 | + | |
| 33 | + | |
| 34 | + | |
| 35 | + | |
| 36 | + | |
| 37 | + | |
| 38 | + | |
| 39 | + | |
| 40 | + | |
| 41 | + | |
| 42 | + | |
| 43 | + | |
| 44 | + | |
| 45 | + | |
| 46 | + | |
| 47 | + | |
| 48 | + | |
| 49 | + | |
| 50 | + | |
| 51 | + | |
| 52 | + | |
| 53 | + | |
| 54 | + | |
| 55 | + | |
| 56 | + | |
| 57 | + | |
| 58 | + | |
| 59 | + | |
| 60 | + | |
| 61 | + | |
| 62 | + | |
| 63 | + | |
| 64 | + | |
| 65 | + | |
| 66 | + | |
| 67 | + | |
| 68 | + | |
| 69 | + | |
| 70 | + | |
| 71 | + | |
| 72 | + | |
| 73 | + | |
| 74 | + | |
| 75 | + | |
| 76 | + | |
| 77 | + | |
| 78 | + | |
| 79 | + | |
| 80 | + | |
| 81 | + | |
| 82 | + | |
| 83 | + | |
| 84 | + | |
| 85 | + | |
| 86 | + | |
| 87 | + | |
| 88 | + | |
| 89 | + | |
| 90 | + | |
| 91 | + | |
| 92 | + | |
| 93 | + | |
| 94 | + | |
| 95 | + | |
| 96 | + | |
| 97 | + | |
| 98 | + | |
| 99 | + | |
| 100 | + | |
| 101 | + | |
| 102 | + | |
| 103 | + | |
| 104 | + | |
| 105 | + | |
| 106 | + | |
| 107 | + | |
| 108 | + | |
| 109 | + | |
| 110 | + | |
| 111 | + | |
| 112 | + | |
| 113 | + | |
| 114 | + | |
| 115 | + | |
| 116 | + | |
| 117 | + | |
| 118 | + | |
| 119 | + | |
| 120 | + | |
| 121 | + | |
| 122 | + | |
| 123 | + | |
| 124 | + | |
| 125 | + | |
| 126 | + | |
| 127 | + | |
| 128 | + | |
| 129 | + | |
| 130 | + | |
| 131 | + | |
| 132 | + | |
| 133 | + | |
| 134 | + | |
| 135 | + | |
| 136 | + | |
| 137 | + | |
| 138 | + | |
| 139 | + | |
| 140 | + | |
| 141 | + | |
| 142 | + | |
| 143 | + | |
| 144 | + | |
| 145 | + | |
| 146 | + | |
| 147 | + | |
| 148 | + | |
| 149 | + | |
| 150 | + | |
| 151 | + | |
| 152 | + | |
| 153 | + | |
| 154 | + | |
| 155 | + | |
| 156 | + | |
| 157 | + | |
| 158 | + | |
| 159 | + | |
| 160 | + | |
| 161 | + | |
| 162 | + | |
| 163 | + | |
| 164 | + | |
| 165 | + | |
| 166 | + | |
| 167 | + | |
| 168 | + | |
| 169 | + | |
| 170 | + | |
| 171 | + | |
| 172 | + | |
| 173 | + | |
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
1 | 1 | | |
2 | 2 | | |
3 | 3 | | |
| 4 | + | |
| 5 | + | |
| 6 | + | |
| 7 | + | |
| 8 | + | |
| 9 | + | |
| 10 | + | |
| 11 | + | |
| 12 | + | |
| 13 | + | |
| 14 | + | |
| 15 | + | |
| 16 | + | |
| 17 | + | |
| 18 | + | |
| 19 | + | |
| 20 | + | |
| 21 | + | |
| 22 | + | |
| 23 | + | |
4 | 24 | | |
5 | 25 | | |
6 | 26 | | |
| |||
0 commit comments