You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
-\[2025-07\] Our project has been renamed to InternUtopia.
20
22
-\[2025-02\] GRUtopia 2.0 released!
21
23
-\[2024-07\] We release the [paper](https://arxiv.org/abs/2407.10943) and demos of GRUtopia.
22
24
23
25
## 🚀 New Features in 2.0 release
24
26
- Gym compatible env implementation.
25
-
- Easy-to-use pythonic config system to use out-of-the-box [sensors](https://grutopia.github.io/usage/tutorials/how-to-use-sensor.html), [controllers](https://grutopia.github.io/usage/tutorials/how-to-use-controller.html), [robots](https://grutopia.github.io/usage/tutorials/how-to-use-robot.html) and [tasks](https://grutopia.github.io/usage/tutorials/how-to-use-task.html).
26
-
- Examples of driving [diverse robots](https://grutopia.github.io/usage/tutorials/how-to-use-robot.html) and the corresponding policies.
27
-
-[Benchmark and baseline](https://grutopia.github.io/usage/get_started/run-benchmark-baseline.html) for social navigation and mobile manipulation task.
28
-
- Teleportation tools with [Mocap](https://grutopia.github.io/usage/get_started/teleoperating-with-mocap.html) and [Apple VisionPro](https://grutopia.github.io/usage/get_started/teleoperating-with-visionpro.html).
29
-
- Physically accurate [interactive object assets](https://huggingface.co/datasets/OpenRobotLab/GRScenes) that are ready for simulation.
30
-
- Procedural [Indoor Scene Generation](https://github.com/OpenRobotLab/GRUtopia/tree/main/toolkits/indoor_scenes_generation) with [GRScenes-100](https://grutopia.github.io/usage/get_started/explore-grscenes.html).
27
+
- Easy-to-use pythonic config system to use out-of-the-box [sensors](https://internrobotics.github.io/user_guide/internutopia/tutorials/how-to-use-sensor.html), [controllers](https://internrobotics.github.io/user_guide/internutopia/tutorials/how-to-use-controller.html), [robots](https://internrobotics.github.io/user_guide/internutopia/tutorials/how-to-use-robot.html) and [tasks](https://internrobotics.github.io/user_guide/internutopia/tutorials/how-to-use-task.html).
28
+
- Examples of driving [diverse robots](https://internrobotics.github.io/user_guide/internutopia/get_started/drive-unitree-g1-with-keyboard.html) and the corresponding policies.
29
+
- Benchmark and baseline for [social navigation](https://internrobotics.github.io/user_guide/internnav/)and [mobile manipulation](https://internrobotics.github.io/user_guide/internmanip/) task.
30
+
- Teleportation tools with [Mocap](https://internrobotics.github.io/user_guide/internutopia/get_started/control-franak-with-your-hand.html) and [Apple VisionPro](https://internrobotics.github.io/user_guide/internutopia/get_started/teleoprate-fourier-gr1-with-visionpro.html).
31
+
- Physically accurate [interactive object assets](https://huggingface.co/datasets/InternRobotics/GRScenes) that are ready for simulation.
32
+
- Procedural [Indoor Scene Generation](https://github.com/InternRobotics/InternUtopia/tree/main/toolkits/indoor_scenes_generation) with [GRScenes-100](https://internrobotics.github.io/user_guide/internutopia/get_started/dive-into-grscenes-100.html).
31
33
32
34
## 📋 Contents
33
35
-[🏠 About](#-about)<!-- omit in toc -->
@@ -47,7 +49,7 @@
47
49
48
50
Recent works have been exploring the scaling laws in the field of Embodied AI. Given the prohibitive costs of collecting real-world data, we believe the <b>Simulation-to-Real (Sim2Real) paradigm</b> is a more feasible path for scaling the learning of embodied models.
49
51
50
-
We introduce project <b>GRUtopia</b> (aka. 桃源 in Chinese), a general-purpose research platform for embodied AGI.
52
+
We introduce project <b>InternUtopia</b> (aka. 桃源 in Chinese), a general-purpose research platform for embodied AGI.
51
53
It features several advancements:
52
54
* 🏙️ <b>GRScenes</b>, the scene dataset, includes 100k interactive finely annotated scenes. GRScenes covers 89 diverse scene categories, facilitating deployment of general robots across different scenarios.
53
55
* 🧑🤝🧑 <b>GRResidents</b>, a Large Language Model (LLM) driven Non-Player Character (NPC) system that enables social interaction, task generation, and task assignment, thus simulating <b>social scenarios</b> for embodied AI applications.
@@ -64,7 +66,7 @@ We hope that this work can alleviate the scarcity of high-quality data in this f
64
66
### Prerequisites
65
67
66
68
- Ubuntu 20.04, 22.04
67
-
-[NVIDIA Omniverse Isaac Sim 4.2.0](https://docs.omniverse.nvidia.com/isaacsim/latest/installation/install_workstation.html)
69
+
-[NVIDIA Omniverse Isaac Sim 4.5.0](https://docs.isaacsim.omniverse.nvidia.com/4.5.0/installation/install_workstation.html)
68
70
- Ubuntu 20.04/22.04 Operating System
69
71
- NVIDIA GPU (RTX 2070 or higher)
70
72
- NVIDIA GPU Driver (recommended version 535.216.01+)
@@ -75,41 +77,41 @@ We hope that this work can alleviate the scarcity of high-quality data in this f
75
77
76
78
### Installation
77
79
78
-
We provide the installation guide [here](https://grutopia.github.io/usage/get_started/installation.html). You can install locally or use docker and verify the installation easily.
80
+
We provide the installation guide [here](https://internrobotics.github.io/user_guide/internutopia/get_started/installation.html). You can install locally or use docker and verify the installation easily.
79
81
80
82
### Documentation \& Tutorial
81
83
82
-
We provide detailed [docs](https://grutopia.github.io) for the basic usage of different modules supported in GRUtopia. Welcome to try and post your suggestions!
84
+
We provide detailed [docs](https://internrobotics.github.io/user_guide/internutopia/) for the basic usage of different modules supported in InternUtopia. Welcome to try and post your suggestions!
83
85
84
86
## 🏙️ Assets
85
87
86
88
> [!NOTE]
87
89
> 📝First of all you **MUST** complete the [User Agreement for GRScenes-100 Dataset Access](https://docs.google.com/forms/d/e/1FAIpQLSccX4pMb57eZbjXpH12Jz6WUBmCfeyc2t0s98k_u4Z-GD3Org/viewform?fbzx=8256642192244696391).
88
90
89
-
Then you can choose to download all assets (~80GB) or a minimum set (~500MB) to examine installation by running the following script with [GRUtopia](https://grutopia.github.io/usage/get_started/installation.html) installed:
91
+
Then you can choose to download all assets (~80GB) or a minimum set (~500MB) to examine installation by running the following script with [InternUtopia](https://internrobotics.github.io/user_guide/internutopia/get_started/installation.html) installed:
90
92
91
93
```shell
92
-
$ python -m grutopia.download_assets
94
+
$ python -m internutopia.download_assets
93
95
```
94
-
The default path to store the downloaded assets is `${PATH/TO/GRUTOPIA/ROOT}/grutopia/assets`. Users have two ways to configure the asset path:
96
+
The default path to store the downloaded assets is `${PATH/TO/INTERNUTOPIA/ROOT}/internutopia/assets`. Users have two ways to configure the asset path:
95
97
96
-
1. Spcecify a custom path during download using `python -m grutopia.download_assets`.
97
-
2. Set it later by running `python -m grutopia.set_assets_path` and entering the preferred directory.
98
+
1. Spcecify a custom path during download using `python -m internutopia.download_assets`.
99
+
2. Set it later by running `python -m internutopia.set_assets_path` and entering the preferred directory.
98
100
99
101
100
102
101
103
### GRScenes-100
102
-
If you want to separately download the `GRScenes-100` scene assets, you can manually download them from [OpenDataLab](https://openxlab.org.cn/datasets/OpenRobotLab/GRScenes/tree/main/scenes/GRScenes-100), [ModelScope](https://www.modelscope.cn/datasets/Shanghai_AI_Laboratory/GRScenes/files) and [HuggingFace](https://huggingface.co/datasets/OpenRobotLab/GRScenes/tree/main/scenes/GRScenes-100). Please refer to the [instructions](https://huggingface.co/datasets/OpenRobotLab/GRScenes#%F0%9F%93%9A-getting-started) for scene usage.
104
+
If you want to separately download the `GRScenes-100` scene assets, you can manually download them from [OpenDataLab](https://openxlab.org.cn/datasets/OpenRobotLab/GRScenes/tree/main/scenes/GRScenes-100), [ModelScope](https://www.modelscope.cn/datasets/Shanghai_AI_Laboratory/GRScenes/files) and [HuggingFace](https://huggingface.co/datasets/InternRobotics/GRScenes/tree/main/scenes/GRScenes-100). Please refer to the [instructions](https://huggingface.co/datasets/InternRobotics/GRScenes#%F0%9F%93%9A-getting-started) for scene usage.
103
105
104
106
### Robots & Weights
105
-
If you want to separately download robots and policy weights, you can manually download the `robot` directory from from [OpenDataLab](https://openxlab.org.cn/datasets/OpenRobotLab/GRScenes/tree/main/robots), [ModelScope](https://www.modelscope.cn/datasets/Shanghai_AI_Laboratory/GRScenes/files) and [HuggingFace](https://huggingface.co/datasets/OpenRobotLab/GRScenes/tree/main/robots) and move it to the root of the asset path.
107
+
If you want to separately download robots and policy weights, you can manually download the `robot` directory from from [OpenDataLab](https://openxlab.org.cn/datasets/OpenRobotLab/GRScenes/tree/main/robots), [ModelScope](https://www.modelscope.cn/datasets/Shanghai_AI_Laboratory/GRScenes/files) and [HuggingFace](https://huggingface.co/datasets/InternRobotics/GRScenes/tree/main/robots) and move it to the root of the asset path.
We preliminarily establish three benchmarks for evaluating the capabilities of embodied agents from different aspects: <b>Object Loco-Navigation</b>, <b>Social Loco-Navigation</b>, and <b>Loco-Manipulation</b>. Please refer to the [documentation](https://grutopia.github.io/usage/get_started/run-benchmark-baseline.html) for running the benchmarks.
114
+
We preliminarily establish three benchmarks for evaluating the capabilities of embodied agents from different aspects: <b>Object Loco-Navigation</b>, <b>Social Loco-Navigation</b>, and <b>Loco-Manipulation</b>. Please refer to the [InternNav](https://internrobotics.github.io/user_guide/internnav/) and [InternManip](https://internrobotics.github.io/user_guide/internmanip/) for running the benchmarks.
113
115
114
116
## 👥 Support
115
117
@@ -123,8 +125,8 @@ Join our [WeChat](https://cdn.vansin.top/taoyuan.jpg) support group or [Discord]
123
125
-\[x\] Polish APIs and related codes.
124
126
-\[x\] Full release and further updates.
125
127
-\[x\] Release the baseline methods and benchmark data.
126
-
-\[\] Support multiple episodes.
127
-
-\[\] Vectorized env and batch execution.
128
+
-\[x\] Support multiple episodes.
129
+
-\[x\] Vectorized env and batch execution.
128
130
-\[\] Training framework.
129
131
130
132
## 🔗 Citation
@@ -144,7 +146,7 @@ If you find our work helpful, please cite:
144
146
145
147
## 📄 License
146
148
147
-
GRUtopia's simulation platform is [MIT licensed](LICENSE). The open-sourced GRScenes are under the <arel="license"href="http://creativecommons.org/licenses/by-nc-sa/4.0/">Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License </a><arel="license"href="http://creativecommons.org/licenses/by-nc-sa/4.0/"><imgalt="Creative Commons License"style="border-width:0"src="https://i.creativecommons.org/l/by-nc-sa/4.0/80x15.png" /></a>.
149
+
InternUtopia's simulation platform is [MIT licensed](LICENSE). The open-sourced GRScenes are under the <arel="license"href="http://creativecommons.org/licenses/by-nc-sa/4.0/">Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License </a><arel="license"href="http://creativecommons.org/licenses/by-nc-sa/4.0/"><imgalt="Creative Commons License"style="border-width:0"src="https://i.creativecommons.org/l/by-nc-sa/4.0/80x15.png" /></a>.
0 commit comments