Skip to content

Commit 44ce400

Browse files
committed
cloud-robotics-lifelong-learning scenario added
Signed-off-by: Aryan <nandaaryan823@gmail.com>
1 parent ba57d45 commit 44ce400

8 files changed

Lines changed: 127 additions & 0 deletions

File tree

docs/index.rst

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -49,6 +49,7 @@ Start your journey on Ianvs with the following links:
4949

5050
Industrial Defect Detection: PCB-AoI <proposals/scenarios/industrial-defect-detection/pcb-aoi>
5151
Cloud Edge Collaborative inference for LLM: Ianvs-MMLU-5-shot <proposals/scenarios/cloud-edge-collaborative-inference-for-llm/mmlu-5-shot>
52+
Cloud Robotics Lifelong Learning <proposals/scenarios/cloud-robotics-lifelong-learning-dataset/cloud-robotics>
5253

5354
.. toctree::
5455
:maxdepth: 1
Lines changed: 126 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,126 @@
1+
# Cloud-Robotics Lifelong Learning Dataset
2+
3+
Download link: [Kaggle](https://www.kaggle.com/datasets/kubeedgeianvs/cloud-robotics/)
4+
5+
## Authors
6+
7+
- KubeEdge/Ianvs: Shijing Hu, Sitong Mao, Siqi Luo, Zhiwei Huang, Zimu Zheng, Jie Pu, Feng Wang
8+
9+
## Background
10+
11+
In the past few years, robotic technology has developed rapidly, and the practical application of intelligent robots such as the Cloud Shadow X20 has become increasingly widespread. For robotic applications, model training requires a large amount of data, and the ability of models to learn throughout their lifetime has become increasingly important due to the complex and ever-changing real environment. However, currently there are relatively few open-source datasets in the field of robotics, making it difficult for developers in the robotics field to obtain high-quality data for model training.
12+
13+
Therefore, we have jointly released the **Cloud-Robotics** dataset on KubeEdge-Ianvs to provide better support for robot learning. The Cloud-Robotics dataset not only provides high-quality data support for robotic tasks but also offers more possibilities for testing the lifelong learning ability of robot application models. We believe that this dataset will become one of the important tools in the field of robot learning and application development.
14+
15+
Cloud-Robotics is a multimodal robot dataset collected by an intelligent robotic dog in the Huawei Shenzhen Industrial Park. Currently, the outdoor image semantic segmentation dataset of Cloud-Robotics has been open-sourced. In the future, we will open-source other modalities of Cloud-Robotics datasets, including but not limited to point clouds and IMU, etc.
16+
17+
![](./images/details.png)
18+
19+
### Examples
20+
21+
Original Image:-
22+
![image1](./images/image1.png)
23+
Segmented Image:-
24+
![image2](./images/image2.png)
25+
Original Image:-
26+
![image3](./images/image3.png)
27+
Segmented Image:-
28+
![image4](./images/image4.png)
29+
30+
31+
## Data Explorer
32+
33+
### Dataset Structure
34+
35+
After decompression, the data organization is listed as follows:
36+
37+
```
38+
"Cloud-Robotics": {
39+
Cloud-Robotics_dataset
40+
├── gtFine
41+
│ ├── test
42+
│ │ ├── 20220420_front
43+
│ │ └── 20220420_garden
44+
│ ├── train
45+
│ │ ├── 20220420_front
46+
│ │ └── 20220420_garden
47+
│ └── val
48+
│ ├── 20220420_front
49+
│ └── 20220420_garden
50+
├── rgb
51+
│ ├── test
52+
│ │ ├── 20220420_front
53+
│ │ └── 20220420_garden
54+
│ ├── train
55+
│ │ ├── 20220420_front
56+
│ │ └── 20220420_garden
57+
│ └── val
58+
│ ├── 20220420_front
59+
│ └── 20220420_garden
60+
└── viz
61+
├── test
62+
│ ├── 20220420_front
63+
│ └── 20220420_garden
64+
├── train
65+
│ ├── 20220420_front
66+
│ └── 20220420_garden
67+
└── val
68+
├── 20220420_front
69+
└── 20220420_garden
70+
}
71+
```
72+
73+
### Dataset Partition Description
74+
75+
Cloud-Robotics dataset has 7 groups of 30 classes. The partition of dataset is as follow:
76+
77+
| **Group** | **Classes** |
78+
|----------------|-----------------------------------------------------------------------------|
79+
| **flat** | road, sidewalk, ramp, runway |
80+
| **human** | person, rider |
81+
| **vehicle** | car, truck, bus, train, motorcycle, bicycle |
82+
| **construction**| building, wall, fence, stair, curb, flowerbed, door |
83+
| **object** | pole, traffic sign, traffic light, CCTV camera, Manhole, hydrant, belt, dustbin |
84+
| **nature** | vegetation, terrain |
85+
| **sky** | sky |
86+
87+
88+
### Data Statistics
89+
90+
**Features**
91+
92+
- Polygonal annotations
93+
- Dense semantic segmentation
94+
- Instance segmentation for vehicle and people
95+
- Complexity
96+
- 30 classes
97+
- Diversity
98+
- Daytime
99+
- Manually selected frames
100+
- Large number of dynamic objects
101+
- Varying scene layout
102+
- Varying background
103+
- Volume
104+
- 2600 annotated real-world images
105+
- Benchmark suite and evaluation server
106+
- Pixel-level semantic labeling
107+
108+
### Data Format
109+
110+
The format of json annotation is as follows:
111+
112+
```
113+
"gtFine_polygons.json": {
114+
"imgHeight": <int> -- Height of the image
115+
"imgWidth": <int> -- Width of the image
116+
"objects": <list> -- List of the objects
117+
"label": <str> -- Name of the label
118+
"polygon": <list> -- Boundary point coordinates
119+
}
120+
```
121+
122+
### Data Annotation
123+
124+
Below are examples of high quality dense pixel annotations of 2500 real-world images. Overlayed colors encode semantic classes. Note that single instances of traffic participants are annotated individually.
125+
126+
![](./images/annotation.png)
1010 KB
Loading
328 KB
Loading
1.94 MB
Loading
1.27 MB
Loading
1.49 MB
Loading
1020 KB
Loading

0 commit comments

Comments
 (0)