Skip to content

Commit d8fa17a

Browse files
authored
Merge pull request #87 from hsj576/main
Update README
2 parents 5f9b934 + ce81fbd commit d8fa17a

File tree

3 files changed

+59
-37
lines changed

3 files changed

+59
-37
lines changed

README.md

Lines changed: 53 additions & 35 deletions
Original file line numberDiff line numberDiff line change
@@ -8,54 +8,52 @@ Ianvs is a distributed synergy AI benchmarking project incubated in KubeEdge SIG
88

99
## Scope
1010

11-
The distributed synergy AI benchmarking Ianvs aims to test the performance of distributed synergy AI solutions following recognized standards, in order to facilitate more efficient and effective development.
11+
The distributed synergy AI benchmarking Ianvs aims to test the performance of distributed synergy AI solutions following recognized standards, in order to facilitate more efficient and effective development.
1212

1313
The scope of Ianvs includes
1414

1515
- Providing end-to-end benchmark toolkits across devices, edge nodes, and cloud nodes based on typical distributed-synergy AI paradigms and applications.
16-
- Tools to manage test environment. For example, it would be necessary to support the CRUD (Create, Read, Update, and Delete) actions in test environments. Elements of such test environments include algorithm-wise and system-wise configuration.
17-
- Tools to control test cases. Typical examples include paradigm templates, simulation tools, and hyper-parameter-based assistant tools.
18-
- Tools to manage benchmark presentation, e.g., leaderboard and test report generation.
16+
- Tools to manage test environment. For example, it would be necessary to support the CRUD (Create, Read, Update, and Delete) actions in test environments. Elements of such test environments include algorithm-wise and system-wise configuration.
17+
- Tools to control test cases. Typical examples include paradigm templates, simulation tools, and hyper-parameter-based assistant tools.
18+
- Tools to manage benchmark presentation, e.g., leaderboard and test report generation.
1919
- Cooperation with other organizations or communities, e.g., in KubeEdge SIG AI, to establish comprehensive benchmarks and developed related applications, which can include but are not limited to
20-
- Dataset collection, re-organization, and publication
21-
- Formalized specifications, e.g., standards
22-
- Holding competitions or coding events, e.g., open source promotion plan
23-
- Maintaining solution leaderboards or certifications for commercial usage
24-
20+
- Dataset collection, re-organization, and publication
21+
- Formalized specifications, e.g., standards
22+
- Holding competitions or coding events, e.g., open source promotion plan
23+
- Maintaining solution leaderboards or certifications for commercial usage
2524

2625
## Architecture
2726

2827
The architectures and related concepts are shown in the below figure. The ianvs is designed to run **within a single node**. Critical components include
2928

3029
- Test Environment Manager: the CRUD of test environments serving for global usage
31-
- Test Case Controller: control the runtime behavior of test cases like instance generation and vanish
32-
- Generation Assistant: assist users to generate test cases based on certain rules or constraints, e.g., the range of parameters
33-
- Simulation Controller: control the simulation process of edge-cloud synergy AI, including the instance generation and vanishment of simulation containers
30+
- Test Case Controller: control the runtime behavior of test cases like instance generation and vanish
31+
- Generation Assistant: assist users to generate test cases based on certain rules or constraints, e.g., the range of parameters
32+
- Simulation Controller: control the simulation process of edge-cloud synergy AI, including the instance generation and vanishment of simulation containers
3433
- Story Manager: the output management and presentation of the test case, e.g., leaderboards
3534

3635
![](docs/guides/images/ianvs_arch.png)
3736

3837
More details on Ianvs components:
3938

4039
1. Test-Environment Manager supports the CRUD of Test environments, which basically includes
41-
- Algorithm-wise configuration
42-
- Public datasets
43-
- Pre-processing algorithms
44-
- Feature engineering algorithms
45-
- Post-processing algorithms like metric computation
46-
- System-wise configuration
47-
- Overall architecture
48-
- System constraints or budgets
49-
- End-to-end cross-node
50-
- Per node
51-
1. Test-case Controller, which includes but is not limited to the following components
52-
- Templates of common distributed-synergy-AI paradigms, which can help the developer to prepare their test case without too much effort. Such paradigms include edge-cloud synergy joint inference, incremental learning, federated learning, and lifelong learning.
53-
- Simulation tools. Develop simulated test environments for test cases
54-
- Other tools to assist test-case generation. For instance, prepare test cases based on a given range of hyper-parameters.
55-
1. Story Manager, which includes but is not limited to the following components
56-
- Leaderboard generation
57-
- Test report generation
58-
40+
- Algorithm-wise configuration
41+
- Public datasets
42+
- Pre-processing algorithms
43+
- Feature engineering algorithms
44+
- Post-processing algorithms like metric computation
45+
- System-wise configuration
46+
- Overall architecture
47+
- System constraints or budgets
48+
- End-to-end cross-node
49+
- Per node
50+
2. Test-case Controller, which includes but is not limited to the following components
51+
- Templates of common distributed-synergy-AI paradigms, which can help the developer to prepare their test case without too much effort. Such paradigms include edge-cloud synergy joint inference, incremental learning, federated learning, and lifelong learning.
52+
- Simulation tools. Develop simulated test environments for test cases
53+
- Other tools to assist test-case generation. For instance, prepare test cases based on a given range of hyper-parameters.
54+
3. Story Manager, which includes but is not limited to the following components
55+
- Leaderboard generation
56+
- Test report generation
5957

6058
## Guides
6159

@@ -69,9 +67,29 @@ Follow the [Ianvs installation document](docs/guides/how-to-install-ianvs.md) to
6967

7068
### Examples
7169

72-
Scenario PCB-AoI:[Industrial Defect Detection on the PCB-AoI Dataset](/docs/proposals/scenarios/industrial-defect-detection/pcb-aoi.md).
73-
Example PCB-AoI-1:[Testing single task learning in industrial defect detection](/docs/proposals/test-reports/testing-single-task-learning-in-industrial-defect-detection-with-pcb-aoi.md).
74-
Example PCB-AoI-2:[Testing incremental learning in industrial defect detection](/docs/proposals/test-reports/testing-incremental-learning-in-industrial-defect-detection-with-pcb-aoi.md).
70+
- Scenario PCB-AoI:[Industrial Defect Detection on the PCB-AoI Dataset](docs/proposals/scenarios/industrial-defect-detection/pcb-aoi.md).
71+
72+
- Example PCB-AoI-1:[Testing single task learning in industrial defect detection](docs/proposals/test-reports/testing-single-task-learning-in-industrial-defect-detection-with-pcb-aoi.md).
73+
74+
- Example PCB-AoI-2:[Testing incremental learning in industrial defect detection](docs/proposals/test-reports/testing-incremental-learning-in-industrial-defect-detection-with-pcb-aoi.md).
75+
76+
- Scenario Cityscapes-Synthia: [Curb Detetion on Cityscapes-Synthia Dataset](docs/proposals/algorithms/lifelong-learning/Additional-documentation/curb_detetion_datasets.md)
77+
78+
- Example Cityscapes-Synthia-1: [Lifelong learning in semantic segmentation](examples/cityscapes-synthia/lifelong_learning_bench/semantic-segmentation/README.md)
79+
80+
- Example Cityscapes-Synthia-2: [Lifelong learning in curb detetion](examples/cityscapes-synthia/lifelong_learning_bench/curb-detection/README.md)
81+
82+
- Example Cityscapes-Synthia-3: [Scene based unknown task recognition in curb detetion](examples/cityscapes-synthia/scene-based-unknown-task-recognition/curb-detection/README.md)
83+
84+
- Example Cityscapes-Synthia-4: [Integrating GAN and Self-taught Learning into Ianvs Lifelong Learning](examples/cityscapes/lifelong_learning_bench/unseen_task_processing-GANwithSelfTaughtLearning/README.md)
85+
86+
- Scenario Cloud-Robotics: [Semantic Segmentation on Cloud-Robotics Dataset](docs/proposals/scenarios/Cloud-Robotics/Cloud-Robotics_zh.md)
87+
88+
- Example Cloud-Robotics-1: [Lifelong learning in semantic segmentation](examples/robot/lifelong_learning_bench/semantic-segmentation/README.md)
89+
90+
- Example Cloud-Robotics-2: [Class increment learning in semantic segmentation](examples/robot-cityscapes-synthia/lifelong_learning_bench/semantic-segmentation/README.md)
91+
92+
- Example Cloud-Robotics-3: [Lifelong learning in sam annotation](examples/robot/lifelong_learning_bench/sam_annotation/tutorial.md)
7593

7694
## Roadmap
7795

@@ -82,7 +100,7 @@ Example PCB-AoI-2:[Testing incremental learning in industrial defect detection
82100
Routine Community Meeting for KubeEdge SIG AI runs weekly:
83101

84102
- Europe Time: **Thursdays at 16:30-17:30 Beijing Time**.
85-
([Convert to your timezone.](https://www.thetimezoneconverter.com/?t=16%3A30&tz=GMT%2B8&))
103+
([Convert to your timezone.](https://www.thetimezoneconverter.com/?t=16%3A30&tz=GMT%2B8&))
86104

87105
Resources:
88106

@@ -107,4 +125,4 @@ If you're interested in being a contributor and want to get involved in developi
107125

108126
## License
109127

110-
Ianvs is under the Apache 2.0 license. See the [LICENSE](LICENSE) file for details.
128+
Ianvs is under the Apache 2.0 license. See the [LICENSE](LICENSE) file for details.

docs/guides/how-to-build-simulation-env.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,4 +1,4 @@
1-
# Using simulation controller build the edge-cloud AI simulation environment with just one host
1+
# How to build simulation env
22

33
This document introduces how to build a edge-cloud AI simulation environment(e.g. kubeedge sedna) with just one host.
44

docs/index.rst

Lines changed: 5 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -40,6 +40,7 @@ Start your journey on Ianvs with the following links:
4040

4141
guides/how-to-install-ianvs
4242
guides/how-to-test-algorithms
43+
guides/how-to-build-simulation-env
4344

4445

4546
.. toctree::
@@ -56,7 +57,8 @@ Start your journey on Ianvs with the following links:
5657

5758
Single Task Learning: FPN <proposals/algorithms/single-task-learning/fpn>
5859
Incremental Learning: BasicIL-FPN <proposals/algorithms/incremental-learning/basicIL-fpn>
59-
60+
Lifelong Learning: RFNet <proposals/algorithms/lifelong-learning/Cloud-Robotic AI Benchmarking for Edge-cloud Collaborative Lifelong Learning>
61+
6062
.. toctree::
6163
:maxdepth: 1
6264
:titlesonly:
@@ -76,6 +78,8 @@ Start your journey on Ianvs with the following links:
7678

7779
Leaderboard: Single Task Learning on PCB-AoI <leaderboards/leaderboard-in-industrial-defect-detection-of-PCB-AoI/leaderboard-of-single-task-learning>
7880
Leaderboard: Incremental Learning on PCB-AoI <leaderboards/leaderboard-in-industrial-defect-detection-of-PCB-AoI/leaderboard-of-incremental-learning>
81+
Leaderboard: Lifelong Learning on Cloud-Robotics <leaderboards/leaderboard-in-semantic-segmentation-of-Cloud-Robotics/leaderboard-of-lifelong-learning>
82+
Leaderboard: Edge-Cloud Collaboration on Cloud-Robotics <leaderboards/leaderboard-in-semantic-segmentation-of-Cloud-Robotics/leaderboard-of-SAM-based-Edge-Cloud-Collaboration>
7983
Test Report: Single Task Learning on PCB-AoI <proposals/test-reports/testing-single-task-learning-in-industrial-defect-detection-with-pcb-aoi>
8084
Test Report: Incremental Learning on PCB-AoI <proposals/test-reports/testing-incremental-learning-in-industrial-defect-detection-with-pcb-aoi>
8185

0 commit comments

Comments
 (0)