You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Embodied Intelligence SDK v25.36 enhances model optimization capabilities with OpenVINO™ toolkit and provides typical workflows and examples, including Diffusion Policy (DP), Robotic Diffusion Transformer (RDT), Improved 3D Diffusion Policy (IDP3), Visual Servoing (CNS) and LLM Robotic Demo. This release has also updated the real-time optimized best-known configuration (BKC) on improving AI and control performance, and supporting the Intel® Arc™ B-series graphics card (B570).
10
6
11
-
**New Features:**
12
-
13
-
* Updated real-time optimization BKC, including BIOS and runtime optimization, balancing performance with AI and control consolidation.
14
-
* Added support for Intel® Arc™ B-series (Battlemage) graphics card (B570).
15
-
* Fixed deadlock issue when reading i915 perf event in Preempt-RT kernel.
16
-
* New EtherCAT Master stack features supporting user-space EtherCAT Master and multiple EtherCAT masters.
17
-
* Added Diffusion Policy pipeline with OpenVINO™ toolkit optimization.
| Diffusion Policy ****diffusion_policy****| An innovative method for generating robot actions by conceptualizing visuomotor policy learning as a conditional denoising diffusion process |
25
+
| Robotics Diffusion Transformer (RDT) ****robotics_diffusion_transformer****| A RDT pipeline provided for evaluating the VLA model on the simulation task |
26
+
| LLM Robotics Demo ****llm_robotics_demo****| A code generation demo for robotics, interacting with a chatbot utilizing AI technologies such as large language models (Phi-4) and computer vision (SAM, CLIP) |
28
27
29
-
#. iGPU performance degradation observed when using passthrough iGPU to VM on ACRN hypervisor.
30
28
31
-
#. Display becomes unresponsive in VMs when running concurrent AI workloads with iGPU SR-IOV enabled on ACRN hypervisor.
29
+
**Improved**
32
30
33
-
**The following model algorithms were added and optimized by OpenVINO™ toolkit:**
31
+
The following model algorithms were added and optimized by OpenVINO™ toolkit:
| Diffusion Policy ****diffusion_policy****| An innovative method for generating robot actions by conceptualizing visuomotor policy learning as a conditional denoising diffusion process |
50
-
| Robotics Diffusion Transformer (RDT) ****robotics_diffusion_transformer****| A RDT pipeline provided for evaluating the VLA model on the simulation task |
51
-
| LLM Robotics Demo ****llm_robotics_demo****| A code generation demo for robotics, interacting with a chatbot utilizing AI technologies such as large language models (Phi-4) and computer vision (SAM, CLIP) |
45
+
- ACRN hypervisor feature and performance
52
46
47
+
- iGPU performance degradation observed when using passthrough iGPU to VM on ACRN hypervisor.
48
+
- Display becomes unresponsive in VMs when running concurrent AI workloads with iGPU SR-IOV enabled on ACRN hypervisor.
Embodied Intelligence SDK v25.15 provides necessary software framework, libraries, tools, BKC, tutorials and example codes to facilitate embodied intelligence solution development on Intel® Core™ Ultra Series 2 processors (Arrow Lake-H), It provides Intel Linux LTS kernel v6.12.8 with Preempt-RT, and supports for Canonical Ubuntu OS 22.04, introduces initial support for ROS2 Humble software libraries and tools. It supports many models optimization with OpenVINO™ toolkit, and provides typical workflows and examples including ACT manipulation, ORB-SLAM3, etc.
59
53
60
-
**New Features:**
54
+
**New**
61
55
62
-
* Provided Linux OS 6.12.8 BSP with Preempt-RT
63
-
* Provided Real-time optimization BKC
64
-
* Optimized IgH EtherCAT master with Linux kernel v6.12
65
-
* Added ACT manipulation pipeline with OpenVINO™ and Intel® Extension for PyTorch framework optimization
66
-
* Added ORB-SLAM3 pipeline focuses on real-time simultaneous localization and mapping
67
-
* Provided typical AI models optimization tutorials with OpenVINO™ toolkit
56
+
- Provided Linux OS 6.12.8 BSP with Preempt-RT
57
+
- Provided Real-time optimization BKC
58
+
- Optimized IgH EtherCAT master with Linux kernel v6.12
59
+
- Added ACT manipulation pipeline with OpenVINO™ and Intel® Extension for PyTorch framework optimization
60
+
- Added ORB-SLAM3 pipeline focuses on real-time simultaneous localization and mapping
61
+
- Provided typical AI models optimization tutorials with OpenVINO™ toolkit
|[Imitation Learning - ACT](../sample_pipelines/imitation_learning_act.rst)| Imitation learning pipeline using Action Chunking with Transformers(ACT) algorithm to train and evaluate in simulator or real robot environment with Intel optimization |
67
+
|[VSLAM: ORB-SLAM3](../sample_pipelines/ORB_VSLAM.rst)| One of popular real-time feature-based SLAM libraries able to perform Visual, Visual-Inertial and Multi-Map SLAM with monocular, stereo and RGB-D cameras, using pin-hole and fisheye lens models |
70
68
71
-
* There is a known deadlock risk and limitation to use ``intel_gpu_top`` to read i915 perf event in Preempt-RT kernel, it will be fixed with next release.
72
69
73
-
**The following model algorithms were optimized by OpenVINO™ toolkit:**
70
+
**Improved**
71
+
72
+
The following model algorithms were optimized by OpenVINO™ toolkit:
| Bird's Eye View Perception: Fast-BEV ****model_fastbev****| Obtaining a BEV perception is to gain a comprehensive understanding of the spatial layout and relationships between objects in a scene |
92
91
| Monocular Depth Estimation: Depth Anything V2 ****model_depthanythingv2****| A powerful tool that leverages deep learning to infer 3D information from 2D images |
| Diffusion Policy ****diffusion_policy****| An innovative method for generating robot actions by conceptualizing visuomotor policy learning as a conditional denoising diffusion process |
99
-
| Robotics Diffusion Transformer (RDT) ****robotics_diffusion_transformer****| A RDT pipeline provided for evaluating the VLA model on the simulation task |
100
-
| LLM Robotics Demo ****llm_robotics_demo****| A code generation demo for robotics, interacting with a chatbot utilizing AI technologies such as large language models (Phi-4) and computer vision (SAM, CLIP) |
93
+
**Known Issues**
101
94
102
-
<!--hide_directive:::
103
-
::::hide_directive-->
95
+
- There is a known deadlock risk and limitation to use ``intel_gpu_top`` to read i915 perf event in Preempt-RT kernel, it will be fixed with next release.
0 commit comments