Skip to content
Open
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
47 commits
Select commit Hold shift + click to select a range
c2eeb94
testing the contribution process
UD31415 Jan 1, 2025
dc2dfa0
applications added
UD31415 May 7, 2025
4bbb4fb
Create README.md
UD31415 May 7, 2025
3ccc0ef
update readme
UD31415 May 7, 2025
772c30e
adding application info
UD31415 May 7, 2025
1d2dbd6
remove non relevant links
UD31415 May 7, 2025
f5d504a
Update README.md
UD31415 May 7, 2025
724fab2
working on readme and adding opencv wrapper
UD31415 May 7, 2025
af83675
Update README.md
UD31415 May 7, 2025
17107c9
Update README.md
UD31415 May 7, 2025
52d676d
readme updates
UD31415 May 7, 2025
1d2cb2e
Update README.md
UD31415 May 7, 2025
27d97cd
Update README.md
UD31415 May 7, 2025
ff6fb60
noise measurement application
UD31415 May 7, 2025
21f76b1
updated readme files
UD31415 May 7, 2025
aae1c9d
adding aruco and barcode detectors
UD31415 May 7, 2025
7f4b788
plane detector - simplify
UD31415 May 11, 2025
1ee5527
adding depth image for planes test
UD31415 May 11, 2025
613f3d5
improving and cleaning. ransac is not working good
UD31415 May 11, 2025
06a01e7
plane detectors are updated
UD31415 May 12, 2025
66cd1e0
Update README.md
UD31415 May 12, 2025
c47cf05
fixing links
UD31415 May 12, 2025
c17df7a
Update README.md
UD31415 May 12, 2025
c07b8d2
removing applications
UD31415 May 12, 2025
33a9295
adding edges and corners
UD31415 May 12, 2025
1292917
removing applications
UD31415 May 12, 2025
1e06c6d
Update README.md
UD31415 May 12, 2025
e66fcfb
Update README.md
UD31415 May 12, 2025
ce749e7
Update README.md
UD31415 May 12, 2025
e43c363
Update README.md
UD31415 May 12, 2025
ba12fa2
Update README.md
UD31415 May 12, 2025
d382efa
Update test_plane_detector.py
UD31415 May 12, 2025
92d6ef8
fixing "your path"
UD31415 May 12, 2025
422909a
pose added
UD31415 May 13, 2025
2035e91
robot calibration data
UD31415 May 14, 2025
6997701
Update README.md
UD31415 May 14, 2025
b497f8e
Update README.md
UD31415 May 14, 2025
7ff9475
Update README.md
UD31415 May 14, 2025
4cb1144
Update README.md
UD31415 May 15, 2025
a563304
Update README.md
UD31415 May 15, 2025
1d05ef1
Update README.md
UD31415 May 15, 2025
cbdc383
Update README.md
UD31415 May 15, 2025
5b29515
Update README.md
UD31415 May 15, 2025
fae12f3
Update README.md
UD31415 May 15, 2025
029eb6f
Update README.md
UD31415 May 15, 2025
9ce2ae1
plane detector is running but it is not perfect
UD31415 May 27, 2025
fbc690b
plane detector starting to work
UD31415 May 27, 2025
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1 change: 1 addition & 0 deletions .gitignore
Original file line number Diff line number Diff line change
Expand Up @@ -89,3 +89,4 @@ librealsense-log.txt
*.cxx

.vscode/*
*.mp4
72 changes: 72 additions & 0 deletions wrappers/python/applications/README.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,72 @@
# Intel RealSense - Object Camera

Objects are everywhere!

This package supports object data extraction from the intel Realsense camera RGB or Depth streams in real time.

The list of the supported objects, frameworks, platforms and applications are below. Click on each image to find out more.

# Objects

- Barcodes, QR Codes, Aruco Markers - well defined objects detected by using RGB camera data.

Barcodes | QR Codes | Aruco Markers |
:------------: | :----------: | :-------------: |
[![Barcode](barcode/doc/barcode_camera.gif)](barcode/README.md) | [![QR Codes](barcode/doc/qrcode_camera.gif)](barcode/README.md) | [![Aruco](barcode/doc/aruco_camera.gif)](barcode/README.md) |

- Planes, Edges, Corners - 3D geometric objects detected using depth camera information.

Planes | Edges | Corners |
:------------: | :----------: | :-------------: |
[![Planes](planes/doc/plane_3.gif)](planes/README.md) | [![Edges](planes/doc/edges-1.gif)](planes/README.md) | [![Corners](planes/doc/corner-1.gif)](planes/README.md) |




# Utilities

OpenCV Like Camera Wrapper - controls low level camera features like exposure, gain, laser power, provides access to left and right sensor images and additional features.
It can be used to connect to Real Sense camera in real time. It provides a simple UI to store videos and images in different formats.

[![RGB](utils/doc/cam_rgb_d.jpg)](utils/README.md) | [![D16](utils/doc/cam_d_3.jpg)](utils/README.md) | [![SC1](utils/doc/cam_d_5.jpg)](utils/README.md) |
:------------: | :----------: | :-------------: |
[![IRL](utils/doc/cam_d_9.jpg)](utils/README.md) | [![EXPOSURE](utils/doc/cam_e_2.jpg)](utils/README.md) | [![GAIN](utils/doc/cam_g_5.jpg)](utils/README.md) |
[![PWR](utils/doc/cam_p_0.jpg)](utils/README.md) | [![SC2](utils/doc/image_sc2_000.png)](utils/README.md) | [![D16](utils/doc/image_d16_000.png)](utils/README.md) |

Depth Noise measurement tool - a simple UI to measure noise in the depth data. It supports measurement of the temporal noise per pixel, spatial noise per image ROI and fitted plane noise. In addition, it reports the number/percent of the non valid pixels. The results are visualized and alo printed in the console window.

Temporal/Spatial ROI | Plane Fit ROI |
:------------: | :----------: |
[![STP](utils/doc/noise_measure_stp.gif)](utils/README.md) | [![PFIT](utils/doc/noise_measure.gif)](utils/README.md) |


Logger - to monitor and print console information, errors and processing time of the applications.

[![LOG](utils/doc/noise_error_log.jpg)](utils/README.md)


# Request Camera Feature
If you want to run the application or object detection on the camera hardware - check this [link](https://docs.google.com/forms/d/e/1FAIpQLSdduDbnrRExDGFQqWAn8pX7jSr8KnwBmwuFOR9dgUabEp0F1A/viewform).

# Supported Platforms and Compute Environments

The following is the check list of supported environments and functionality:
- Windows
- Ubuntu
- Jetson (NVIDIA) - TBD
- Raspeberry PI - TBD

# How to Contribute

We greatly appreciate contributions from the community, including examples, applications, and guides. If you'd like to contribute, please follow these guidelines:

1. **Create a pull request (PR)** with the title prefix `[RS]`, adding your new example folder to the `root/` directory within the repository.

2. **Ensure your project adheres to the following standards:**
- Makes use of the `vision` package.
- Includes a `README.md` with clear instructions for setting up and running the example.
- Avoids adding large files or dependencies unless they are absolutely necessary for the example.




79 changes: 79 additions & 0 deletions wrappers/python/applications/barcode/README.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,79 @@
![](doc/show_examples.jpg)

[![image](https://img.shields.io/pypi/v/scikit-spatial.svg)](https://pypi.python.org/pypi/scikit-spatial)
[![image](https://anaconda.org/conda-forge/scikit-spatial/badges/version.svg)](https://anaconda.org/conda-forge/scikit-spatial)
[![image](https://img.shields.io/pypi/pyversions/scikit-spatial.svg)](https://pypi.python.org/pypi/scikit-spatial)


# Introduction

This code provides examples of how to detect Barcodes, Aruco Markers and QR Codes using RealSense camera in real time.
The object detection is based on RGB values of the camera. The following objects are supported:

- Barcodes, QR Codes : detected by using PyZbar external library
- Aruco Markers : using OpenCV

These objects could be integrated in your robotics and video processing pipe line.
Please be aware that /qrcode/aruco detection relies on the libraries in use.
Please refer to library limitations if barcode, qrcode or aruco marker are not detected.


# Modules and License

We are using pyzbar and opencv contributed to detect barcodes and aruco markers.


# Installation Windows

1. Install python 3.10 from Python Release Python 3.10.0 | <https://www.python.org>

2. Create virtual environment. In Windows PowerShell:

python -m venv "your path"\Envs\barcode

3. Activate virtual environment. In Windows CMD shell:

"your path"\Envs\barcode\Scripts\activate.bat

4. Installing realsense python wrapper for librealsense SDK. For example, download pyrealsense2-2.55.10.6089-cp310-cp310-win_amd64.whl (the latest : ![link](https://github.com/IntelRealSense/librealsense/releases/download/v2.56.3/pyrealsense2-2.56.3.7838-cp310-cp310-win_amd64_beta.whl)):

pip install pyrealsense2-2.55.10.6089-cp310-cp310-win_amd64.whl

5. Install opencv and numpy:

pip install opencv-contrib-python

6. Instrall PyZbar library:

pip install pyzbar

7. Install scipy:

pip install scipy

8. Install matplotlib:

pip install matplotlib

# Usage

```py
>>>
>>> python barcode_realsense_detector.py

```
or
```py
>>>
>>> python aruco_realsense_detector.py # run the example

```

# Troubleshooting

## During PyZbar installation if the following error happens:

FileNotFoundError: Could not find module '<your path>\Envs\barcode\lib\site-packages\pyzbar\libzbar-64.dll' (or one of its dependencies). Try using the full path with constructor syntax.

Fix: Install vcredist_x64.exe From <https://www.microsoft.com/en-gb/download/details.aspx?id=40784>
Download Visual C++ Redistributable Packages for Visual Studio 2013 from Official Microsoft Download Center
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Loading