Stereo-Camera-Path-Planning

KO | EN

gitlite — search

#react #ai #llm #golang #android #rust #deep-learning #linux #nodejs #windows #awesome #kubernetes #awesome-list #open-source

Stereo-Camera-Path-Planning

(★ 53)

Real-time path-planning from 3D reconstruction and depth estimation: an algorithm for calibrated stereo cameras.

Stereo-Camera-Path-Planning Latest Version Download

Download Latest Version (.zip)

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

# Stereo Camera Path-Planning

#### Description:
This program is for a stereo camera device, and enables real-time path planning and obstacle avoidance for robotic vehicles. The code implements OpenCV with Python for camera calibration, stereo correspondence, 3D reconstruction, and pathfinding.

#### Algorithm Procedure:
The input images are first rectified from camera calibration parameters before using OpenCV's StereoSGBM algorithm to compute the disparity map. The disparity map is then reprojected to a 3D space in the world coordinate system for obstacle filtering. Obstacles located above the floor plane are used to construct an occupancy grid. The A* pathfinding algorithm operates on the occupancy grid, with the end node determined by the furthest depth value with the shortest Euclidian distance from unified camera's principal point. The computed A* path is then back-projected to 2D image coordinates and overlaid on the unrectified left camera image.

## Results:
#### Video demonstration: 
https://youtu.be/Hd16ineBsT8

#### Screenshots:
![Fig. 0](https://raw.githubusercontent.com/bwalsh0/Stereo-Camera-Path-Planning/main/example_results/figure_00.png)

##### 3D Scene Projection with Planned Path:
![Fig. 4](https://raw.githubusercontent.com/bwalsh0/Stereo-Camera-Path-Planning/main/example_results/figure_04.png)

##### Image of Stereo Camera Device:
![Device Photo](https://raw.githubusercontent.com/bwalsh0/Stereo-Camera-Path-Planning/main/example_results/device_photo.png)

##### System Diagram:
![SBD](https://raw.githubusercontent.com/bwalsh0/Stereo-Camera-Path-Planning/main/example_results/system_block_diagram.png)

## Core Dependencies:
* [Python 3.9.1](https://www.python.org/)
* [OpenCV-contrib Python Bindings](https://github.com/opencv/opencv_contrib/tree/master)
* [Pathfinding Algorithm Implementations](https://github.com/brean/python-pathfinding)

Stereo-Camera-Path-Planning

Stereo-Camera-Path-Planning Latest Version Download

Today's picks

Was this content helpful?

Recent Feedback

Stereo-Camera-Path-Planning

Stereo-Camera-Path-Planning Latest Version Download

Today's picks

Was this content helpful?

Recent Feedback

Download README