KO | EN

GitLite

Minimalist Open Source Repository Search Engine

gitlite — search

#dsh #dsh-plugin #typescript #developer-tools #claude-code #ai-agent #codex #deepseek-harness #ai-agents #cli #react #mcp

unet-depth-prediction

★ 33 Open GitHub ↗

predicting depth from single rgb images using u-net architecture

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

# unet-depth-prediction
predicting depth from single rgb images using u-net architecture

**Pytorch implementation of single image depth predicion using u-net architecture**
Diksha Meghwal, [Imran Ali](https://github.com/ii398)

For more details: 
[paper](https://www.scribd.com/document/401913439/Depth-Prediction-Single-Image)

### Requirements
This code was developed using [Python 2.7.15](https://www.python.org/downloads/release/python-2715/), [Pytorch 0.4.1](https://pytorch.org/get-started/previous-versions/), CUDA, [tensorboard logger](https://www.tensorflow.org/guide/summaries_and_tensorboard) to plot graphs.

#### I just want to try an image!
You can try our model on an image by using the script testRun.py. It will take as input a file with suitable extension(.png, .jpg) and save the output in a file called output.png.
```
python testRun --path <image file path> model.pth
```

#### Architecture

 <img src="https://cdn-images-1.medium.com/max/1600/1*TXfEPqTbFBPCbXYh2bstlA.png" alt="monodepth">

#### Data
This model requires images with rgb images paired with its corresponding depth map. The images should be such that there is a valid depth value for each pixel.

Hence we use the [NYU depth dataset](https://cs.nyu.edu/~silberman/datasets/nyu_depth_v2.html). The NYU depth dataset is divided into 3 parts. We use the labeled dataset part.

#### Training and Validation
We train the model using images of size 64 x 64 pixels. The model's dataloader expects a matlab file containing the labeled dataset of RGB images along with their depth maps.
The training scripts runs on CUDA with a batch size of 1 and takes 200 epochs to converge. It takes about 20 minutes for the whole process to complete.

You can monitor the learning process using tensorboard and pointing it to your the log directory location.
The validation part of the script validates the performance of the model using a bunch of evaluation metrics each plotted in a separate graph.
We save the model generated at each step to a sub-folder named "model" in a file named containing the model tag as the suffix.

```
python main.py <model_tag> --epochs=200 --batch-size=1
```

### Evaluation
Post training we evaluate the model on a part of NYU labeled depth dataset. We evaluate with a batch size of 8 and plot the output depth map along with the original RGB images and the target depth map and save these plots in a folder names "plots".
We can also customize the no of the generated model which we wish to use with the help of the flag as shown below. 
```
python evaluate.py <model_tag> --model_no=200
```

### Model
You can download our model from the file model.pth.

unet-depth-prediction

Explore Similar Repositories

Was this content helpful?

Recent Feedback

Download README