Mobile-Image-Matting

KO | EN

gitlite — search

#python #hacktoberfest #llm #go #rust #deep-learning #linux #nodejs #windows #cli #vue #pytorch #openai #open-source

Mobile-Image-Matting

(★ 70)

a lightweight image matting model

Mobile-Image-Matting 최신버젼 다운로드

최종 버전 다운로드 (.zip)

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

# Deep Mobile Matting
This is a lightweight image matting model in PyTorch.

## Features

1. MobileNetV2 as backbone.
2. DeepLabv3 heads.
3. Small model (size: 23.5MB, FLOPs: 11.39GB, total params: 7.62 millions)

## Performance
- The Composition-1k testing dataset.
- Evaluate with whole image.
- SAD normalized by 1000.
- Input image is normalized with mean=[0.485, 0.456, 0.406] and std=[0.229, 0.224, 0.225].
- Both erode and dialte to generate trimap.

|Models|SAD|MSE|Download|
|---|---|---|---|
|paper-stage0|59.6|0.019||
|paper-stage1|54.6|0.017||
|paper-stage3|50.4|0.014||
|my-stage0|127.4|0.068|[Link](https://github.com/foamliu/Deep-Image-Matting-v2/releases/download/v1.0/BEST_checkpoint.tar)|

## Dependencies

- Python 3.6.8
- PyTorch 1.3

## Dataset
### Adobe Deep Image Matting Dataset
Follow the [instruction](https://sites.google.com/view/deepimagematting) to contact author for the dataset.

### MSCOCO
Go to [MSCOCO](http://cocodataset.org/#download) to download:
* [2014 Train images](http://images.cocodataset.org/zips/train2014.zip)

### PASCAL VOC
Go to [PASCAL VOC](http://host.robots.ox.ac.uk/pascal/VOC/) to download:
* VOC challenge 2008 [training/validation data](http://host.robots.ox.ac.uk/pascal/VOC/voc2008/VOCtrainval_14-Jul-2008.tar)
* The test data for the VOC2008 challenge

## Usage
### Data Pre-processing
Extract training images:
```bash
$ python pre_process.py
# python data_gen.py
```

### Train
```bash
$ python train.py
```

If you want to visualize during training, run in your terminal:
```bash
$ tensorboard --logdir runs
```

## Experimental results

### The Composition-1k testing dataset

1. Test:
```bash
$ python test.py
```

It prints out average SAD and MSE errors when finished.

### Demo
Download pre-trained Deep Image Matting [Link](https://github.com/foamliu/Deep-Mobile-Matting/releases/download/v1.0/BEST_checkpoint.tar) then run:
```bash
$ python demo.py
```

Image/Trimap | Output/GT | New BG/Compose | 
|---|---|---|
|![image](https://github.com/foamliu/Deep-Mobile-Matting/raw/master/images/0_image.png)  | ![image](https://github.com/foamliu/Deep-Mobile-Matting/raw/master/images/0_out.png)   | ![image](https://github.com/foamliu/Deep-Mobile-Matting/raw/master/images/0_new_bg.png) |
|![image](https://github.com/foamliu/Deep-Mobile-Matting/raw/master/images/0_trimap.png) | ![image](https://github.com/foamliu/Deep-Mobile-Matting/raw/master/images/0_alpha.png) | ![image](https://github.com/foamliu/Deep-Mobile-Matting/raw/master/images/0_compose.png)|
|![image](https://github.com/foamliu/Deep-Mobile-Matting/raw/master/images/1_image.png)  | ![image](https://github.com/foamliu/Deep-Mobile-Matting/raw/master/images/1_out.png)   | ![image](https://github.com/foamliu/Deep-Mobile-Matting/raw/master/images/1_new_bg.png) | 
|![image](https://github.com/foamliu/Deep-Mobile-Matting/raw/master/images/1_trimap.png) | ![image](https://github.com/foamliu/Deep-Mobile-Matting/raw/master/images/1_alpha.png) | ![image](https://github.com/foamliu/Deep-Mobile-Matting/raw/master/images/1_compose.png)|
|![image](https://github.com/foamliu/Deep-Mobile-Matting/raw/master/images/2_image.png)  | ![image](https://github.com/foamliu/Deep-Mobile-Matting/raw/master/images/2_out.png)   | ![image](https://github.com/foamliu/Deep-Mobile-Matting/raw/master/images/2_new_bg.png) |
|![image](https://github.com/foamliu/Deep-Mobile-Matting/raw/master/images/2_trimap.png) | ![image](https://github.com/foamliu/Deep-Mobile-Matting/raw/master/images/2_alpha.png) | ![image](https://github.com/foamliu/Deep-Mobile-Matting/raw/master/images/2_compose.png)|
|![image](https://github.com/foamliu/Deep-Mobile-Matting/raw/master/images/3_image.png)  | ![image](https://github.com/foamliu/Deep-Mobile-Matting/raw/master/images/3_out.png)   | ![image](https://github.com/foamliu/Deep-Mobile-Matting/raw/master/images/3_new_bg.png) |
|![image](https://github.com/foamliu/Deep-Mobile-Matting/raw/master/images/3_trimap.png) | ![image](https://github.com/foamliu/Deep-Mobile-Matting/raw/master/images/3_alpha.png) | ![image](https://github.com/foamliu/Deep-Mobile-Matting/raw/master/images/3_compose.png)|
|![image](https://github.com/foamliu/Deep-Mobile-Matting/raw/master/images/4_image.png)  | ![image](https://github.com/foamliu/Deep-Mobile-Matting/raw/master/images/4_out.png)   | ![image](https://github.com/foamliu/Deep-Mobile-Matting/raw/master/images/4_new_bg.png) |
|![image](https://github.com/foamliu/Deep-Mobile-Matting/raw/master/images/4_trimap.png) | ![image](https://github.com/foamliu/Deep-Mobile-Matting/raw/master/images/4_alpha.png) | ![image](https://github.com/foamliu/Deep-Mobile-Matting/raw/master/images/4_compose.png)|
|![image](https://github.com/foamliu/Deep-Mobile-Matting/raw/master/images/5_image.png)  | ![image](https://github.com/foamliu/Deep-Mobile-Matting/raw/master/images/5_out.png)   | ![image](https://github.com/foamliu/Deep-Mobile-Matting/raw/master/images/5_new_bg.png) |
|![image](https://github.com/foamliu/Deep-Mobile-Matting/raw/master/images/5_trimap.png) | ![image](https://github.com/foamliu/Deep-Mobile-Matting/raw/master/images/5_alpha.png) | ![image](https://github.com/foamliu/Deep-Mobile-Matting/raw/master/images/5_compose.png)|
|![image](https://github.com/foamliu/Deep-Mobile-Matting/raw/master/images/6_image.png)  | ![image](https://github.com/foamliu/Deep-Mobile-Matting/raw/master/images/6_out.png)   | ![image](https://github.com/foamliu/Deep-Mobile-Matting/raw/master/images/6_new_bg.png) |
|![image](https://github.com/foamliu/Deep-Mobile-Matting/raw/master/images/6_trimap.png) | ![image](https://github.com/foamliu/Deep-Mobile-Matting/raw/master/images/6_alpha.png) | ![image](https://github.com/foamliu/Deep-Mobile-Matting/raw/master/images/6_compose.png)|
|![image](https://github.com/foamliu/Deep-Mobile-Matting/raw/master/images/7_image.png)  | ![image](https://github.com/foamliu/Deep-Mobile-Matting/raw/master/images/7_out.png)   | ![image](https://github.com/foamliu/Deep-Mobile-Matting/raw/master/images/7_new_bg.png) |
|![image](https://github.com/foamliu/Deep-Mobile-Matting/raw/master/images/7_trimap.png) | ![image](https://github.com/foamliu/Deep-Mobile-Matting/raw/master/images/7_alpha.png) | ![image](https://github.com/foamliu/Deep-Mobile-Matting/raw/master/images/7_compose.png)|
|![image](https://github.com/foamliu/Deep-Mobile-Matting/raw/master/images/8_image.png)  | ![image](https://github.com/foamliu/Deep-Mobile-Matting/raw/master/images/8_out.png)   | ![image](https://github.com/foamliu/Deep-Mobile-Matting/raw/master/images/8_new_bg.png) |
|![image](https://github.com/foamliu/Deep-Mobile-Matting/raw/master/images/8_trimap.png) | ![image](https://github.com/foamliu/Deep-Mobile-Matting/raw/master/images/8_alpha.png) | ![image](https://github.com/foamliu/Deep-Mobile-Matting/raw/master/images/8_compose.png)|
|![image](https://github.com/foamliu/Deep-Mobile-Matting/raw/master/images/9_image.png)  | ![image](https://github.com/foamliu/Deep-Mobile-Matting/raw/master/images/9_out.png)   | ![image](https://github.com/foamliu/Deep-Mobile-Matting/raw/master/images/9_new_bg.png) |
|![image](https://github.com/foamliu/Deep-Mobile-Matting/raw/master/images/9_trimap.png) | ![image](https://github.com/foamliu/Deep-Mobile-Matting/raw/master/images/9_alpha.png) | ![image](https://github.com/foamliu/Deep-Mobile-Matting/raw/master/images/9_compose.png)|

Mobile-Image-Matting

Mobile-Image-Matting 최신버젼 다운로드

오늘의 추천 프로젝트

Was this content helpful?

Recent Feedback

Mobile-Image-Matting

Mobile-Image-Matting 최신버젼 다운로드

오늘의 추천 프로젝트

Was this content helpful?

Recent Feedback

Download README