clothing-segmentation

KO | EN

gitlite — search

#javascript #css #nodejs #php #hacktoberfest #java #html #library #golang #epub #xml #jquery

clothing-segmentation

★ 88 Open GitHub ↗

Clothing segmentation with DeepLabV3+

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

<p align="center">
  <h1 align="center">Clothes Segmentation using DeepLabV3+</h1>
  <p align="center">
    Train the DeepLabV3+ model on Colab with Tensorflow API.
    <br />
  </p>
</p>

<h3>
  <strong>Table of Contents</strong>
</h3>

> * [Introduction](#introduction)
> * [Training Details](#training-details)
> * [Jupyter Notebook](#jupyter-notebook) 
> * [Data](#data)
> * [Test Results](#test-results)
> * [References](#references)

# Introduction

Recently, the fashion industry has undergone a digital transformation by expanding on online platforms. Especially after the pandemic, online platforms have grown considerably commercially and as an area where data scientists can develop applications and provide benefits. This growth allows the development of compelling use cases of artificial intelligence in the fashion industry. For example, extracting clothing products and their related features from pictures can improve consumers' shopping experience and improve work efficiency for fashion workers. Therefore, the automatic labelling and visual analysis of clothing images in this area have attracted increasing attention.

# Training Details

The DeepLab architecture has proven to be quite successful. This study used a pre-trained inceptionresnetv2 backbone network to parse clothing images into five main categories. 13520 images from iMaterialists (Fashion) 2020 FGVC7 for training have been resized to 256x256.  In the study, to reduce the complex structure of the data set, 46 different categories were converted into 5 main categories ( 'upper-body', 'lower-body', 'whole-body', 'feet' and 'accessories'). The Adam optimization method and categorical cross-entropy loss were used for model optimization.

This project uses DeepLabV3 as a deep learning model. However, instead of having 1 channel output from DeepLabV3 for the typical noticeable semantic segmentation task, it outputs 5 channels of output, each representing 5 main categories.

# Jupyter Notebook
You can train the DeepLabV3+ model. Click the button below to open it on Colab.

[![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://githubtocolab.com/mberkay0/clothing-segmentation/blob/main/deepLabV3plus.ipynb)

# Data

## Test Results

Here are some visual and numerical results from the iMaterialist test dataset. Reasonably good results have been achieved in this dataset, which is complex, and labels are inconsistent.

| loss | Avg. IoU (%) | F1-Score (%) |  
|:---:|:---:|:---:|
| 0.3414 | 54.69 | 61.92 |

### Visual Results
<div align="center">
    <img src="/images/result2.png" alt="example-result"/>
    <img src="/images/result3.png" alt="example-result"/>
    <img src="/images/result4.png" alt="example-result"/>
    <img src="/images/result5.png" alt="example-result"/>
    <img src="/images/result6.png" alt="example-result"/>
</div>

# References

* [iMaterialist (Fashion) 2020 at FGVC7](https://kaggle.com/competitions/imaterialist-fashion-2020-fgvc7)
* [Based tensorflow repo model](https://github.com/tensorflow/models/tree/master/research/deeplab)
* [DeepLabV3+](https://arxiv.org/pdf/1802.02611.pdf)
* [Tensorflow](https://www.tensorflow.org/)

clothing-segmentation

Explore Similar Repositories

Was this content helpful?

Recent Feedback

Download README