BoundingBoxGenerator

KO | EN

gitlite — search

#python #react #typescript #golang #go #android #docker #macos #nodejs #java #kubernetes #awesome-list #pytorch #ios

BoundingBoxGenerator

(★ 30)

Official PyTorch Implementation of BB Generator & pRoI Generator [WACV2020]

BoundingBoxGenerator Latest Version Download

Download Latest Version (.zip)

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

# Generating Positive Bounding Boxes for Balanced Training of Object Detectors

This repository contains Pytorch implementations of the Bounding Box Generator, positive RoI Generator and Online Foreground Balanced sampling. The repository is based on the mmdetection object detection framework. You may refer to [mmdetection](https://github.com/open-mmlab/mmdetection) for a thorough understanding of the framework. If you are unfamiliar with the setup of the mmdetection the please refer to this [link](https://github.com/open-mmlab/mmdetection/blob/master/docs/INSTALL.md).

Please cite the following paper if you use this repository.

Kemal Oksuz, Baris Can Cam, Emre Akbas, Sinan Kalkan, "Generating Positive Bounding Boxes for Balanced Training of Object Detectors," In: IEEE Winter Conference on Applications of Computer Vision (WACV) (2020). [[arXiv-preprint]](https://arxiv.org/abs/1909.09777)

Here, we present the implementations of 3 modules in this repository:

## Bounding Box Generator

IDEA: Given a bounding box <img src="https://latex.codecogs.com/gif.latex?B" /> (or any arbitrary rectangle) and a desired minimum IoU threshold (<img src="https://latex.codecogs.com/gif.latex?T" />), bounding box generator outputs a bounding box <img src="https://latex.codecogs.com/gif.latex?\hat{B}" /> with <img src="https://latex.codecogs.com/gif.latex?IoU(B,\hat{B})>T" />. The following figure illustrates the idea.

![BB demo image](https://raw.githubusercontent.com/kemaloksuz/BoundingBoxGenerator/master/demo/BBteaser.png)

CODE: In this [link](https://github.com/kemaloksuz/BoundingBoxGenerator/blob/5ee77b0f73b31bad711f0eee73cc2b0d5a35f1cc/mmdet/core/bbox/samplers/bounding_box_generator.py#L180) you can see an implementation of the extended version of the bounding box generator which outputs one box for each IoU in the given list of IoUs. Also, you can see a basic demo of the bounding box generator in this [script](https://github.com/kemaloksuz/BoundingBoxGenerator/blob/master/demo/bounding_box_generator_demo.py).

## Positive RoI Generator

IDEA: We devised positive RoI (pROI) Generator as a specific application of the Bounding Box Sampler. Given the desired IoU and spatial distributions of the RoIs, pRoI generator is able to generate a set of foreground-balanced bounding boxes by sticking to the specified input distributions. In order to generate bounding boxes pRoI Generator uses Bounding Box Generator as a subroutione. Following figure illustrates our pipeline during training.

![pRoI demo image](https://raw.githubusercontent.com/kemaloksuz/BoundingBoxGenerator/master/demo/pRoIteaser.png)

CODE: [This](https://github.com/kemaloksuz/BoundingBoxGenerator/blob/5ee77b0f73b31bad711f0eee73cc2b0d5a35f1cc/mmdet/core/bbox/samplers/pRoI_generator.py) is the address of the code of our pRoI generator.

One can employ it easily by sticking to the sampler conventions in the mmdetection framework. You can find configuration file examples in the configs/BBGeneration folder.

Experimentally we have showed that our pRoI sampler is able to provide more samples for larger IoUs compared to RPN RoIs.

## Online Foreground Balanced Sampling

IDEA: Different from the generators, Online Foreground Sampling is a sampler such as Random Sampler, OHEM Sampler etc. One difference from them is that we only consider positive examples in the batch, so it can also be combined to negative samplers. Main motivation is to generate a batch as balanced as possible from the classes within the batch. That's why we assign probabilities to each positive candidate RoI by considering the total number of each class. Basically, we utilize multinomial sampling.

CODE:One can check the our plain [OFB sampler](https://github.com/kemaloksuz/BoundingBoxGenerator/blob/5ee77b0f73b31bad711f0eee73cc2b0d5a35f1cc/mmdet/core/bbox/samplers/foreground_balanced_pos_sampler.py) and [OFB sampler combined with Online Hard Negative Mining](https://github.com/kemaloksuz/BoundingBoxGenerator/blob/5ee77b0f73b31bad711f0eee73cc2b0d5a35f1cc/mmdet/core/bbox/samplers/OFB_with_OHNM.py) respectively.

You can find configuration file examples in the configs/OFB folder.

## Citation

If you use any of these properties in your research, please cite our paper.

```
@inProceedings{BBGenerator,
  title   = {Generating Positive Bounding Boxes for Balanced Training of Object Detectors},
  author  = {Oksuz, Kemal and Cam, Baris Can and Akbas, Emre and Kalkan, Sinan},
  booktitle={IEEE Winter Conference on Applications of Computer Vision (WACV)},
  year      = {2020}
}
```

## Contact
Please contact Kemal Öksüz (kemal.oksuz@metu.edu.tr) for your questions about this webpage.

BoundingBoxGenerator

BoundingBoxGenerator Latest Version Download

Today's picks

Was this content helpful?

Recent Feedback

BoundingBoxGenerator

BoundingBoxGenerator Latest Version Download

Today's picks

Was this content helpful?

Recent Feedback

Download README