Bible_3_32_Pytorch_Complex_Yolo_Yolov4

KO | EN

gitlite — search

#ai #llm #golang #go #android #machine-learning #rust #docker #macos #awesome #security #pytorch #mcp #open-source

Bible_3_32_Pytorch_Complex_Yolo_Yolov4

(★ 10)

No description available.

Bible_3_32_Pytorch_Complex_Yolo_Yolov4 최신버젼 다운로드

최종 버전 다운로드 (.zip)

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

### English Tutorial : https://wikidocs.net/181734
### 한글 Tutorial : https://wikidocs.net/181710

# Pytorch Complex Yolo - Yolov4

Complete but Unofficial PyTorch Implementation of [Complex-YOLO: Real-time 3D Object Detection on Point Clouds](https://arxiv.org/pdf/1803.06199.pdf) with YoloV3
Code was tested with following specs:
- Code was tested on Windows 10

## 1. Installation
First, clone or download this GitHub repository.
Install requirements and download from official darknet weights:
```
# yolov3
wget -P model_data https://pjreddie.com/media/files/yolov3.weights

# yolov3-tiny
wget -P model_data https://pjreddie.com/media/files/yolov3-tiny.weights

# yolov4
wget -P model_data https://github.com/AlexeyAB/darknet/releases/download/darknet_yolo_v3_optimal/yolov4.weights

# yolov4-tiny
wget -P model_data https://github.com/AlexeyAB/darknet/releases/download/darknet_yolo_v4_pre/yolov4-tiny.weights
```

Or you can download darknet weights from my google drive:

https://drive.google.com/drive/folders/1w4KNO2jIlkyzQgUkkcZ18zrC8A1Nqvwa?usp=sharing

## 2. Pretrained weights

You can download darknet weights from my google drive:

- [x] Complex Yolo v4:

https://drive.google.com/file/d/1jVNRuencSHRtjDQcWySVDGSI_bqfKfCP/view?usp=sharing

- [x] Complex Yolo v4 - tiny:

https://drive.google.com/file/d/1Ho_BzaWN0fpyKCKXfTVA8wQS9ijxuP7U/view?usp=sharing

## 3. Quick start

### 3.1. Download pretrained weights

### 3.2. Dataset shall contains shall contains belows.
- [x] `detect_1` folder shall contain folders and contents.
- [x] `ImageSets` folder shall contain *.txt files.

${ROOT}
      ├── dataset/
      │    ├── classes.names
      │    └── kitti/
      │          ├── classes_names.txt
      │          ├── detect_1/    <-- for detection test
      │          │    ├── calib/
      │          │    ├── image_2/
      │          │    └── velodyne/
      │          ├── ImageSets/ 
      │          │    ├── detect_1.txt
      │          │    ├── detect_2.txt
      │          │    ├── sample.txt
      │          ├── sampledata/ 
      │          │    ├── image_2/
      │          │    ├── calib/
      │          │    ├── label_2/
      │          │    └── velodyne/

### 3.3 Test [without downloading dataset]

- [x] Detection test for `Yolo v3` with `detect_1` folder.

$ python detection.py --model_def config/cfg/complex_yolov4.cfg --pretrained_path checkpoints/Complex_yolo_yolo_v4.pth
       $ python detection.py
      
- [x] Detection test for `Yolo v3-tiny` with `detect_1` folder.

$ python detection.py --model_def config/cfg/complex_yolov4_tiny.cfg.cfg --pretrained_path checkpoints/Complex_yolo_yolo_v3_tiny.pth --batch_size 8
             
       
### 3.4 Demo Video 
- [x] One side detection demo.

![pred_complex_yolo_v4](https://raw.githubusercontent.com/RichardMinsooGo-ML/Bible_3_32_Pytorch_Complex_Yolo_Yolov4/main/asset/pred_complex_yolo_v4.gif)

## 4. Data Preparation from KITTI

You can see `sampledata` folder in `dataset/kitti/sampledata` directory which can be used for testing this project without downloading KITTI dataset. However, if you want to train the model by yourself and check the mAP in validation set just follow the steps below.

#### Download the [3D KITTI detection dataset](http://www.cvlibs.net/datasets/kitti/eval_object.php?obj_benchmark=3d) 
1. Camera calibration matrices of object data set (16 MB)
2. Training labels of object data set (5 MB)
3. Velodyne point clouds (29 GB)
4. Left color images of object data set (12 GB)

Now you have to manage dataset directory structure. Place your dataset into `dataset` folder. Please make sure that you have the dataset directory structure as follows.

The `train/valid` split of training dataset as well as `sample` and `test` dataset ids are in `dataset/kitti/ImageSets` directory. From training set of 7481 images, 6000 images are used for training and remaining 1481 images are used for validation. The mAP results reported in this project are evaluated into this valid set with custom mAP evaluation script with 0.5 iou for each object class.

## 5. Data Preparation from my google drive

If you download the dataset from `the KITTI Vision Benchmark Suite`, it is difficult to build detect dataset.
So, I recommend you to download dataset from my google drive.

https://drive.google.com/file/d/12Fbtxo2F8Nn9dHDV9UPnovVaCf-Uc89R/view?usp=sharing

### 5.1 Dataset folder structure shall be

```
${ROOT}
├── dataset/
│    ├── classes.names
│    └── kitti/
│          ├── classes_names.txt
│          ├── detect_1/    <-- for detection test
│          │    ├── calib/
│          │    ├── image_2/
│          │    └── velodyne/
│          ├── detect_2/    <-- for detection test
│          │    ├── calib/
│          │    ├── image_2/
│          │    └── velodyne/
│          ├── ImageSets/ 
│          │    ├── detect_1.txt
│          │    ├── detect_2.txt
│          │    ├── sample.txt
│          │    ├── test.txt
│          │    ├── train.txt
│          │    ├── val.txt
│          │    └── valid.txt
│          ├── sampledata/ 
│          │    ├── image_2/
│          │    ├── calib/
│          │    ├── label_2/
│          │    └── velodyne/
│          ├── training/    <-- 7481 train data
│          │    ├── image_2/  <-- for visualization
│          │    ├── calib/
│          │    ├── label_2/
│          │    └── velodyne/
│          └── testing/     <-- 7580 test data
│                ├── image_2/  <-- for visualization
│                ├── calib/
│                └── velodyne/
```

## 6. Train

- [x] `Complex Yolo v4` training from `pretrained weight`.

$ python train.py --model_def config/cfg/complex_yolov4.cfg --pretrained_path checkpoints/Complex_yolo_yolo_v4.pth --save_path checkpoints/Complex_yolo_yolo_v4.pth
       $ python train.py
       
- [x] `Complex Yolo v4` training from `darknet weight`.

$ python train.py --model_def config/cfg/complex_yolov4.cfg --pretrained_path checkpoints/yolov4.weights --save_path checkpoints/Complex_yolo_yolo_v4.pth
    
- [x] `Complex Yolo v4-tiny` training from `pretrained weight`.

$ python train.py --model_def config/cfg/complex_yolov4_tiny.cfg --pretrained_path checkpoints/yolov4-tiny.weights --save_path checkpoints/Complex_yolo_yolo_v4_tiny.pth --batch_size 8 
    
- [x] `Complex Yolo v4-tiny` training from `darknet weight`.

$ python train.py --model_def config/cfg/complex_yolov4_tiny.cfg --pretrained_path checkpoints/Complex_yolo_yolo_v4_tiny.pth --save_path checkpoints/Complex_yolo_yolo_v4_tiny.pth --batch_size 8 
    
## 7. Evaluation

- [x] `Complex Yolo v4` evaluation.

$ python eval_mAP.py 
       $ python eval_mAP.py --model_def config/cfg/complex_yolov4.cfg --pretrained_path checkpoints/Complex_yolo_yolo_v4.pth

```
      100%|██████████████████████████████████████████████████████████████████████████| 354/354 [02:50<00:00,  2.07it/s]
      Computing AP: 100%|███████████████████████████████████████████████████████████████| 3/3 [00:00<00:00, 111.53it/s]

Done computing mAP...

>>>      Class 0 (Car): precision = 0.9115, recall = 0.9753, AP = 0.9688, f1: 0.9423
        >>>      Class 1 (Ped): precision = 0.6961, recall = 0.9306, AP = 0.7848, f1: 0.7964
        >>>      Class 2 (Cyc): precision = 0.8000, recall = 0.9377, AP = 0.9096, f1: 0.8634

mAP: 0.8877
``` 
    
- [x] `Complex Yolo v4 - tiny` evaluation.

$ python eval_mAP.py --model_def config/complex_yolov3_tiny.cfg --pretrained_path checkpoints/Complex_yolo_yolo_v3_tiny.pth --batch_size 8
    
```
      100%|███████████████████████████████████████████████████████████████████████████| 354/354 [01:37<00:00,  3.63it/s]
      Computing AP: 100%|████████████████████████████████████████████████████████████████| 3/3 [00:00<00:00, 107.29it/s]

Done computing mAP...

>>>      Class 0 (Car): precision = 0.6226, recall = 0.9699, AP = 0.7933, f1: 0.7584
        >>>      Class 1 (Ped): precision = 0.1332, recall = 0.3299, AP = 0.0548, f1: 0.1898
        >>>      Class 2 (Cyc): precision = 0.1299, recall = 0.3626, AP = 0.0663, f1: 0.1913

mAP: 0.3048
```

## Credit

1. Complex-YOLO: https://arxiv.org/pdf/1803.06199.pdf

YoloV3 Implementation is borrowed from:
1. https://github.com/eriklindernoren/PyTorch-YOLOv3

Point Cloud Preprocessing is based on:  
1. https://github.com/skyhehe123/VoxelNet-pytorch
2. https://github.com/dongwoohhh/MV3D-Pytorch

## Folder structure

```
${ROOT}
├── detection.py
├── eval_mAP.py
├── README.md 
├── train.py
├── checkpoints/ 
│    ├── Complex_yolo_yolo_v4.pth
│    ├── Complex_yolo_yolo_v4_tiny.pth
│    ├── yolov4.weights
│    └── yolov4-tiny.weights
├── config/ 
│    ├── cfg/
│    │     ├── complex_yolov3.cfg
│    │     ├── complex_yolov3_tiny.cfg
│    │     ├── complex_yolov4.cfg
│    │     └── complex_yolov4_tiny.cfg
│    ├── kitti_config.py
│    └── train_config.py
├── data_process/ 
│    ├── kitti_aug_utils.py
│    ├── kitti_bev_utils.py
│    ├── kitti_dataloader.py
│    ├── kitti_dataset.py
│    └── kitti_utils.py
├── dataset/
│    ├── classes.names
│    └── kitti/
│          ├── classes_names.txt
│          ├── detect_1/    <-- for detection test
│          │    ├── calib/
│          │    ├── image_2/
│          │    └── velodyne/
│          ├── detect_2/    <-- for detection test
│          │    ├── calib/
│          │    ├── image_2/
│          │    └── velodyne/
│          ├── ImageSets/ 
│          │    ├── detect_1.txt
│          │    ├── detect_2.txt
│          │    ├── sample.txt
│          │    ├── test.txt
│          │    ├── train.txt
│          │    ├── val.txt
│          │    └── valid.txt
│          ├── sampledata/ 
│          │    ├── image_2/
│          │    ├── calib/
│          │    ├── label_2/
│          │    └── velodyne/
│          ├── training/    <-- 7481 train data
│          │    ├── image_2/  <-- for visualization
│          │    ├── calib/
│          │    ├── label_2/
│          │    └── velodyne/
│          └── testing/     <-- 7580 test data
│                ├── image_2/  <-- for visualization
│                ├── calib/
│                └── velodyne/
├── logs/ 
├── models/
│    ├── darknet_utils.py
│    ├── darknet2pytorch.py
│    ├── model_utils.py
│    ├── models.py
│    └── yolo_layer.py
└── utils/ 
      ├── evaluation_utils.py
      ├── find_anchors.py
      ├── iou_rotated_boxes_utils.py
      ├── mayavi_viewer.py
      ├── misc.py
      ├── torch_utils.py
      ├── train_utils.py
      └── utils.py

```

Bible_3_32_Pytorch_Complex_Yolo_Yolov4

Bible_3_32_Pytorch_Complex_Yolo_Yolov4 최신버젼 다운로드

오늘의 추천 프로젝트

Was this content helpful?

Recent Feedback

Bible_3_32_Pytorch_Complex_Yolo_Yolov4

Bible_3_32_Pytorch_Complex_Yolo_Yolov4 최신버젼 다운로드

오늘의 추천 프로젝트

Was this content helpful?

Recent Feedback

Download README