resnet-cifar10

KO | EN

gitlite — search

#python #java #python3 #arduino #golang #machine-learning #rust #html #flask #javascript #seismology #nodejs

★ 20 Open GitHub ↗

ResNet for Cifar10

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

# Residual Networks Test
============================

Original Paper: "Deep Residual Learning for Image Recognition"(http://arxiv.org/abs/1512.03385) and "Identity Mappings in Deep Residual Networks"(http://arxiv.org/abs/1603.05027)

By [Kaiming He](http://research.microsoft.com/en-us/um/people/kahe/), [Xiangyu Zhang](https://scholar.google.com/citations?user=yuB-cfoAAAAJ&hl=en), [Shaoqing Ren](http://home.ustc.edu.cn/~sqren/), [Jian Sun](http://research.microsoft.com/en-us/people/jiansun/).

Microsoft Research Asia (MSRA).

## Introduction
This repository contains the models for testing resnet networks on cifar-10

- 50000 samples for training, batch size 250, 200 iterations for 1 epoch, 64000 iterations in total
  - 10000 samples for testing, test batch size 100 and 100 test iterations reduce learning rate after 32000 iters by factor of 10 then another factor of 10 after anohter 16000 iters

## Notes
### Data augmentation applied (please find the data augmentation fork in https://github.com/twtygqyy/caffe-augmentation): 
```
max_color_shift = 5

contrast_variation = 0.8 ~ 1.2

max_brightness_shift = 5

zero-padding with 2 pixels for each side and crop with 32x32
```
Please download the training images with zero-padding here [Google Drive](https://drive.google.com/file/d/0B5i4atpKg9EcZWRCOVFEUHJkSWM/view?usp=sharing)

## Result

- Resnet-20: best model achieved 0.927 accuracy on test datasets for single round and single crop

- Resnet-32: best model achieved 0.9364 accuracy on test datasets for single round and single crop

- Resnet-56: best model achieved 0.9418 accuracy on test datasets for single round and single crop

- Resnet-56: 0.944 accuracy on test datasets with LSUV initializer (https://github.com/ducha-aiki/LSUVinit/blob/master/tools/extra/lsuv_init.py/)

- WRN-28-10 ["Wide Residual Networks" (http://arxiv.org/abs/1605.07146)]: best model achieved 0.958 accuracy on test datasets for single round and single crop

resnet-cifar10

Explore Similar Repositories

Was this content helpful?

Recent Feedback

Download README