AI-Driver-CNN-DeepLearning-PyTorch

KO | EN

gitlite — search

#javascript #python #hacktoberfest #react #ai #typescript #llm #go #golang #android #machine-learning #rust #deep-learning #linux

AI-Driver-CNN-DeepLearning-PyTorch

(★ 21)

AI-driving Vehicle Simulation using Machine Learning(CNN) | PyTorch implementation of "End to End Learning for Self-Driving Cars" (arXiv:1604.07316)

AI-Driver-CNN-DeepLearning-PyTorch 최신버젼 다운로드

최종 버전 다운로드 (.zip)

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

# Self-Driving Vehicle Simulation using Deep Learning(CNN)

This repo contains code for predicting steering angles of self driving car. The inspiraion is taken from Udacity Self driving car module as well End to End Learning for Self-Driving Cars module from NVIDIA

The End to End Learning for Self-Driving Cars research paper can be found at (https://arxiv.org/abs/1604.07316) This repository is built on PyTorch library.

## Abstract

Data contains 3 camera(left, centre, right) output images as inputs along with steering angle as labels. Task is a supervised machine learning problem where objective is to predict steering angle based on camera inputs.

Here, I have used CNN based architecture, which comprises of 5 Convolutions layers followed by a fully connected deep neural network with 3 hidden layers for predicting steering angles. Loss function used here is Mean Squared Error.

## Prerequisites

We will use Python as the primary programming language and PyTorch as the Deep Learning framework. Other resources / software / library could be found as follows.

1. Self-driving car simulator developed by [Udacity](https://www.udacity.com/course/self-driving-car-engineer-nanodegree--nd013) with Unity. Download [here](https://github.com/udacity/self-driving-car-sim)

2. Install PyTorch environment (latest version the best) in your local machine.

3. Log in Google Colab (if you do not have GPU and would love to utilize the power of GPU, please try this and be sure to enable GPU as accelerator)

## Usage

```
git clone https://github.com/milsun/AI-Driver-CNN-DeepLearning-PyTorch.git
python3 drive.py model/model.pth  
```

## Dataset

The Udacity provided dataset works well but it is not enough to get the car running in difficult terrain (like the second track in Udacity simulator). To gather the data from track 2, we would first need to create a folder in our project directory. Let’s call this folder "data". Now, start the simulator. Select the second track from the menu and go to the training mode option.

![Menu](https://raw.githubusercontent.com/milsun/AI-Driver-CNN-DeepLearning-PyTorch/master/images/menu.png)

Click "RECORD" button on the right corner and select a directory as the folder to save your training image and driving log information.

![Record](https://raw.githubusercontent.com/milsun/AI-Driver-CNN-DeepLearning-PyTorch/master/images/recording.png)

![SelectDir](https://raw.githubusercontent.com/milsun/AI-Driver-CNN-DeepLearning-PyTorch/master/images/select_dir.png)

Click "RECORD" again and move your car slowly and carefully. After you have completed recording your move, the training data will be stored in the folder you selected. Here I suggest you record at least 3 laps of the race. Please try best to stay at the center of the road. Also, record laps in reverse direction as it will give more data and thus would help avoid overfitting.

### Data

|         Left        |         Center        |         Right        |
|:-------------------:|:---------------------:|:--------------------:|
| ![](https://raw.githubusercontent.com/milsun/AI-Driver-CNN-DeepLearning-PyTorch/master/images/left.jpg) | ![](https://raw.githubusercontent.com/milsun/AI-Driver-CNN-DeepLearning-PyTorch/master/images/center.jpg) | ![](https://raw.githubusercontent.com/milsun/AI-Driver-CNN-DeepLearning-PyTorch/master/images/right.jpg) |

* /IMG/ - recorded images from cneter, left and right cameras.
* driving_log.csv - saved the image information and associated information like steer angle, current speed, throttle and brake.

## Training Network

Below fig shows architecture used in the project.

![Network](https://raw.githubusercontent.com/milsun/AI-Driver-CNN-DeepLearning-PyTorch/master/images/training.png)

## Results

### Training loss vs Validation loss

<div align="center">
  <img src="https://raw.githubusercontent.com/milsun/AI-Driver-CNN-DeepLearning-PyTorch/master/images/loss.png" width="50%">
  <p>Training loss vs Validation loss (generalized)</p>
</div>

## Demo
[![Watch the video](http://i3.ytimg.com/vi/7VmIJRY-JtY/maxresdefault.jpg)](https://www.youtube.com/watch?v=7VmIJRY-JtY)

AI-Driver-CNN-DeepLearning-PyTorch

AI-Driver-CNN-DeepLearning-PyTorch 최신버젼 다운로드

오늘의 추천 프로젝트

Was this content helpful?

Recent Feedback

AI-Driver-CNN-DeepLearning-PyTorch

AI-Driver-CNN-DeepLearning-PyTorch 최신버젼 다운로드

오늘의 추천 프로젝트

Was this content helpful?

Recent Feedback

Download README