Eye-Gaze_and_Blink-detection-using-Neural-Network

KO | EN

gitlite — search

#golang #go #android #machine-learning #rust #deep-learning #macos #awesome #cli #awesome-list #pytorch #ios #openai #open-source

Eye-Gaze_and_Blink-detection-using-Neural-Network

(★ 24)

No description available.

Eye-Gaze_and_Blink-detection-using-Neural-Network Latest Version Download

Download Latest Version (.zip)

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

[![forthebadge](https://forthebadge.com/images/badges/check-it-out.svg)](https://forthebadge.com) 
[![forthebadge](https://forthebadge.com/images/badges/built-with-love.svg)](https://forthebadge.com) 
[![forthebadge](https://forthebadge.com/images/badges/made-with-python.svg)](https://forthebadge.com)

# Realtime GAZE & BLINK Detection. 
In this project, we use Neural Networks for the detection of Eyeblink and Eyegaze concurrently. For that, we use 2 pre-trained Neural Networks. One network is used for the detection of eye-blink and another is used for the detection of 'Left', 'Right', and 'Center' gaze of the eye. For the detection of the eye, we use dlib library.

### A quick demo can be found [HERE](https://youtu.be/YG0AjafnwXs)

# How it works
For each frame in a second:
1. Using Dlib frontal face detector all of the 68 facial landmarks co-ordinates are detected and the co-ordinates are converted into numpy array.
2. Pass 36,37,38,39,40,41th index of array to the ```crop_eye()```
function as it contains co-ordinates of respective landmarks and function returns cropped image for left eye.
3. Similarly pass 42,43,44,45,46,47 index to get cropped image of right eye.
 
<img src="MEDIA/crop.png">
4. Pass the cropped eye images through the model for the detection of the eye's state. 
5. If the opening of the left eye and opening of the right eye is less than 10% then it is registered as blink and gaze is determined through the index of highest value in the array returned by the model.

6. Show all the status and results in the final window.

![Alt Text](https://raw.githubusercontent.com/R4j4n/Eye-Gaze_and_Blink-detection-using-Neural-Network/master/MEDIA/FACE.gif)

# Dependencies
This code was developed on: 
```
python == 3.7.0
opencv-python == 4.3.0.36
tensorflow==2.3.0
dlib == 19.20.0
imutils==0.5.3
```
I was able to achieve more the 20 fps on GTX 1050 and more than 15 fps on i5-7300HQ.

![visitors](https://visitor-badge.glitch.me/badge?page_id=page.https://github.com/R4j4n/Eye-Gaze_and_Blink-detection-using-Neural-Network.)

Eye-Gaze_and_Blink-detection-using-Neural-Network

Eye-Gaze_and_Blink-detection-using-Neural-Network Latest Version Download

Today's picks

Was this content helpful?

Recent Feedback

Eye-Gaze_and_Blink-detection-using-Neural-Network

Eye-Gaze_and_Blink-detection-using-Neural-Network Latest Version Download

Today's picks

Was this content helpful?

Recent Feedback

Download README