BioSensor-Grouplevel-Emotion-Recognition

KO | EN

gitlite — search

#python #java #python3 #arduino #golang #machine-learning #rust #html #flask #javascript #seismology #nodejs

BioSensor-Grouplevel-Emotion-Recognition

★ 12 Open GitHub ↗

No description available.

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

========================================================================

# BioSensor-Grouplevel-Emotion-Recognition

========================================================================

![image](https://user-images.githubusercontent.com/26008298/132282618-0440b99c-af47-4e75-9c45-2253ba94f59d.png)

========================================================================

========================================================================

## Introduction 
Use bioSensors for group-level emotion recognition

## Used device
### [Beacon]
for detecting people in the same room 
<img src="https://user-images.githubusercontent.com/26008298/132282742-d21cea84-a607-4038-b9f2-69ddf8d408b0.png" width="160">

### [Muse Mind Monitor]
Accelerometer ,Gyrometer
brain wave(EEG)->Attention,Mediation 
<img src="https://user-images.githubusercontent.com/26008298/132282807-9775c223-0d4b-48eb-9d75-a308ffea37d1.png" width="160">
### [Polar H10]
heart rate(LF/HF) 
<img src="https://user-images.githubusercontent.com/26008298/132282872-a2a6b140-0707-4bd1-9bda-5e4b4e778d64.png" width="150">

### [Sensor]
BME280 sensor based on raspberry pi4,to get environment data(temperature,humidity,pressure) 
<img src="https://user-images.githubusercontent.com/26008298/132282977-fd54ee04-b335-455b-bf5e-32b5e313fb84.png" width="170">
![image](https://user-images.githubusercontent.com/26008298/132282884-ba2faa0c-b897-4cab-b360-0220d821504e.png)

### [VR device]
for emotion Arousal 
oculus quest2 
<img src="https://user-images.githubusercontent.com/26008298/132283403-9d1f2ed8-8238-4ca3-aedc-af52e3fc1ef1.png" width="160">

## Code
[polar H10]use python‘s bleak library to detect polar h10，get its Mac address,and record ECG or Accelerometer.

[PI_SENSOR]BME280 sensor based on raspberry pi4,to get environment data(temperature,humidity,pressure).

[ECG_EEG_PROCESS]EEG and ECG data process program. ECG->lfhf,pnn50... EEG->Attention,Meditation... 
process to 60s data,one second one row

========================================================================
## Data Collection
Based on VR virtual world to arose people's emotion 
meanwhile,sensors will collect collaborators' bio-data and save to csv

## Data Processing
Pre-process data,delete no-use parameter and create new parameter 
for example: 
ECG->LFHF,pnn59...
EEG->attetion,meditation...
 
## Group-level utterance atmosphere
1.talk on a certain topic 
2.collaborate with each other in VR

## Futrure
1.use gaze in VR to recognize interest and attention of dialogue with avater/players  
2.consider generlizing model for individual differences

## Machine Learning
SVM
KNN
CNN-SVM
LSTM
Transformer
...

========================================================================

BioSensor-Grouplevel-Emotion-Recognition

Explore Similar Repositories

Was this content helpful?

Recent Feedback

Download README