Color-based-Emotional-Analysis-using-Machine-Learning

KO | EN

gitlite — search

#javascript #ai #llm #machine-learning #rust #linux #windows #awesome #cli #security #ios #mcp #openai #open-source

Color-based-Emotional-Analysis-using-Machine-Learning

(★ 8)

Code for papers(JDSC, CSCI 2020)

Color-based-Emotional-Analysis-using-Machine-Learning Latest Version Download

Download Latest Version (.zip)

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

# Color-based Emotional Analysis using Machine Learning

Code for Papers
- T. Lee, **N. Lee**, S. Seo, D. Kang, "A Study on the Prediction of Emotion from Image by Time-flow using Color Analysis", CSCI 2020, Las Vegas, United States ([Paper](https://ieeexplore.ieee.org/document/9458016))
- **N. Lee**, T. Lee, "The Study for Emotion Analysis from Images depend on Machine Learning Models", Journal of Digital Contents Society ([Paper](http://journal.dcs.or.kr/xml/30273/30273.pdf))

## Application
### Example 01 : In Timelaps Video
The graph visualizes how the sensibilities of 'happy', 'press', 'angry' and 'comfort' change over time.

![](https://raw.githubusercontent.com/NahyukLEE/Color-based-Emotional-Analysis-using-Machine-Learning/master/imgs/application.png)
### Example 02 : In 1 minute Movie Scene
The graph shows that the color contrast between green and red shows that the scene effectively reveals emotional changes.

![](https://raw.githubusercontent.com/NahyukLEE/Color-based-Emotional-Analysis-using-Machine-Learning/master/imgs/application2.png)

## System Flow
The system flow of our project is as follows.

### a) K-means Clustering for color
Groups have been formed to ensure that the color spectrum is well representative of the color information of a single image, while maintaining the degree to which the operation speed is not too slow. Thg color spectrum data clustered into five groups were used to analyze images and to use them in the course of future machine learning.

![](https://raw.githubusercontent.com/NahyukLEE/Color-based-Emotional-Analysis-using-Machine-Learning/master/imgs/spectrum.jpg)

### b) Extracting emotion
Through k-mean clustering, five color information clustered and its ratio determined the RGB color information of the image. The color difference was calculated using Euclidean distance. The harmonization of colors is generally indicated by the coloration relationship, and we calculated and measured the relationship with the adjacent color.

| **Type** | **Date** | **R_avg** | **G_avg** | **B_avg** | **Color_Var** | **V_Var** | **S_Var** | **Label** |
|:--------:|:--------:|:--------:|:--------:|:--------:| :--------:|:--------:|:--------:|:--------:|
| ![](https://raw.githubusercontent.com/NahyukLEE/Color-based-Emotional-Analysis-using-Machine-Learning/master/imgs/011.jpg) | ![](https://raw.githubusercontent.com/NahyukLEE/Color-based-Emotional-Analysis-using-Machine-Learning/master/imgs/012.jpg) | 41.2 | 6.3 | 4.1 | 8428.3 | 24893.5 | 0.4 | **2 (Passion)** |
| ![](https://raw.githubusercontent.com/NahyukLEE/Color-based-Emotional-Analysis-using-Machine-Learning/master/imgs/021.jpg) | ![](https://raw.githubusercontent.com/NahyukLEE/Color-based-Emotional-Analysis-using-Machine-Learning/master/imgs/022.jpg) | 9.9 | 9.9 | 9.9 | 2311.1 | 3618.5 | 0.0 | **1 (Depress)** |
| ![](https://raw.githubusercontent.com/NahyukLEE/Color-based-Emotional-Analysis-using-Machine-Learning/master/imgs/031.jpg) | ![](https://raw.githubusercontent.com/NahyukLEE/Color-based-Emotional-Analysis-using-Machine-Learning/master/imgs/032.jpg) | 41.0 | 33.2 | 34.7 | 10127.2 | 17885.0 | 0.1 | **0 (Happy)** | 
| ![](https://raw.githubusercontent.com/NahyukLEE/Color-based-Emotional-Analysis-using-Machine-Learning/master/imgs/041.jpg) | ![](https://raw.githubusercontent.com/NahyukLEE/Color-based-Emotional-Analysis-using-Machine-Learning/master/imgs/042.jpg) | 34.7 | 40.0 | 45.2 | 5702.1 | 30707.2 | 0.1 | **3 (Comport)** |

The feature information we used for mechanical learning is as shown in Table. The spectrum was extracted for a given image and the characteristics and labels for each were matched. The labels are numbered 0, 1, 2, 3 and each means happy, depress, passion, and comport.

### c) Machine Learning
Emotional classification models were produced through the representative classification learning algorithms, Decision Tree, Random Forest, and Logistic Regression. The line was optimized by tuning the hyper parameter of the classification model.

## Code

### Install dependencies
We recommend you to use Anaconda that already including mandotory packages. 
```
python -m pip install -r requirements.txt
```
Our code was tested with Python 3.6.

### Data Preprocessing
Before you extract color spectrum from Video, you should split it by the command below,
```
python split_video.py
```

Then, you can extract color spectrums from frames, and calculate features for your training.
```
python video_analysis.py
```

### Training model & Check Result
To train  classification models with preprocessed dataset, you can handle IPython notebook with 'training.ipynb'.

## References
- O. Icoglu, B.Gunsel, B. and S. Sariel, “Classification and indexing of paintings based on art movements”. Signal Processing Conference 12th European, 2004
- J. Zujovic, L. Gandy, S. Friedman, B. Pardo, and T.N. Pappas, “Classifying paintings by artistic genre: An analysis of features and classifiers.”, Multimedia Signal Processing IEEE International Workshop on 2009, 2009.
- T. Lee, H. Lim, D. Kim, S. Hwang, and K. Yoon, “System for Matching Paintings with Music based on Emotion”s, In Technical Brief of the Siggraph Asia, 2016.
- H.G. Chambers,“Clothing selection “, Prentice-Hall, 1978
- N. Kolenda, The Psychology of Color. Kolenda Entertainment LLC, 2016.
- S. Kobayashi. “The aim and method of the Color Image Scale”, Color Research and Application,6: 93–107, 1981.
- D. Patil, “Coloring Consumer's Psychology Using Different Shades the Role of Perception of Colors by Consumersin Consumer Decision Making Process:a Micro Study of Select Departmental Stores in Mumbai City,India,” Journal of Business & Retail Management Research,7(1),60-73, 2012.

Color-based-Emotional-Analysis-using-Machine-Learning

Color-based-Emotional-Analysis-using-Machine-Learning Latest Version Download

Today's picks

Was this content helpful?

Recent Feedback

Color-based-Emotional-Analysis-using-Machine-Learning

Color-based-Emotional-Analysis-using-Machine-Learning Latest Version Download

Today's picks

Was this content helpful?

Recent Feedback

Download README