SyDES

KO | EN

gitlite — search

#react #ai #go #android #rust #deep-learning #linux #docker #awesome #kubernetes #vue #security #mcp #ios

(★ 12)

Official PyTorch implementation of the paper "Beyond Words: Enhancing Desire, Emotion, and Sentiment Recognition with Non-Verbal Cues"

SyDES 최신버젼 다운로드

최종 버전 다운로드 (.zip)

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

# SyDES

This is the official repository for our [SyDES]() model.

## Illustration

![Arch_figure](https://raw.githubusercontent.com/especiallyW/SyDES/main/fig/model.png)

## Attention Map with Modal Perception

![attns](https://raw.githubusercontent.com/especiallyW/SyDES/main/fig/attns.png)

## Data Preparation

1. Download the [MSED](https://github.com/MSEDdataset/MSED) and save it to the `playground/data` directory.
2. Run the preparation script:
   ```bash
   python playground/prepare_msed.py
   ```

## Evaluation

### Pre-training
```bash
python main.py --config configs/pretrain_msed.yaml --mode train
```

### Fine-tuning
For sentiment analysis:
```bash
python main.py --config configs/finetune_msed_sentiment.yaml --mode train --model_path [pretrained_model_path]
```

For emotion recognition:
```bash
python main.py --config configs/finetune_msed_emotion.yaml --mode train --model_path [pretrained_model_path]
```

For desire understanding:
```bash
python main.py --config configs/finetune_msed_desire.yaml --mode train --model_path [pretrained_model_path]
```

## Citation

If you use our work, please cite.

## Acknowledgments

Our implementation uses code from the following repositories:
- https://github.com/facebookresearch/mae
- https://github.com/mlfoundations/open_clip
- https://github.com/huggingface/huggingface_hub

We appreciate their contributions to the community.

## Contact

For any questions, please email us.

SyDES

SyDES 최신버젼 다운로드

오늘의 추천 프로젝트

Was this content helpful?

Recent Feedback

SyDES

SyDES 최신버젼 다운로드

오늘의 추천 프로젝트

Was this content helpful?

Recent Feedback

Download README