Signformer

KO | EN

gitlite — search

#hacktoberfest #ai #golang #rust #deep-learning #linux #macos #awesome #cli #kubernetes #vue #security #ios #openai

(★ 21)

Signformer is all you need: Towards Edge AI for Sign Language

Signformer 최신버젼 다운로드

최종 버전 다운로드 (.zip)

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

<h1 align="center"> Official: Signformer is all you need: Towards Edge AI for Sign Language
</h1>

[![arXiv](https://img.shields.io/badge/arXiv%20paper-2410.06940-b31b1b.svg)](https://arxiv.org/abs/2411.12901v1)&nbsp;
[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/signformer-is-all-you-need-towards-edge-ai-1/gloss-free-sign-language-translation-on)](https://paperswithcode.com/sota/gloss-free-sign-language-translation-on?p=signformer-is-all-you-need-towards-edge-ai-1)

![scheme](https://raw.githubusercontent.com/EtaEnding/Signformer/main/radar.jpg)
## Outline

🚀 In this work, we present the World's 1st LLM-comparable "Small Language Model" as a from-scratch model for Sign Language Translation

🚀 Signformer-Full achieves new 2nd place in Gloss-Free sign language translation leaderboard of 2024

🥳 Signformer is the least parametric model across all scoreboards, Signformer-Feather of 0.57 Million achieves TOP5

## Dataset and Feature Files Preparation
### Phoenix14T:
    wget "http://cihancamgoz.com/files/cvpr2020/phoenix14t.pami0.train"
    wget "http://cihancamgoz.com/files/cvpr2020/phoenix14t.pami0.dev"
    wget "http://cihancamgoz.com/files/cvpr2020/phoenix14t.pami0.test"

### Config
    train: [PATH]/phoenix14t.pami0.train
    dev: [PATH]/phoenix14t.pami0.dev
    test: [PATH]/phoenix14t.pami0.test

* Install required packages using the `requirements.txt` file.
    `pip install -r requirements.txt`

* Remember after downloading sophiag, modify their __init__.py by removing the last:
`from sophia.sophia import SophiaG`

## Usage
### Train
  `python -m main train [CONFIG PATH]` 
### Test
  `python -m main test [CONFIG PATH] --ckpt [CHECKPOINT PATH]`

## BIBTEX
```bibtex
@article{eta2024signformer,
      title={Signformer is all you need: Towards Edge AI for Sign Language}, 
      author={Eta Yang},
      year={2024},
      journal={arXiv preprint arXiv:2411.12901}, 
}
```

Signformer

Signformer 최신버젼 다운로드

오늘의 추천 프로젝트

Was this content helpful?

Recent Feedback

Signformer

Signformer 최신버젼 다운로드

오늘의 추천 프로젝트

Was this content helpful?

Recent Feedback

Download README