Sign-Language-Recognition-Using-Mediapipe-and-React

KO | EN

gitlite — search

#typescript #ai-agents #ai #dsh-plugin #deepseek-harness #open-source #cli #claude-code #codex #developer-tools #react #windows

Sign-Language-Recognition-Using-Mediapipe-and-React

★ 56 Open GitHub ↗

A Sign Language Learning Platform where who know sign language can come and practice Sign Language and also people who don't know can learn through this

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

# **Sign Language Recognition for Deaf and Dumb**

![Banner](https://raw.githubusercontent.com/shubhammore1251/Sign-Language-Recognition-Using-Mediapipe-and-React/main/public/banner.png)

- Our sign language recognition project involved creating a custom dataset, preprocessing images, training a model, integrating with React, and hosting with Firebase.

- The result is a real-time sign language recognition application that recognizes a variety of sign language gestures.

- Our Model is trained for 26 alphabets and 16 words of ASL and which are commonly used in general communication.

## Features

- Real-Time Recognition

- Easy-to-Use Interface

- Adaptive Learning

- High Accuracy

- Real Time User Progress Data

## Tech Stack

**Front-end:**

- React
- Redux

**Back-end:**

- Firebase (for hosting, authentication, and storage)

**Machine Learning Framework:**

- MediaPipe

**NPM Packages:**

- @mediapipe/drawing_utils
- @mediapipe/hands
- @mediapipe/tasks-vision
- @redux-devtools/extension
- chart.js
- firebase
- js-cookie
- react-chartjs-2
- react-icons
- react-redux
- react-router-dom
- react-toastify
- react-webcam
- redux
- redux-thunk
- uuid

## Team Members

- So this project is a group project done in collaboration with the members mentioned below.

## Project Details

- **Our Project Report:** [Report.pdf](https://drive.google.com/file/d/1A_gBXKfEjNwHZbtnanu82jgLrbtblQ38/view?usp=sharing)

- **Published Paper:** [Paper.pdf](https://drive.google.com/file/d/1KEP_kAessP08Zo8zHsG9IqlP4Yuj9SO0/view?usp=sharing)

- **Dataset Link:** [Sign_Dataset](https://drive.google.com/drive/folders/1LUUknqqRNHAmIZYrcgo-4n2HrM37uFa3?usp=share_link)

- **Gesture Recogition Documentation:** [Mediapipe](https://developers.google.com/mediapipe/solutions/vision/gesture_recognizer)

- **The Model Training File is located in root folder**

## Steps to set up the project

- **Check this document for project setup:** [SetUpDoc.docx](https://docs.google.com/document/d/1siwZjc0LJQgKTn__vtzs8tMfr9OElrsThmqmRJc9dHE/edit?usp=sharing)

## Authors

- [@shubham-more](https://github.com/shubhammore1251/)
- [@sameer-metkar](https://github.com/sameermetkar/)
- [@omkar-mandavkar](https://github.com/omkarmandavkar/)
- [@durgesh-kolhe](https://github.com/Durgesh240)

## Acknowledgements

- [React](https://react.dev/)
- [mediapipe](https://developers.google.com/mediapipe)
- [Firebase](https://firebase.google.com/)
- [NPM](https://www.npmjs.com/)

## Screenshots

![Hello Image](https://raw.githubusercontent.com/shubhammore1251/Sign-Language-Recognition-Using-Mediapipe-and-React/main/public/screenshots/Hello.jpg)

![Meet Image](https://raw.githubusercontent.com/shubhammore1251/Sign-Language-Recognition-Using-Mediapipe-and-React/main/public/screenshots/Meet.jpg)

![Deaf Image](https://raw.githubusercontent.com/shubhammore1251/Sign-Language-Recognition-Using-Mediapipe-and-React/main/public/screenshots/Deaf.jpg)

![Bye Image](https://raw.githubusercontent.com/shubhammore1251/Sign-Language-Recognition-Using-Mediapipe-and-React/main/public/screenshots/Bye.jpg)

![D Image](https://raw.githubusercontent.com/shubhammore1251/Sign-Language-Recognition-Using-Mediapipe-and-React/main/public/screenshots/D.jpg)

![Dashboard Image](https://raw.githubusercontent.com/shubhammore1251/Sign-Language-Recognition-Using-Mediapipe-and-React/main/public/screenshots/dasboard.jpeg)

## Support

For support, contact

- email: shubhamp1251@gmail.com
- LinkedIn: [Shubham More](https://www.linkedin.com/in/shubham-more1251/)

Sign-Language-Recognition-Using-Mediapipe-and-React

Explore Similar Repositories

Was this content helpful?

Recent Feedback

Download README