Indian Sign Language Interpretor

An AI powered system that can interpret Indian (or any) Sign Language. Just train the model with any Sign Language that you want and it'll be able to interpret it.

How does it work?

1. Two separate datasets are created.
2. Each dataset is divided into two parts, i.e. the training data set and the testing dataset.
3. The training data of each dataset is used to train different Machine Learning models and the accuracy of each model is shown here.
4. The webcam feed is given as input to the Mediapipe API and using it’s returned value, it is decided whether the user is showing gestures using one hand or two hands.
5. The data is sent to the corresponding trained Kernel SVM model which returns the predicted alphabets that are then displayed on the screen.

Flowchart

Accuracy report

Screenshots

Local installation and usage

1. Setup the app locally

  python3 -m venv env

  source env/bin/activate

  pip install -r requirements.txt

2. Collect dataset

python3 scripts/collect_data.py

3. Train the model with the dataset

python3 scripts/train.py

4. Train the model with the dataset

python3 scripts/predict.py