Gloss-Based ASL Translator

Introduction

This project translates English sentences into American Sign Language (ASL) glosses and generates corresponding GIFs of the ASL signs.

Prerequisites

Before running this project, ensure you have followed the instructions of Gloss-Based Pipeline for Spoken to Signed Language Translation. Some of the commands from the pipeline can now be automated using the provided scripts.

Usage

Translate English to ASL Gloss

The text_to_gloss.py script utilizes the GPT-3.5 Turbo model to translate English sentences into ASL glosses.

To run the script, use the following command:

python text_to_gloss.py "put your english sentence here"

Generate GIF from English Sentence

The pose_gif.py script automates the generation of GIFs from English sentences.

Dataset

We use the WLASL dataset, which contains the 2000 most common sign words, as specified in selected.json. For more information on the sign videos, please refer to the WLASL Dataset on Kaggle.