Skip to content

nsc2022-24p23w0016 Handslate is an Android application that translates sign language into text using AI and Machine Learning. Developed with TensorFlow and Teachable Machine, it helps users learn and understand sign language gestures by capturing hand movements through a device's camera and converting them into corresponding letters.

License

PoomGamerE/nsc2022-24p23w0016

Repository files navigation

Requirements

  • Android Studio 3.2 (installed on a Linux, Mac or Windows machine)

  • Android device in developer mode with USB debugging enabled

  • USB cable (to connect Android device to your computer)

Build and run

Step 1. Clone the source code

Clone the TensorFlow examples GitHub repository to your computer to get the demo application.

git clone https://github.com/PoomGamerE/nsc2022-24p23w0016.git

Open the TensorFlow source code in Android Studio. To do this, open Android Studio and select Open an existing project, setting the folder to nsc2022-24p23w0016

Step 2. Build the Android Studio project

Select Build -> Make Project and check that the project builds successfully. You will need Android SDK configured in the settings. You'll need at least SDK version 23. The build.gradle file will prompt you to download any missing libraries.

The file download.gradle directs gradle to download the two models used in the example, placing them into assets.

Note:

`build.gradle` is configured to use TensorFlow Lite's nightly build.

If you see a build error related to compatibility with Tensorflow Lite's Java API (for example, `method X is undefined for type Interpreter`), there has likely been a backwards compatible change to the API. You will need to run `git pull` in the examples repo to obtain a version that is compatible with the nightly build.

Step 3. Install and run the app

Connect the Android device to the computer and be sure to approve any ADB permission prompts that appear on your phone. Select Run -> Run app. Select the deployment target in the connected devices to the device on which the app will be installed. This will install the app on the device.

To test the app, open the app called Handslate on your device. When you run the app the first time, the app will request permission to access the camera. Re-installing the app may require you to uninstall the previous installations.

Assets folder

Do not delete the assets folder content. If you explicitly deleted the files, choose Build -> Rebuild to re-download the deleted model files into the assets folder.

About

nsc2022-24p23w0016 Handslate is an Android application that translates sign language into text using AI and Machine Learning. Developed with TensorFlow and Teachable Machine, it helps users learn and understand sign language gestures by capturing hand movements through a device's camera and converting them into corresponding letters.

Resources

License

Stars

Watchers

Forks

Packages

No packages published

Languages