Skip to content

sign-language-processing/signwriting-animation

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

73 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

SignWriting Animation

This project aims to automatically animate SignWriting into skeletal poses.

This is the reverse of signwriting-transcription.

We would ideally like to have to implementations:

  • diffusion - a diffusion-based method to animate SignWriting
  • translation - a translation-based method to animate SignWriting using the sign-vq model.

Usage

pip install git+https://github.com/sign-language-processing/signwriting-animation

To animate a SignWriting FSW sequence into a .pose file:

signwriting_to_pose --signwriting="M525x535S2e748483x510S10011501x466S2e704510x500S10019476x475" --pose="example.pose"

When generating full sentences, it is recommended to post-process the .pose files using fluent-pose-synthesis.

Data

The full data is available in sign/data. These examples are taken from the DSGS Vokabeltrainer:

00004 00007 00015
SignWriting
Video

About

Automatic animation from SignWriting to skeletal pose animation

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Contributors 3

  •  
  •  
  •