SLRPapers

papers on sign language recognition and related fields

Table of Content

• Papers

  • HMM
  • CNN+RNN
  • 3D CNN
  • GCN
  • Others

• Datasets

• Related Fields

  • Action Recognition
  • Speech Recognition
  • Video Captioning

Papers

HMM

1. Online Early-Late Fusion Based on Adaptive HMM for Sign Language Recognition TOMM2017 paper code
2. Chinese sign language recognition with adaptive HMM ICME2016 paper code
3. Sign language recognition based on adaptive HMMS with data augmentation ICIP2016 paper code
4. Continuous sign language recognition using level building based on fast hidden Markov model Pattern Recognit.Lett.2016 paper code
5. Sign Transition Modeling and a Scalable Solution to Continuous Sign Language Recognition for Real-World Applications TACCESS2016 paper code
6. A Threshold-based HMM-DTW Approach for Continuous Sign Language Recognition ICIMCS2014 paper code
7. Improving Continuous Sign Language Recognition: Speech Recognition Techniques and System Design SLPAT2013 paper code
8. Using Viseme Recognition to Improve a Sign Language Translation System IWSLT2013 paper code
9. Advances in phonetics-based sub-unit modeling for transcription alignment and sign language recognition CVPRW2011 paper code
10. Speech Recognition Techniques for a Sign Language Recognition System INTERSPEECH2007 paper code
11. Large-Vocabulary Continuous Sign Language Recognition Based on Transition-Movement Models TSMC2007 paper code
12. Real-time American sign language recognition using desk and wearable computer based video TPAMI1998 paper code

CNN+RNN

CNN includes 2D CNN and 3D CNN, and RNN includes LSTM and BLSTM.

1. SF-Net: Structured Feature Network for Continuous Sign Language Recognition ArXiv2019 paper code
2. Iterative Alignment Network for Continuous Sign Language CVPR2019 paper code
3. Fingerspelling recognition in the wild with iterative visual attention ICCV2019 paper code
4. Zero-Shot Sign Language Recognition: Can Textual Data Uncover Sign Languages? BMVC2019 paper code
5. Sign Language Recognition Analysis using Multimodal Data DSAA2019 paper code
6. Dynamic Sign Language Recognition Based on Video Sequence With BLSTM-3D Residual Networks ACCESS2019 paper code
7. Attention in Convolutional LSTM for Gesture Recognition NIPS2018 paper code
8. Hierarchical LSTM for Sign Language Translation AAAI2018 paper code
9. Neural Sign Language Translation CVPR2018 paper code
10. SubUNets: End-to-End Hand Shape and Continuous Sign Language Recognition ICCV2017 paper code
11. Recurrent Convolutional Neural Networks for Continuous Sign Language Recognition by Staged Optimization CVPR2017 paper code
12. Learning Spatiotemporal Features Using 3DCNN and Convolutional LSTM for Gesture Recognition ICCV2017 paper code
13. Online Detection and Classification of Dynamic Hand Gestures with Recurrent 3D Convolutional Neural Networks CVPR2016 paper code

3D CNN

1. Dense Temporal Convolution Network for Sign Language Translation IJCAI2019 paper code
2. Thai Sign Language Recognition Using 3D Convolutional Neural Networks ICCCM2019 paper code
3. Video-based sign language recognition without temporal segmentation AAAI2018 paper code
4. Using Convolutional 3D Neural Networks for User-independent continuous gesture recognition ICPR2016 paper code
5. Hand Gesture Recognition with 3D Convolutional Neural Networks CVPRW2015 paper code
6. Sign Language Recognition using 3D convolutional neural networks ICME2015 paper code

GCN

1. Spatial-Temporal Graph Convolutional Networks for Sign Language Recognition ICANN2019 paper code

Others

1. Sign Language Translation with Transformers ArXiv2020 paper code
2. Sign Language Transformers: Joint End-to-end Sign Language Recognition and Translation ArXiv2020 paper code
3. Word-level Deep Sign Language Recognition from Video: A New Large-scale Dataset and Methods Comparison WACV2020 paper code
4. Human-like sign-language learning method using deep learning ETRI2018 paper code
5. Re-Sign: Re-Aligned End-to-End Sequence Modelling with Deep Recurrent CNN-HMMs CVPR2017 paper code
6. Deep Hand: How to Train a CNN on 1 Million Hand Images When Your Data is Continuous and Weakly Labelled CVPR2016 paper code
7. Deep Sign: Hybrid CNN-HMM for Continuous Sign Language Recognition BMVC2016 paper code
8. SIGN LANGUAGE RECOGNITION WITH LONG SHORT-TERM MEMORY ICIP2016 paper code
9. Iterative Reference Driven Metric Learning for Signer Independent Isolated Sign Language Recognition. ECCV2016 paper code
10. Automatic Alignment of HamNoSys Subunits for Continuous Sign Language Recognition LREC2016 paper code
11. Curve Matching from the View of Manifold for Sign Language Recognition ACCV2014 paper code
12. Sign Language Recognition and Translation with Kinect AFGR2013 paper code
13. Large-scale Learning of Sign Language by Watching TV (Using Cooccurrences). BMVC2013 paper code
14. Sign Language Recognition using Sequential Pattern Trees CVPR2012 paper code
15. Sign language recognition using sub-units JMLR2012 paper code
16. American Sign Language word recognition with a sensory glove using artificial neural networks Eng.Appl.Artif.Intell.2011 paper code
17. Learning sign language by watching TV (using weakly aligned subtitles) CVPR2009 paper code

Datasets

Dataset	Language	Classes	Samples	Data Type	Language Level
CSL Dataset I	Chinese	500	125,000	Videos&Depth from Kinect	isolated
CSL Dataset II	Chinese	100	25,000	Videos&Depth from Kinect	continuous
RWTH-PHOENIX-Weather 2014	German	1,081	6,841	Videos	continuous
RWTH-PHOENIX-Weather 2014 T	German	1,066	8,257	Videos	continuous
ASLLVD	American	3,300	9,800	Videos(multiple angles)	isolated
ASLLVD-Skeleton	American	3,300	9,800	Skeleton	isolated
SIGNUM	German	450	33,210	Videos	continuous
DGS Kinect 40	German	40	3,000	Videos(multiple angles)	isolated
DEVISIGN-G	Chinese	36	432	Videos	isolated
DEVISIGN-D	Chinese	500	6,000	Videos	isolated
DEVISIGN-L	Chinese	2000	24,000	Videos	isolated
LSA64	Argentinian	64	3,200	Videos	isolated
GSL isol.	Greek	310	40,785	Videos&Depth from RealSense	isolated
GSL SD	Greek	310	10,290	Videos&Depth from RealSense	continuous
GSL SI	Greek	310	10,290	Videos&Depth from RealSense	continuous
IIITA -ROBITA	Indian	23	605	Videos	isolated
PSL Kinect	Polish	30	300	Videos&Depth from Kinect	isolated
PSL ToF	Polish	84	1,680	Videos&Depth from ToF camera	isolated
BUHMAP-DB	Turkish	8	440	Videos	isolated
LSE-Sign	Spanish	2,400	2,400	Videos	isolated
Purdue RVL-SLLL	American	39	546	Videos	isolated
RWTH-BOSTON-50	American	50	483	Videos(multiple angles)	isolated
RWTH-BOSTON-104	American	104	201	Videos(multiple angles)	continuous
RWTH-BOSTON-400	American	400	843	Videos	continuous
WLASL	American	2,000	21,083	Videos	isolated

Related Fields

Action Recognition

1. DistInit: Learning Video Representations Without a Single Labeled Video ICCV2019 paper code
2. SCSampler: Sampling Salient Clips from Video for Efficient Action Recognition ICCV2019 paper code
3. Reasoning About Human-Object Interactions Through Dual Attention Networks ICCV2019 paper code
4. SlowFast Networks for Video Recognition ICCV2019 paper code
5. Video Classification with Channel-Separated Convolutional Networks ICCV2019 paper code
6. BMN: Boundary-Matching Network for Temporal Action Proposal Generation ICCV2019 paper code
7. DynamoNet: Dynamic Action and Motion Network ICCV2019 paper code
8. Graph Convolutional Networks for Temporal Action Localization ICCV2019 paper code
9. Can Spatiotemporal 3D CNNs Retrace the History of 2D CNNs and ImageNet? CVPR2018 paper code
10. A Closer Look at Spatiotemporal Convolutions for Action Recognition CVPR2018 paper code
11. Spatial Temporal Graph Convolutional Networks for Skeleton-Based Action Recognition AAAI2018 paper code
12. Co-occurrence Feature Learning from Skeleton Data for Action Recognition and Detection with Hierarchical Aggregation IJCAI2018 paper code
13. Quo Vadis, Action Recognition? A New Model and the Kinetics Dataset CVPR2017 paper code
14. Action Recognition using Visual Attention ICLR2016 paper code
15. Action Recognition with Trajectory-Pooled Deep-Convolutional Descriptors CVPR2015 paper code
16. Two-Stream Convolutional Networks for Action Recognition in Videos NIPS2014 paper code

Speech Recognition

1. State-of-the-art Speech Recognition With Sequence-to-Sequence Models ICASSP2018 paper code
2. Lip Reading Sentences in the Wild CVPR2017 paper code
3. Listen, Attend and Spell ICASSP2016 paper code
4. Deep speech 2: End-to-end speech recognition in english and mandarin ICML2016 paper code
5. Attention-Based Models for Speech Recognition NIPS2015 paper code
6. Convolutional Neural Networks for Speech Recognition TASLP2014 paper code
7. Hybrid speech recognition with Deep Bidirectional LSTM ASRU2013 paper code
8. New types of deep neural network learning for speech recognition and related applications: an overview ICASSP2013 paper code
9. Speech Recognition with Deep Recurrent Neural Networks ICASSP2013 paper code

Video Captioning

1. Video Description A Survey of Methods, Datasets and Evaluation Metrics ACM Computing Surveys2019 paper code
2. Spatio-Temporal Dynamics and Semantic Attribute Enriched Visual Encoding for Video Captioning CVPR2019 paper code
3. Reconstruction Network for Video Captioning CVPR2018 paper code
4. Multimodal Memory Modelling for Video Captioning CVPR2018 paper code
5. Interpretable Video Captioning via Trajectory Structured Localization CVPR2018 paper code
6. Video Captioning with Transferred Semantic Attributes CVPR2017 paper code
7. Video Paragraph Captioning Using Hierarchical Recurrent Neural Networks CVPR2016 paper code
8. Jointly Modeling Embedding and Translation to Bridge Video and Language CVPR2016 paper code
9. Describing Videos by Exploiting Temporal Structure ICCV2015 paper code