STM Journals Peer-reviewed research from Consortium e-Learning Network

Journal of Image Processing & Pattern Recognition Progress

Sign Language Recognition Using Deep Learning

  1. Subhashini R.
  2. Sushmita Manna
  3. Pratik Sarkar
  4. Shashank A. M.
  5. M.V. Keerthana

Abstract

People with hearing/speech disabilities use sign language to communicate their thoughts and feelings, but non-disabled people often find it hard to comprehend these hand gestures since they do not know sign language. This project aims to create a system that uses MediaPipe, LSTM and Keras for sign language recognition. The webcam will capture video footage of people performing sign language gestures, then MediaPipe will extract and identify the hand landmarks and motion from the video. After that, LSTM, a sequence modelling technique, is used to process the extracted features. Lastly, a deep learning LSTM model implemented in Keras is trained to recognize the different sign language gestures. This system can potentially aid those with hearing impairments in communicating with others quickly and easily.

Keywords

Support