STM Journals Peer-reviewed research from Consortium e-Learning Network

Journal of Electronic Design Technology Original Research

Real-Time Gesture Recognition with Convolutional Neural Networks

  1. Anjali Singh Rewa Engineering College,
  2. Badal Singh Rewa Engineering College,
  3. Deepa Shukla Rewa Engineering College,
  4. Kirti Pandey Rewa Engineering College,
  5. A.K. Dohare Rewa Engineering College,
  6. M. S. Mandloi Rewa Engineering College,

Abstract

Sign language detection plays a pivotal role in bridging communication barriers for the deaf and hard of hearing community. An extensive investigation on the use of convolutional neural networks (CNNs) for sign language recognition is presented in this article. Leveraging the power of deep learning, our research aims to develop an accurate and efficient system capable of recognizing and classifying sign language gestures in real-time. The report begins with an overview of the significance of sign language detection in fostering inclusivity and accessibility. The approach is then covered in detail, including the architecture of the CNN model that was used, methods for gathering datasets and preparing them, and the training procedure. Results obtained from experimentation are presented, showcasing the effectiveness of the CNN model in accurately detecting a diverse range of sign language gestures. In conclusion, this report highlights the promising capabilities of CNN-based sign language detection systems, emphasizing their potential to enhance accessibility and communication for the deaf and hard of hearing community.

Keywords

References (11)

  1. Pala G, Jethwani JB, Kumbhar SS, Patil SD. Machine Learning-based Hand Sign Recognition. 2021 International Conference on Artificial Intelligence and Smart Systems (ICAIS). 2021:356-363. doi:10.1109/icais50930.2021.9396030
  2. Lionel Pigou, Sander Dieleman, Pieter- Jan Kindermans and Benjamin Schrauwen, “Sign Language Recognition Using Convolutional Neural Networks,” 2015 European Conference on Computer Vision.
  3. Bhagat NK, Vishnusai Y, Rathna GN. Indian Sign Language Gesture Recognition using Image Processing and Deep Learning. 2019 Digital Image Computing: Techniques and Applications (DICTA). 2019:1-8. doi:10.1109/dicta47822.2019.8945850
  4. Dutta KK, Bellary SA. Machine learning techniques for Indian sign language recognition. In2017 International Conference on Current Trends in Computer, Electrical, Electronics and Communication (CTCEEC) 2017 Sep 8 (pp. 333-336). IEEE.
  5. Patil R, Patil V, Bahuguna A, Datkhile G. Indian sign language recognition using convolutional neural network. InITM web of conferences 2021 (Vol. 40, p. 03004). EDP Sciences.
  6. Bantupalli K, Xie Y. American Sign Language Recognition using Deep Learning and Computer Vision. 2018 IEEE International Conference on Big Data (Big Data). 2018:4896-4899. doi:10.1109/bigdata.2018.8622141
  7. Mukai N, Harada N, Chang Y. Japanese Fingerspelling Recognition Based on Classification Tree and Machine Learning. 2017 Nicograph International (NicoInt). 2017:19-24. doi:10.1109/nicoint.2017.9
  8. Liu T, Zhou W, Li H. Sign language recognition with long short-term memory. 2016 IEEE International Conference on Image Processing (ICIP). 2016:2871-2875. doi:10.1109/icip.2016.7532884
  9. Zhang J, Zhou W, Xie C, Pu J, Li H. Chinese sign language recognition with adaptive HMM. 2016 IEEE International Conference on Multimedia and Expo (ICME). 2016:1-6. doi:10.1109/icme.2016.7552950
  10. Badhe PC, Kulkarni V. Indian sign language translator using gesture recognition algorithm. 2015 IEEE International Conference on Computer Graphics, Vision and Information Security (CGVIS). 2015:195-200. doi:10.1109/cgvis.2015.7449921
  11. Adhikari H, Bin Jahangir MS, Jahan I, Mia MS, Hassan MR. A Sign Language Recognition System for Helping Disabled People. 2023 5th International Conference on Sustainable Technologies for Industry 5.0 (STI). 2023:1-6. doi:10.1109/sti59863.2023.10465011
Support