International Journal of Algorithms Design and Analysis Review Review Article

ASL Mobile Translator with CNN Algorithm

  1. Sasikumar M. Department of Computer Applications, People’s Education Society University, Bengaluru
  2. Lekha Achuth Department of Computer Applications, People’s Education Society University, Bengaluru

DOI: https://doi.org/10.37591/ijadar.v01i02.129066

Abstract

There are around 63 million people in India with speech and hearing disabilities, and the number goes all the way up to 300 million across the world. All of them face issues in their day-to-day life as they can only have conversations with gestures. American Sign Language (ASL) mobile translator with convolutional neural network (CNN) algorithm is an easy-to-use mobile application, which uses complex images and video recognizing models built with an open-source tool called OpenCV. It efficiently recognizes gestures being shown to the camera and translates it to voice message, which can be understood by a normal person. Being a mobile application, it is portable and can be carried anywhere.

Keywords

References (12)

  1. He K, Zhang X, Ren S, Sun J. Deep residual learning for image recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA, June 27–30, 2016. pp. 770–
  2. Jenkins J, Rashad S. An innovative method for automatic American Sign Language interpretation using machine learning and Leap motion controller. In: IEEE 12th Annual Ubiquitous Computing, Electronics & Mobile Communication Conference (UEMCON), New York, NY, USA, December 1–4, 2021. pp. 633– doi:10.1109/UEMCON53757.2021.9666640.
  3. Boulares M, Jemni M. Mobile sign language translation system for deaf community. In: W4A 2012 – International Cross-Disciplinary Conference on Web Accessibility, Lyon, France, April 16–17, 2012. Article 37, pp. 1–4. doi:10.1145/2207016.2207049.
  4. Bird JJ, Ekárt A, Faria DR. British Sign Language recognition via late fusion of computer vision and Leap motion with transfer learning to American Sign Language. Sensors (Basel, Switzerland). 2020; 20: 5151. doi:10.3390/s20185151.
  5. Murthy GR, Jadon RS. A review of vision based hand gestures recognition. Int J Inform Technol Knowledge Manage. 2009; 2 (2): 405–410.
  6. Tawalare S, Karale N, Pande S, Khamparia A. Identification of characters (digits) through customized convolutional neural network. Lecture Notes Data Eng Commun Technol. 2022; 122: 38– doi:10.1007/978-981-16-6285-0_38.
  7. Srivastava S, Gangwar A, Mishra R, Singh S. Sign language recognition system using TensorFlow Object Detection API. In: Woungang I, Dhurandher SK, Pattanaik KK, Verma A, Verma P, editors. Advanced Network Technologies and Intelligent Computing. Volume 1. Berlin, Germany: Springer; 2022. pp. Volume 1, pp. 634–646. doi:10.1007/978-3-030-96040-7_48.
  8. Johnny S, Nirmala SJ. Sign language translator using machine learning. SN Computer Sci. 2022; 3: 1–6.
  9. Al-Saffar AAM, Tao H, Talab MA. Review of deep convolution neural network in image classification. In: International Conference on Radar, Antenna, Microwave, Electronics, and Telecommunications, (ICRAMET), Jakarta, Indonesia, October 23–24, 2017. pp. 1–6. doi:10.1109/ICRAMET.2017.8253139.
  10. Szegedy S, Liu W, Jia Y, Sermanet P, Reed S, Anguelov D, Erhan D, Vanhoucke V, Rabinovich A. Going deeper with convolutions. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Boston, MA, USA, June 7–12, 2015. pp. 1–9. doi:10.1109/CVPR.2015.7298594.
  11. Goyal S, Sharma I, Sharma S. Sign language recognition system for deaf and dumb people. Int J Eng Res Technol. 2013; 2 (4): 382–387.
  12. Krizhevsky A, Sutskever I, Hinton GE. ImageNet classification with deep convolutional neural networks. Commun ACM. 2017; 60 (6): 84–90. doi:10.1145/3065386.

Read more of it

Subscribe to one journal or build your own list of several. One invoice, one payment, access for a full year.

Subscribe to journals →

Publish your article

Peer-reviewed journals across every subject, with open access options. Send your manuscript to the right editor today.

Publish with us → Calculate your APC
Support