CNN based Gesture Recognition for ISL
Abstract
AbstractGesture recognition has always been at a peak when it comes to computer vision and human-computer interaction (HCI). Hand gestures can be used for interaction with systems like managing UAVs, medical devices, videogames, etc. In this paper, the main focus is on handicapped people, who are physically unable to speak or listen. With the help of computer interaction, gestures will be recognized. As, the same gesture by another people differs, recognizing it is the main task. The Convolution Neural Network (CNN) is used, to the extraction of features and gesture recognition, RGB dynamic gesture recognition method is used, the average accuracy received is around 97.44%, which is higher comparatively. The dataset used is the original dataset of Indian Sign Language (ISL), for learning features and the gestures of the images. The method sets the feature concatenation layer of Canny Edge and RGB images in the CNN structure, to give better performance of gesture recognition. Keywords: Convolution Neural Network, Indian Sign Language, hand gesture recognition, Human-Computer Interaction.Keywords
References (12)
- Hongnian Yu, Mohammad S. Hasan, “Innovative Developments in HCI and Future Trends”, International Journal of Automation and Computing, springer link, 14(1), 10-20, December 2016.
- Honghai Liu, Gongfa Li, Hao Wu, Shuang Xu, Guozhang Jiang, "Dynamic Gesture Recognition in the Internet of Things", IEEE Access, 2019
- Xiaoming Deng, Shuo Yang, Yinda Zhang, Ping Tan, Liang Chang, Hongan Wang, Ye Yuan, “Joint H and Detection and Rotation Estimation Using CNN”, IEEE Journal volume 27, Issue:4, Page(s): 1888 – 1900, April 2018.
- Haanvid Lee, Minju Jung, Jun Tani, “Recognition of Visually Perceived Compositional Human Actions by Multiple Spatio -Temporal Scales Recurrent Neural Networks”, IEEE Transactions on Cognitive and Developmental Systems, Volume: 10, Issue: 4, Pages: 1058 – 1069, Dec. 2018.
- "Gesture recognition" in Cambridge English Dictionary, Cambridge, U.K.:Cambridge Univ. Press, Jun. 2013.
- Jack Sheng, Wei Fang, Feihong Zhang, Yewen Ding, “Gesture Recognition Based on CNN and DCGAN for Calculation and Text Output”, IEEE Journal volume 7, Pages: 28230 – 28237, 27 February 2019.
- E. Kiran Kumar, P. V. V. Kishore, A. S. C. S. Sastry, M. Teja Kiran Kumar, D. Anil Kumar, “Training CNNs for 3 -D Sign Language Recognition with Color Texture Coded Joint Angular Displacement Maps”, IEEE Journal, Volume:25, issue:5, Pages: 645 – 649, March 2018.
- Bin Xie, Xiaoyu He, Yi Li, “RGB -D static gesture recognition based on convolutional neural network”, The Journal of Engineering, Volume: 2018, Issue: 16, Nov 2018.
- Jin Woo Kim, Hong Gul Han, Sanghoon Lee, Tae Wook Kim, Seo Yul Kim, “A Hand Gesture Recognition Sensor Using Reflected Impulses”, IEEE Sensors Journal Volume: 17, Issue: 10, Pages: 2975 – 2976, May15, 15 2017.
- Asha Ambhaikar,Vishakha L. Bansod,” Crowd Analysis System for Images of CCTV Camera”, IJRT E, ISSN: 2277 - 3878, Volume-8 Issue-5, January 2020.
- Bo Tao, Du Jiang Gongfa Li, Jianyi Kong, Ying Sun, “Gesture recognition based on skeletonization algorithm and CNN with ASL database”, Springer Link, pp: 1 -18, October 2018.
- Yun Cheng, Sheng Yu, Li Xie, Shao-Zi Li, “Fully convolutional networks for action recognition”, IEEE Journal, Volume 11, Issue:8, Pages: 744-749, December 2017. 2 Cite this Article Vaishnavi Mohan Ahire, A.A. Khaparde, V.V. Deshmukh . CNN based Gesture Recognition for ISL. Journal of Network Security. 2020; 8(3): 11–19p.