Journal of Instrumentation Technology & Innovations
Hand Gesture Recognition
Abstract
The goal of this research is to detect and recognize hand motions. Photographs of hand gestures are captured using a camera and compared to images in the database; all images are divided in testing and training data set and converted into train. Record and test. record. This. records file trained in TensorFlow Mobile Net pre trained model. Loading of this model using karas gives us the best match of video frame gesture and saved gesture, and the gesture label is shown according to match. One of the most important strategies for removing a dumb person’s communication barrier is gesture recognition. For example, if a person who is unable to speak wishes to communicate with another person, gesture recognition language will enable them to do so.The accuracy of the below proposed model is 93%.This model use Convolution Neural Network. All gesture signs which display on screen will converted into text file and this text file converted into mp3 using gTTs API. so this file can be share to anyone and communication happen smoothly. A hand gesture recognition system allows for nonverbal communication that is natural, inventive, and modern. Its applications in human-computer interaction and sign language are numerousReferences (15)
- A. S. Ghotkar, R. Khatal, S. Khupase, S. Asati and M. Hadap, “Hand gesture recognition for Indian Sign Language,” 2012 International Conference on Computer Communication and Informatics, Coimbatore, India, 2012, pp. 1-4. doi:10.1109/ICCCI.2012.6158807
- J. H. Sun, T. T. Ji, S. B. Zhang , J. K. Yang and G. R. Ji, “Research on the Hand Gesture Recognition Based on Deep Learning,” 2018 12th International Symposium on Antennas, Propagation and EM Theory (ISAPE), Hangzhou, China, 2018, pp. 1 -4. doi:10.1109/ISAPE.2018.8634348
- V. Gajjar, V. Ma vani and A. Gurnani, “Hand gesture real time paint tool -box: Machine learning approach,” 2017 IEEE International Conference on Power, Control, Signals and Instrumentation Engineering (ICPCSI), Chennai, India, 2017, pp. 856-860. doi:10.1109/ICPCSI.2017.8391833 Journal of Instrumentation Technology & Innovations Volume 12, Issue 2 ISSN: 2249-4731 (Online), ISSN: 2347-7261 (Print) © STM Journals 2022. All Rights Reserved 15
- A. Mohanarathinam, K. G. Dharani, R. Sangeetha, G. Aravindh and P. Sasikala, “Study on Hand Gesture Recoginition by using Machine Learning,” 2020 4th International Conference on Electronics, Communication and Aerospace Technology (ICECA), Coimbatore, India, 2020, pp. 1498-1501. doi:10.1109/ICECA49313.2020.9297513
- A. N. Borodzhieva, “FPGA Implementation of Systematic Linear Block Encoders for Educational Purposes,” 2019 X National Conference with International Participation (ELECTRONICA), Sofia, Bulgaria, 2019, pp. 1-4. doi:10.1109/ELECTRONICA.2019.8825652
- K. R. Dixit, T. Verma, U. S. Subramanya and V. Umadevi, “Hand Gesture Based Quadcopter Control Using Image Processing And Adaptive Machine Learning,” 2018 3rd IEEE International Conference on Recent Trends in Electronics, Information Communication Technology (RTEICT), Bangalore, India, 2018, pp. 1214-1218. doi:10.1109/RTEICT42901.2018.9012139
- S. Hussain, R. Saxena, X. Han, J. A. Khan and H. Shin, ”Hand gesture recognition using deep learning,” 2017 International SoC Design Conference (ISOCC), Seoul, Korea (South), 2017, pp. 48-49. doi:10.1109/ISOCC.2017.8368821
- F. Ertam and G. Aydın, “Data classification with deep learning using Tensorflow,” 2017 International Conference on Computer Science and Engineering (UBMK), Antalya, Turkey, 2017, pp. 755-758. doi:10.1109/UBMK.2017.8093521
- R. Phadnis, J. Mishra and S. Bendale, “Objects Talk - Object Detection and Pattern Tracking Using TensorFlow,” 2018 Second International Conference on Inventive Communication and Computational Technologies (ICICCT), Coimbatore, India, 2018, pp. 1216 -1219. doi:10.1109/ICICCT.2018.8473331
- G. Yu, L. Wang, M. Hou, Y. Liang and T. He, “An adaptive dead fish detection approach using SSD-MobileNet,” 2020 Chinese Automation Congress (CAC), Shanghai, China, 2020, pp. 1973 - 1979. doi:10.1109/CAC51589.2020.9326648
- B. Ye, Y. Shi, H. Li, L. Li and S. Tong, “Face SSD: A Real -time Face Detector based on SSD,” 2021 40th Chinese Control Conference (CCC), Shanghai, China, 2021, pp. 8445 -8450. d oi: 10.23919/CCC52363.2021.9550294
- A. K. Gupta, A. Raman, N. Kumar and R. Ranjan . “Design and Implementation of High -Speed Universal Asynchronous Receiver and Trans- mitter (UART),” 2020 7th International Conference on Signal Processing and Integrated Networks (SPIN), Noida, India, 2020, pp. 295 -300. doi:10.1109/SPIN48934.2020.9070856
- S. Mane and S. Mangale, “Moving Object Detection and Tracking Using Convolutional Neural Networks,” 2018 Second International Conference on Intelligent Computing and Control Systems (ICICCS), Madurai, India, 2018, pp. 1809-1813. doi:10.1109/ICCONS.2018.8662921
- S. Namiki, K. Yokoyama, S. Yachida, T. Shibata, H. Miyano and M. Ishikawa, ”Online O bject Recognition Using CNN -based Algorithm on High -speed Camera Imaging: Framework for fast and robust high -speed camera object recognition based on population data cleansing and data ensemble,” 2020 25th International Conference on Pattern Recognition (I CPR), Milan, Italy, 2021, pp. 2025-2032. doi:10.1109/ICPR48806.2021.9413042
- S. Shrenika and M. Madhu Bala, “Sign Language Recognition Using Template Matching Technique,” 2020 International Conference on Computer Science, Engineering and Applications (ICCSEA), Gunupur, India, 020, pp. 1-5. doi:10.1109/ICCSEA49143.2020.9132899