STM Journals Peer-reviewed research from Consortium e-Learning Network

Journal of Operating Systems Development & Trends Review Article

Air Touch Mouse Interface

  1. Sheetal Nilawar Department of Computer Engineering, Vishwaniketan's Institute of Management Entrepreneurship and Engineering Technology (ViMEET), Khalapur
  2. Yashswini Inamdar Department of Computer Engineering, Vishwaniketan's Institute of Management Entrepreneurship and Engineering Technology (ViMEET), Khalapur
  3. Charusheela Pandit Department of Computer Engineering, Vishwaniketan's Institute of Management Entrepreneurship and Engineering Technology (ViMEET), Khalapur

Abstract

The “Air Touch Mouse Interface” introduces a groundbreaking method for human–computer interaction (HCI) by utilizing hand gestures captured through web cameras to control cursor movements without physical input devices. This project investigates the feasibility and effectiveness of employing image processing techniques to interpret hand gestures as mouse inputs, thereby enhancing the accessibility and versatility of computing interfaces. By eliminating the dependency on traditional mice and mouse pads, the proposed interface offers users a more intuitive and natural interaction experience, in line with the principles of natural user interface (NUI) design. Furthermore, the research explores potential applications of this technology in areas such as sign language recognition and motion-based gaming. Through comprehensive experimentation and analysis, this project aims to demonstrate the practicality and efficiency of the Air Touch Mouse Interface in improving user interaction with computing systems.

Keywords

References (30)

  1. Dubey S, Agarwal H, Singh J, Singh H. Virtual mouse using hand gesture. J Adv Res Image Process Appl. 2023;6:16–18.
  2. Nandwalkar DJ, Mandal M, Khirari A, Bhalchim T. Control Mouse using Hand Gesture and Voice. International Journal for Research in Applied Science and Engineering Technology. 2023;11(4):3261-3268. doi:10.22214/ijraset.2023.50850
  3. Barot T, Karhadkar S. Development of Platform Independent Hand Gesture Controlled Wearable Mouse. 2018 3rd International Conference for Convergence in Technology (I2CT). 2018:1-5. doi:10.1109/i2ct.2018.8529544
  4. Tran DS, Ho NH, Yang HJ, Kim SH, Lee GS. Real-time virtual mouse system using RGB-D images and fingertip detection. Multimedia Tools and Applications. 2020;80(7):10473-10490. doi:10.1007/s11042-020-10156-5
  5. Shriram S, Nagaraj B, Jaya J, Shankar S, Ajay P. Deep Learning-Based Real-Time AI Virtual Mouse System Using Computer Vision to Avoid COVID-19 Spread. Journal of Healthcare Engineering. 2021;2021:1-8. doi:10.1155/2021/8133076
  6. Chaaraoui AA, Florez-Revuelta F. Adaptive Human Action Recognition With an Evolving Bag of Key Poses. IEEE Transactions on Autonomous Mental Development. 2014;6(2):139-152. doi:10.1109/tamd.2014.2315676
  7. Chen X, Guo H, Wang G, Zhang L. Motion feature augmented recurrent neural network for skeleton-based dynamic hand gesture recognition. 2017 IEEE International Conference on Image Processing (ICIP). 2017:2881-2885. doi:10.1109/icip.2017.8296809
  8. Lee G, Lee S, Kim J, Kim JH. Hand gesture recognition for human–computer interaction: A review. Sensors. 2020;20:5543.
  9. Song Z, Cao Z, Li Z, Wang J, Liu Y. Inertial motion tracking on mobile and wearable devices: Recent advancements and challenges. Tsinghua Science and Technology. 2021;26(5):692-705. doi:10.26599/tst.2021.9010017
  10. Sharma S, Singh S. Vision-based hand gesture recognition using deep learning for the interpretation of sign language. Expert Systems with Applications. 2021;182:115657. doi:10.1016/j.eswa.2021.
  11. Sharma V, Jaiswal M, Sharma A, Saini S, Tomar R. Dynamic Two Hand Gesture Recognition using CNN-LSTM based networks. 2021 IEEE International Symposium on Smart Electronic Systems (iSES). 2021:224-229. doi:10.1109/ises52644.2021.00059
  12. Moin A, Zhou A, Rahimi A, Menon A, Benatti S, Alexandrov G, et al. A wearable biosensing system with in-sensor adaptive machine learning for hand gesture recognition. Nature Electronics. 2020;4(1):54-63. doi:10.1038/s41928-020-00510-8
  13. Fang B, Sun F, Liu H, Guo D. A novel data glove using inertial and magnetic sensors for motion capture and robotic arm-hand teleoperation. Industrial Robot: An International Journal. 2017;44(2):155-165. doi:10.1108/ir-07-2016-0179
  14. Du G, Guo D, Su K, Wang X, Teng S, Li D, et al. A Mobile Gesture Interaction Method for Augmented Reality Games Using Hybrid Filters. IEEE Transactions on Instrumentation and Measurement. 2022;71:1-12. doi:10.1109/tim.2022.3181305
  15. Zhou H, Wang D, Yu Y, Zhang Z. Research Progress of Human–Computer Interaction Technology Based on Gesture Recognition. Electronics. 2023;12(13):2805. doi:10.3390/electronics12132805
  16. Kumar D, Ganesh A. A critical review on hand gesture recognition using SEMG: Challenges [Application], process and techniques. In: Journal of Physics: Conference Series. Vol. 2327, No. 1, p. 012075. IOP Publishing; 2022.
  17. Wang S, Wang A, Ran M, Liu L, Peng Y, Liu M, et al. Hand gesture recognition framework using a lie group based spatio-temporal recurrent network with multiple hand-worn motion sensors. Information Sciences. 2022;606:722-741. doi:10.1016/j.ins.2022.05.085
  18. Wu M. Gesture recognition in virtual reality. Psychomachina. 2023;1:1–10. doi:10.59388/pm
  19. Feng C, Wang N, Jiang Y, Zheng X, Li K, Wang Z, et al. Wi-Learner. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies. 2022;6(3):1-27. doi:10.1145/3550318
  20. Park S, Wang X, Chen K, Lee Y. Station: Gesture-Based Authentication for Voice Interfaces. IEEE Internet of Things Journal. 2024;11(12):22668-22683. doi:10.1109/jiot.2024.3382721
  21. Kumar R, Gupta R, Faraz MS. Application and designing of wireless mouse using object tracking. In: 2019 6th International Conference on Computing for Sustainable Global Development (INDIACom). IEEE Publications; 2019. pp. 22–26.
  22. Reddy KB, Fayazuddin M, Manohar MJ, Tavanam V. Artificial Intelligence Based Virtual Mouse. International Journal of Computer Science and Mobile Computing. 2022;11(1):25-35. doi:10.47760/ijcsmc.2022.v11i01.005
  23. Gaikwad S. Devansh rane. [AI virtual mouse]. International Research Journal of Engineering and Technology (IRJET). 2022;09:1293–1295.
  24. Kavitha R, Janasruthi SU, Lokitha S, Tharani G. Hand gesture controlled virtual mouse using artificial intelligence. IJARIIE. 2023;9:307–320.
  25. Srivastava N. Invisible mouse: Interacting with computer systems without physical mouse. International Journal of Engineering Research and Technology (IJERT). 2012;1:1–4.
  26. CHI '11 Extended Abstracts on Human Factors in Computing Systems. 2011. doi:10.1145/1979742
  27. Pradhan A, Deepak BBVL. Design of Intangible Interface for Mouseless Computer Handling using Hand Gestures. Procedia Computer Science. 2016;79:287-292. doi:10.1016/j.procs.2016.03.037
  28. Tejaswi D, Preethi G, Sirisha B, Swathi K, Priya DJ, Sravani G. Mouseless cursor using facial movements. Journal of Engineering Sciences. 2023;14.
  29. Villar N, Izadi S, Rosenfeld D, Benko H, Helmes J, Westhues J, et al. Mouse 2.0. Proceedings of the 22nd annual ACM symposium on User interface software and technology. 2009:33-42. doi:10.1145/1622176.1622184
  30. Sandra BK, Vardhan KH, Uday C, Surya VS, Raju B, Kumar DV. Gesture-Controlvirtual-mouse. International Research Journal of Modernization in Engineering Technology and Science. 2022;4.
Support