Journal of Instrumentation Technology & Innovations
Computer Vision Controlled Robotic ARM
Abstract
By combining sophisticated robotics and visual awareness, computer vision operated robotic arms have revolutionized technology. These devices are having a profound effect on a number of industries, from manufacturing processes to healthcare. Computer vision controlled robotic arms are altering the game with their ability to see, comprehend, and interact with their surroundings. In this study we have tried to develop and implement software and hardwares to improve the freedom of movement in a robotic arm which will have a similar look to hand gesture. In the modern world, robotic arms are becoming essential, with uses in a wide range of sectors including the military, defense, healthcare, and industrial automation. These amazing devices can replicate the movements and hand gestures of a human, which makes them incredibly useful in a variety of scenarios. The most innovative automation technology available now is robotic systems. Initially, robots were employed on manufacturing floors in the 1960s and early 1970s.Evaluating the precision of system was done by sort of methods such as sorting, kinematic modelling, and centre recognition which elevate the movements of robotic arms. More innovation if performed to elevate the free movement of robotic arm can enhance it's applications at defence and industrial level.References (13)
- Rai N., Rai B., Rai P. Computer vision approach for controlling educational robotic arm based on object properties; Proceedings of the 2014 2nd International Conference on Emerging Technology Trends in Electronics, Communication and Networking; Surat, India. 26–27 December 2014
- Hsu Y.H., Hsu H.-Y., Lin J.-S. Control design and implementation of intelligent vehicle with robot arm and computer vision; Proceedings of the 2015 International Conference on Advanced Robotics and Intelligent Systems (ARIS); Taipei, Taiwan. 29–31 May 2015
- Chen X., Huang X., Wang Y., Gao X. Combination of augmented reality based brain -computer interface and computer vision for high-level control of a robotic arm. IEEE Trans. Neural Syst. Rehabil, Eng. 2020;28:3140–3147. doi:10.1109/TNSRE.2020.3038209
- Fisher Yu, Wenqi Xian, Yingying Chen, Fangchen Liu, Mike Liao, Vashisht Madhavan, and Trevor Darrell. Bdd100k: A diverse driving video database with scalable annotation tooling. arXiv preprint arXiv:1805.04687, 2018 Computer Vision Controlled Robotic ARM Shukla et al. © STM Journals 2023. All Rights Reserved 6
- Lerrel Pinto and Abhinav Gupta. Supersizing selfsupervision: Learning to grasp from 50k tries and 700 robot hours. In International Conference on Robotics and Automation, 2016.
- Wenhan Luo, Peng Sun, Fangwei Zhong, Wei Liu, Tong Zhang, and Yizhou Wang. End -to-end active object tracking via reinforcement learning. In International Conference on Machine Learning, pages 3286–3295, 2018
- Raheja J.L, Shyam R, Kumar U, Prasad P.B: “Robot Controlled Using Hand Motion Recognition”, IEEE Second International Conference on Machine Learning and Computing, 2010
- Andreas Geiger, Philip Lenz, Christoph Stiller, and Raquel Urtasun. Vision meets robotics: The kitti dataset. The International Journal of Robotics Research, 32(11):1231–1237, 2013.
- Sergey Levine, Peter Pastor, Alex Krizhevsky, Julian Ibarz, and Deirdre Quillen. Learning hand- eye coordination for robotic grasping with deep learning and large-scale data collection. The International Journal of Robotics Research, 37(4-5):421–436, 2018
- Cabre TP, Cairol MT, Calafell DF, Ribes MT, Roca JP. Project-based learning example: controlling an educational robotic arm with computer vision. IEEE Revista Iberoamericana de Tecnologias del Aprendizaje. 2013 Jul 19;8(3):135-42.
- C.K. Gomathy et al. The Gesture Controlled Robot. International Research Journal of Engineering and Technology (IRJET). Volume-8, Issue-4 file:///C:/Users/PC54/Downloads/IRJET - V8I4325.pdf
- S. S. Dheeban et al. Gesture Controlled Robotic Arm. The International Journal of Science & Technoledge. Volume-4(3),2016, file:///C:/Users/PC54/Downloads/17.ST1603-078.pdf
- Chinmay Patil et al. Design and Implementation of Gesture Controlled Robot with a Robotic Arm. International Research Journal of Engineering a nd Technology (IRJET). Volume-6[9],2019 https://www.irjet.net/archives/V6/i9/IRJET-V6I9205.pdf