Journal of Instrumentation Technology & Innovations
Efficient Masked Face Recognition Methods using Deep Learning
Abstract
Covid-19 questioned not only people's health but alsoconventional scientific systems. Due to face masks that were made mandatory to wear, the existing cognitive systems failed to perform in real-time scenarios. The demand to develop face recognition systems that detect people even when they wore masks was naturallyhigh. Deep learning techniques help to solve this problem, working efficiently in detecting user face features and comparing them with a known image database. This paper discusses Deep learning-based high-performing face detection algorithms and evaluates state-of-the-art face recognition algorithms like AlexNet, FaceNet, VGG16, and ResNet-50. The efficiency in detecting non- occluded faces derived from prominent datasets such as LFW, COMASK20, and S-LFW is elaborated. Then the paper’s focus shifts toward Masked Face Recognition (MFR) where the authors propose an end-end pipeline to detect faces occluded with a mask. The paper also reviewsthe existing progress made in object detection, face detection and recognition, occluded face recognition, and masked face recognitionto date. Furthermore, the paper addresses the challenges and scope of improvement of MFR methods.References (53)
- S.O’Dea.(2022).”Smartphonesubscriptionsworldwide2016-2027. https://www.statista.com/statistics/330695/number-of-smartphone-users- worldwide/
- Luo, D., Lu, X., Hu, C., Peng, X., & Wang, W. (2016, December). “A robust traffic driver face detection method” In 2016 International Conference on Progress in Informatics and Computing (PIC) (pp. 285– 288). IEEE, https://ieeexplore.ieee.org/abstract/document/7949511.
- Ahmed, M., Masood, S., Ahmad, M., & Abd El-Latif, A. A. (2021).” Intelligent Driver Drowsiness Detection for Traffic Safety Based on Multi CNN Deep Model and Facial Subsampling”Volume- 22,Issue-10, IEEE Transactions on Intelligent Transportation Systems.
- Alioua, N., Amine, A., Rziza, M., & Aboutajdine, D. (2011, August). Driver’s fatigu e and drowsiness detection to reduce traffic accidents on road”. In International Conference on Computer Analysis of Images and Patterns (pp. 397 –404). Springer, Berlin, Heidelberg, https://link.springer.com/chapter/10.1007/978–3–642–23678–5_47
- Manlises, C. O., Martinez, J. M., Belenzo, J. L., Perez, C. K., & Postrero, M. K. T. A. (2015, December). “Real -time integrated CCTV using face and pedestrian detection image processing algorithm for automatic trafficlight transitions”. In 2015 International Conference on Humanoid, Nanotechnology, Information Technology, Communication and Control, Environment and Management (HNICEM) (pp. 1–4). IEEE.
- Worby, C. J., & Chang, H. H. (2020). “Face mask use in the general population and optimal resource allocation during the COVID -19 pandemic” Nature communications,Volume-11,Issue-1, 1–9, https://www.nature.com/articles/s41467–020–17922–x
- Badillo-Goicoechea, E., Chang, T. H., Kim, E., LaRocca, S., Morris, K., Deng, X., ... & Stuart, E. A. (2021). Global trends and predictors of face mask usage during the COVID-19 pandemic. BMC public health, Volume-21,Issue-(1), 1–12.
- Kwon, S., Joshi, A. D., Lo, C. H., Drew, D. A., Nguyen, L. H., Guo, C. G., ... & Chan, A. T. (2021). “Association of social distancing and face mask use with risk of COVID -19” Nature Communications, Volume-12,Issue-(1), 1–10.
- Katharina Buchholz. (2020). Asians Still Most Likely to Wear Face Masks Due to COVID -19. https://www.statista.com/chart/21452/share-of- people-wearing-face-masks-per-country-covid-19/ © STM Journals 2023. All Rights Reserved 9 Journal of Instrumentation Technology & Innovations Volume 13, Issue 2 ISSN: 2249-4731 (Online), ISSN: 2347-7261 (Print)
- Viola, P., & Jones, M. (2001, December). Rapid object detection using aboosted cascade of simple features. In Proceedings of the 2001 IEEE computer society conference on computer vision and pattern recognition. CVPR 2001 (Vol. 1, pp. I-I). IEEE Xplore.
- Hapsari, D. T. P., Berliana, C. G., Winda, P., & Soeleman, M. A. (2018, September). Face detection using Haar cascade in difference illumination. In 2018 International Seminar on Application for Technology of Information and Communication (pp. 555–559). IEEE.
- Mantoro, T., & Ayu, M. A. (2018, May). Multi -faces recognition processusing Haar cascades and eigenface methods. In 2018 6th International Conference on Multimedia Computing and Systems (ICMCS) (pp. 1–5). IEEE.
- Chinimilli, B. T., Anjali, T., Kotturi, A., Kaipu, V. R., & Mandapati, J. V. (2020, June). Face recognition-based attendance system using haar cascade and local binary pattern histogram algorithm. In 2020 4th International Conference on Trends in Electroni cs and Informatics (ICOEI)(48184) (pp. 701–704). IEEE.
- Dalal, N., & Triggs, B. (2005, June). Histograms of oriented gradients forhuman detection. In 2005 IEEE computer society conference on computervision and pattern recognition (CVPR'05) (Vol. 1, pp. 886–893). Ieee.
- Redmon, J., & Farhadi, A. (2018). Yolov3: An incremental improvement. arXiv preprint arXiv:1804.02767.
- Li, C., Wang, R., Li, J., & Fei, L. (2020). Face detection based on YOLOv3. In Recent Trends in Intelligent Computing, Communication and Devices (pp. 277–284). Springer, Singapore.
- Uijlings, J. R., Van De Sande, K. E., Gevers, T., & Smeulders, A. W. (2013). Selective search for object recognition. International journal of computer vision, 104(2), 154–171.
- Zafeiriou, S., Zhang, C., & Zhang, Z. (2015). A survey on face detectionin the wild: past, present, and future. Computer Vision and Image Understanding, 138, 1–24.
- Kumar, A., Kaur, A., & Kumar, M. (2019). Face detection techniques: a review. Artificial Intelligence Review, Volume-52, Issue-(2), 927–948.
- Hjelmås, E., & Low, B. K. (2001). “Face detection: A survey”. Computer vision and image understanding, Volume-83,issue-(3), 236–274.
- Zhang, C., & Zhang, Z. (2010). “A survey of recent advances in face detection” .
- Razzaq, A. N., Ghazali, R., El Abbadi, N. K., & Dosh, M. (2022). A Comprehensive Survey on Face Detection Techniques. Webology,Volume-19,Issue-1.
- Oloyede, M. O., Hancke, G. P., & Myburgh, H. C. (2020). A review on face recognition systems: recent approaches and challenges. Multimedia Tools and Applications, Volume-79,issue-(37), 27891–27922.
- Naseem, I., Togneri, R., & Bennamoun, M. (2010). Linear regression for face recognition. IEEE transactions on pattern analysis and machine intelligence, Volume-32,issue-(11), 2106–2112.
- Rahim, M. A., Azam, M. S., Hossain, N., & Islam, M. R. (2013). Face recognition using local binary patterns (LBP). Global Journal of Computer Science and Technology.
- Ahonen, T., Hadid, A., & Pietikäinen, M. (2004, May). Face recognitionwith local binary patterns. In European conference on computer vision (pp. 469–481). Springer, Berlin, Heidelberg.
- Ahonen, T., Hadid, A., & Pietikainen, M. (2006). Face description with local binary patterns: Application to face recognition. IEEE transactions on pattern analysis and machine intelligence, Volume-28,issue-(12), 2037-2041.
- Liu, L., Fieguth, P., Zhao, G., Pietikäinen, M., & Hu, D. (2016). Extended local binary patterns for face recognition. Information Sciences, 358, 56–72.
- Maturana, D., Mery, D., & Soto, Á. (2010, November). Face recognition with decision tree -based local binary patterns. In Asian Conference on Computer Vision (pp. 618–629). Springer, Berlin, Heidelberg.
- Tan, X., & Triggs, B. (2010). Enhanced local texture feature sets for facerecognition under difficult lighting conditions. IEEE transactions on image processing, Volume-19,issue-(6), 1635–1650.
- Karim, T. F., Lipu, M. S. H., Rahman, M. L., & Sultana, F. (2010, July). Face recognition using PCA-based method. In 2010 IEEE International Conference on Advanced Management Science (ICAMS 2010) (Vol. 3, pp. 158–162). IEEE. © STM Journals 2023. All Rights Reserved 10 Efficient Masked Face Recognition Teja et al.
- Ebied, H. M. (2012, May). Feature extraction using PCA and Kernel-PCA for face recognition. In 2012 8th International Conference on Informatics and Systems (INFOS) (pp. MM-72). IEEE.
- Faruqe, M. O., & Hasan, M. A. M. (2009, August). Face recognition using PCA and SVM. In 2009 3rd international conference on anti- counterfeiting, security, and identification in communication (pp. 97– 101). IEEE.
- Schroff, F., Kalenichenko, D., & Philbin, J. (2015). Facenet: A unified embedding for face recognition and clustering. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 815– 823).
- Jose, E., Greeshma, M., Haridas, M. T., & Supriya, M. H. (2019, March). Face recognition based surveillance system using facenet and mtcnn on jetson tx2. In 2019 5th International Conference on Advanced Computing & Communication Systems (ICACCS) (pp. 608–613). IEEE.
- Taigman, Y., Yang, M., Ranzato, M. A., & Wolf, L. (2014). Deepface: Closing the gap to human - level performance in face verification. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 1701–1708).
- Min, R., Hadid, A., & Dugelay, J. L. (2011, March). Improving the recognition of faces occluded by facial accessories. In 2011 IEEE International Conference on Automatic Face & Ge sture Recognition (FG) (pp. 442–447). IEEE.
- Wang, Z., Wang, G., Huang, B., Xiong, Z., Hong, Q., Wu, H., ... & Liang, J. (2020). Masked face recognition dataset and application. arXiv preprint arXiv:2003.09093.
- Li, Y., Guo, K., Lu, Y., & Liu, L. (2021). Cropping and attention -based approach for masked face recognition. Applied Intelligence, Volume-51,issue-(5), 3012–3025.
- Mhadgut, S. (2021, July). Masked Face Detection and Recognition System in Real Time using YOLOv3 to combat COVID -19. In 2021 12th International Conference on Computing Communication and Networking Technologies (ICCCNT) (pp. 1–7). IEEE.
- Vu, H. N., Nguyen, M. H., & Pham, C. (2021). Masked face recognition with convolutional neural networks and local binary patterns. Applied Intelligence, 1–16.
- Alzu’bi, A., Albalas, F., Al-Hadhrami, T., Younis, L. B., & Bashayreh, (2021). Masked Face Recognition Using Deep Learning: AReview. Electronics, volume-10,issue-(21), 2666.
- Zhang, K., Zhang, Z., Li, Z., & Qiao, Y. (2016). Joint face detection andalignment using multitask cascaded convolutional networks. IEEE signalprocessing letters, volume-23,issue-(10), 1499–1503.
- Anwar, A., & Raychowdhury, A. (2020). Masked face recognition for secure authentication. arXiv preprint arXiv:2008.11104.
- Geng, M., Peng, P., Huang, Y., & Tian, Y. (2020, October). Masked facerecognition with generative data augmentation and domain constrained ranking. In Proceedings of the 28th ACM International Conference on Multimedia (pp. 2246–2254).
- Wang, Z., Wang, G., Huang, B., Xiong, Z., Hong, Q., Wu, H., ... & Liang, J. (2020). Masked face recognition dataset and application. arXiv preprint arXiv:2003.09093.
- Hong, J. H., Kim, H., Kim, M., Nam, G. P., Cho, J., Ko, H. S., & Kim, I. J. (2021, September). A 3D model -based approach for fitting masks to faces in the wild. In 2021 IEEE International Conference on Image Processing (ICIP) (pp. 235–239). IEEE.
- Vu, H. N., Nguyen, M. H., & Pham, C. (2022). Masked face recognitionwith convolutional neura l networks and local binary patterns. Applied Intelligence, 52(5), 5497–5512.
- Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017). Imagenet classification with deep convolutional neural networks. Communications of the ACM, 60(6), 84–90.
- Schroff, F., Kalenichenko, D., & Philbin, J. (2015). Facenet: A unified embedding for face recognition and clustering. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 815– 823).
- He, K., Zhang, X., Ren, S., & Sun, J. (2016). Deep residu al learning for image recognition. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 770–778).
- Simonyan, K., & Zisserman, A. (2014). Very deep convolutional networks for large -scale image recognition. arXiv preprint arXiv:1409.1556. © STM Journals 2023. All Rights Reserved 11 Journal of Instrumentation Technology & Innovations Volume 13, Issue 2 ISSN: 2249-4731 (Online), ISSN: 2347-7261 (Print)
- Huang, G. B., Mattar, M., Berg, T., & Learned-Miller, E. (2008, October). Labeled faces in the wild: A database forstudying face recognition in unconstrained environments. In Workshop on faces in'Real-Life'Images: detection, alignment, and recognition.