Journal of Computer Technology & Applications

An Abnormal Expression Detection System (AEDS) Using Deep Learning Algorithms

  1. Nimmagadda Muralikrishna ✉
  2. Dwiti Krishna Bebarta
  3. Angadi Seshagiri Rao

Abstract

In the last decade, many deep learning algorithms have achieved remarkable success and gained popularity in various computer vision tasks, including object detection, image recognition, and segmentation. This AEDS (Abnormal Expression Detection System)leverages the power of deep learning algorithms to detect abnormal facial expressions in real-time automatically. AEDS proposed two important models; those are Deep CNN and RNN. CNN is responsible for learning discriminative features from facial images and capturing local and global information. These features are fed into the RNN, which can effectively model the temporal dependencies present in facial expressions. To train the AEDS, a large dataset of facial expressions, comprising both normal and abnormal instances, is collected and labeled. Data augmentation techniques enhance the model's generalization capabilities and reduce overfitting. The deep learning model is trained using this dataset supervised, where the ground truth labels indicate normal or abnormal expressions. The evaluation of the AEDS is performed on an independent test set, and AEDS outcomes prove high accuracy and robustness in detecting strange facial expressions. Furthermore, the system exhibits real-time performance, making it fit for the many applications, for instance, security monitoring, healthcare, and human-computer interaction.

Keywords

References (13)

  1. Yadan Lv, Zhiyong Feng, Chao Xu. Facial expression recognition via deep learning. In 2014 IEEE International Conference on Smart Computing. 2014 Nov 3; 303–308.
  2. Majid Mehmood R, Du R, Lee HJ. Optimal feature selection and deep learning ensembles method for emotion recognition from human brain EEG sensors. IEEE Access. 2017; 5: 14797–14806.
  3. Li S, Deng W, Du J. Reliable crowdsourcing and deep locality-preserving learning for expression recognition in the wild . In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA. 2017 Jul; 2852–2861.
  4. Chen L, Zhou M, Su W, Wu M, She J, Hirota K. Softmax regression based deep sparse autoencoder network for facial emotion recognition in human-robot interaction. Inf Sci. 2018; 428: 49–61.
  5. Babajee P, Suddul G, Armoogum S, Foogooa R. Identifying human emotions from facial expressions with deep learning. In Proceedings of the 2020 IEEE Zooming Innovation in Consumer Technologies Conference (ZINC), Novi Sad, Serbia. 2020 May; 36–39.
  6. Hassouneh A, Mutawa AM, Murugappan M. Development of a real -time emotion recognition system using facial expressions and EEG based on machine learning and deep neural network methods. Inform Med Unlocked. 2020; 20: 100372. 0 20 40 60 80 100 Auto Encoder DNN AEDS Accuracy Precision Recall F1-Score Specificity An Abnormal Expression Detection System (AEDS) Muralikrishna et al. © STM Journals 2023. All Rights Reserved 79
  7. Tan C, Šarlija M, Kasabov N. NeuroSense: short -term emotion recognition and understanding based on spiking neural network modelling of spatio -temporal EEG patterns . Neurocomputing. 2021; 434: 137–148.
  8. Satyanarayana P, Vardhan DP, Tejaswi R, Kumar SVP. Emotion recognition by deep learning and cloud access . In Proceedings of the 2021 IEEE 3rd International Conference on Advances in Computing, Communication Control and Networking (ICAC3N), Greater Noida, India. 2021 Dec; 360–365.
  9. Jayanthi K, Mohan S. An integrated framework for emotion recognition using speech and static images with deep classifier fusion approach. Int J Inf Technol. 2022; 14: 3401–3411.
  10. Li S, Deng W. Deep Facial Expression Recognition: A Survey. IEEE Trans Affect Comput. 2020; 7(3): 1195–1215.
  11. Yadahalli SS, Rege S, Kulkarni S. Facial micro expression detection using deep learning architecture. In Proceedings of the 2020 IEEE International Conference on Smart Electronics and Communication (ICOSEC), Trichy, India. 2020 Sep; 167–171.
  12. Yang B, Han X, Tang J. Three class emotions recognition based on deep learning using staked autoencoder. In Proceedings of the 2017 IEEE 10th International Congress on Image and Signal Processing, BioMedical Engineering and Informatics (CISP -BMEI), Shanghai, China. 2017 Oct; 1–5.
  13. Asaju C, Vadapalli H. A temporal approach to facial emotion expression recognition . In Proceedings of the Southern African Conference for Artificial Intelligence Research . Cham: Springer; 2021 Jan; 274–286.

Read more of it

Subscribe to one journal or build your own list of several. One invoice, one payment, access for a full year.

Subscribe to journals →

Publish your article

Peer-reviewed journals across every subject, with open access options. Send your manuscript to the right editor today.

Publish with us → Calculate your APC
Support