Skip to main content

Advertisement

Springer Nature Link
Log in

RETRACTED ARTICLE: Local Directional Maximum Edge Patterns for facial expression recognition

  • Original Research
  • Published:
Journal of Ambient Intelligence and Humanized Computing Aims and scope Submit manuscript

This article was retracted on 05 July 2022

This article has been updated

Abstract

Cognitive science and neuroscience use human facial expressions of emotion. Every single facial expression can be seen at different passions in a face space. Nowadays, facial expression recognition and analysis is vital due to the demand of introducing advanced biometric applications in every domain space. The imperative task in facial expressions of emotion classification is precise feature extraction, which helps to get detailed description of facial marks. Existing feature descriptors are suffering from various problems such as intensity variations, discrimination, vulnerability etc. In this paper, propose a new feature descriptor method called LDMEP (Local Directional Maximum Edge Patterns) for facial expression analysis to overcome the hindrance. We calculated the gradients in four directions of reference pixel to elicit the more feature for better recognition instead of calculating the local differences among neighboring pixels. We also access the orientations of the pixels then thresholded based on the dynamic threshold to avoid the featureless area calculation. Furthermore, we considered only dominant magnitude and orientation directions instead of all eight directions to generate feature. Thus, imperative and efficient features are covered in dominant positions to detect the strong edges. The paper confers that how the subsequent model can be used for the recognition of facial expression of emotion.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6

Similar content being viewed by others

Explore related subjects

Discover the latest articles and news from researchers in related subjects, suggested using machine learning.

Change history

References

  • Ahonen T, Hadid A, Pietik¨ainen M (2006) Face description with local binary patterns: application to face recognition. IEEE Trans Pattern Anal Mach Intell 28(12):2037–2041

    Article  Google Scholar 

  • Al-Saiyd AN, Al-Said I, Al-Takrori AH (2010) Semantic-based retrieving model of reuse software component. Int J Comput Sci Netw Secur 10(7):154–161

    Google Scholar 

  • Ao EJ, Kirste T (2005) Ambient intelligence-towards smart appliance ensembles. In: Hemmje M, Niederee C, Risse T (eds) From integrated publication and information systems to information and knowledge environments. Springer, Berlin, pp 261–270

    Google Scholar 

  • Bhushan K, Gupta BB (2019) Distributed denial of service (DDoS) attack mitigation in software defined network (SDN)-based cloud computing environment. J Ambient Intell Hum Comput 10:1985–1997. https://doi.org/10.1007/s12652-018-0800-9

    Article  Google Scholar 

  • Burnham J, Hardy J, Meaders K (1997) Comparison of the Robberts, Sobel, Robbinson, Canny, and Hough Image Detection Algorithms. In: Image processing group: comparison of edge detection algorithms MS State DSP conference, pp 1–18

  • Castillo JAR, Rivera AR, Chae O (2012) Facial expression recognition based on local sign directional pattern. In: 2012 19th IEEE international conference on image processing, IEEE, pp 2613–2616

  • Çevik N, Çevik T (2019) A novel high-performance holistic descriptor for face retrieval. Pattern Anal Appl 23:1–13

    Google Scholar 

  • Chakraborty S, Singh SK, Chakraborty P (2018) Local gradient hexa pattern: a descriptor for face recognition and retrieval. IEEE Trans Circuits Syst Video Technol 28(1):171–180

    Article  Google Scholar 

  • Chan CH, Kittler J, Poh N, Ahonen T, Pietikainen M (2009) (Multiscale) Local phase quantization histogram discriminant analysis with score normalization for robust face recognition. In: Computer Vision workshops (ICCV Workshops), 2009 IEEE 12th International Conference, pp 633–640

  • Chellappa R, Wilson C, Sirohey S (1995) Human and machine recognition of faces: a survey. Proc IEEE 83(5):705–741

    Article  Google Scholar 

  • Danelakis A, Theoharis T, Pratikakis I (2018) Action unit detection in 3D facial videos with application in facial expression retrieval and recognition. Multimed Tools Appl 77:1–29

    Article  Google Scholar 

  • Diro AA, Reda HT, Chilamkurti N (2018) Differential flow space allocation scheme in SDN based fog computing for IoT applications. J Ambient Intell Human Comput. https://doi.org/10.1007/s12652-017-0677-z

    Article  Google Scholar 

  • Doctor F, Hagras H, Callaghan V (2005) A fuzzy em-bedded agent-based approach for realizing ambient intelligence in intelligent inhabited environments. IEEE Trans Syst Man Cybern Part A 35(1):55–65

    Article  Google Scholar 

  • Fasel B, Luettin J (2003) Automatic facial expression analysis: a survey. Pattern Recogn 36(1):259–275

    Article  MATH  Google Scholar 

  • Fasel B, Monay F, Gatica-Perez D (2004) Latent semantic analysis of facial action codes for automatic facial expression recognition. In: Proceedings of the 6th ACM SIGMM international workshop on Multimedia information retrieval, ACM, pp 181–188

  • Hagras H et al (2003) A hierarchical fuzzy genetic multi-agent architecture for intelligent buildings learning, adaptation and control. Int J Inf Sci 150:33–54

    Google Scholar 

  • Hagras H, Doctor F, Callaghan V, Lopez A (2007) An incremental adaptive lifelong learning approach for type-2 fuzzy embedded agent in ambient intelligent environments. IEEE Trans Fuzzy Syst 15(1):41–55

    Article  Google Scholar 

  • (1998) http://www.kasrl.org/jaffe.html

  • (1998) http://vasc.ri.cmu.edu/idb/html/face/facial_expression

  • Iqbal MTB, Abdullah-Al-Wadud M, Ryu B, Makhmudkhujaev F, Chae O (2018) Facial expression recognition with neighborhood-aware edge directional pattern (NEDP). IEEE Trans Affect Comput 11:1–12

    Google Scholar 

  • Iroju O, Soriyan A, Gambo I (2012) An ontology matching: an ultimate solution for semantic interoperability in healthcare. Int J Comput Appl 51(21):7–14

    Google Scholar 

  • Jabid T, Kabir MH, Chae O (2010a) Local directional pattern (LDP) for face recognition. In: Proceedings of the IEEE international conference on consumer electronics, pp 329–330

  • Jabid T, Kabir H, Chae O (2010b) Local directional pattern (LDP)—a robust image descriptor for object recognition. In: Proceedings 2010 seventh IEEE international conference on advanced video and signal based surveillance, IEEE, pp 482–487

  • Kalasapur S, Kumar M, Shirazi BA (2007) Dynamic service composition in pervasive computing. IEEE Trans Parallel Distrib Syst 18(7):907–918

    Article  Google Scholar 

  • Kanade T, Cohn J, Tian YL (2000) Comprehensive database for facial expression analysis. In: Automatic face and gesture recognition. Proceedings fourth IEEE international conference, pp 46–53

  • Kaur G, Kaushik S (2020) Effect of image gradients as initial step for watershed approach. Int J Adv Res Comput Sci Softw Eng 3(2):382–391

    Google Scholar 

  • Kotsia I, Pitas I (2007) Facial expression recognition in image sequences using geometric deformation features and support vector machines. IEEE Trans Image Process 16(1):172–187

    Article  MathSciNet  Google Scholar 

  • Liu C (2004) Enhanced independent component analysis and its application to content based face image retrieval. IEEE Trans Syst Man Cybern B Cybern 34(2):1117–1127

    Article  Google Scholar 

  • Li X-X, Hao P, He L, Feng Y (2019) Image gradient orientations embedded structural error coding for face recognition with occlusion. J Ambient Intell Humaniz Comput 10(1):1–19

    Google Scholar 

  • Lucey P, Cohn J, Kanade T, Saragih J, Ambadar Z, Matthews I (2010) The extended Cohn-Kanade dataset (CK +): a complete dataset for action unit and emotion-specified expression. In: Computer vision and pattern recognition workshops (CVPRW), 2010 IEEE computer society conference on Jun. 2010, pp 94–101

  • Lyons M, Akamatsu S, Kamachi M, Gyoba J (1998) Coding facial expressions with gabor wavelets. In: Proceedings Third IEEE international conference on automatic face and gesture recognition, IEEE, pp 200–205

  • Makhmudkhujaev F, Abdullah-Al-Wadud M, Iqbal MTB, Ryu B, Chae O (2019) Facial expression recognition with local prominent directional pattern. Signal Process Image Commun 74:1–12

    Article  Google Scholar 

  • Mandal M, Verma M, Mathur S, Vipparthi S, Murala S, Deveerasetty K (2019) RADAP: regional adaptive affinitive patterns with logical operators for facial expression recognition. IET Image Process 13:850–861

    Article  Google Scholar 

  • Murala S, Maheshwari RP, Balasubramanian R (2012a) Local tetra patterns: a new feature descriptor for content-based image retrieval. IEEE Trans Image Process 21(5):2874–2886

    Article  MathSciNet  MATH  Google Scholar 

  • Murala S, Maheshwari RP, Balasubramanian R (2012b) Directional local extrema patterns: a new descriptor for content based image retrieval. Int J Multimed Inf Retr 1(3):191–203

    Article  MATH  Google Scholar 

  • Pietikäinen M (2005) Image analysis with local binary patterns. In: Scandinavian conference on image analysis. Springer, Berlin, pp 115–118

  • Ramalingam SP, Paturu CM, Rama VSS (2013) Dimensionality reduced local directional number pattern for face recognition. J Ambient Intell Humaniz Comput 7(1):95–103

    Article  Google Scholar 

  • Rivera AR, Castillo JR (2012) Local directional number pattern for face analysis: face and expression recognition. IEEE Trans Image Process 22:1740–1752

    Article  MathSciNet  MATH  Google Scholar 

  • Rivera AR, Castillo JAR, Chae O (2012) Recognition of face expressions using local principal texture pattern. In: 2012 19th IEEE international conference on image processing, IEEE, pp 2609–2612

  • Santos OC, Boticario JG (2011) Requirements for semantic educational recommender systems in formal e-learning scenarios. Algorithms 4:131–154

    Article  Google Scholar 

  • Shanbhag SS, Udupi GR, Patil KM, Ranganath K (2014) Quantitative analysis of diffusion weighted MR images of brain tumor using signal intensity gradient technique. J Med Eng 214:1–8

    Article  Google Scholar 

  • Stöckli S, Schulte-Mecklenbeck M, Borer S, Samson AC (2018) Facial expression analysis with AFFDEX and FACET: a validation study. Behav Res Methods 50(4):1446–1460

    Article  Google Scholar 

  • Tan X, Triggs B (2010) Enhanced local texture feature sets for face recognition under difficult lighting conditions. IEEE Trans Image Process 19(6):1635–1650

    Article  MathSciNet  MATH  Google Scholar 

  • Tariq U, Huang TS (2012) Features and fusion for expression recognition—a comparative analysis. In: 2012 IEEE computer society conference on computer vision and pattern recognition workshops, IEEE, pp 146–152

  • Thang ND, Rasheed T, Lee YK, Lee S, Kim TS (2011) Content-based facial image retrieval using constrained independent component analysis. Inf Sci 181(15):3162–3174

    Article  Google Scholar 

  • Turk M, Pentland A (1991) Eigenfaces for recognition. J Cognit Neurosci 3(1):71–86

    Article  Google Scholar 

  • Uma Maheswari V, Prasad GV, Raju S (2018) A survey on local textural patterns for facial feature extraction. Int J Comp Vis Image Process (IJCVIP) 8(2):1–26

    Google Scholar 

  • VenkateswarLal P, Nitta GR, Prasad A (2019) Ensemble of texture and shape descriptors using support vector machine classification for face recognition. J Ambient Intell Humaniz Comput 10(1):1–8

    Google Scholar 

  • Vipparthi SK, Murala S, Sagar SK (2015) Local gabor maximum edge position octal patterns for image retrieval. Nuero Comput 167:336–345

    Google Scholar 

  • Virrey RA, Liyanage CDS, Petra MIBPH, Abas PE (2019) Visual data of facial expressions for automatic pain detection. J Vis Commun Image Represent 61:209–217

    Article  Google Scholar 

  • Wirsing M, Sebastian SB, Schroeder A (2010) Modeling and analyzing adaptive user-centric systems in real-time mode. In: RTRTS 2010 first international workshop on rewriting techniques for real-time systems, pp 1–25

  • Wolf L, Hassner T, Taigman Y (2008) Descriptor based methods in the wild. In: Real-life images workshop at the European conference on computer vision (ECCV)

  • Xhafa F, Wang J, Chen X, Liu J, Li J, Krause P (2014) An efficient PHR service system supporting fuzzy keyword search and finegrained access control. Soft Comput 18(9):1795–1803. https://doi.org/10.1007/s00500-013-1202-8

    Article  Google Scholar 

  • Yang J, Zhang D, Frangi AF, Yang J (2004) “Two-dimensional PCA: a new approach to appearance-based face representation and recognition. IEEE Trans Pattern Anal Mach Intell 26:131–137

    Article  Google Scholar 

  • Zhang B, Gao Y, Zhao S, Liu J (2010) Local derivative pattern versus local binary pattern: face recognition with high-order local pattern descriptor. IEEE Trans Image Process 19(2):533–544

    Article  MathSciNet  MATH  Google Scholar 

  • Zhang Z, Lu G, Yan J, Li H, Sun N, Li X (2018) Compact local Gabor directional number pattern for facial expression recognition. Turk J Electr Eng Comput Sci 26:1236–1248

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Computer Science and Engineering, Vardhaman College of Engineering, Hyderabad, India

    V. Uma Maheswari

  2. Department of Computer Science and Engineering, B.M.S. College of Engineering, Bangaluru, India

    G. Varaprasad

  3. Department of Computer Science and Engineering, JNTUHCEJ, Jagityal, Karimnagar, India

    S. Viswanadha Raju

Authors
  1. V. Uma Maheswari
    View author publications

    You can also search for this author inPubMed Google Scholar

  2. G. Varaprasad
    View author publications

    You can also search for this author inPubMed Google Scholar

  3. S. Viswanadha Raju
    View author publications

    You can also search for this author inPubMed Google Scholar

Corresponding author

Correspondence to V. Uma Maheswari.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

This article has been retracted. Please see the retraction notice for more detail: https://doi.org/10.1007/s12652-022-04301-1

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Maheswari, V.U., Varaprasad, G. & Raju, S.V. RETRACTED ARTICLE: Local Directional Maximum Edge Patterns for facial expression recognition. J Ambient Intell Human Comput 12, 4775–4783 (2021). https://doi.org/10.1007/s12652-020-01886-3

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s12652-020-01886-3

Keywords