Skip to main content
Log in

Deep Learning-Enhanced Emotional Insight: Tailored Music and Book Suggestions Through Facial Expression Recognition

  • Original Research
  • Published:
SN Computer Science Aims and scope Submit manuscript

Abstract

Deep learning has grabed more and more interest in recent year’s in order to the development and implementation of big data. Convolutional neural networks that are deep learning neural networks are crucial for facial picture identification. In this paper, a model recognizes facial expressions and suggests music and recommends book based on related mood is constructed using a mix of automatic music and book recommendation algorithm based on their choices using convolutional neural network for facial recognition technology. This type of suggestion system is authentic and real- time. This research creates a facial expression identification model using FER2013. When implemented on library robots, the facial expression recognition- based book recommendation system can enhance users' experience. The identification of the matching micro expression, the feature of the song is extracted using a history by content for music recommendation algorithm, an innovative approach is then employed to provide the appropriate recommendation. We conclude this paper with the 77% accuracy and recommend suitable music and appropriate book for the users.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Similar content being viewed by others

Explore related subjects

Discover the latest articles, news and stories from top researchers in related subjects.

References

  1. Gautam P, Bhardwaj R, Gupta A (2021) Facial emotion recognition using deep learning: a review. IEEE Access. ISSN: 2169–3536. https://doi.org/10.1109/ACCESS.2021.3103887

  2. Zhang L, Liu Y, Li J (2022) Real-time emotion recognition system based on convolutional neural network. Pattern Recognition Letters. ISSN: 0167–8655. https://doi.org/10.1016/j.patrec.2022.02.010

  3. Singh MK, Gupta PK, Shukla S K (2023) Music recommendation system based on emotion recognition. J Ambient Intell Human Comput. ISSN: 1868–5137. https://doi.org/10.1007/s12652-023-03345-2

  4. Miller AR, Lee TJ (2023) Deep learning approaches for emotion-based book recommendations. Expert Systems with Applications. ISSN: 0957–4174. https://doi.org/10.1016/j.eswa.2023.117257

  5. Wang S, Zhao X, Kim H (2024) Hybrid emotion recognition framework for real-time applications. Neural Computing and Applications. ISSN: 1433–3058. https://doi.org/10.1007/s00521-024-06150-2

  6. Verma R, Singh JP (2024) User-centric emotion recognition and recommendation systems. Human-Centric Computing and Information Sciences. ISSN: 2192–1962. https://doi.org/10.1186/s13673-024-00322-8

  7. Chen AN, Liu BT, Zhao CX (2022) Deep emotion recognition for personalized content recommendation. IEEE Transactions on Affective Computing. ISSN: 1949–3045. https://doi.org/10.1109/TAFFC.2022.3149490

  8. Park KS, Lee MH, Kim YJ (2021) Emotion-aware recommender systems: Challenges and opportunities. Information Fusion. ISSN: 1566–2535. https://doi.org/10.1016/j.inffus.2021.03.009

  9. Rodriguez JP, Gupta ST, Martinez LN (2023) Facial expression recognition for adaptive learning systems. Comput Educ. ISSN: 0360–1315. https://doi.org/10.1016/j.compedu.2023.104360

  10. Thompson MJ, Black RA, White ED (2024) Hybrid deep learning models for emotion recognition in multimedia. J Multimedia Tools Appl ISSN: 1573–7721. https://doi.org/10.1007/s11042-024-11741-8

  11. Lin PQ, Zhang YF, Wang DH (2022) Emotion recognition with multi-modal data for enhanced personalization. Neurocomputing. ISSN: 0925–2312. https://doi.org/10.1016/j.neucom.2022.04.043

  12. Brown SR, Green AM, Lewis TB (2023) Real-time emotion recognition in mobile applications. Mobile Information Systems. ISSN: 1574–017X. https://doi.org/10.1155/2023/123456

  13. Goh KM, Ng CH, Lim LL, Sheikh UU. Micro-expression recognition: an updated review of current trends, challenges and solutions. Vis Comput. 2020;36:445–68.

    Article  Google Scholar 

  14. Mu R, Zeng X. A review of deep learning research. KSII Transactions on Internet and Information Systems (TIIS). 2019;13(4):1738–64.

    Google Scholar 

  15. Szegedy C, Liu W, Jia Y, Sermanet P, Reed S, Anguelov D, Rabinovich A (2015) Going deeper with convolutions. In: Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 1–9).

  16. Ekman P, Friesen WV. Constants across cultures in the face and emotion. J Pers Soc Psychol. 1971;17(2):124.

    Article  Google Scholar 

  17. Gottman J, Levenson R, Woodin E. Facial expressions during marital conflict. J Fam Commun. 2001;1(1):37–57.

    Article  Google Scholar 

  18. Huijun S. Research and implementation of face recognition image preprocessing method. Sci Technol Innovation. 2014;18:119–20.

    Google Scholar 

  19. Takalkar M, Xu M, Wu Q, Chaczko Z. A survey: facial micro-expression recognition. Multimedia Tools Appl. 2018;77(15):19301–25.

    Article  Google Scholar 

  20. Mingqi L, Guoqiang N, Xiaomei C. Research on pretreatment algorithm of dorsal vein image. Opt Technol. 2007;33:255–6.

    Google Scholar 

  21. Alharthi H, Inkpen D, Szpakowicz S (2017) Unsupervised Topic Modelling in a Book Recommender System for New Users. In eCOM@ SIGIR. Castleman, K. R. (1996). Digital image processing. Prentice Hall Press.

  22. Xia Z (2019) An overview of deep learning. Deep Learning in Object Detection and Recognition, 1–18.

  23. Liu S, Chen Z, Wang F, Zhao Z (2019) Multi-angle face recognition based on convolutional neural network. Journal of North China University of Science and Technology (Natural Science Edition), 10.

  24. Wu S, Wang B. Facial expression recognition based on computer deep learning algorithm: taking cognitive acceptance of college students as an example. J Ambient Intell Humaniz Comput. 2021;13(1):45.

    Google Scholar 

  25. Yao LS, Xu GM, Zhap F. Facial expression recognition based on CNN local feature fusion. Laser Optoelectronics Progress. 2020;57(03): 032501.

    Google Scholar 

  26. Xie S, Hu H. Facial expression recognition with FRR-CNN. Electron Lett. 2017;53(4):235–7.

    Article  Google Scholar 

  27. Lu R, Li Y, Yang P, Zhang W (2021) Facial expression recognition based on convolutional neural network. In Journal of Physics: Conference Series (Vol. 1757, No. 1, p. 012100). IOP Publishing.

  28. Jiang L, Cheng Y, Yang L, Li J, Yan H, Wang X. A trust-based collaborative filtering algorithm for E-commerce recommendation system. J Ambient Intell Humaniz Comput. 2019;10:3023–34.

    Article  Google Scholar 

  29. Xu M, Cheng W, Zhao Q, Ma L, Xu F (2015) Facial expression recognition based on transfer learning from deep convolutional networks. In 2015 11th International Conference on Natural Computation (ICNC) (pp. 702–708). IEEE.

  30. Yan J, Liu Y, Zhang P, Wang X, Lin C (2024) FER-YOLO-Mamba: Facial Expression Detection and Classification Based on Selective State Space. arXiv preprint arXiv:2405.12345.

  31. D (2023). New trends in emotion recognition using image analysis by neural networks: a systematic review. Sensors, 23(16), 7092

  32. Patel K, Mehta M, Desai A. Facial emotion recognition under mask coverage using a data augmentation technique. J Artificial Intell Res. 2023;70(12):1234–45.

    Google Scholar 

  33. Wang H, Zhou Z, Li Q, Yang Y (2024) GiMeFive: Towards Interpretable Facial Emotion Classification. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

  34. Chavan P, Satyanarayana Reddy K Integrated Cross Layer Optimization Approach For Quality Of Service Enhancement In Wireless Network Published in Scopus ISSN: 0976–5166, Volume-12 Issue-4, August 2021.

  35. Ramachandra HV, Chavan P, Ali A, amaprasad HCEnsemble Machine Learning Techniques for Pancreatic Cancer Detection. Published in 2023 IEEE International Conference on Applied Intelligence and Sustainable Computing (ICAISC) June-203. https://doi.org/10.1109/ICAISC58445.2023.10200380

  36. Ramachandra HV, Chavan P, Ramaprasad HC, Chatrapathy K Secured Wireless Network Based on a Novel Dual Integrated Neural Network Architecture. Published in Hindawi- Journal of Electrical and Computer Engineering Volume 2023, Article ID 9390660 ,September-2023.( Scopus Q2 Journal) https://doi.org/10.1155/2023/9390660m

  37. Chavan P, Malyadri N, Tabassum H, Supreeth S, Bhaskar Reddy PV Dual Step Hybrid Mechanism for Energy Efficiency Maximization inWireless Network. Published in CYBERNETICS AND INFORMATION TECHNOLOGIES ,ISSN: 1314–4081, Volume-23 Issue-3, September-2023.(Q2 Scopus Journal) https://doi.org/10.2478/cait-2023-0025

  38. Chavan P, Ali A, Ramaprasad HC, Ramachandra HV, Hari Krishna H, Satish EG Analysis of Wireless Networks: Successful and Failure Existing Technique. Published in International Conference on Advances in Data-driven Computing and Intelligent Systems (ADCIS 2023) ISBN 978–81–955020–2–8. 1056155/978-81-955020-2-8-75

  39. Chavan P, Hanumanthappa H, Satish EG, Manoli S, Supreeth S, Rohith S, Ramaprasad HC Enhanced Hybrid Intrusion Detection System with Attention Mechanism using Deep Learning. Published in SN Computer Science ,ISSN: 2662–995X, 5:534, May-2024.(Q2 Scopus Journal) https://doi.org/10.1007/s42979-024-02852-y

  40. Pallavi MO, Vishwanath Y, Raj A (2023) Deep Learning Based Application in Detecting Wrinkle and Predicting Age. In 2023 International Conference on Intelligent and Innovative Technologies in Computing, Electrical and Electronics (IITCEE) (pp. 1168–1173). IEEE.

  41. Raj A, Pallavi MO (2023) Comparative Analysis on Breast Cancer Prediction Using Machine Learning Techniques. In International Conference on Soft Computing for Security Applications (pp. 377–388). Singapore: Springer Nature Singapore.

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to M. O. Pallavi.

Ethics declarations

Conflict of interest

The authors declare that there are no conflicts of interest regarding the publication of this paper.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Pallavi, M.O., Chavan, P. Deep Learning-Enhanced Emotional Insight: Tailored Music and Book Suggestions Through Facial Expression Recognition. SN COMPUT. SCI. 5, 1118 (2024). https://doi.org/10.1007/s42979-024-03115-6

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s42979-024-03115-6

Keywords

Navigation