Abstract
Deep learning has grabed more and more interest in recent year’s in order to the development and implementation of big data. Convolutional neural networks that are deep learning neural networks are crucial for facial picture identification. In this paper, a model recognizes facial expressions and suggests music and recommends book based on related mood is constructed using a mix of automatic music and book recommendation algorithm based on their choices using convolutional neural network for facial recognition technology. This type of suggestion system is authentic and real- time. This research creates a facial expression identification model using FER2013. When implemented on library robots, the facial expression recognition- based book recommendation system can enhance users' experience. The identification of the matching micro expression, the feature of the song is extracted using a history by content for music recommendation algorithm, an innovative approach is then employed to provide the appropriate recommendation. We conclude this paper with the 77% accuracy and recommend suitable music and appropriate book for the users.







Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.References
Gautam P, Bhardwaj R, Gupta A (2021) Facial emotion recognition using deep learning: a review. IEEE Access. ISSN: 2169–3536. https://doi.org/10.1109/ACCESS.2021.3103887
Zhang L, Liu Y, Li J (2022) Real-time emotion recognition system based on convolutional neural network. Pattern Recognition Letters. ISSN: 0167–8655. https://doi.org/10.1016/j.patrec.2022.02.010
Singh MK, Gupta PK, Shukla S K (2023) Music recommendation system based on emotion recognition. J Ambient Intell Human Comput. ISSN: 1868–5137. https://doi.org/10.1007/s12652-023-03345-2
Miller AR, Lee TJ (2023) Deep learning approaches for emotion-based book recommendations. Expert Systems with Applications. ISSN: 0957–4174. https://doi.org/10.1016/j.eswa.2023.117257
Wang S, Zhao X, Kim H (2024) Hybrid emotion recognition framework for real-time applications. Neural Computing and Applications. ISSN: 1433–3058. https://doi.org/10.1007/s00521-024-06150-2
Verma R, Singh JP (2024) User-centric emotion recognition and recommendation systems. Human-Centric Computing and Information Sciences. ISSN: 2192–1962. https://doi.org/10.1186/s13673-024-00322-8
Chen AN, Liu BT, Zhao CX (2022) Deep emotion recognition for personalized content recommendation. IEEE Transactions on Affective Computing. ISSN: 1949–3045. https://doi.org/10.1109/TAFFC.2022.3149490
Park KS, Lee MH, Kim YJ (2021) Emotion-aware recommender systems: Challenges and opportunities. Information Fusion. ISSN: 1566–2535. https://doi.org/10.1016/j.inffus.2021.03.009
Rodriguez JP, Gupta ST, Martinez LN (2023) Facial expression recognition for adaptive learning systems. Comput Educ. ISSN: 0360–1315. https://doi.org/10.1016/j.compedu.2023.104360
Thompson MJ, Black RA, White ED (2024) Hybrid deep learning models for emotion recognition in multimedia. J Multimedia Tools Appl ISSN: 1573–7721. https://doi.org/10.1007/s11042-024-11741-8
Lin PQ, Zhang YF, Wang DH (2022) Emotion recognition with multi-modal data for enhanced personalization. Neurocomputing. ISSN: 0925–2312. https://doi.org/10.1016/j.neucom.2022.04.043
Brown SR, Green AM, Lewis TB (2023) Real-time emotion recognition in mobile applications. Mobile Information Systems. ISSN: 1574–017X. https://doi.org/10.1155/2023/123456
Goh KM, Ng CH, Lim LL, Sheikh UU. Micro-expression recognition: an updated review of current trends, challenges and solutions. Vis Comput. 2020;36:445–68.
Mu R, Zeng X. A review of deep learning research. KSII Transactions on Internet and Information Systems (TIIS). 2019;13(4):1738–64.
Szegedy C, Liu W, Jia Y, Sermanet P, Reed S, Anguelov D, Rabinovich A (2015) Going deeper with convolutions. In: Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 1–9).
Ekman P, Friesen WV. Constants across cultures in the face and emotion. J Pers Soc Psychol. 1971;17(2):124.
Gottman J, Levenson R, Woodin E. Facial expressions during marital conflict. J Fam Commun. 2001;1(1):37–57.
Huijun S. Research and implementation of face recognition image preprocessing method. Sci Technol Innovation. 2014;18:119–20.
Takalkar M, Xu M, Wu Q, Chaczko Z. A survey: facial micro-expression recognition. Multimedia Tools Appl. 2018;77(15):19301–25.
Mingqi L, Guoqiang N, Xiaomei C. Research on pretreatment algorithm of dorsal vein image. Opt Technol. 2007;33:255–6.
Alharthi H, Inkpen D, Szpakowicz S (2017) Unsupervised Topic Modelling in a Book Recommender System for New Users. In eCOM@ SIGIR. Castleman, K. R. (1996). Digital image processing. Prentice Hall Press.
Xia Z (2019) An overview of deep learning. Deep Learning in Object Detection and Recognition, 1–18.
Liu S, Chen Z, Wang F, Zhao Z (2019) Multi-angle face recognition based on convolutional neural network. Journal of North China University of Science and Technology (Natural Science Edition), 10.
Wu S, Wang B. Facial expression recognition based on computer deep learning algorithm: taking cognitive acceptance of college students as an example. J Ambient Intell Humaniz Comput. 2021;13(1):45.
Yao LS, Xu GM, Zhap F. Facial expression recognition based on CNN local feature fusion. Laser Optoelectronics Progress. 2020;57(03): 032501.
Xie S, Hu H. Facial expression recognition with FRR-CNN. Electron Lett. 2017;53(4):235–7.
Lu R, Li Y, Yang P, Zhang W (2021) Facial expression recognition based on convolutional neural network. In Journal of Physics: Conference Series (Vol. 1757, No. 1, p. 012100). IOP Publishing.
Jiang L, Cheng Y, Yang L, Li J, Yan H, Wang X. A trust-based collaborative filtering algorithm for E-commerce recommendation system. J Ambient Intell Humaniz Comput. 2019;10:3023–34.
Xu M, Cheng W, Zhao Q, Ma L, Xu F (2015) Facial expression recognition based on transfer learning from deep convolutional networks. In 2015 11th International Conference on Natural Computation (ICNC) (pp. 702–708). IEEE.
Yan J, Liu Y, Zhang P, Wang X, Lin C (2024) FER-YOLO-Mamba: Facial Expression Detection and Classification Based on Selective State Space. arXiv preprint arXiv:2405.12345.
D (2023). New trends in emotion recognition using image analysis by neural networks: a systematic review. Sensors, 23(16), 7092
Patel K, Mehta M, Desai A. Facial emotion recognition under mask coverage using a data augmentation technique. J Artificial Intell Res. 2023;70(12):1234–45.
Wang H, Zhou Z, Li Q, Yang Y (2024) GiMeFive: Towards Interpretable Facial Emotion Classification. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR).
Chavan P, Satyanarayana Reddy K Integrated Cross Layer Optimization Approach For Quality Of Service Enhancement In Wireless Network Published in Scopus ISSN: 0976–5166, Volume-12 Issue-4, August 2021.
Ramachandra HV, Chavan P, Ali A, amaprasad HCEnsemble Machine Learning Techniques for Pancreatic Cancer Detection. Published in 2023 IEEE International Conference on Applied Intelligence and Sustainable Computing (ICAISC) June-203. https://doi.org/10.1109/ICAISC58445.2023.10200380
Ramachandra HV, Chavan P, Ramaprasad HC, Chatrapathy K Secured Wireless Network Based on a Novel Dual Integrated Neural Network Architecture. Published in Hindawi- Journal of Electrical and Computer Engineering Volume 2023, Article ID 9390660 ,September-2023.( Scopus Q2 Journal) https://doi.org/10.1155/2023/9390660m
Chavan P, Malyadri N, Tabassum H, Supreeth S, Bhaskar Reddy PV Dual Step Hybrid Mechanism for Energy Efficiency Maximization inWireless Network. Published in CYBERNETICS AND INFORMATION TECHNOLOGIES ,ISSN: 1314–4081, Volume-23 Issue-3, September-2023.(Q2 Scopus Journal) https://doi.org/10.2478/cait-2023-0025
Chavan P, Ali A, Ramaprasad HC, Ramachandra HV, Hari Krishna H, Satish EG Analysis of Wireless Networks: Successful and Failure Existing Technique. Published in International Conference on Advances in Data-driven Computing and Intelligent Systems (ADCIS 2023) ISBN 978–81–955020–2–8. 1056155/978-81-955020-2-8-75
Chavan P, Hanumanthappa H, Satish EG, Manoli S, Supreeth S, Rohith S, Ramaprasad HC Enhanced Hybrid Intrusion Detection System with Attention Mechanism using Deep Learning. Published in SN Computer Science ,ISSN: 2662–995X, 5:534, May-2024.(Q2 Scopus Journal) https://doi.org/10.1007/s42979-024-02852-y
Pallavi MO, Vishwanath Y, Raj A (2023) Deep Learning Based Application in Detecting Wrinkle and Predicting Age. In 2023 International Conference on Intelligent and Innovative Technologies in Computing, Electrical and Electronics (IITCEE) (pp. 1168–1173). IEEE.
Raj A, Pallavi MO (2023) Comparative Analysis on Breast Cancer Prediction Using Machine Learning Techniques. In International Conference on Soft Computing for Security Applications (pp. 377–388). Singapore: Springer Nature Singapore.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors declare that there are no conflicts of interest regarding the publication of this paper.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Pallavi, M.O., Chavan, P. Deep Learning-Enhanced Emotional Insight: Tailored Music and Book Suggestions Through Facial Expression Recognition. SN COMPUT. SCI. 5, 1118 (2024). https://doi.org/10.1007/s42979-024-03115-6
Received:
Accepted:
Published:
DOI: https://doi.org/10.1007/s42979-024-03115-6