Skip to main content
SpringerLink
Log in

A Novel Approach Based on Multi-View Content Analysis and Semi-Supervised Enrichment for Movie Recommendation

  • Regular Paper
  • Published:
Journal of Computer Science and Technology Aims and scope Submit manuscript

Abstract

Although many existing movie recommender systems have investigated recommendation based on information such as clicks and tags, much less efforts have been made to explore the multimedia content of movies, which has potential information for the elicitation of the user’s visual and musical preferences. In this paper, we explore the content from three media types (image, text, audio) and propose a novel multi-view semi-supervised movie recommendation method, which represents each media type as a view space for movies. The three views of movies are integrated to predict the rating values under the multi-view framework. Furthermore, our method considers the casual users who rate limited movies. The algorithm enriches the user profile with a semi-supervised way when there are only few rating histories. Experiments indicate that the multimedia content analysis reveals the user’s profile in a more comprehensive way. Different media types can be a complement to each other for movie recommendation. And the experimental results validate that our semi-supervised method can effectively enrich the user profile for recommendation with limited rating history.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Park J, Lee S J, Lee S J et al. Online video recommendation through tag-cloud aggregation. IEEE MultiMedia, 2011, 18(1): 78–87.

    Article  Google Scholar 

  2. Hu J, Wang B, Liu Y, Li D Y. Personalized tag recommendation using social influence. Journal of Computer Science and Technology, 2012, 27(3): 527–540.

    Article  Google Scholar 

  3. Manzato M G. Discovering latent factors from movies genres for enhanced recommendation. In Proc. the 6th ACM Conference on Recommender Systems, Sept. 2012, pp.249–252.

  4. Qumsiyeh R, Ng Y K. Predicting the ratings of multimedia items for making personalized recommendations. In Proc. the 35th ACM SIGIR Int. Conf. Research and Development in Information Retrieval, Aug. 2012, pp.475–484.

  5. Davidson J, Liebald B, Liu J et al. The YouTube video recommendation system. In Proc. the 4th ACM Conference on Recommender Systems, Sept. 2010, pp.293–296.

  6. Chen B, Wang J, Huang Q, Mei T. Personalized video recommendation through tripartite graph propagation. In Proc. the 20th ACM Int. Conf. Multimedia, Oct. 2012, pp.1133–1136.

  7. Zhao X, Li G, Wang M et al. Integrating rich Information for video recommendation with multi-task rank aggregation. In Proc. the 19th ACM Int. Conf. Multimedia, Nov. 2011, pp.1521–1534.

  8. Esparza S G, O’Mahony M P, Smyth B. On the real-time web as a source of recommendation knowledge. In Proc. the 4th ACM Conf. Recommender Systems, Sept. 2010, pp.305–308.

  9. Mei T, Yang B, Hua X S, Li S. Contextual video recommendation by multimodal relevance and user feedback. ACM Transactions on Information Systems, 2011, 29(2): Article No. 10.

  10. Toutanova K, Klein D, Manning C D, Singer Y. Feature-rich part-of-speech tagging with a cyclic dependency network. In Proc. the 2003 Conf. the North American Chapter of the Association for Computational Linguistics on Human Language Technologies, May 2003, pp.173–180.

  11. Carrer-Neto W, Hernandez-Alcaraz M L, Valencia-Garcia R, Garcia-Sanchez F. Social knowledge-based recommender system. Application to the movies domain. Journal of Expert Systems with Applications, 2012, 39(12): 10990–11000.

    Article  Google Scholar 

  12. Said A. Identifying and utilizing contextual data in hybrid recommender systems. In Proc. the 4th ACM Conference on Recommender Systems, Sept. 2010, pp.365–368.

  13. Shi Y, Larson M, Hanjalic A. Mining mood-specific movie similarity with matrix factorization for context-aware recommendation. In Proc. the Workshop on Context-Aware Movie Recommendation, Sept. 2010, pp.34–40.

  14. Ganter Z, Rendle S, Schimidt-Thieme L. Factorization models for context-/time-aware movie recommendations. In Proc. the Workshop on Context-Aware Movie Recommendation, Sept. 2010, pp.14–19.

  15. Biancalana C, Gasparetti F, Micarelli A, Miola A, Sansonetti G. Context-aware movie recommendation based on signal processing and machine learning. In Proc. the 2nd Challenge on Context-Aware Movie Recommendation, Oct. 2011, pp.5–10.

  16. Chen T, Lu A, Hu S M. Visual storylines: Semantic visualization of movie sequence. Computer & Graphics, 2012, 36(4):241–249.

    Article  Google Scholar 

  17. Parry M L, Legg P A, Chung D H S et al. Hierarchical event selection for video storyboards with a case study on snooker video visualization. IEEE Trans. Visualization and Computer Graphics, 2011, 17(12): 1747–1756.

    Article  Google Scholar 

  18. Hoeferlin M, Kurzhals K, Hoeferlin B et al. Evaluation of fast-forward video visualization. IEEE Trans. Visualization and Computer Graphics, 2012, 18(12): 2095–2103.

    Article  Google Scholar 

  19. Yarowsky D. Unsupervised word sense disambiguation rivaling supervised methods. In Proc. the 33rd Meeting on Association for Computational Linguistics, June 1995, pp.189–196.

  20. Usunier N, Amini M R, Goutte C. Multiview semi-supervised learning for ranking multilingual documents. In Proc. the 2011 European Conf. Machine Learning and Knowledge Discovery in Databases, Sept. 2011, Vol.3, pp.443-458.

  21. Smeulders A W M, Worring M, Santini S et al. Contentbased image retrieval at the end of the early years. IEEE Trans. Pattern Analysis and Machine Intelligence, 2000, 22(12): 1349–1380.

    Article  Google Scholar 

  22. Solli M, Lenz R. Color emotions for image classification and retrieval. In Proc. the 4th European Conference on Colour in Graphics, Imaging, and Vision, June 2008, pp.367-371.

  23. Wang X H, Jia J, Liao H Y, Cai L H. Affective image colorization. Journal of Computer Science and Technology, 2012, 27(6): 1119–1128.

    Article  Google Scholar 

  24. Ou L, Luo M, Woodcock A et al. A study of colour emotion and colour preference — Part 1: Colour emotion for single colours. Color Research & Application, 2005, 29(3): 232–240.

    Article  Google Scholar 

  25. Varam M, Zisserman A. A statistical approach to texture classification from single images. Journal of Computer Vision, 2005, 62(1/2): 61–81.

    Article  Google Scholar 

  26. Toutanova K, Klein D, Manning C D, Singer Y. Feature-rich part-of-speech tagging with a cyclic dependency network. In Proc. the 2003 Conf. the North American Chapter of the Association for Computational Linguistics on Human Language Technologies, May 2003, pp.173-180.

  27. Finkel J R, Grenager T, Manning C. Incorporating non-local information into information extraction systems by Gibbs sampling. In Proc. the 43rd Annual Meeting on Association for Computational Linguistics, June 2005, pp.363-370.

  28. Porter M F. An algorithm for suffix stripping. In Readings in Information Retrieval, Jones K S, Willett P (eds.), Morgan Kaufmann Publishers Inc., 1997, pp.313-317.

  29. Scherer K R, Zentner M R. Emotional effects of music: Production rules. In Music and Emotion: Theory and Research, Juslin P, Sloboda J (eds.), New York: Oxford University Press, 2001, pp.361-387.

    Google Scholar 

  30. Hunter P G, Schellenburg E G, Schimmack U. Feelings and perceptions of happiness and sadness induced by music: Similarities, differences, and mixed emotions. Psychology of Aesthetics, Creativity and the Arts, 2010, 4(1): 47–56.

    Article  Google Scholar 

  31. Logan B. Mel frequency cepstral coefficients for music modeling. In Proc. Int. Symp. Music Information Retrieval, Oct. 2000.

  32. Casey M A, Veltkamp R, Goto M, Leman M, Rhodes C, Slaney M. Content-based music information retrieval: Current directions and future challenges. Proceedings of the IEEE, 2008, 96(4):668–696.

    Article  Google Scholar 

  33. McKinney M F, Breeebat J. Features for audio and music classification. In Proc. the International Symposium on Music Information Retrieval, Oct. 2003.

  34. Gabrielsson A, Lindstrom E. The influence of musical structure on emotional expression. In Music and Emotion: Theory and Research, Juslin P N, Sloboda J A (eds.), New York: Oxford University Press, 2001, pp.23–248.

  35. Zhang J, Marszalek M, Lazebnik S et al. Local features and kernels for classification of texture and object categories: A comprehensive study. J. Computer Vision, 2007, 73(2): 213–238.

    Article  Google Scholar 

  36. Lartillot O, Toiviainen P. A Matlab toolbox for musical feature extraction from audio. In Proc. the 10th International Conference on Digital Audio Effects, Sept. 2007.

  37. Ricci F, Rokach L, Shapira B, Knator P B. Recommender Systems Handbook. Springer, 2011.

Download references

Author information

Authors and Affiliations

  1. School of Information Science and Engineering, Northeastern University, Shenyang, 110819, China

    Wen Qu, Kai-Song Song, Yi-Fei Zhang, Shi Feng, Da-Ling Wang & Ge Yu

Authors
  1. Wen Qu
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Kai-Song Song
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Yi-Fei Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Shi Feng
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Da-Ling Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Ge Yu
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Ge Yu.

Additional information

Supported by the National Basic Research 973 Program of China under Grant No. 2011CB302200-G, the Key Program of National Natural Science Foundation of China under Grant No. 61033007, the National Natural Science Foundation of China under Grant Nos. 61100026, 60973019, and the Fundamental Research Funds for the Central Universities of China under Grant Nos. N110604003, N100704001, N100304004, N120404007.

Electronic supplementary material

Below is the link to the electronic supplementary material.

(DOCX 13 kb)

Rights and permissions

Reprints and permissions

About this article

Cite this article

Qu, W., Song, KS., Zhang, YF. et al. A Novel Approach Based on Multi-View Content Analysis and Semi-Supervised Enrichment for Movie Recommendation. J. Comput. Sci. Technol. 28, 776–787 (2013). https://doi.org/10.1007/s11390-013-1376-7

Download citation

  • Received:

  • Revised:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11390-013-1376-7

Keywords

Search

Navigation