Skip to main content
Log in

A multimedia recommender integrating object features and user behavior

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Despite the great amount of work done in the last decade, retrieving information of interest from a large multimedia repository still remains an open issue. In this paper, we propose an intelligent browsing system based on a novel recommendation paradigm. Our approach combines usage patters with low-level features and semantic descriptors in order to predict users’ behavior and provide effective recommendations. The proposed paradigm is very general and can be applied to any type of multimedia data. In order to make the recommender system even more flexible, we introduce the concept of multichannel browser, i.e. a browser that allows concurrent browsing of multiple media channels. We implemented a prototype of the proposed system and tested the effectiveness of our approach in a virtual museum scenario. Experimental results have proved that the system greatly enhances users’ experience, thus encouraging further research in this direction.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5

Similar content being viewed by others

Notes

  1. Here we do not consider link-based systems mainly used in WEB search engines.

  2. Ad-hoc metrics could be defined to evaluate the similarity of non-taxonomic attributes. Without loss of generality, we omit further discussions on this topic.

  3. We will discuss in Section 6.2 how to build this set.

  4. We use cookies to track sessions, and don’t set an expiration date, so they will be deleted when the browser session ends. In this way, different users browsing the collection from a shared computer (e.g., in a public library) will not misinterpreted as the same user.

  5. The people involved in the experiments were mainly students from the University of Naples, Italy.

References

  1. Adomavicius G, Tuzhilin A (2005) Toward the next generation of recommender systems: a survey of the state-of-the-art and possible extensions. IEEE Trans Knowl Data Eng 17(6):734–749

    Article  Google Scholar 

  2. Albanese M, Chianese A, d’Acierno A, Moscato V, Picariello A (2009) A recommendation system for browsing digital libraries. In: SAC ’09: proceedings of the 24th symposium on applied computing. ACM, Honolulu pp 1771–1778

    Google Scholar 

  3. Anand SS, Kearney P, Shapcott M (2007) Generating semantically enriched user profiles for web personalization. ACM Trans Internet Technol 7(4):22

    Article  Google Scholar 

  4. Basilico J, Hofmann T (2004) Unifying collaborative and content-based filtering. In: ICML ’04: proceedings of the 21st international conference on machine learning, ACM, Banff

    Google Scholar 

  5. Ciaccia P, Patella M, Zezula P (1997) M-tree: an efficient access method for similarity search in metric spaces. In: Jarke M, et al. (eds) VLDB 97: proceedings of 23rd conference on very large database. Morgan Kaufmann, Athens, pp 426–435

    Google Scholar 

  6. Eirinaki M, Vazirgiannis M (2003) Web mining for web personalization. ACM Trans Internet Technol 3(1):1–27

    Article  Google Scholar 

  7. Fayzullin M, Subrahmanian V, Albanese M, Cesarano C, Picariello A (2007) Story creation from heterogeneous data sources. Multimed Tools Appl 33(3):351–377

    Article  Google Scholar 

  8. Hart SG, Stavenland LE (1988) Development of NASA-TLX (task load index): results of empirical and theoretical research. In: Hancock PA, Meshkati N (eds) Human mental workload, chapter 7. Elsevier, Amsterdam, pp 139–183

    Chapter  Google Scholar 

  9. Hijikata Y, Iwahama K, Nishida S (2006) Content-based music filtering system with editable user profile. In: SAC ’06: proceedings of the 21st ACM symposium on applied computing. ACM, Dijon, pp 1050–1057

    Chapter  Google Scholar 

  10. Lam XN, Vu T, Le TD, Duong AD (2008) Addressing cold-start problem in recommendation systems. In: ICUIMC ’08: proceedings of the 2nd international conference on ubiquitous information management and communication. ACM, Suwon, pp 208–211

    Chapter  Google Scholar 

  11. Lekakos G, Caravelas P (2008) A hybrid approach for movie recommendation. Multimed Tools Appl 36(1–2):55–70

    Article  Google Scholar 

  12. Levenshtein VI (1966) Binary codes capable of correcting deletions, insertions, and reversals. Sov Phys Dokl 10(8):707–710

    MathSciNet  Google Scholar 

  13. Lew MS, Sebe N, Djeraba C, Jain R (2006) Content-based multimedia information retrieval: state of the art and challenges. ACM Trans Multimedia Comput Commun Appl 2(1):1–19

    Article  Google Scholar 

  14. Li Y, Bandar ZA, Mclean D (2003) An approach for measuring semantic similarity between words using multiple information sources. IEEE Trans Knowl Data Eng 15(4):871–882

    Article  Google Scholar 

  15. Maidel V, Shoval P, Shapira B, Taieb-Maimon M (2008) Evaluation of an ontology-content based filtering method for a personalized newspaper. In: RecSys ’08: proceedings of the 2nd ACM international conference on recommender systems. ACM, Lausanne, pp 91–98

    Chapter  Google Scholar 

  16. Park S-T, Pennock DM (2007) Applying collaborative filtering techniques to movie search for better ranking and browsing. In: KDD ’07: proceedings of the 13th ACM international conference on knowledge discovery and data mining. ACM, San Jose, pp 550–559

    Chapter  Google Scholar 

  17. Pasi G, Bordogna G, Villa R (2007) A multi-criteria content-based filtering system. In: SIGIR ’07: proceedings of the 30th annual international ACM SIGIR conference. ACM, Amsterdam, pp 775–776

    Chapter  Google Scholar 

  18. Pazzani M J, Billsus D (2007) Content-based recommendation systems. In: Brusilovsky P, Kobsa A, Nejdl W (eds) The adaptive web: methods and strategies of web personalization. Lecture Notes in Computer Science, vol 4321, chapter 10. Springer, Berlin, pp 325–341

    Google Scholar 

  19. Santini S (2000) Evaluation vademecum for visual information systems. In: Proceedings of SPIE storage and retrieval for image and video databases, vol 3972. San Jose, USA, pp 132–143

    Google Scholar 

  20. Si L, Jin R (2004) Unified filtering by combining collaborative filtering and content-based filtering via mixture model and exponential model. In: CIKM ’04: proceedings of the thirteenth ACM international conference on information and knowledge management. ACM, Washington, D.C., pp 156–157

  21. Smeulders AWM, Worring M, Santini S, Gupta A, Jain R (2000) Content-based image retrieval at the end of the early years. IEEE Trans Pattern Anal Mach Intell 22(12):1349–1380

    Article  Google Scholar 

  22. Tso-Sutter KHL, Marinho LB, Schmidt-Thieme L (2008) Tag-aware recommender systems by fusion of collaborative filtering algorithms. In: SAC ’08: proceedings of the 23rd ACM symposium on applied computing. ACM, Fortaleza, pp 1995–1999

    Chapter  Google Scholar 

  23. Wang J, de Vries AP, Reinders MJT (2008) Unified relevance models for rating prediction in collaborative filtering. ACM Trans Inf Sys 26(3):1–42

    Article  MATH  Google Scholar 

  24. Yeung MM, Yeo B-L (1997) Video visualization for compact presentation and fast browsing of pictorial content. IEEE Trans Circuits Syst Video Technol 7(5):771–785

    Article  Google Scholar 

  25. Zhang HJ, Low CY, Smoliar SW, Zhong D (1995) Video parsing, retrieval and browsing: an integrated and content-based solution. In: Proceedings of the ACM international conference on multimedia. San Francisco, California, USA, November, pp 15–24

  26. Zhu X, Elmagarmid AK, Xue X, Wu L, Catlin AC (2005) Insightvideo: toward hierarchical video content organization for efficient browsing, summarization and retrieval. IEEE Trans Multimedia 7(4):648–666

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Massimiliano Albanese.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Albanese, M., Chianese, A., d’Acierno, A. et al. A multimedia recommender integrating object features and user behavior. Multimed Tools Appl 50, 563–585 (2010). https://doi.org/10.1007/s11042-010-0480-8

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-010-0480-8

Keywords

Navigation