Skip to main content
SpringerLink
Log in

A Semantic-Driven Music Recommendation Model for Digital Photo Albums

  • Conference paper
  • First Online:
Semantic Web and Web Science

Part of the book series: Springer Proceedings in Complexity ((SPCOM))

  • 1752 Accesses

Abstract

Digital photo album softwares like iPhoto have enjoyed great popularity for years. These years, online photo album services (e.g., Flickr and Picasa) have been becoming more and more popular with the development of social Web. In this paper, we present a semantic-driven model to recommend music for photo albums automatically. In particular, we exploit semantic data to represent both images and music. Furthermore, we leverage mining techniques to capture semantic relatedness between these different types of multimedia data, which is the essential step for recommendation. In the experiment, our method achieved a performance of about 68% satisfaction measured by participants’ feedback.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 169.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 219.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 219.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    http://www.apple.com/ilife/iphoto/.

  2. 2.

    http://www.flickr.com/.

  3. 3.

    https://picasaweb.google.com/.

  4. 4.

    http://www.facebook.com/.

  5. 5.

    http://en.wikipedia.org/wiki/Flickr.

  6. 6.

    http://en.wikipedia.org/wiki/Facebook.

  7. 7.

    http://www.photoweeklyonline.com/.

  8. 8.

    http://allmusic.com/.

  9. 9.

    http://wordnet.princeton.edu/.

  10. 10.

    http://en.wikipedia.org/.

  11. 11.

    http://www.image-net.org/.

  12. 12.

    http://www.flickr.com/services/api/.

  13. 13.

    http://dbtune.org/.

  14. 14.

    http://www.last.fm/.

  15. 15.

    http://www.google.cn/music/.

References

  1. Banerjee, S., Pedersen, T.: An adapted lesk algorithm for word sense disambiguation using WordNet. Lect. Note Comput. Sci. 2276, 136–145 (2001)

    Article  Google Scholar 

  2. Barnard, K., Duygulu, P., Forsyth, D., de Freitas, N., Blei, D.M., Jordan, M.I.: Matching words and pictures. J. Mach. Learn. Res. 3, 1107–1135 (2003)

    MATH  Google Scholar 

  3. Bollegala, D., Matsuo, Y., Ishizuka, M.: Measuring semantic similarity between words using web search engines. In: Williamson, C.L., Zurko, M.E., Patel-Schneider, P.F., Shenoy, P.J. (eds.) WWW. pp. 757–766. ACM, New York (2007)

    Google Scholar 

  4. Carneiro, G., Chan, A.B., Moreno, P.J., Vasconcelos, N.: Supervised learning of semantic classes for image annotation and retrieval. IEEE Trans. Pattern Anal. Mach. Intell. 29(3), 394–410 (2007)

    Article  Google Scholar 

  5. Cilibrasi, R., Vitanyi, P.M.B.: The google similarity distance. IEEE Trans. Knowl. Data Eng. (3), 370–383 (2007)

    Article  Google Scholar 

  6. Deng, J., Dong, W., Socher, R., Li, L.J., Li, K., Fei, L.F.: Imagenet: A large-scale hierarchical image database. In: CVPR, pp. 248–255 (2009)

    Google Scholar 

  7. Duygulu, P., Barnard, K., de Freitas, J.F.G., Forsyth, D.A.: Object recognition as machine translation: Learning a lexicon for a fixed image vocabulary. In: ECCV, p. IV: 97 ff. (2002)

    Google Scholar 

  8. Fellbaum, C.: WordNet: An Electronic Lexical Database. MIT Press (1998)

    Google Scholar 

  9. Gabrilovich, E., Markovitch, S.: Computing semantic relatedness using wikipedia-based explicit semantic analysis. In: Veloso, M.M. (ed.) IJCAI, pp. 1606–1611 (2007)

    Google Scholar 

  10. Gracia, J., Mena, E.: Web-based measure of semantic relatedness. In: The 9th International Conference on Web Information Systems Engineering, pp. 136–150. Springer, Berlin, Heidelberg (2008)

    Google Scholar 

  11. Gurevych, I.: Using the structure of a conceptual network in computing semantic relatedness. In: Dale, R., Wong, K.F., Su, J., Kwong, O.Y. (eds.) IJCNLP. Lecture Notes in Computer Science, vol. 3651, pp. 767–778. Springer, New York (2005)

    Google Scholar 

  12. Hirst, G., St-Onge, D.: Lexical chains as representations of context for detection and correction of malapropisms. In: Fellbaum, C. (ed.) WordNet: An Electronic Lexical Database, pp. 305–332. MIT Press, Cambridge, MA (1998)

    Google Scholar 

  13. Jarmasz, M., Szpakowicz, S.: Roget’s thesaurus and semantic similarity. In: Nicolov, N., Bontcheva, K., Angelova, G., Mitkov, R. (eds.) RANLP. Current Issues in Linguistic Theory (CILT), vol. 260, pp. 111–120. John Benjamins, Amsterdam/Philadelphia (2003)

    Google Scholar 

  14. Jin, R., Chai, J.Y., Si, L.: Effective automatic image annotation via a coherent language model and active learning. In: Schulzrinne, H., Dimitrova, N., Sasse, M.A., Moon, S.B., Lienhart, R. (eds.) ACM Multimedia, pp. 892–899. ACM, New York (2004)

    Google Scholar 

  15. Leacock, C., Chodorow, M.: Combining local context and WordNet similarity for word sense identification. In: Fellbaum, C. (ed.) WordNet: An Electronic Lexical Database, pp. 265–283. MIT Press, Cambridge, MA (1998)

    Google Scholar 

  16. Li, J., Wang, J.Z.: Real-time computerized annotation of pictures. IEEE Trans. Pattern Anal. Mach. Intell. 30(6), 985–1002 (2008)

    Article  Google Scholar 

  17. Lux, M., Chatzichristofis, S.A.: Lire: lucene image retrieval: an extensible java CBIR library. In: El-Saddik, A., Vuong, S., Griwodz, C., Bimbo, A.D., Candan, K.S., Jaimes, A. (eds.) ACM Multimedia, pp. 1085–1088. ACM, New York (2008)

    Google Scholar 

  18. Miller, G.A.: Wordnet: A lexical database for english. Commun. ACM 38(11), 39–41 (1995)

    Article  Google Scholar 

  19. Mori, Y., Takahashi, H.: Image-to-word transformation based on dividing and vector quantizing images with words (Oct 27 1999)

    Google Scholar 

  20. Patwardhan, S., Pedersen, T.: Using WordNet-based context vectors to estimate the semantic relatedness of concepts. In: Proceedings of the EACL 2006 Workshop on Making Sense of Sense: Bringing Computational Linguistics and Psycholinguistics Together, pp. 1–8. Trento, Italy (April 2006)

    Google Scholar 

  21. Rada, R., Mili, H., Bicknell, E., Blettner, M.: Development and application of a metric on semantic nets. IEEE Trans. Syst. Man Cybern. 19(1), 17–30 (1989)

    Article  Google Scholar 

  22. Seco, N., Veale, T., Hayes, J.: An intrinsic information content metric for semantic similarity in wordnet. In: de Mántaras, R.L., Saitta, L. (eds.) ECAI, pp. 1089–1090. IOS Press (2004)

    Google Scholar 

  23. Spanakis, G., Siolas, G., Stafylopatis, A.: A hybrid web-based measure for computing semantic relatedness between words. In: The 2009 21st IEEE International Conference on Tools with Artificial Intelligence, pp. 441–448. Washington, DC (2009)

    Google Scholar 

  24. Strube, M., Ponzetto, S.P.: Wikirelate! computing semantic relatedness using wikipedia. In: 21. AAAI/18. IAAI 2006. AAAI Press, Atlanta, Georgia (2006)

    Google Scholar 

  25. Swartz, A.: Musicbrainz: A semantic web service. IEEE Intell. Syst. 17(1), 76–77 (2002)

    Article  Google Scholar 

  26. Wang, J.Z., Li, J.: Learning-based linguistic indexing of pictures with 2-D MHMMs. In: Proceedings of the Tenth ACM International Conference on Multimedia (MM-02), pp. 436–445. ACM Press, New York (2002)

    Google Scholar 

  27. Wu, Z., Palmer, M.S.: Verb semantics and lexical selection. In: ACL, pp. 133–138 (1994)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Computer Science and Engineering, APEX Data & Knowledge Management Lab, Shanghai Jiao Tong University, Shanghai, P.R.China

    Jiansong Chao, Haofen Wang, Wenlei Zhou, Weinan Zhang & Yong Yu

Authors
  1. Jiansong Chao
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Haofen Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Wenlei Zhou
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Weinan Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Yong Yu
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Jiansong Chao .

Editor information

Editors and Affiliations

  1. , Dept. of Computer Science and Technology, Tsinghua University, Room 10-206, East main building, Beijing, 100084, China, People's Republic

    Juanzi Li

  2. , School of Comp. Sci. & Eng., Southeast University, Dongda Road 2, Nanjing, 211189, Jiangsu, China, People's Republic

    Guilin Qi

  3. Peking University, Inst. of Computer Science & Tech., North Zhongguancun Street 128, Beijing, 100871, China, People's Republic

    Dongyan Zhao

  4. L3S Research Center, Leibniz University Hannover, Appelstr. 4, Hannover, 30167, Germany

    Wolfgang Nejdl

  5. Tsinghua Campus H202B, Shenzhen City, 518055, China, People's Republic

    Hai-Tao Zheng

Rights and permissions

Reprints and permissions

Copyright information

© 2013 Springer Science+Business Media New York

About this paper

Cite this paper

Chao, J., Wang, H., Zhou, W., Zhang, W., Yu, Y. (2013). A Semantic-Driven Music Recommendation Model for Digital Photo Albums. In: Li, J., Qi, G., Zhao, D., Nejdl, W., Zheng, HT. (eds) Semantic Web and Web Science. Springer Proceedings in Complexity. Springer, New York, NY. https://doi.org/10.1007/978-1-4614-6880-6_32

Download citation

  • DOI: https://doi.org/10.1007/978-1-4614-6880-6_32

  • Published:

  • Publisher Name: Springer, New York, NY

  • Print ISBN: 978-1-4614-6879-0

  • Online ISBN: 978-1-4614-6880-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation