Abstract
Digital photo album softwares like iPhoto have enjoyed great popularity for years. These years, online photo album services (e.g., Flickr and Picasa) have been becoming more and more popular with the development of social Web. In this paper, we present a semantic-driven model to recommend music for photo albums automatically. In particular, we exploit semantic data to represent both images and music. Furthermore, we leverage mining techniques to capture semantic relatedness between these different types of multimedia data, which is the essential step for recommendation. In the experiment, our method achieved a performance of about 68% satisfaction measured by participants’ feedback.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
Notes
- 1.
- 2.
- 3.
- 4.
- 5.
- 6.
- 7.
- 8.
- 9.
- 10.
- 11.
- 12.
- 13.
- 14.
- 15.
References
Banerjee, S., Pedersen, T.: An adapted lesk algorithm for word sense disambiguation using WordNet. Lect. Note Comput. Sci. 2276, 136–145 (2001)
Barnard, K., Duygulu, P., Forsyth, D., de Freitas, N., Blei, D.M., Jordan, M.I.: Matching words and pictures. J. Mach. Learn. Res. 3, 1107–1135 (2003)
Bollegala, D., Matsuo, Y., Ishizuka, M.: Measuring semantic similarity between words using web search engines. In: Williamson, C.L., Zurko, M.E., Patel-Schneider, P.F., Shenoy, P.J. (eds.) WWW. pp. 757–766. ACM, New York (2007)
Carneiro, G., Chan, A.B., Moreno, P.J., Vasconcelos, N.: Supervised learning of semantic classes for image annotation and retrieval. IEEE Trans. Pattern Anal. Mach. Intell. 29(3), 394–410 (2007)
Cilibrasi, R., Vitanyi, P.M.B.: The google similarity distance. IEEE Trans. Knowl. Data Eng. (3), 370–383 (2007)
Deng, J., Dong, W., Socher, R., Li, L.J., Li, K., Fei, L.F.: Imagenet: A large-scale hierarchical image database. In: CVPR, pp. 248–255 (2009)
Duygulu, P., Barnard, K., de Freitas, J.F.G., Forsyth, D.A.: Object recognition as machine translation: Learning a lexicon for a fixed image vocabulary. In: ECCV, p. IV: 97 ff. (2002)
Fellbaum, C.: WordNet: An Electronic Lexical Database. MIT Press (1998)
Gabrilovich, E., Markovitch, S.: Computing semantic relatedness using wikipedia-based explicit semantic analysis. In: Veloso, M.M. (ed.) IJCAI, pp. 1606–1611 (2007)
Gracia, J., Mena, E.: Web-based measure of semantic relatedness. In: The 9th International Conference on Web Information Systems Engineering, pp. 136–150. Springer, Berlin, Heidelberg (2008)
Gurevych, I.: Using the structure of a conceptual network in computing semantic relatedness. In: Dale, R., Wong, K.F., Su, J., Kwong, O.Y. (eds.) IJCNLP. Lecture Notes in Computer Science, vol. 3651, pp. 767–778. Springer, New York (2005)
Hirst, G., St-Onge, D.: Lexical chains as representations of context for detection and correction of malapropisms. In: Fellbaum, C. (ed.) WordNet: An Electronic Lexical Database, pp. 305–332. MIT Press, Cambridge, MA (1998)
Jarmasz, M., Szpakowicz, S.: Roget’s thesaurus and semantic similarity. In: Nicolov, N., Bontcheva, K., Angelova, G., Mitkov, R. (eds.) RANLP. Current Issues in Linguistic Theory (CILT), vol. 260, pp. 111–120. John Benjamins, Amsterdam/Philadelphia (2003)
Jin, R., Chai, J.Y., Si, L.: Effective automatic image annotation via a coherent language model and active learning. In: Schulzrinne, H., Dimitrova, N., Sasse, M.A., Moon, S.B., Lienhart, R. (eds.) ACM Multimedia, pp. 892–899. ACM, New York (2004)
Leacock, C., Chodorow, M.: Combining local context and WordNet similarity for word sense identification. In: Fellbaum, C. (ed.) WordNet: An Electronic Lexical Database, pp. 265–283. MIT Press, Cambridge, MA (1998)
Li, J., Wang, J.Z.: Real-time computerized annotation of pictures. IEEE Trans. Pattern Anal. Mach. Intell. 30(6), 985–1002 (2008)
Lux, M., Chatzichristofis, S.A.: Lire: lucene image retrieval: an extensible java CBIR library. In: El-Saddik, A., Vuong, S., Griwodz, C., Bimbo, A.D., Candan, K.S., Jaimes, A. (eds.) ACM Multimedia, pp. 1085–1088. ACM, New York (2008)
Miller, G.A.: Wordnet: A lexical database for english. Commun. ACM 38(11), 39–41 (1995)
Mori, Y., Takahashi, H.: Image-to-word transformation based on dividing and vector quantizing images with words (Oct 27 1999)
Patwardhan, S., Pedersen, T.: Using WordNet-based context vectors to estimate the semantic relatedness of concepts. In: Proceedings of the EACL 2006 Workshop on Making Sense of Sense: Bringing Computational Linguistics and Psycholinguistics Together, pp. 1–8. Trento, Italy (April 2006)
Rada, R., Mili, H., Bicknell, E., Blettner, M.: Development and application of a metric on semantic nets. IEEE Trans. Syst. Man Cybern. 19(1), 17–30 (1989)
Seco, N., Veale, T., Hayes, J.: An intrinsic information content metric for semantic similarity in wordnet. In: de Mántaras, R.L., Saitta, L. (eds.) ECAI, pp. 1089–1090. IOS Press (2004)
Spanakis, G., Siolas, G., Stafylopatis, A.: A hybrid web-based measure for computing semantic relatedness between words. In: The 2009 21st IEEE International Conference on Tools with Artificial Intelligence, pp. 441–448. Washington, DC (2009)
Strube, M., Ponzetto, S.P.: Wikirelate! computing semantic relatedness using wikipedia. In: 21. AAAI/18. IAAI 2006. AAAI Press, Atlanta, Georgia (2006)
Swartz, A.: Musicbrainz: A semantic web service. IEEE Intell. Syst. 17(1), 76–77 (2002)
Wang, J.Z., Li, J.: Learning-based linguistic indexing of pictures with 2-D MHMMs. In: Proceedings of the Tenth ACM International Conference on Multimedia (MM-02), pp. 436–445. ACM Press, New York (2002)
Wu, Z., Palmer, M.S.: Verb semantics and lexical selection. In: ACL, pp. 133–138 (1994)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer Science+Business Media New York
About this paper
Cite this paper
Chao, J., Wang, H., Zhou, W., Zhang, W., Yu, Y. (2013). A Semantic-Driven Music Recommendation Model for Digital Photo Albums. In: Li, J., Qi, G., Zhao, D., Nejdl, W., Zheng, HT. (eds) Semantic Web and Web Science. Springer Proceedings in Complexity. Springer, New York, NY. https://doi.org/10.1007/978-1-4614-6880-6_32
Download citation
DOI: https://doi.org/10.1007/978-1-4614-6880-6_32
Published:
Publisher Name: Springer, New York, NY
Print ISBN: 978-1-4614-6879-0
Online ISBN: 978-1-4614-6880-6
eBook Packages: Computer ScienceComputer Science (R0)