Skip to main content
SpringerLink
Log in

Mass personalization: social and interactive applications using sound-track identification

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

This paper describes mass personalization, a framework for combining mass media with a highly personalized Web-based experience. We introduce four applications for mass personalization: personalized content layers, ad hoc social communities, real-time popularity ratings and virtual media library services. Using the ambient audio originating from a television, the four applications are available with no more effort than simple television channel surfing. Our audio identification system does not use dedicated interactive TV hardware and does not compromise the user’s privacy. Feasibility tests of the proposed applications are provided both with controlled conversational interference and with “living-room” evaluations.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Bulterman DCA (2001) SMIL 2.0: overview, concepts, and structure. IEEE Multimed 8(4):82–88

    Article  Google Scholar 

  2. Buttery P, Korhonen A (2005) Large-scale analysis of verb subcategorization differences between child directed speech and adult speech. In: Proceedings of the workshop on identification and representation of verb features and verb classes

  3. Covell M, Baluja S, Fink M (2006) Advertisement replacement using acoustic and visual repetition. In: Proceedings of IEEE multimedia signal processing

  4. Fischler M, Bolles R (1981) Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography. Commun ACM 24(6):381–395

    Article  MathSciNet  Google Scholar 

  5. Henzinger M, Chang B, Milch B, Brin S (2003) Query-free news search. In: Proceedings of the international WWW conference.

  6. Hong J, Landay J (2001) A context/communication information agent. Personal and Ubiquitous Computing 5(1):78–81

    Article  Google Scholar 

  7. Ke Y, Hoiem D, Sukthankar R (2005) Computer vision for music identification. In: Proceedings of computer vision and pattern recognition

  8. Kupiec J, Pedersen J, Chen F (1995) A trainable document summarizer. In: Proceedings of ACM SIG information retrieval, pp 68–73

  9. Mann J (2005) CBS, NBC to offer replay episodes for 99 cents. http://www.techspot.com/news/

  10. Pennock D, Horvitz E, Lawrence S, Giles CL (2000) Collaborative filtering by personality diagnosis: a hybrid memory- and model-based approach. In: Proceedings of uncertainty in artificial intelligence, pp 473–480

  11. Rhodes B, Maes P (2003) Just-in-time information retrieval agents. IBM Syst J 39(4):685–704

    Google Scholar 

  12. Rymniak M (1997) The essential review: test of English as a foreign language. Kaplan Educational Centers, New York

  13. Shazam Entertainment, Inc. (2005) http://www.shazamentertainment.com/

  14. Viola P, Jones M (2002) Robust real-time object detection. Int J Comput Vis

  15. Xinaris T, Kolouas A (2006) PVR: one more step from passive viewing. Euro ITV (invited presentation)

Download references

Author information

Authors and Affiliations

  1. Center for Neural Computation, The Hebrew University of Jerusalem, Jerusalem, 91904, Israel

    Michael Fink

  2. Google Research, Google Inc., 1600 Amphitheatre Parkway, Mountain View, CA, 94043, USA

    Michele Covell & Shumeet Baluja

Authors
  1. Michael Fink
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Michele Covell
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Shumeet Baluja
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Michael Fink.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Fink, M., Covell, M. & Baluja, S. Mass personalization: social and interactive applications using sound-track identification. Multimed Tools Appl 36, 115–132 (2008). https://doi.org/10.1007/s11042-006-0083-6

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-006-0083-6

Keywords

Search

Navigation