Abstract
In earlier work we proposed the Watch-and-Comment (WaC) paradigm as the seamless capture of multimodal comments made by one or more users while watching a video, resulting in the automatic generation of multimedia documents specifying annotated interactive videos. The aim is to allow services to be offered by applying document engineering techniques to the multimedia document generated automatically. The WaC paradigm was demonstrated with a WaCTool prototype application which supports multimodal annotation over video frames and segments, producing a corresponding interactive video. In this chapter, we extend the WaC paradigm to consider contexts in which several viewers may use their own mobile devices while watching and commenting on an interactive-TV program. We first review our previous work. Next, we discuss scenarios in which mobile users can collaborate via the WaC paradigm. We then present a new prototype application which allows users to employ their mobile devices to collaboratively annotate points of interest in video and interactive-TV programs. We also detail the current software infrastructure which supports our new prototype; the infrastructure extends the Ginga middleware for the Brazilian Digital TV with an implementation of the UPnP protocol – the aim is to provide the seamless integration of the users’ mobile devices into the TV environment. As a result, the work reported in this chapter defines the WaC paradigm for the mobile-user as an approach to allow the collaborative annotation of the points of interest in video and interactive-TV programs.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
http://www.w3.org/TR/2008/REC-SMIL3-20081201, visited on March 13, 2009.
- 2.
http://www.ncl.org.br, visited on March 13, 2009.
- 3.
http://www.nintendo.com/wii/what/accessories, visited on March 13, 2009.
- 4.
http://www.apple.com/ipodtouch, visited on March 13, 2009.
- 5.
http://www.youtube.com, visited on March 13, 2009.
- 6.
http://www.asterpix.com, visited on March 13, 2009.
- 7.
In this text we use video to refer to digital (non-interactive) video, and interactive video to refer to digital interactive video.
- 8.
Compact Oxford English Dictionary of Current English http://www.askoxford.com/concise oed/discrimination, visited on March 13, 2009.
- 9.
Implemented using the Cyberlink UPnP API for C ++ http://clinkcc.sourceforge.net, visited on March 13, 2009.
- 10.
Java 2 Micro Edition for mobile devices and Java 2 Standard Edition to other devices such as a netbook computer or a tablet PC.
- 11.
http://www.microsoft.com/windowsxp/using/moviemaker, visited on March 13, 2009.
- 12.
http://www.apple.com/imovie, visited on March 13, 2009.
- 13.
http://www.adobe.com/products/premiere, visited on March 13, 2009.
References
Abowd, G. D., Mynatt, E. D., & Rodden, T. (2002). The human experience. IEEE Pervasive Computing, 1(1), 48–57.
Bulterman, D. C. A., C´esar, P., & Jansen, A. J. (2006). An architecture for viewer-side enrichment of tv content. In Proceedings of the ACM International Conference on Multimedia (pp. 651–654). New York: ACM.
César, P., Bulterman, D. C. A., & Jansen, A. J. (2006). The Ambulant Annotator: Empowering viewer-side enrichment of multimedia content. In Proceedings of the ACM Symposium on Document Engineering (pp. 186–187). New York: ACM.
César, P., Bulterman, D. C. A., & Jansen, A. J. (2008). Usages of the secondary screen in an interactive television environment: Control, enrich, share, and transfer television content. In European Interactive TV Conference, Lecture Notes in Computer Science (Vol. 5066, pp. 168–177).
César, P., Bulterman, D. C. A., Obrenovic, Z., Ducret, J., & Cruz-Lara, S. (2007). An architecture for non-intrusive user interfaces for interactive digital television. In European Interactive TV Conference, Lecture Notes in Computer Science (Vol. 4471, pp. 11–20). Heidelberg, Germany: Springer.
César, P., & Chorianopoulos, K. (2008). Interactivity and user participation in the television lifecycle: Creating, sharing, and controlling content. In Proceedings of the UXTV (pp. 125–128).
Cattelan, R. G., & Pimentel, M. G. C. (2008). Supporting multimedia capture in mobile computing environments through a peer-to-peer platform. In Proceedings of the ACM Symposium on Applied Computing (pp. 1246–1251). New York: ACM.
Cattelan, R. G., Teixeira, C. A. C., Goularte, R., & Pimentel, M. G. C. (2008). Watch-and-comment as a paradigm toward ubiquitous interactive video editing. ACM Transactions on Multimedia Computing, Communications and Applications, 4(4), 1–24.
Engström, A., Esbj¨ornsson, M., & Juhlin, O. (2008). Mobile collaborative live video mixing. In Mobile HCI (pp. 157–166).
Geerts, D., C´esar, P., & Bultermand, D. A. (2008). The implications of program genres for the design of social television systems. In Proceedings of the UXTV (pp. 71–80).
Girgensohn, A., Boreczky, J., Chiu, P., Doherty, J., Foote, J., Golovchinsky, G., Uchihashi, S., & Wilcox, L. (2000). A semi-automatic approach to home video editing. In Proceedings of ACM Symposium on User Interface Software and Technology (pp. 81–89). New York: ACM.
Goularte, R., Cattelan, R. G., Camacho-Guerrero, J. A., Inácio, V. I., & Pimentel, M. G. C. (2004). Interactive multimedia annotations: enriching and extending content. In Proceedings of the ACM Symposium on Document Engineering (pp. 84–86). New York: ACM.
Guimara˜es, R. L., Costa, R. M. R., & Soares, L. F. G. (2008). Composer: Authoring tool for iTV programs. In European Interactive TV Conference, Lecture Notes in Computer Science (Vol. 5066, pp. 61–71). Berlin: Springer.
Holbling, G., Rabl, T., Coquil, D., & Kosch, H. (2008). Interactive tv services on mobile devices. IEEE MultiMedia, 15(2), 72–76.
Hua, X. S., & Li, S. (2006). Interactive video authoring and sharing based on two-layer templates. In Proceedings of the ACM International Workshop on Human-centered Multimedia (pp. 65–74). New York: ACM.
Hua, X. S., Lu, L., & Zhang, H. J. (2004). P-karaoke: Personalized karaoke system. In Proceedings of the ACM International Conference on Multimedia (pp. 172–173). New York: ACM.
Kirk, D., Sellen, A., Harper, R., & Wood. K. (2007). Understanding videowork. In Proceedings of the ACM International Conference on Human Factors in Computing Systems (pp. 61–70). New York: ACM.
Pimentel, M. G. C., Baldochi, L. A., & Cattelan, R. G. (2007). Prototyping applications to document human experiences. IEEE Pervasive Computing, 6(2), 93–100.
Pimentel, M. G. C., Cattelan, R. G., Melo, E. L., & Teixeira, C. A. (forthcoming). Ubiquitous end-user live editing of itv programs. International Journal of Advanced Multimedia and Communications, p. 25p.
Pimentel, M. G. C., Goularte, R., Cattelan, R. G., Santos, F. S., & Teixeira, C. A. (2007). Enhancing multimodal annotations with pen-based information. In Workshop on New Techniques for Consuming, Managing, and Manipulating Interactive Digital Media at Home (pp. 207–213).
Pimentel, M. G. C., Goularte, R., Cattelan, R. G., Santos, F. S., & Teixeira, C. A. (2008). Ubiquitous interactive video editing via multimodal annotations. In European Interactive TV Conference, Lecture Notes in Computer Science (Vol. 5066, pp. 72–81). Berlin: Springer
Soares, L. F. G., Ferreira, R. R., & Moreno, M. F. (2007). Ginga-NCL: The declarative environment of the Brazilian Digital TV System. Journal of the Brazilian Computer Society, 13(1), 37–46.
Tuomi, P. (2008). SMS-based human-hosted interactive tv in Finland. In Proceedings of the UXTV (pp. 67–70).
Ullmer, B., Ishii, H., & Glas, D. (1998). mediaBlocks: Physical containers, transports, and controls for online media. In Proceedings of the Conference on Computer Graphics and Interactive Techniques (pp. 379–386). New York: ACM.
Ursu, M. F., Kegel, I., Williams, D., Thomas, M., Mayer, H., Zsombori, V., et al. (2008). ShapeShifting TV: Interactive screen media narratives. Multimedia Systems, 14(2), 115–132.
Weiser, M. (1991). The computer for the 21st century. Scientific American, 265(3), 94–104.
Zigelbaum, J., Horn, M. S., Shaer, O., Jacob, R. J. K. (2007). The tangible video editor: collaborative video editing with active tokens. In Proceedings of the International Conference on Tangible and Embedded Interaction (pp. 43–46). New York: ACM.
Acknowledgements
We thank the following organizations for their financial support: FINEP, FAPESP, CAPES, and CNPq. We thank Dick Bulterman for great discussions on this topic. We thank Luiz F. G. Soares for inspiring us with Ginga-NCL. We thank Felipe S. Santos, Bruno C. Furtado, and Rudinei Goularte for their collaboration in our previous work.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2010 Springer-Verlag London Limited
About this chapter
Cite this chapter
Pimentel, M.d.G.C., Cattelan, R.G., Melo, E.L., Freitas, G.B., Teixeira, C.A. (2010). Watch-and-Comment as an Approach to Collaboratively Annotate Points of Interest in Video and Interactive-TV Programs. In: Marcus, A., Roibás, A., Sala, R. (eds) Mobile TV: Customizing Content and Experience. Human-Computer Interaction Series. Springer, London. https://doi.org/10.1007/978-1-84882-701-1_23
Download citation
DOI: https://doi.org/10.1007/978-1-84882-701-1_23
Published:
Publisher Name: Springer, London
Print ISBN: 978-1-84882-700-4
Online ISBN: 978-1-84882-701-1
eBook Packages: Computer ScienceComputer Science (R0)