Skip to main content
SpringerLink
Log in

Point-of-capture archiving and editing of personal experiences from a mobile device

  • Original Article
  • Published:
Personal and Ubiquitous Computing Aims and scope Submit manuscript

Abstract

Personal experience computing is an emerging research area in computing support for capturing, archiving, and editing. This paper presents our design, implementation, and evaluation of a mobile authoring tool called mProducer that enables everyday users to effectively and efficiently perform archiving and editing at or immediately after the point-of-capture of digital personal experiences from their camera-equipped mobile devices. This point-of-capture capability is crucial to enable immediate sharing of digital personal experiences anytime, anywhere. For example, we have seen everyday people who used handheld camcorders to capture and report their personal, eye-witnessed experiences during the September 11, 2001 terrorist attack in New York (The September 11 Digital Archive. http://www.911digitalarchive.org/). With mProducer, they would be able to perform editing immediately after the point of capture, and then share these newsworthy, time-sensitive digital experiences on the Internet. To address the challenges in both user interface constraints and limited system resources on a mobile device, mProducer provides the following innovative system techniques and UI designs. (1) Keyframe-based editing UI enables everyday users to easily and efficiently edit recorded digital experiences from a mobile device using only key frames with the storyboard metaphor. (2) Storage constrained uploading (SCU) algorithm archives continuous multimedia data by uploading them to remote storage servers at the point of capture, so that it alleviates the problem of limited storage on a mobile device. (3) Sensor-assisted automated editing uses data from a GPS receiver and a tilt sensor attached to a mobile device to facilitate two manual editing steps at the point of capture: removal of blurry frames from hand-induced camera shaking, and content search via location-based content management. We have conducted user studies to evaluate mProducer. Results from the user studies have shown that mProducer scores high in user satisfaction in editing experience, editing quality, task performance time, ease of use, and ease of learning.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11

Similar content being viewed by others

Notes

  1. We implemented the SBD algorithm based on color histograms described in [10]. Note that the SBD algorithm is not the focus of our work. We chose the color histogram-based SBD because of its ease for rapid prototyping. More sophisticated SBD algorithms [5] can surely enhance the key frame selection quality, which in turn improves the editing satisfaction of keyframe-based content editing.

  2. A shot is defined as one or more frames generated and recorded contiguously and represents continuous action in time and space [8].

References

  1. Aizawa K, Hori T, Kawasaki S, Ishikawa T (2004) Capture and efficient retrieval of life log. In: Pervasive 2004 workshop on memory and sharing of experiences

  2. Ashbrook D et al (2003) Using GPS to learn significant locations and predict movement across multiple users. Pers Ubiquitous Comput 7(5):275–286

    Article  Google Scholar 

  3. Blog Website, http://www.blogdex.net/

  4. Boll S, Bulterman D, Chua T-S, Davis M, Jain R, Lienhart R, Venkatesh S (2004) Between context-aware media capture and multimedia content analysis—where do we find the promised land ? In: Proceedings of multimedia conference

  5. Browne P, Smeaton AF, Murphy N, O’Connor N, Marlow S, Berrut C (2000) Evaluating and combining digital video shot boundary detection algorithms. In: Proceedings of Irish machine vision and image processing conference

  6. Casares J, Long AC, Myers BA, Bhatnagar R, Stevens SM, Dabbish L, Yocum D, Corbett A (2002) Simplifying video editing using metadata. In: Proceedings of designing interactive systems (DIS)

  7. Counts S, Fellheimer E (2004) Supporting social presence through lightweight photo sharing on and off the desktop. ACM CHI

  8. Davenport G, Smith TA, Pincever N (1991) Cinematic primitives for multimedia. IEEE Comput Graph Appl: 67–74

  9. Frigo A (2004) Storing indexing and retrieving my autobiography. In: Pervasive 2004 workshop on memory and sharing of experiences

  10. Gargi U, Kasturi R (1996) An evaluation of color histogram based methods in video indexing. In: International workshop on image databases and multimedia search

  11. Gemmell J, Bell G, Lueder R, Drucker S, Wong C (2002) MyLifeBits: fulfilling the memex vision. In: ACM international conference on multimedia

  12. Girgensohn A, Boreczky J, Chiu P, Doherty J, Foote J, Golovchinsky G, Uchihashi S, Wilcox L (2000) A semi-automatic approach to home video editing. In: ACM UIST

  13. Jokela T (2003) Authoring tools for mobile multimedia content. in: IEEE international conference on multimedia and expo (ICME), pp 637–640

  14. Kern N, Schiele B, Junker H, Lukowicz P, Troster G, Schmidt A (2004) Context annotation for a live life recording. In: Pervasive 2004 workshop on memory and sharing of experiences

  15. Kumlodi A, Marchionini G (1998) Key frame preview techniques for video browsing. In: ACM international conference on digital libraries, pp 118–125

  16. de Lara E, Kumar R, Wallach DS, Zwaenepoel W (2003) Collaboration and multimedia authoring on mobile devices. In: International conference on mobile systems, applications and services (MobiSys)

  17. Marmasse N, Schmandt C, Spectre D (2004) WatchMe: communication and awareness between member of a closely-knit group. In: Proceedings of Ubicomp 2004

  18. MPEG industry forum, http://www.m4if.org

  19. Nilsson M, Drugge M, Parnes P (2004) Sharing experience and knowledge with wearable computers. In: Pervasive 2004 workshop on memory and sharing of experiences

  20. Pervasive 2004 workshop on memory and sharing of experiences

  21. Sarvas R, Herrarte E, Wilhelm A, Davis M (2004) Metadata creation system for mobile images. In: MobiSYS '04: proceedings of the 2nd international conference on mobile systems, applications, and services. ACM Press, pp 36–48

  22. Snoek CGM, Worring M (2004) Multimodal video indexing: a review of the state-of-the-art. Multimedia Tools Appl (in press)

  23. Sumi Y, Ito S, Matsuguchi T, Fels S, Mase K (2004) Collaborative capturing and interpretation of experiences. In: Proceedings of advances in pervasive computing

  24. Tarumi H et al (2000) Communication through virtual active objects overlaid onto the real world. In: Proceedings of the 3rd international conference on collaborative virtual environments (CVE 2000), pp 155–164

  25. Teng C-M, Chu H-H, Wu C-I (2004) mProducer: authoring multimedia personal experiences on mobile phones. In: IEEE International conference on multimedia and expo (ICME 2004)

  26. Teng C-M et al (2004) Design and evaluation of mProducer: a mobile authoring tool for personal experience computing. In: ACM 3rd international conference on mobile and ubiquitous mutimedia (MUM2004)

  27. The September 11 Digital Archive. http://www.911digitalarchive.org/

  28. Ueda N et al (2004) Geographic information system using a mobile phone equipped with a camera and a GPS, and its exhibitions. In: Fourth international workshop on smart appliances and wearable computing (IWSAWC 2004)

  29. Vemuri S, Schmandt C, Bender W, Tellex S, Lassey B (2004) An audio-based personal memory aid. In: Proceedings of Ubicomp 2004

  30. Yan W-Q, Kankanhalli MS (2002) Detection and removal of lighting & shaking artifacts in home videos. In: ACM international conference on multimedia, pp 107–116

  31. Zhang H-J, Low C-Y, Wu J-H (1995) Video parsing, retrieval and browsing: an integrated and content-based solution. In: ACM international conference on multimedia

Download references

Author information

Authors and Affiliations

  1. Department of Computer Science and Information Engineering and Graduate Institute of Networking Multimedia, National Taiwan University, Taipei, Taiwan

    Chon-In Wu, Yi-Chao Chen, Tung-Yun Lin, Hao-Hua Chu & Jane Yung-jen Hsu

  2. MIT Media Lab, Cambridge, USA

    Chao-ming James Teng

Authors
  1. Chon-In Wu
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Chao-ming James Teng
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Yi-Chao Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Tung-Yun Lin
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Hao-Hua Chu
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Jane Yung-jen Hsu
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Jane Yung-jen Hsu.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Wu, CI., James Teng, Cm., Chen, YC. et al. Point-of-capture archiving and editing of personal experiences from a mobile device. Pers Ubiquit Comput 11, 235–249 (2007). https://doi.org/10.1007/s00779-006-0082-7

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00779-006-0082-7

Keywords

Search

Navigation