skip to main content
10.1145/1027527.1027647acmconferencesArticle/Chapter ViewAbstractPublication PagesmmConference Proceedingsconference-collections
Article

Designing experiential environments for management of personal multimedia

Published: 10 October 2004 Publication History

Abstract

With the increasing ubiquity of sensors and computational resources, it is becoming easier and increasingly common for people to electronically record, photographs, text, audio, and video gathered over their lifetime. Assimilating and taking advantage of such data requires recognition of its multimedia nature, development of data models that can represent semantics across different media, representation of complex relationships in the data (such as spatio-temporal, causal, or evolutionary), and finally, development of paradigms to mediate user-media interactions. There is currently a paucity of theoretical frameworks and implementations that allow management of diverse and rich multimedia data collections in context of the aforementioned requirements. This paper presents our research in designing an experiential Multimedia Electronic Chronicle system that addresses many of these issues in the concrete context of personal multimedia information. Central to our approach is the characterization and organization of media using the concept of an "event" for unified modeling and indexing. The event-based unified multimedia model underlies the experiential user interface, which supports direct interactions with the data within a unified presentation-exploration-query environment. In this environment, explicit facilities to model space and time aid in exploration and querying as well as in representation and reasoning with dynamic relationships in the data. Experimental and comparative studies demonstrate the promise of this research.

References

[1]
Bederson, B. "Quantum Treemaps and Bubblemaps for a Zoomable Image Browser", in ACM Conference on User Interface and Software Technology, 2001]]
[2]
<http://openmap.bbn.com>]]
[3]
<http://www.filehand.com>]]
[4]
<http://www.accessoryware.com/fileview.htm>]]
[5]
Gemmell, J., Bell, G., Lueder, R., Drucker, S. and Wong, C. "MyLifeBits: fulfilling the Memex vision". ACM Multimedia, pp. 235--238, ACM, 2002.]]
[6]
Hutchins E.L., J. D. Hollan, D. A. Norman. "Direct Manipulation Interfaces," User Centered System Design. Lawrence Erlbaum Associates. 1986]]
[7]
Jain, R. "Experiential Computing", Communications of the ACM, Vol. 46, No. 7, July 2003]]
[8]
Janecek, P. and Pu, P. A Framework for Designing Fisheye Views to Support Multiple Semantic Contexts. in International Conference on Advanced Visual Interfaces (AVI '02), ACM Press, 2002]]
[9]
Little, T. and A. Ghafoor, "Interval-Based Conceptual Models for Time-Dependent Multimedia Data", IEEE Trans. On Knowledge and Data Engineering, Vol. 4, No. 5, 1993]]
[10]
Loui, A. and A. Savakis, "Automated Event Clustering and Quality Screening of Consumer Pictures for Digital Albuming", IEEE Trans. On Multimedia, Vol. 5, No. 3, 2000]]
[11]
Plaisant, C., Milash, B., Rose, A., Widoff, S., Shneiderman, B. "LifeLines: visualizing personal histories", in Proceedings of CHI'96, pp. 221--227, Vancouver, BC, Canada, April 14-18, 1996]]
[12]
<http://www.dcviews.com/press/Ricoh_RDC-i700G.htm>.]]
[13]
Santini S., A. Gupta, and R. Jain, "Emergent Semantics Through Interaction in Image Databases", IEEE Trans. On Knowledge and Data Engineering, Vol. 13, No. 3, 2001]]
[14]
Singh R., Li Z., Kim P., Pack D, and Jain R, "Event-Based Modeling and Processing of Digital Media", First SIGMOD Workshop on Computer Vision Meets Databases, 2004]]
[15]
Toyama K., Logan R., Roseway A., and Anandan P., "Geographic Location Tags on Digital Images", ACM Multimedia, pp. 156--166, 2003]]
[16]
Widerhold G., S. Jajodia, and W. Litwin, "Dealing with Granularity of Time in Temporal Databases", CAiSE91, pp. 124--140, 1991.]]

Cited By

View all
  • (2009)Semantic Maps Capturing Organization Knowledge in e-LearningLeveraging Knowledge for Innovation in Collaborative Networks10.1007/978-3-642-04568-4_79(777-784)Online publication date: 2009
  • (2007)Study and Analysis of User Behaviour and Usage Patterns in a Unified Personal Multimedia Information EnvirionmentMultimedia and Expo, 2007 IEEE International Conference on10.1109/ICME.2007.4284829(1031-1034)Online publication date: Jul-2007
  • (2007)Event detection in real time on a personal camera phone image collectionMultimedia Systems10.1007/s00530-007-0075-z12:6(479-492)Online publication date: 22-Feb-2007
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
MULTIMEDIA '04: Proceedings of the 12th annual ACM international conference on Multimedia
October 2004
1028 pages
ISBN:1581138938
DOI:10.1145/1027527
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 10 October 2004

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. UI metaphors
  2. experiential computing
  3. personal media
  4. unified multimedia modeling

Qualifiers

  • Article

Conference

MM04

Acceptance Rates

Overall Acceptance Rate 2,145 of 8,556 submissions, 25%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)1
  • Downloads (Last 6 weeks)0
Reflects downloads up to 12 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2009)Semantic Maps Capturing Organization Knowledge in e-LearningLeveraging Knowledge for Innovation in Collaborative Networks10.1007/978-3-642-04568-4_79(777-784)Online publication date: 2009
  • (2007)Study and Analysis of User Behaviour and Usage Patterns in a Unified Personal Multimedia Information EnvirionmentMultimedia and Expo, 2007 IEEE International Conference on10.1109/ICME.2007.4284829(1031-1034)Online publication date: Jul-2007
  • (2007)Event detection in real time on a personal camera phone image collectionMultimedia Systems10.1007/s00530-007-0075-z12:6(479-492)Online publication date: 22-Feb-2007
  • (2006)From Information-Centric to Experiential EnvironmentsInteractive Computation10.1007/3-540-34874-3_13(323-351)Online publication date: 2006
  • (2006)An experiential approach to interacting with biological informationProceedings of the Second international conference on Advances in Visual Computing - Volume Part II10.1007/11919629_68(678-687)Online publication date: 6-Nov-2006
  • (2004)ResearchexplorerProceedings of the 6th ACM SIGMM international workshop on Multimedia information retrieval10.1145/1026711.1026714(7-14)Online publication date: 15-Oct-2004

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media