Skip to main content

Accessing Multimodal Meeting Data: Systems, Problems and Possibilities

  • Conference paper
Book cover Machine Learning for Multimodal Interaction (MLMI 2004)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 3361))

Included in the following conference series:

Abstract

As the amount of multimodal meetings data being recorded increases, so does the need for sophisticated mechanisms for accessing this data. This process is complicated by the different informational needs of users, as well as the range of data collected from meetings. This paper examines the current state of the art in meeting browsers. We examine both systems specifically designed for browsing multimodal meetings data and those designed to browse data collected from different environments, for example broadcast news and lectures. As a result of this analysis, we highlight potential directions for future research – semantic access, filtered presentation, limited display environments, browser evaluation and user requirements capture.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. M4 Project, http://www.m4project.org/

  2. IM2 Project, http://www.im2.ch/

  3. Degen, L., Mander, R., Salomon, G.: Working With Audio: Integrating Personal Tape Recorders And Desktop Computers. In: Proceedings of CHI 1992, Monterey, CA, USA, pp. 413–418 (1992)

    Google Scholar 

  4. Arons, B.: SpeechSkimmer: A System for Interactively Skimming Recorded Speech. ACM Transcations on Computer-Human Interaction, 3–38 (1997)

    Google Scholar 

  5. Foote, J., Boreczky, G., Wilcox, L.: An Intelligent Media Browser Using Automatic Multimodal Analysis. In: Proceedings of ACM Multimedia, Bristol, UK, pp. 375–380 (1998)

    Google Scholar 

  6. Girgensohm, A., Borczky, J., Wilcox, L.: Keyframe-based User Interfaces For Digital Video. IEEE Computer, 61–67 (2001)

    Google Scholar 

  7. Lalanne, D., Sire, S., Ingold, R., Behera, A., Mekhaldi, D., Rotz, D.: A Research Agenda For Assessing The Utility Of Document Annotations In Multimedia Databases Of Meeting Recordings. In: Proceedings of 3rd International Workshop on Multimedia Data And Document Engineering, Berlin, Germany (2003)

    Google Scholar 

  8. Ferret Browser, http://mmm.idiap.ch/

  9. Kimber, D.G., Wilcox, L.D., Chen, F.R., Moran, T.P.: Speaker Segmentation For Browsing Recorded Audio. In: Proceedings of CHI 1995 (1995)

    Google Scholar 

  10. Hindus, D., Schmandt, C.: Ubiquitous Audio: Capturing Spontaneous Collaboration. In: Proceedings of 1992 ACM Conference on Computer-Supported Cooperative Work, Toronto, Ontario, Canada, pp. 210–217 (1992)

    Google Scholar 

  11. Roy, D.K., Schmandt, C.: NewsComm: A Hand-Held Interface for Interactive Access To Structured Audio. In: Proceedings of CHI 1996 (1996)

    Google Scholar 

  12. Christel, M.G., Smith, M.A., Taylor, C.R., Winkler, D.B.: Evolving Video Skims Into Useful Multimedia Abstractions. In: Proceedings of CHI 1998, Los Angeles, CA (1998)

    Google Scholar 

  13. Lee, D., Erol, B., Graham, J., Hull, J.J., Murata, N.: Portable Meeting Recorder. In: Proceedings of ACM Multimedia, pp. 493–502 (2002)

    Google Scholar 

  14. Brotherton, J.A., Bhalodia, J.R., Abowd, G.D.: Automated Capture, Integration and Visualization of Multiple Media Streams. In: Proceedings of The IEEE International Conference on Multimedia Computing And Systems, pp. 54–63 (1998)

    Google Scholar 

  15. Geyer, W., Richter, H., Fuchs, L., Frauenhofer, T., Daijavad, S., Poltrock, S.: A Team Collaboration Space Supporting Capture And Access Of Virtual Meetings. In: Proceedings of 2001 International ACM SIGGROUP Conference On Supporting Group Work, Boulder, Colorado, pp. 188–196 (2001)

    Google Scholar 

  16. Cutler, R., Rui, Y., Gupta, A., Cadiz, J.J., Tashev, I., He, L., Colburn, A., Zhang, Z., Liu, Z., Silverberg, S.: Distributed Meetings: A Meeting Capture And Broadcasting System. In: Proceedings of 10th ACM International Conference on Multimedia, Juan-les-Pins, France, pp. 503–512 (2002)

    Google Scholar 

  17. Whittaker, S., Hyland, P., Wiley, M.: Filochat: Handwritten Notes Provide Access To Recorded Conversations. In: Proceedings of CHI 1994, Boston, Massachusetts, USA (1994)

    Google Scholar 

  18. Moran, T.P., Palen, L., Harrison, S., Chiu, P., Kimber, D., Minneman, S., Melle, W., Zellweger, P.: I’ll get that off the audio: A Case study of salvaging multimedia meeting records. In: Proceedings of CHI 1997, Atlanta, Georgia (1997)

    Google Scholar 

  19. Whittaker, S., Hitschberg, J., Amento, B., Stark, L., Bacchiani, M., Isenhour, P., Stead, L., Zamchick, G., Rosenberg, A.: SCANMail: A Voicemail Interface That Makes Speech Browsable, Readable and Searchable. In: Proceedings of CHI 2002, Minneapolis, Minnesota, USA (2002)

    Google Scholar 

  20. Whittaker, S., Hirschberg, J., Choi, J., Hindle, D., Pereira, F., Singhal, A.: SCAN: Designing and Evaluating User Interfaces to Support Retrieval from Speech Archives. In: Proceedings of SIGIR 1999 Conference On Research And Development In Information Retrieval, Berkley, USA, pp. 26–33 (1999)

    Google Scholar 

  21. Colbath, S., Kubala, F., Liu, D., Srivastava, A.: Spoken Documents: Creating Searchable Archives From Continuous Audio. In: Proceedings of 33rd Hawaii International Conference On System Sciences (2000)

    Google Scholar 

  22. Bett, M., Gross, R., Yu, H., Zhu, X., Pan, Y., Yang, J., Waibel, A.: Multimodal Meeting Tracker. In: Proceedings of RIAO, Paris, France (2000)

    Google Scholar 

  23. Kazman, R., Kominek, J.: Supporting the Retrieval Process In Multimedia Information Systems. In: Proceedings of the 30th Annual Hawaii International Conference On System Sciences, Hawaii, pp. 229–238 (1997)

    Google Scholar 

  24. Kazman, R., Al-Halimi, R., Hunt, W., Mantei, M.: Four Paradigms for Indexing Video Conferences. IEEE Multimedia 3(1), 63–73 (1996)

    Article  Google Scholar 

  25. Chiu, P., Boreczky, J., Girgensohn, A., Kimber, D.: LiteMinutes: An Internet-Based System For Multimedia Meeting Minutes. In: Proceedings of 10th WWW Conference, Hong Kong, pp. 140–149 (2001)

    Google Scholar 

  26. Flynn, M., Wellner, P.D.: Search of a Good BET: A Proposal for a Browser Evaluation Test. IDIAP IDIAP-COM03-11 (2004)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2005 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Tucker, S., Whittaker, S. (2005). Accessing Multimodal Meeting Data: Systems, Problems and Possibilities. In: Bengio, S., Bourlard, H. (eds) Machine Learning for Multimodal Interaction. MLMI 2004. Lecture Notes in Computer Science, vol 3361. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-30568-2_1

Download citation

  • DOI: https://doi.org/10.1007/978-3-540-30568-2_1

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-24509-4

  • Online ISBN: 978-3-540-30568-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics