Skip to main content
Springer Nature Link
Log in

Accessing Multimodal Meeting Data: Systems, Problems and Possibilities

  • Conference paper
Machine Learning for Multimodal Interaction (MLMI 2004)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 3361))

Included in the following conference series:

  • 1035 Accesses

Abstract

As the amount of multimodal meetings data being recorded increases, so does the need for sophisticated mechanisms for accessing this data. This process is complicated by the different informational needs of users, as well as the range of data collected from meetings. This paper examines the current state of the art in meeting browsers. We examine both systems specifically designed for browsing multimodal meetings data and those designed to browse data collected from different environments, for example broadcast news and lectures. As a result of this analysis, we highlight potential directions for future research – semantic access, filtered presentation, limited display environments, browser evaluation and user requirements capture.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Similar content being viewed by others

References

  1. M4 Project, http://www.m4project.org/

  2. IM2 Project, http://www.im2.ch/

  3. Degen, L., Mander, R., Salomon, G.: Working With Audio: Integrating Personal Tape Recorders And Desktop Computers. In: Proceedings of CHI 1992, Monterey, CA, USA, pp. 413–418 (1992)

    Google Scholar 

  4. Arons, B.: SpeechSkimmer: A System for Interactively Skimming Recorded Speech. ACM Transcations on Computer-Human Interaction, 3–38 (1997)

    Google Scholar 

  5. Foote, J., Boreczky, G., Wilcox, L.: An Intelligent Media Browser Using Automatic Multimodal Analysis. In: Proceedings of ACM Multimedia, Bristol, UK, pp. 375–380 (1998)

    Google Scholar 

  6. Girgensohm, A., Borczky, J., Wilcox, L.: Keyframe-based User Interfaces For Digital Video. IEEE Computer, 61–67 (2001)

    Google Scholar 

  7. Lalanne, D., Sire, S., Ingold, R., Behera, A., Mekhaldi, D., Rotz, D.: A Research Agenda For Assessing The Utility Of Document Annotations In Multimedia Databases Of Meeting Recordings. In: Proceedings of 3rd International Workshop on Multimedia Data And Document Engineering, Berlin, Germany (2003)

    Google Scholar 

  8. Ferret Browser, http://mmm.idiap.ch/

  9. Kimber, D.G., Wilcox, L.D., Chen, F.R., Moran, T.P.: Speaker Segmentation For Browsing Recorded Audio. In: Proceedings of CHI 1995 (1995)

    Google Scholar 

  10. Hindus, D., Schmandt, C.: Ubiquitous Audio: Capturing Spontaneous Collaboration. In: Proceedings of 1992 ACM Conference on Computer-Supported Cooperative Work, Toronto, Ontario, Canada, pp. 210–217 (1992)

    Google Scholar 

  11. Roy, D.K., Schmandt, C.: NewsComm: A Hand-Held Interface for Interactive Access To Structured Audio. In: Proceedings of CHI 1996 (1996)

    Google Scholar 

  12. Christel, M.G., Smith, M.A., Taylor, C.R., Winkler, D.B.: Evolving Video Skims Into Useful Multimedia Abstractions. In: Proceedings of CHI 1998, Los Angeles, CA (1998)

    Google Scholar 

  13. Lee, D., Erol, B., Graham, J., Hull, J.J., Murata, N.: Portable Meeting Recorder. In: Proceedings of ACM Multimedia, pp. 493–502 (2002)

    Google Scholar 

  14. Brotherton, J.A., Bhalodia, J.R., Abowd, G.D.: Automated Capture, Integration and Visualization of Multiple Media Streams. In: Proceedings of The IEEE International Conference on Multimedia Computing And Systems, pp. 54–63 (1998)

    Google Scholar 

  15. Geyer, W., Richter, H., Fuchs, L., Frauenhofer, T., Daijavad, S., Poltrock, S.: A Team Collaboration Space Supporting Capture And Access Of Virtual Meetings. In: Proceedings of 2001 International ACM SIGGROUP Conference On Supporting Group Work, Boulder, Colorado, pp. 188–196 (2001)

    Google Scholar 

  16. Cutler, R., Rui, Y., Gupta, A., Cadiz, J.J., Tashev, I., He, L., Colburn, A., Zhang, Z., Liu, Z., Silverberg, S.: Distributed Meetings: A Meeting Capture And Broadcasting System. In: Proceedings of 10th ACM International Conference on Multimedia, Juan-les-Pins, France, pp. 503–512 (2002)

    Google Scholar 

  17. Whittaker, S., Hyland, P., Wiley, M.: Filochat: Handwritten Notes Provide Access To Recorded Conversations. In: Proceedings of CHI 1994, Boston, Massachusetts, USA (1994)

    Google Scholar 

  18. Moran, T.P., Palen, L., Harrison, S., Chiu, P., Kimber, D., Minneman, S., Melle, W., Zellweger, P.: I’ll get that off the audio: A Case study of salvaging multimedia meeting records. In: Proceedings of CHI 1997, Atlanta, Georgia (1997)

    Google Scholar 

  19. Whittaker, S., Hitschberg, J., Amento, B., Stark, L., Bacchiani, M., Isenhour, P., Stead, L., Zamchick, G., Rosenberg, A.: SCANMail: A Voicemail Interface That Makes Speech Browsable, Readable and Searchable. In: Proceedings of CHI 2002, Minneapolis, Minnesota, USA (2002)

    Google Scholar 

  20. Whittaker, S., Hirschberg, J., Choi, J., Hindle, D., Pereira, F., Singhal, A.: SCAN: Designing and Evaluating User Interfaces to Support Retrieval from Speech Archives. In: Proceedings of SIGIR 1999 Conference On Research And Development In Information Retrieval, Berkley, USA, pp. 26–33 (1999)

    Google Scholar 

  21. Colbath, S., Kubala, F., Liu, D., Srivastava, A.: Spoken Documents: Creating Searchable Archives From Continuous Audio. In: Proceedings of 33rd Hawaii International Conference On System Sciences (2000)

    Google Scholar 

  22. Bett, M., Gross, R., Yu, H., Zhu, X., Pan, Y., Yang, J., Waibel, A.: Multimodal Meeting Tracker. In: Proceedings of RIAO, Paris, France (2000)

    Google Scholar 

  23. Kazman, R., Kominek, J.: Supporting the Retrieval Process In Multimedia Information Systems. In: Proceedings of the 30th Annual Hawaii International Conference On System Sciences, Hawaii, pp. 229–238 (1997)

    Google Scholar 

  24. Kazman, R., Al-Halimi, R., Hunt, W., Mantei, M.: Four Paradigms for Indexing Video Conferences. IEEE Multimedia 3(1), 63–73 (1996)

    Article  Google Scholar 

  25. Chiu, P., Boreczky, J., Girgensohn, A., Kimber, D.: LiteMinutes: An Internet-Based System For Multimedia Meeting Minutes. In: Proceedings of 10th WWW Conference, Hong Kong, pp. 140–149 (2001)

    Google Scholar 

  26. Flynn, M., Wellner, P.D.: Search of a Good BET: A Proposal for a Browser Evaluation Test. IDIAP IDIAP-COM03-11 (2004)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Information Studies, University of Sheffield, Regent Court, 211 Portobello Street, Sheffield, S1 4DP, UK

    Simon Tucker & Steve Whittaker

Authors
  1. Simon Tucker
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Steve Whittaker
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. IDIAP Research Institute, Martigny, Switzerland

    Samy Bengio

  2. IDIAP Research Institute, CH-1920, Martigny, Switzerland

    Hervé Bourlard

Rights and permissions

Reprints and permissions

Copyright information

© 2005 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Tucker, S., Whittaker, S. (2005). Accessing Multimodal Meeting Data: Systems, Problems and Possibilities. In: Bengio, S., Bourlard, H. (eds) Machine Learning for Multimodal Interaction. MLMI 2004. Lecture Notes in Computer Science, vol 3361. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-30568-2_1

Download citation

  • DOI: https://doi.org/10.1007/978-3-540-30568-2_1

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-24509-4

  • Online ISBN: 978-3-540-30568-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics