skip to main content
10.1145/1877937.1877947acmconferencesArticle/Chapter ViewAbstractPublication PagesmmConference Proceedingsconference-collections
research-article

The interaction ontology: low-level cue processing in real-time group conversations

Published:25 October 2010Publication History

ABSTRACT

The Interaction Ontology is a software component that receives a stream of low-level information from audiovisual analysis in group-to-group videoconferencing situations and detects higher-level events on the real-time stream. Based on this higher-level information, the Orchestrator acts as a virtual director that decides which video streams are displayed for individual participants. The Interaction Ontology component comprises an OWL model defining simple and complex events as well as states of the system and its participants. Based on reasoning and Jena rules, state changes are determined and used to inform the Orchestrator. Regarding the performance and scalability evaluation of the OWL-based approach, we conclude that it performs good enough for our limited test scenario, but won't scale for the larger setups we envision.

References

  1. S. Abbas, M. Mosbah, A. Zemmari, and U. Bordeaux. Itu-t recommendation g.114, one way transmission time. In In International Conference on Dynamics in Logistics 2007 (LDIC 2007), Lect. Notes in Comp. Sciences. Springer-Verlag, 1996.Google ScholarGoogle Scholar
  2. A. Adi and O. Etzion. Amit - the situation manager. The VLDB Journal, 13(2):177--203, 2004. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. M. Christie, R. Machap, J. marie Norm, P. Olivier, and J. Pickering. Virtual camera planning: A survey. In In Proceedings Smart Graphics, pages 40--52. Springer, 2005. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. A. Hakeem and M. Shah. Ontology and taxonomy collaborated framework for meeting classification. International Conference on Pattern Recognition, 4:219--222, 2004. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. N. Kock. The psychobiological model: Towards a new theory of computer-mediated communication based on darwinian evolution. Organization Science, 15(3):327--348, 2004. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. G. Lavee, E. Rivlin, and M. Rudzsky. Understanding video events: a survey of methods for automatic interpretation of semantic occurrences in video. Trans. Sys. Man Cyber Part C, 39(5):489--504, 2009. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. M. R. N. Mendes, P. Bizarro, and P. Marques. A framework for performance evaluation of complex event processing systems. In DEBS '08: Proceedings of the second international conference on Distributed event-based systems, pages 313--316, New York, NY, USA, 2008. ACM. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. B. O'Conaill, S. Whittaker, and S. Wilbur. Conversations over video conferences: An evaluation of the spoken aspects of video-mediated communication. Human Computer Interaction, 8:389--428, 1993. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. S. Park. A hierarchical bayesian network for event recognition of human actions and interactions. In Association For Computing Machinery Multimedia Systems Journal, pages 164--179, 2004.Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. C. Town. Ontology-driven bayesian networks for dynamic scene understanding. In Proceedings of the 2004 Conference on Computer Vision and Pattern Recognition Workshop (CVPRW'04) Volume 7, page 116, Washington, DC, USA, 2004. IEEE Computer Society. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. E. Wu, Y. Diao, and S. Rizvi. High-performance complex event processing over streams. In SIGMOD '06: Proceedings of the 2006 ACM SIGMOD international conference on Management of data, pages 407--418, New York, NY, USA, 2006. ACM. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. The interaction ontology: low-level cue processing in real-time group conversations

        Recommendations

        Comments

        Login options

        Check if you have access through your login credentials or your institution to get full access on this article.

        Sign in
        • Published in

          cover image ACM Conferences
          EiMM '10: Proceedings of the 2nd ACM international workshop on Events in multimedia
          October 2010
          68 pages
          ISBN:9781450301763
          DOI:10.1145/1877937

          Copyright © 2010 ACM

          Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

          Publisher

          Association for Computing Machinery

          New York, NY, United States

          Publication History

          • Published: 25 October 2010

          Permissions

          Request permissions about this article.

          Request Permissions

          Check for updates

          Qualifiers

          • research-article

          Acceptance Rates

          EiMM '10 Paper Acceptance Rate9of16submissions,56%Overall Acceptance Rate19of36submissions,53%

          Upcoming Conference

          MM '24
          MM '24: The 32nd ACM International Conference on Multimedia
          October 28 - November 1, 2024
          Melbourne , VIC , Australia

        PDF Format

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader