Skip to main content
SpringerLink
Log in
Book cover

International Conference on Engineering and Employment of Cooperative Information Systems

EDCIS 2002: Engineering and Deployment of Cooperative Information Systems pp 547–562Cite as

The Neem Platform: An Extensible Framework for the Development of Perceptual Collaborative Applications

  • Conference paper
  • First Online:

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 2480))

Abstract

The Neem Platform is a research test bed for Project Neem, concerned with the development of socially and culturally aware group systems.

The Neem Platform is a generic framework for the development of augmented collaborative applications, mainly targeting synchronous distributed collaboration over the internet. It supports rapid prototyping, as well as Wizard of Oz experiments to ease development and evolution of such applications.

A novelty of the work is its focus on the dynamic aspects that distinguish group interaction under a Perceptual interface paradigm. Participants’ multimodal interactions such as voice exchanges, textual messages, widget operations and eventually gestures, eye gaze and facial expressions are made available to applications, that apply situated reasoning, using this rich contextual information to dynamically adapt their behavior. The system presents itself multimodally as well, through a set of virtual participants - automated entities that are perceived by human participants as having personalities and emotions, making use of animation and voice generation.

This is a preview of subscription content, log in via an institution.

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. P. Barthelmess and C.A. Ellis. Aspect-oriented composition in extensible collaborative applications. In Proceedings of the 2002 International Conference on Parallel and Distributed Processing Techniques and Applications (PDPTA’ 02), Las Vegas, June 2002. Accepted for publication.

    Google Scholar 

  2. P. Barthelmess and C.A. Ellis. The neem platform: an evolvable framework for perceptual collaborative applications. Technical report, University of Colorado at Boulder, Computer Science Department, 2002.

    Google Scholar 

  3. R. A. Bolt. “put-that-there”: Voice and gesture at the graphics interface. In SIGGRAPH’ 80 Proceedings, volume 14, 1980.

    Google Scholar 

  4. N. Carriero and D. Gelernter. Linda in context. Communications of the ACM, 32(4), 1989.

    Google Scholar 

  5. P. R. Cohen, M. Johnston, D. McGee, I. Smith, S. Oviatt, J. Pittman, L. Chen, and J. Clow. Quickset: Multimodal interaction for simulation set-up and control. In Proceedings of the Fifth Applied Natural Language Processing meeting, 1997.

    Google Scholar 

  6. Paul Dourish. Consistency guarantees: Exploiting application semantics for consistency management in a collaboration toolkit. In Proceedings of the ACM Conference on Computer Supported Cooperative Work, Concurrency, 1996.

    Google Scholar 

  7. Paul Dourish. Using metalevel techniques in a flexible toolkit for CSCW applications. ACM Transactions on Computer-Human Interaction, 5(2), 1998.

    Google Scholar 

  8. W. Keith Edwards. Coordination Infrastructure in Collaborative Systems. PhD thesis, Georgia Institute of Technology, College of Computing, 1995.

    Google Scholar 

  9. C.A. Ellis. Neem project: An agent based meeting augmentation system. Technical report, University Of Colorado at Boulder, Department of Computer Science, 2002.

    Google Scholar 

  10. C.A. Ellis, P. Barthelmess, B. Quan, and J. Wainer. Neem: An agent-based meeting augmentation system. Technical report, University of Colorado at Boulder,Department of Computer Science, 2001.

    Google Scholar 

  11. Katherine Isbister, Cliff Nass, Hideyuki Nakanishi, and Toru Ishida. Helper agent: An assistant for human-human interaction in a virtual meeting space. In Proceedings of the CHI 2000 Conference, 2000.

    Google Scholar 

  12. Tony Jebara, Yuri Ivanov, Ali Rahimi, and Alex Pentland. Tracking conversational context for machine mediation of human discourse. In AAAI Fall 2000 Symposium-Socially Intelligent Agents-The Human in the Loop, 2000.

    Google Scholar 

  13. Michael Johnston, Philip R. Cohen, David McGee, Sharon L. Oviatt, James A. Pittman, and Ira Smith. Unification-based multimodal integration. In Proceedings of the Thirty-Fifth Annual Meeting of the Association for Computational Linguistics and Eighth Conference of the European Chapter of the Association for Computational Linguistics, 1997.

    Google Scholar 

  14. Gregor Kiczales. Beyond the black box: open implementation — soapbox. IEEE Software, 13(1), 1996.

    Google Scholar 

  15. D. McGee and P. Cohen. Creating tangible interfaces by augmenting physical objects with multimodal language. In Proceedings of the International Conference on Intelligent User Interfaces (IUI 2001), 2001.

    Google Scholar 

  16. Mitre Corporation. Galaxy Communicator Documentation, 2002. Available on the web at http://communicator.sourceforge.net/sites/MITRE/distributions/GalaxyCommunicator/docs/manual/index.html.

  17. Laurence Nigay and Joëlle Coutaz. A design space for multimodal systems: Concurrent processing and data fusion. In Proceedings of INTERCHI’ 93, 1993.

    Google Scholar 

  18. Kazushi Nishimoto, Yasuyuki Sumi, and Kenji Mase. Enhancement of creative aspects of a daily conversation with a topic development agent. In Coordination Technology for Collaborative Applications-Organizations, Processes, and Agents, volume 1364 of Lecture Notes on Computer Science, 1998.

    Google Scholar 

  19. George A. Papadopoulos and Farhad Arbab. Coordination models and languages. In The Engineering of Large Systems, volume 46 of Advances in Computers. Academic Press, 1998.

    Google Scholar 

  20. Rameshsharma Ramloll. Micis: A multimodal interface for a common information space. In ECSCW’97 Conference Supplement, 1997.

    Google Scholar 

  21. Byron Reeves and Clifford Nass. The Media Equation. How People Treat Computers, Television, and New Media Like Real People and Places. CSLI Publications, 1996.

    Google Scholar 

  22. Byron Reeves and Clifford Nass. Perceptual user interfaces: perceptual bandwidth. Communications of the ACM, 43(3), 2000.

    Google Scholar 

  23. Mark Roseman and Saul Greenberg. Building real-time groupware with groupkit, a groupware toolkit. ACM Transactions on Computer-Human Interaction, 3(1), 1996.

    Google Scholar 

  24. Vassil Roussev, Prasun Dewan, and Vibhor Jain. Composable collaboration infrastructures based on programming patterns. In Proceedings of the ACM Conference on Computer Supported Cooperative Work, Component Based Infrastructures, 2000.

    Google Scholar 

  25. M. Turk and G. Robertson, editors. Communications of the ACM, volume 43, March 2000. Special Issue on Perceptual User Interfaces.

    Google Scholar 

    Google Scholar 

  26. Alex Waibel. Interactive translation of conversational speech. IEEE Computer, 29(7), 1996.

    Google Scholar 

  27. W. Ward and B. Pellom. The cu communicator system. In IEEE Workshop on Automatic Speech Recognition and Understanding, 1999.

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Computer Science, University of Colorado at Boulder, Campus Box 430, Boulder, CO, 80309-0430, USA

    P. Barthelmess & C. A. Ellis

Authors
  1. P. Barthelmess
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. C. A. Ellis
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Institute of Computing Technique, P.O. Box 2704, 100080, Beijing, China

    Yanbo Han

  2. IBM T.J. Watson Research Center, P.O. Box 704, 10598, NY, Yorktown Heights, USA

    Stefan Tai

  3. FH Brandenburg, University of Applied Sciences, Magdeburger Str. 50, 14770, Brandenburg an der Havel, Germany

    Dietmar Wikarski

Rights and permissions

Reprints and permissions

Copyright information

© 2002 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Barthelmess, P., Ellis, C.A. (2002). The Neem Platform: An Extensible Framework for the Development of Perceptual Collaborative Applications. In: Han, Y., Tai, S., Wikarski, D. (eds) Engineering and Deployment of Cooperative Information Systems. EDCIS 2002. Lecture Notes in Computer Science, vol 2480. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-45785-2_44

Download citation

  • DOI: https://doi.org/10.1007/3-540-45785-2_44

  • Published:

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-44222-6

  • Online ISBN: 978-3-540-45785-5

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics

Search

Navigation