Scott R. Klemmer
Björn Hartmann
Leila Takayama
ABSTRACT
Our physical bodies play a central role in shaping human experience in the world, understandingof the world, and interactions in the world. This paper draws on theories of embodiment - from psychology, sociology, and philosophy - synthesizing five themes we believe are particularly salient for interaction design: thinking through doing, performance, visibility, risk, and thick practice. We intro-duce aspects of human embodied engagement in the world with the goal of inspiring new interaction design ap-proaches and evaluations that better integrate the physical and computational worlds.
- Verified Voting Foundation. http://www.verifiedvoting.org/]]Google Scholar
- Alibali, M. W., S. Kita, and A. Young. Gesture and the process of speech production: We think, therefore we gesture. Language and Cognitive Processes 15. pp. 593--613, 2000.]]Google Scholar
- Becker, H. W., Writing for social scientists: How to start and finish your thesis, book, or article. Chicago: University of Chicago Press. 180 pp. 1986.]]Google Scholar
- Bellotti, V. and Y. Rogers. From Web Press to Web Pressure: Multimedia Representations and Multimedia Publishing. In Proceedings of CHI: Human Factors in Computing Systems. Atlanta, GA: ACM Press. pp. 279--86, 1997.]] Google ScholarDigital Library
- Brooks, J., Frederick P., M. Ouh-Young, J. Batter, J. , and P. J. Kilpatrick, Project GROPE: Haptic displays for scientific visualization, in Proceedings of the 17th annual conference on Computer graphics and interactive techniques. 1990, ACM Press: Dallas, TX, USA.]] Google ScholarDigital Library
- Brown, J. S. and P. Duguid, The Social Life of Information: Harvard Business School Press. 352 pp. 2002.]] Google ScholarDigital Library
- Buxton, W., A. S., Human skills in interface design, in Interacting with virtual environments, L.W. MacDonald and J. Vince, Editors. Wiley: New York, NY. pp. 1--12, 1994.]]Google Scholar
- Buxton, W., A. S., There's More to Interaction than Meets the Eye: Some Issues in Manual Input, in User Centered System Design: New Perspectives on Human-Computer Interaction, D.A. Norman and S.W. Draper, Editors. Lawrence Erlbaum Associates: Hillsdale, NJ. pp. 319--37, 1986.]]Google ScholarDigital Library
- Buxton, W. and B. Myers, A study in two-handed input, in Proceedings of the SIGCHI conference on Human factors in computing systems. 1986, ACM Press: Boston, Massachusetts, United States.]] Google ScholarDigital Library
- Card, S. K., T. P. Moran, and A. Newell, The Psychology of Human-Computer Interaction. Hillsdale: Lawrence Erlbaum. 469 pp. 1983.]] Google ScholarDigital Library
- Chong, J. Transparency and Organizational Knowledge: Knowledge Sharing Through Work Practice. In Proceedings of Academy of Management. Atlanta, GA, 2006.]]Google Scholar
- Church, R. B. and S. Goldin-Meadow. The mismatch between gesture and speech as an index of transitional knowledge. Cognition 23. pp. 43--71, 1986.]]Google Scholar
- Dibbell, J., My tiny life: Crime and passion in a virtual world. New York: Henry Holt and Companypp. 1999.]] Google ScholarDigital Library
- Djajadiningrat, T., S. Wensveen, J. Frens, and K. Overbeeke. Tangible products: redressing the balance between appearance and action. Pers Ubiquit Comp 8: Springer-Verlag. pp. 294--309, 2004.]] Google ScholarDigital Library
- Dourish, P., Where the action is: the foundations of embodied interaction: MIT Press. 233 pp. 2001.]] Google ScholarDigital Library
- Dreyfus, H., Being-in-the-world. Cambridge, Mass.: MIT Presspp. 1992.]]Google Scholar
- Dreyfus, H., Disembodied Telepresence and the Remoteness of the Real, in On the Internet. Routledge: London. pp. 50--72, 2001.]]Google Scholar
- Dreyfus, H. L., Kierkegaard on the Internet: Anonymity vrs. Commitment in the Present Age, 2005. http://ist-socrates.berkeley.edu/~hdreyfus/html/paper_kierkegaard.html]]Google Scholar
- Fishkin, K. P. A taxonomy for and analysis of tangible interfaces. Personal Ubiquitous Comput. 8(5): Springer-Verlag. pp. 347--58, 2004.]] Google ScholarDigital Library
- Fitzmaurice, G. W., H. Ishii, and W. Buxton, A. S. , Bricks: laying the foundations for graspable user interfaces, in Pro-ceedings of the SIGCHI conference on Human factors in com-puting systems. 1995, ACM Press/Addison-Wesley Publishing Co.: Denver, Colorado, United States.]] Google ScholarDigital Library
- Gibson, J. J., The Senses Considered as a Perceptual System. Boston, MA: Hougton Mifflin. 335 pp. 1966.]]Google Scholar
- Goldin-Meadow, S., H. Nusbaum, S. D. Delly, and S. Wagner. Explaining math: Gesturing lightens the load. Psychological Science 12(6). pp. 516--22, 1991.]]Google ScholarCross Ref
- Grudin, J. The case against user interface consistency. Com-mun. ACM 32(10). pp. 1164--73, 1989.]] Google ScholarDigital Library
- Hayles, K., How We Became Posthuman: Virtual Bodies in Cybernetics, Literature, and Informatics. Chicago: University of Chicago Presspp. 1999.]] Google ScholarDigital Library
- Heath, C. and P. Luff. Documents and professional practice: "bad" organisational reasons for "good" clinical records. In Proceedings of Proceedings of the 1996 ACM conference on Computer supported cooperative work. Boston, Massachu-setts, United States: ACM Press. pp. 354--63, 1996.]] Google ScholarDigital Library
- Hollan, J., E. Hutchins, and D. Kirsh. Distributed cognition: toward a new foundation for human-computer interaction re-search. ACM Trans. Comput.-Hum. Interact. 7(2): ACM Press. pp. 174--96, 2000.]] Google ScholarDigital Library
- Hollan, J. and S. Stornetta. Beyond being there. In Proceed-ings of Human factors in computing systems. pp. 119--25, 1992.]] Google ScholarDigital Library
- Hornecker, E. A design theme for tangible interaction: Embodied facilitation. In Proceedings of European Confer-ence on Computer-Supported Cooperative Work. Paris, France, September 18-22, 2005.]] Google ScholarDigital Library
- Hutchins, E., Cognition in the wild. Cambridge: MIT Press. 381 pp. 1995.]]Google Scholar
- Igoe, T. and D. O'Sullivan, Physical Computing: Thomson Course Technologypp. 2004.]]Google Scholar
- Iverson, J. and S. Goldin-Meadow. Gesture paves the way for language development. Psychological Science 16(5). pp. 367--71, 2005.]]Google ScholarCross Ref
- Iverson, J. and S. Goldin-Meadow. What's communication got to do with it: Gesture in blind children. Developmental Psy-chology 33. pp. 453--67, 1997.]]Google Scholar
- Kermoian, R. and J. J. Campos. Locomotor experience: A facilitator of spatial cognitive development. Child Develop-ment 59(4). pp. 908--17, 1988.]]Google ScholarCross Ref
- Kirsh, D. and P. Maglio. On distinguishing epistemic from pragmatic action. Cognitive Science 18. pp. 513--49, 1994.]]Google Scholar
- Klemmer, S. R., Tangible User Interface Input: Tools and Techniques, Unpublished PhD, University of California, Computer Science, Berkeley, CA, 2004. http://hci.stanford.edu/srk/KlemmerDissertation.pdf]] Google ScholarDigital Library
- Klemmer, S. R., J. Graham, G. J. Wolff, and J. A. Landay. Books with Voices: Paper Transcripts as a Tangible Interface to Oral Histories. CHI: ACM Conference on Human Factors in Computing Systems, CHI Letters 5(1): ACM Press. pp. 89--96, 2003.]] Google ScholarDigital Library
- Kraut, R. E., M. Patterson, V. Lundmark, S. Kiesler, T. Mukopadhyay, and W. Scherlis. Internet paradox. A social technology that reduces social involvement and psychological well-being? , American Psychologist 53(9). pp. 1017--31, 1998.]]Google ScholarCross Ref
- Lakoff, G. and M. Johnson, The embodied mind, in Philoso-phy in the flesh: Embodied mind and its challenges to Western thought. Basic Books: New York. pp. 16--41, 1999.]]Google Scholar
- Lakoff, G. and R. E. Núñez, Where Mathematics Comes From. New York, NY: Basic Bookspp. 2000.]]Google Scholar
- Lave, J. and E. Wenger, Situated Learning: Legitimate Peripheral Participation. 1st ed. Learning in Doing: Social, Cognitive, and Computational Perspectives, J.S. Brown, et al. Cambridge: Cambridge Press. 138 pp. 1991.]]Google Scholar
- Mackay, W. E. Is Paper Safer? The Role of Paper Flight Strips in Air Traffic Control. ACM Transactions on Computer-Human Interaction 6(4). pp. 311--40, 1999.]] Google ScholarDigital Library
- Maglio, P. and D. Kirsh. Epistemic action increases with skill. In Proceedings of Cognitive Science Society: LEA, 1996.]]Google Scholar
- Maglio, P., T. Matlock, D. Raphaely, B. Chernicky, and D. Kirsh. Interactive skill in Scrabble. In Proceedings of Twenty-first annual conference of the cognitive science society: Law-rence Erlbaum, 1999.]]Google Scholar
- McGrath, D. No Pain, No Game, Wired, 03/07, 2002.]]Google Scholar
- McLuhan, M., Understanding Media: The Extensions of Man. Cambridge, MA: MIT Presspp. 1994.]]Google Scholar
- Meagher, M., K. Bielaczyc, and J. Huang. OpenD: Supporting Parallel Development of Digital Designs. In Proceedings of DUX: Designing for User eXperience. San Francisco, CA: AIGA, November, 2005.]] Google ScholarDigital Library
- Milgram, S., Obedience to authority. New York: Harper & Rowpp. 1974.]]Google Scholar
- Montessori, M., The montessori method. New York: Frederick A. Stokes Co. 376 pp. 1964.]]Google Scholar
- Newman, M. W. and J. A. Landay. Sitemaps, Storyboards, and Specifications: A Sketch of Web Site Design Practice. In Pro-ceedings of DIS: Symposium on Designing Interactive Systems New York, NY: ACM Press. pp. 263--74, August 17-19, 2000.]] Google ScholarDigital Library
- Norman, D. A., Emotional Design: Why we love (or hate) everyday things. New York, NY: Basic Bookspp. 2004.]]Google Scholar
- Norman, D. A., Things that make us smart: Defending human attributes in the age of the machine: Addison Wesley Publish-ing Company. 290 pp. 1993.]] Google ScholarDigital Library
- Olson, G. M. and J. S. Olson. Distance matters. Human-Computer Interaction 15. pp. 139-78, 2000.]]Google ScholarDigital Library
- Patten, J., B. Recht, and H. Ishii. Audiopad: A Tag-based Interface for Musical Performance, in Proceedings of Confer-ence on New Interface for Musical Expression. In Proceedings of New Instruments for Musical Expression. Dublin, Ireland, 2002.]] Google ScholarDigital Library
- Pecher, D. and R. A. Zwaan, ed. Grounding Cognition: The Role of Perception and Action in Memory, Language and Thinking. ed. Cambridge University Press: Cambridge, UK. 334 pp., 2005.]]Google Scholar
- Piaget, J., The origins of intelligence in children. New York: International University Press. 419 pp. 1952.]]Google Scholar
- Polanyi, M., The Tacit Dimension. London: Routledge & Kegan Paul Ltd. 108 pp. 1967.]]Google Scholar
- Rocco, E. Trust breaks down in electronic contexts but can be repaired by some initial face-to-face contact. In Proceedings of Proceedings of the CHI'98 Conference on Human Factors in Computing Systems: ACM Press. pp. 496--502, 1998.]] Google ScholarDigital Library
- Schön, D. A., The Reflective Practitioner: How Professionals Think in Action. New York: Basic Bookspp. 1983.]]Google Scholar
- Schön, D. A. and J. Bennett, Reflective Conversation with Materials, in Bringing Design to Software, T. Winograd, Edi-tor. ACM Press: New York, 1996.]] Google ScholarDigital Library
- Schrage, M., Cultures of Prototyping, in Bringing Design to Software, T. Winograd, Editor. ACM Press: New York, 1996.]] Google ScholarDigital Library
- Seitz, J. A. The Bodily Basis of Thought. In Proceedings of 29th Annual Symposium of the Jean Piaget Society. Mexico City, Mexico, 1999.]]Google Scholar
- Sellen, A. J. and R. Harper, The Myth of the Paperless Office. 1st ed. Cambridge, Mass.: MIT Press. 245 pp. 2001.]] Google ScholarDigital Library
- Shaer, O., N. Leland, E. H. Calvillo-Gamez, and R. J. K. Jacob. The TAC Paradigm: Specifying Tangible User Inter-faces. Personal and Ubiquitous Computing 8(5). pp. 359--69, 2004.]] Google ScholarCross Ref
- Simon, H. A., The Science of Design, in The Sciences of the Artificial. MIT Press: Cambridge, MA. pp. 129--60, 1981.]] Google ScholarDigital Library
- Sproull, L. and S. Kiesler, Connections: New ways of working in the networked organization. Cambridge, MA: MIT Press. 212 pp. 1991.]] Google ScholarDigital Library
- Suchman, L. Do Categories Have Politics? The Lan-guage/Action Perspective Reconsidered. Computer Supported Collaborative Work (2). pp. 177--90, 1994.]]Google Scholar
- Sudnow, D., Ways of the hand : the organization of impro-vised conduct. Cambridge, MA: MIT 171 pp. 1993.]]Google Scholar
- Switkes, J. P., E. J. Rossetter, I. A. Coe, and J. C. Gerdes. Handwheel force feedback for lanekeeping assistance: Com-bined dynamics and stability. In Proceedings of International symposium on advanced vehicle control. Arnhem, Nether-lands. pp. 47--52, 2004.]]Google Scholar
- Underkoffler, J. and H. Ishii, Illuminating light: an optical design tool with a luminous-tangible interface, in Proceedings of the SIGCHI conference on Human factors in computing systems. 1998, ACM Press/Addison-Wesley Publishing Co.: Los Angeles, California, United States.]] Google ScholarDigital Library
- Wang, Q. and C. Nass. Less Visible and Wireless: Two experiments on the effects of microphone type on users' per-formance and perception. In Proceedings of Human factors in computing systems. Portland, Oregon, 2005.]] Google ScholarDigital Library
- Watzlawick, P., J. H. Beavin, and D. D. Jackson, Pragmatics of human communication; a study of interactional patterns, pathologies and paradoxes. New York, NY: Norton. 294 pp. 1967.]]Google Scholar
- Weiser, M. The Computer for the 21st Century. Scientific American 265. pp. 94--104, 1991.]]Google Scholar
- Weiser, M. and J. S. Brown, The Coming Age of Calm Technology, in Beyond Calculation: The Next Fifty Years of Computing, P.J. Denning and R.M. Metcalfe, Editors. Coper-nicus Books: New York, NY. p. 331, 1997.]] Google ScholarDigital Library
- Williams, A., E. Kabisch, and P. Dourish. From Interaction to Participation: Configuring Space Through Embodied Interac-tion. In Proceedings of Ubicomp. Tokyo, Japan. pp. 287--304, 2005.]] Google ScholarDigital Library
- Wilson, F. R., The Hand. New York, NY: Vintage Books. 397 pp. 1999.]]Google Scholar
- Winograd, T. and F. Flores, Understanding Computers and Cognition: A new foundation for design: Addison Wesley. 207 pp. 1986.]] Google ScholarDigital Library
- Yee, N., The psychology of massively multi-user online role-playing games: Motivations, emotional investment, relation-ships, and problematic usage, in Avatars at work and play: Collaboration and interaction in shared virtual environments, R. Schroeder and A. Axelsson, Editors. Springer-Verlag: London, 2005.]]Google Scholar
- Zhang, J. and H. Wang. The effect of external representations on numeric tasks. Quarterly Journal of Experimental Psychol-ogy 58A(5). pp. 817--38, 2005.]]Google ScholarCross Ref
- Zuboff, S., In the Age of the Smart Machine: The Future of Work and Power. New York: Basic Books. 468 pp. 1988.]] Google ScholarDigital Library
Index Terms
- How bodies matter: five themes for interaction design
Recommendations
Interaction design for and with the lived body: Some implications of merleau-ponty's phenomenology
Special issue on the theory and practice of embodied interaction in HCI and interaction designIn 2001, Paul Dourish proposed the term embodied interaction to describe a new paradigm for interaction design that focuses on the physical, bodily, and social aspects of our interaction with digital technology. Dourish used Merleau-Ponty's ...
Beyond arcade machines: students building interactive tangible installations
IE '12: Proceedings of The 8th Australasian Conference on Interactive Entertainment: Playing the SystemIn a University course on phenomenology, embodiment and tangible interaction, students were asked to design and build installations that can be played. This article describes some of their works and the concept of the course. The results are critically ...
Children and embodied interaction: seeking common ground
IDC '09: Proceedings of the 8th International Conference on Interaction Design and ChildrenAs computation plays an ever larger role as an embedded part of the environment, research that seeks to understand the embodied nature of children's interactions with computation becomes increasingly important. Embodied interaction is an approach to ...
Comments