skip to main content
10.1145/2598510.2598602acmconferencesArticle/Chapter ViewAbstractPublication PagesdisConference Proceedingsconference-collections
research-article

Human actions made tangible: analysing the temporal organization of activities

Published: 21 June 2014 Publication History

Abstract

With designers increasingly moving beyond button pushing and flat-screen interaction towards tangible and embodied interaction, techniques for user studies need to develop as well. While ethnographic video studies and ethnomethod-ological analyses are becoming standard in many interaction design projects, it remains a challenge to investigate in detail how people interact with all of their body. Analysis of full-body movement is time consuming, notation techniques are rare, and findings are difficult to share between members of a design team. In this paper we propose tangible video analysis, a method developed to engage people from different backgrounds in collaboratively analysing videos with the help of physical objects. We will present one of these tools, Action Scrabble, for analysing temporal organisation of human actions. We work with a case of skilled forklift truck driving. By backtracking our design research experiments, we will unfold how and why the tangible tool succeeds in engaging designers with varied analysis experience to collaboratively focus on human action structures -- and even find video analysis fun!

References

[1]
Brandt, E., Messeter, J. & Binder, T. 2008. Formatting design dialogues -- games and participation. CoDesign: International Journal of Co-creation in Design and the Arts 4(1), pp. 51--64.
[2]
Brereton, M. & McGarry, B. 2000. An observational study of how objects support engineering design thinking and communication: Implications for the design of tangible media. CHI 2000, The Hague, Amsterdam.
[3]
Buur, J., Beuthel, M. & Caglio A. 2013. Designerly analysis of participation structures. Nordic Design Research Conference (NORDES '13), Copenhagen, Denmark.
[4]
Buur, J., Binder, T. & Brandt, E. 2000. Taking video beyond "hard data" in user centred design. Proceedings of Participatory Design Conference (PDC '00), New York, USA.
[5]
Buur, J. & Soendergaard, A. 2000. Video card game: An augmented environment for User Centred Design discussions. DARE 2000, Proceedings of Designing Augmented Reality Systems, New York: ACM, pp. 63--9.
[6]
Crabtree, A. 2004. Design in the absence of practice: Breaching experiments. Designing Interactive Systems Conference (DIS '04), Cambridge, MA. Figure 11. Tokens with icons representing actions (left) and with arbitrary markings open to interpretation (right).
[7]
Cross, N. 1982. Designerly ways of knowing. Design Studies 3(4), pp. 221--7.
[8]
Fleck, R., Rogers, Y., Yuill, N., Marchall, P., Carr, A., Rick, J. & Bonnett V. 2009. Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces. New York: ACM, pp. 189--96.
[9]
Goodwin, C. 1980. Restarts, pauses, and the achievement of a state of mutual gaze at turn-beginning. Sociological Inquiry 50(3--4), pp. 272--302.
[10]
Heritage, J. & Clayman, S.E. 2010. Talk in Action: Interactions, Identities and Institutions. Boston: WileyBlackwell.
[11]
Heath, C. 1984. Talk and recipiency: Sequential organization in speech and body movement. In J.M. Atkinson & J. Heritage (eds), Structures of Social Action, pp. 247--65. Cambridge: Cambridge University Press.
[12]
Hinricks, U. & Carpendale, S. 2011. Gestures in the wild: Studying multi-touch gesture sequences on interactive tabletop exhibits. Computer Human Interaction Conference (CHI '11), Vancouver, Canada.
[13]
Jordan, B. & Henderson, A., 1995. Interaction analysis: Foundations and practice. Journal of the Learning Sciences 4(1), pp. 39--103.
[14]
Koskinen, I., Zimmerman, J., Binder, T., Redström, J. & Wensveen, S. 2011. Design Research Through Practice: From the Lab, Field, and Showroom. Waltham, MA: Morgan Kaufman.
[15]
Laban, R. 1975. Laban's Principles of Dance and Movement Notation. 2nd ed. London: MacDonald and Evans.
[16]
Mondada, L. 2011. Understanding as an embodied, situated and sequential achievement in interaction. Journal of Pragmatics 43(2), pp. 542--52.
[17]
Sacks, H. 1984. Notes on methodology. In J.M. Atkinson and K. Heritage (eds), Structures of Social Action, pp. 21--7. Cambridge: Cambridge University Press.
[18]
Sacks, H., Schegloff, E. & Jefferson, G. 1974. A simplest systematics for the organization of turn-taking for conversation. Language 50(4), pp. 696--735.
[19]
Schlegoff, E. 1999. Naiveté vs sophistication or discipline vs. self indulgence: Rejoinder to Billig. Discourse and Society 10: 577--82.
[20]
Yull, N. & Rogers Y. 2012. Mechanisms for collaboration: A design and evaluation framework for multi-user interfaces. Transactions of Computer-Human Interaction 19(1). New York: ACM.
[21]
Crown. QuickPick® Remote: Order picking redefined. Available at http://www.crown.com/usa/forklifts/orderpicking-quickpick.html.

Cited By

View all
  • (2023)On the Interaction Between Construction Vehicles and Humans in Close CooperationDesign for Equality and Justice10.1007/978-3-031-61688-4_28(292-298)Online publication date: 28-Aug-2023
  • (2022)Memory Portal: Investigating Data Meaning-making through Spatio-temporal ExperiencesExtended Abstracts of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491101.3519798(1-8)Online publication date: 27-Apr-2022
  • (2017)Seeing Through the Eyes of Heavy Vehicle OperatorsHuman-Computer Interaction - INTERACT 201710.1007/978-3-319-67684-5_16(263-282)Online publication date: 20-Sep-2017
  • Show More Cited By

Index Terms

  1. Human actions made tangible: analysing the temporal organization of activities

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    DIS '14: Proceedings of the 2014 conference on Designing interactive systems
    June 2014
    1102 pages
    ISBN:9781450329026
    DOI:10.1145/2598510
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 21 June 2014

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. collaboration
    2. objects
    3. participatory design
    4. tangibles
    5. toolkits
    6. video
    7. video analysis

    Qualifiers

    • Research-article

    Conference

    DIS '14
    Sponsor:
    DIS '14: Designing Interactive Systems Conference 2014
    June 21 - 25, 2014
    BC, Vancouver, Canada

    Acceptance Rates

    DIS '14 Paper Acceptance Rate 107 of 402 submissions, 27%;
    Overall Acceptance Rate 1,158 of 4,684 submissions, 25%

    Upcoming Conference

    DIS '25
    Designing Interactive Systems Conference
    July 5 - 9, 2025
    Funchal , Portugal

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)7
    • Downloads (Last 6 weeks)4
    Reflects downloads up to 15 Feb 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2023)On the Interaction Between Construction Vehicles and Humans in Close CooperationDesign for Equality and Justice10.1007/978-3-031-61688-4_28(292-298)Online publication date: 28-Aug-2023
    • (2022)Memory Portal: Investigating Data Meaning-making through Spatio-temporal ExperiencesExtended Abstracts of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491101.3519798(1-8)Online publication date: 27-Apr-2022
    • (2017)Seeing Through the Eyes of Heavy Vehicle OperatorsHuman-Computer Interaction - INTERACT 201710.1007/978-3-319-67684-5_16(263-282)Online publication date: 20-Sep-2017
    • (2016)What Is It About Space That Is Important in Interaction? … Let’s Take the World from a Situated Point of ViewArchitecture and Interaction10.1007/978-3-319-30028-3_3(37-52)Online publication date: 10-Jun-2016
    • (2015)Understanding the user in self-managing systemsProceedings of the 2015 European Conference on Software Architecture Workshops10.1145/2797433.2797438(1-4)Online publication date: 7-Sep-2015
    • (2015)Composing InteractionProceedings of the Ninth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/2677199.2687915(667-672)Online publication date: 15-Jan-2015

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media