Skip to main content
SpringerLink
Log in

Giving Form to Smart Objects: Exploring Intelligence as an Interaction Design Material

  • Chapter
  • First Online:
New Directions in Third Wave Human-Computer Interaction: Volume 1 - Technologies

Part of the book series: Human–Computer Interaction Series ((HCIS))

Abstract

Artificial intelligence (AI) has recently been highlighted as a design material in the HCI community. This acknowledgement is a call for interaction designers to consider intelligence as a resource for design. While this view is valid and well-grounded, it brings with it a need to better understand how intelligence as a design material can be used in formgiving practices. This chapter seeks to address this need by suggesting a new approach that integrates AI in the designer’s toolkit. This approach considers intelligence as being part of, and expressed through, an object's character, hereby integrating artificial intelligence into a product's form. We describe and discuss this approach by presenting and reflecting on our experiences in a design course where students were asked to give form to intelligent everyday objects in three iterative design cycles. We discuss the implications of our approach and findings within the frame of third wave HCI.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 219.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 279.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 279.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  • Allmendinger G, Lombreglia R (2005) Four strategies for the age of smart services. Harv Bus Rev 83(10):131–145

    Google Scholar 

  • Amazon Echo (2017) https://www.amazon.com/dp/product/B00X4WHP5E. Last checked 14 Sept 2017

  • Apple HomePod (2017) https://www.apple.com/homepod/. Last checked 14 Sept 2017

  • Bergström J, Brendon C, Frigo A, Mazé R, Vallgårda A (2010) Becoming materials: material forms and forms of practice. Digital Creativity 21(3):155–172

    Article  Google Scholar 

  • Bødker S (2006) When second wave HCI meets third wave challenges. In: Proceedings of the 4th Nordic conference on Human-computer interaction: changing roles (NordiCHI’06). ACM, New York, pp 1–8

    Google Scholar 

  • Bødker S (2015) Third-wave HCI, 10 years later—participation and sharing. Interactions 22(5):24–31. ACM, New York

    Article  Google Scholar 

  • Bødker S, Klokmose CN (2012) Dynamics in artifact ecologies. In: Proceedings of the 7th Nordic conference on Human-Computer Interaction: making sense through design. ACM, New York, pp 448–457

    Chapter  Google Scholar 

  • Cila N, Giaccardi E, Tynan O’Mahony F, Speed C, Caldwell M (2015) Thing-centered narratives: a study of object personas. Paper presented at Research Network for Design Anthropology Seminar 3: Collaborative Formation of Issues (January 2015), Aarhus, Denmark

    Google Scholar 

  • Cila N, Smit I, Giaccardi E, Kröse B (2017) Products as agents: metaphors for designing the products of the IoT age. In: Proceedings of the 2017 CHI conference on human factors in computing systems. ACM, New York, pp 448–459

    Chapter  Google Scholar 

  • Crilly N, Moultrie J, Clarkson PJ (2009) Shaping things: intended consumer response and the other determinants of product form. Des Stud 30(3):224–254. Design, Helsinki

    Article  Google Scholar 

  • Djajadiningrat T, Overbeeke K, Wensveen S (2002) But how, Donald, tell us how?: on the creation of meaning in interaction design through feedforward and inherent feedback. In: Proceedings of the 4th conference on designing interactive systems: processes, practices, methods, and techniques. ACM, New York, pp 285–291

    Google Scholar 

  • Dourish P (2004) Where the action is. MIT Press, Cambridge, MA

    Google Scholar 

  • Dourish P, Mazmanian M (2011) Media as material: information representations as material foundations for organizational practice. In: Proceedings of the third international symposium on process organization studies, pp 92–xx

    Chapter  Google Scholar 

  • Dove G, Halskov K, Forlizzi J, Zimmerman J (2017) UX design innovation: challenges for working with machine learning as a design material. In: Proceedings of the 2017 CHI conference on human factors in computing systems. ACM, New York, pp 278–288

    Chapter  Google Scholar 

  • Evans M, Sommerville S (2007) Seeing is believing: the challenge of product semantics in the curriculum. In: Shaping the future, proceedings of the international conference on engineering and product design education, 13–14 Sept 2007, Northumbria University, Newcastle Upon Tyne, UK

    Google Scholar 

  • Farooq U, Grudin JT (2016) Human-computer integration. Interactions 23(6):26–32

    Article  Google Scholar 

  • Ghajargar M (2017) Toward intelligent environments: supporting reflection with smart objects in the home. Interactions 24(4):60–62. ACM, New York

    Article  Google Scholar 

  • Giaccardi E (2015) Designing the connected everyday. Interactions 22(1):26–31

    Article  Google Scholar 

  • Giaccardi E, Cila N, Speed C, Caldwell M (2016) Thing ethnography: doing design research with non-humans. In: Proceedings of the 2016 ACM conference on designing interactive systems. ACM, New York, pp 377–387

    Google Scholar 

  • Gibson JJ (1979) The ecological approach to visual perception. Houghton Mifflin, Boston

    Google Scholar 

  • Google Home (2017) https://madeby.google.com/home/. Last checked 14 Sept 2017

  • Halse J, Brandt E, Clark B, Binder T (2010) Rehearsing the future. The Danish Design School Press, København

    Google Scholar 

  • Harrison S, Tatar D, Sengers P (2007) The three paradigms of HCI. In: Proceeding of CHI 2007. ACM, New York

    Google Scholar 

  • Heider F, Simmel M (1944) An experimental study of apparent behavior. Am J Psychol 57(2):243–259

    Article  Google Scholar 

  • Hoffman G, Ju W (2014) Designing robots with movement in mind. J Human-Robot Interact 3(1):89–122

    Article  Google Scholar 

  • Hoffman G, Kubat R, Breazeal C (2008) A hybrid control system for puppeteering a live robotic stage actor. In: The 17th IEEE international symposium on Robot and Human Interactive Communication, 2008. RO-MAN 2008. IEEE, pp 354–359

    Google Scholar 

  • Holmquist LE (2017) Intelligence on tap: artificial intelligence as a new design material. Interactions 24(4):28–33

    Article  MathSciNet  Google Scholar 

  • WikiPedia Pixar’s Luxo ‘Junior’. https://en.wikipedia.org/wiki/Luxo_Jr. Last checked 14 Sept 2017

  • Jacucci G, Spagnolli A, Freeman J, Gamberini L (2014) Symbiotic interaction: a critical definition and comparison to other human-computer paradigms. In: International workshop on symbiotic interaction. Springer International Publishing, Cham, pp 3–20

    Google Scholar 

  • Janlert LE, Stolterman E (1997) The character of things. Des Stud 18(3):297–314

    Article  Google Scholar 

  • Janlert L-E, Stolterman E (2017) The meaning of interactivity—some proposals for definitions and measures. Human Comput Interact 32(3):103–138

    Article  Google Scholar 

  • Kaptelinin V, Nardi BA (2006) Acting with technology: activity theory and interaction design. MIT Press, Cambridge, MA

    Google Scholar 

  • Kortuem G, Kowsar F, Fitton D, Vasughi S (2010) Smart artifacts as building blocks for the internet of things. J Internet Comput IEEE 14(1):44–51

    Article  Google Scholar 

  • Krippendorff K (1989) Product semantics: a triangulation and four design theories. In: Väkevä S (ed) Product semantic ‘89. University of Industrial Arts, Helsinki

    Google Scholar 

  • Krippendorff K (2006) The semantic turn: a new foundation for design. Taylor & Francis CRC, New York

    Book  Google Scholar 

  • Kuutti K, Bannon LJ (2014) The turn to practice in HCI: towards a research agenda. In: Proceedings of the 32nd annual ACM conference on Human factors in computing systems. ACM, New York, pp 3543–3552

    Google Scholar 

  • Laurel B (1997) Interface agents: metaphors with character. In: Friedman B (ed) Human values and the design of computer technology. Cambridge University Press, Cambridge, MA, pp 207–219

    Google Scholar 

  • Licklider JC (1960) Man-computer symbiosis. IRE trans Hum Factors Electron 1:4–11

    Article  Google Scholar 

  • Lim YK, Stolterman E, Jung H, Donaldson J (2007) Interaction gestalt and the design of aesthetic interactions. In: Proceedings of the 2007 conference on Designing pleasurable products and interfaces. ACM, New York, pp 239–254

    Chapter  Google Scholar 

  • Marenko B, van Allen P (2016) Animistic design: how to reimagine digital interaction between the human and the nonhuman. Digital Creativity 27(1):52–70

    Article  Google Scholar 

  • McKim RH (1980) Thinking visually: a strategy manual for problem solving. Wadsworth, Belmont

    Google Scholar 

  • Muller W (2001) Order and meaning in design. Lemma, Utrecht

    Google Scholar 

  • Niess J, Diefenbach S (2016) Communication styles of interactive tools for self-improvement. Psychol Well Being 6(1):3

    Article  Google Scholar 

  • Norman DA (1994) How might people interact with agents. Commun ACM 37(7):68–71

    Article  Google Scholar 

  • Papanek V (1971) Design for the Real World: human ecology and social change. Pantheon Books, New York

    Google Scholar 

  • Pasman G, Rozendaal M (2016) Exploring interaction styles through video. In: Proceedings of the 18th international conference on engineering and product design education (E&PDE16), Aalborg, Denmark, 8th–9th September 2016

    Google Scholar 

  • Petersen MG, Iversen OS, Krogh PG, Ludvigsen M (2004) Aesthetic Interaction: a pragmatist's aesthetics of interactive systems. In: Proceedings of the 5th conference on Designing interactive systems: processes, practices, methods, and techniques. ACM, New York, pp 269–276

    Google Scholar 

  • Pevsner N (1991) Pioneers of modern design: from William Morris to Walter Gropius. Penguin Books, London

    Google Scholar 

  • Raizman D (2004) A history of modern design: graphics and products since the industrial revolution. Laurence King Publishing, London

    Google Scholar 

  • Ramduny-Ellis D, Dix A, Evans M, Hare J, Gill S (2010) Physicality in design: an exploration. Des J 13(1):48–76

    Google Scholar 

  • Reeves B, Nass C (1996) How people treat computers, television, and new media like real people and places. CSLI Publications and Cambridge university press, Stanford/Cambridge, MA, pp 3–18

    Google Scholar 

  • Robles E, Wiberg M (2010) Texturing the material turn in interaction design. In: Proceedings of the fourth international conference on Tangible, embedded, and embodied interaction. ACM, New York, pp 137–144

    Chapter  Google Scholar 

  • Rosner DK (2012) The material practices of collaboration. In: Proceedings of the ACM 2012 conference on computer supported cooperative work. ACM, New York, pp 1155–1164

    Google Scholar 

  • Ross PR, Wensveen SA (2010) Designing behavior in interaction: using aesthetic experience as a mechanism for design. Int J Des 4(2):3–13

    Google Scholar 

  • Rozendaal MC (2016) Objects with intent: a new paradigm for interaction design. Interactions 23(3):62–65

    Article  Google Scholar 

  • Sabou M (2010) Smart artifacts: challenges for semantic web research, semantic web – interoperability. Usability Applicability 1:1–5

    Google Scholar 

  • Schön DA (1984) The reflective practitioner: how professionals think in action, vol 5126. Basic Books, New York

    Google Scholar 

  • Siegman AW, Feldstein S (eds) (2014) Nonverbal behavior and communication. In: Psychology press, Oxford

    Google Scholar 

  • Smets G, Overbeeke K, Gaver W (1994, April) Form-giving: expressing the nonobvious. In: Proceedings of the SIGCHI conference on human factors in computing systems. ACM, New York, pp 79–84

    Google Scholar 

  • Taylor AS (2009) Machine intelligence. In: Proceedings of the SIGCHI conference on human factors in computing systems. ACM, New York, pp 2109–2118

    Google Scholar 

  • Tholander J, Normark M, Rossitto C (2012) Understanding agency in interaction design materials. In: Proceedings of the SIGCHI conference on human factors in computing systems. ACM, New York, pp 2499–2508

    Google Scholar 

  • Vallgårda A (2014) Giving form to computational things: developing a practice of interaction design. Pers Ubiquit Comput 18(3):577–592

    Article  Google Scholar 

  • Vallgårda A, Redström J (2007) Computational composites. In: Proceedings of the SIGCHI conference on Human factors in computing systems. ACM, New York, pp 513–522

    Chapter  Google Scholar 

  • Verplank B (2009) Interaction design sketchbook: frameworks for designing interactive products and systems. https://ccrma.stanford.edu/courses/250a-fall-2004/IDSketchbok.pdf. Last access 14 Sept 2017

  • Vihma S (1995) Products as representations: a semiotic and aesthetic study of design products. University of Arts & Design, Helsinki

    Google Scholar 

  • Wiberg M (2014) Methodology for materiality: interaction design research through a material lens. Pers Ubiquit Comput 18(3):625–636

    Article  Google Scholar 

  • Wiberg M (2018) The materiality of interaction: notes on the materials of interaction design. MIT Press, Cambridge, MA

    Google Scholar 

  • Wiberg M, Robles E (2010) Computational compositions: aesthetics, materials, and interaction design. Int J Des 4(2):65–76

    Google Scholar 

  • Wiberg M, Ishii H, Dourish P, Vallgårda A, Kerridge T, Sundström P, Rosner D, Rolston M (2013) Materiality matters – experience materials. Interactions 20(2):54–57

    Article  Google Scholar 

  • Wooldridge M, Jennings NR (1995) Intelligent agents: theory and practice. Knowl Eng Rev 10(2):115–152

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Delft University of Technology, Delft, The Netherlands

    Marco C. Rozendaal & Gert Pasman

  2. Polytechnic University of Turin, Turin, Italy

    Maliheh Ghajargar

  3. Umeå University, Umeå, Sweden

    Mikael Wiberg

Authors
  1. Marco C. Rozendaal
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Maliheh Ghajargar
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Gert Pasman
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Mikael Wiberg
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Marco C. Rozendaal .

Editor information

Editors and Affiliations

  1. School of Interactive Arts & Technology, Simon Fraser University, Surrey, British Columbia, Canada

    Michael Filimowicz

  2. School of Communications, Simon Fraser University, Burnaby, British Columbia, Canada

    Veronika Tzankova

Rights and permissions

Reprints and permissions

Copyright information

© 2018 Springer International Publishing AG, part of Springer Nature

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Rozendaal, M.C., Ghajargar, M., Pasman, G., Wiberg, M. (2018). Giving Form to Smart Objects: Exploring Intelligence as an Interaction Design Material. In: Filimowicz, M., Tzankova, V. (eds) New Directions in Third Wave Human-Computer Interaction: Volume 1 - Technologies. Human–Computer Interaction Series. Springer, Cham. https://doi.org/10.1007/978-3-319-73356-2_3

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-73356-2_3

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-73355-5

  • Online ISBN: 978-3-319-73356-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation