Skip to main content
SpringerLink
Log in

Formidable Bracelet, Beautiful Lantern

Studying Multi-sensory User Experience from a Semiotic Perspective

  • Conference paper
Design Science at the Intersection of Physical and Virtual Design (DESRIST 2013)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 7939))

Abstract

We live in an experience economy. The more saturated the global market becomes with products offering the same functions, services and quality, the more companies are wanting to appeal to the intangible needs and desires of consumers. To achieve this, designers and researchers are turning inwards to investigate the psychological factors affecting peoples’ relationships and reactions towards design properties. For this reason, design semantics studies on user experience have been advancing all the time. Much emphasis has been placed on visual product experience, as well as the relationship between brand perception and user experience. These are important steps, which are referred to in this paper. However, experience is multi-sensory, that is, our mental impressions and representations are constantly stimulated and informed by what we see, hear, taste, smell and touch. This paper explains user experience from a semiotic perspective. It then introduces a cognitive semiotic model, the C-model, of user experience and describes its application in an empirical study. Findings of the study suggest that while people favor what is perceived through sight in contrast to what is perceived through touch. However, the sense of touch inspires imaginative interpretation of form and associations with visual properties such as color.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Pine, B.J., Gilmore, J.H.: The Experience Economy. Harvard Business School Press, Boston (1999)

    Google Scholar 

  2. Warell, A.: Visual Experience of Brand-Specific Automobile Design: Studying appreciation, emotion and comprehension using the VPE framework. In: 1st European Conference on Affective Design and Kansei (Emotion) Engineering, Lund University (2007), http://www.ep.liu.se/ecp/026/116/ecp0726116.pdf

  3. Hekkert, P.: Design Aesthetics: principles of pleasure in design. J. Psych. Sci. 48, 157–172 (2006)

    Google Scholar 

  4. Dewey, J.: Art as Experience. Perigee, New York (1980)

    Google Scholar 

  5. Forlizzi, J., Battarbee, K.: Understanding Experience in Interactive Systems. In: Designing Interactive Systems: Processes, Practices, Methods, and Techniques, pp. 261–268. Human-Computer Interaction Institute, Cambridge (2004), http://repository.cmu.edu/hcii/46

    Google Scholar 

  6. McCarthy, J., Wright, P.: Technology as Experience. In: Interactions, vol. 11(5), pp. 42–43. ACM, New York (2004), doi:10.1145/1015530.1015549

    Google Scholar 

  7. Roto, V., Law, E., Vermeeren, A., Hoonhout, J.: User Experience White Paper – bringing clarity to the concept of user experience. Report, Dagstuhl Seminar on Demarcating User Experience (2011), http://www.allaboutux.org/files/UX-WhitePaper.pdf

  8. Kohut, H.: Introspection, Empathy, and Psychoanalysis – an examination of the relationship between mode of observation and theory. JAPA 7, 459–483 (1959)

    Google Scholar 

  9. Lakoff, G.: Don’t Think of an Elephant: Know Your Values and Frame the Debate: The Essential Guide for Progressives. Chelsea Green Publishing, White River Junction (2004)

    Google Scholar 

  10. Carroll, J.: Making Use: scenario-based design of human-computer interactions. MIT Press, Cambridge (2000)

    Google Scholar 

  11. Kerkow, D.: Don’t have to know what it is like to be a Bat to Build a Radar Reflector – functionalism in UX. In: Towards a UX Manifesto, pp. 19–25 (2007), http://141.115.28.2/cost294/upload/506.pdf

  12. Jackson, F.: Epiphenomenal Qualia. Phil. Q. 32, 127–136 (1982)

    Article  Google Scholar 

  13. Revonsuo, A.: Consciousness: the science of subjectivity. Psychology Press, New York (2010)

    Google Scholar 

  14. Warell, A.: Multi-Modal Visual Experience of Brand-Specific Automobile Design. J. TQM 20(4), 356–371 (2008), http://dx.doi.org/10.1108/17542730810881348

    Article  Google Scholar 

  15. Feiner, S., Macintyre, B., Seligmann, D.: Knowledge-Based Augmented Reality. In: Cohen, J. (ed.) Communications of the ACM Special Issue on Computer Augmented Environments: Back to the Real World, vol. 36(7), pp. 53–62. ACM, New York (1993)

    Google Scholar 

  16. Haller, M., Billinghurst, M., Thomas, B.: Emerging Technologies of Augmented Reality: Interfaces and Design. Idea Group Publishing, Hersey (2007)

    Google Scholar 

  17. Csikszentmihalyi, M., Rochberg-Halton, E.: The Meaning of Things: Domestic Symbols and the Self. Cambridge University Press, Cambridge (1981)

    Book  Google Scholar 

  18. Krippendorff, K., Butter, R.: Product Semantics: exploring the symbolic qualities of form. In: IDSA (1984)

    Google Scholar 

  19. Vihma, S.: Products as Representations: a semiotic and aesthetic study of design products. Doctoral thesis, University of Art and Design, Helsinki (1995)

    Google Scholar 

  20. Monö, R.: Design for Product Understanding. Liber AB, Stockholm (1997)

    Google Scholar 

  21. Muller, W.: Order and Meaning in Design. Lemma Publishers, Utrecht (2001)

    Google Scholar 

  22. Van Breemen, E.J.J., Sudijono, S.: The Role of Shape in Communicating Designers’ Aesthetic Intents. In: 1999 ASME Design Engineering Technical Conferences, Las Vegas (1999)

    Google Scholar 

  23. Warell, A.: Design Syntactics – a functional approach to visual product form. Doctoral thesis, Chalmers University of Technology, Gothenburg (2001)

    Google Scholar 

  24. Warell, A.: Towards a Theory-Based Method for Evaluation of Visual Form Syntactics. In: TMCE 2004, Tools and Methods of Competitive Engineering, Lausanne (2004)

    Google Scholar 

  25. Karjalainen, T.-M.: Semantic Transformation in Design – communicating strategic brand identity through product design references, Gummerus Kirjapaino Oy, Jyväskylä (2004)

    Google Scholar 

  26. Warell, A.: Modelling perceptual product experience – towards a cohesive framework of presentation and representation in design. Paper for Design and Emotion Conference (2008), http://www.designandemotion.org/library/page/viewDoc/207

  27. Hekkert, P.L., Desmet, P.M.: The Basis of Product Emotions. In: Green, W., Jordan, P. (eds.) Pleasure with Products, Beyond Usability, pp. 60–68. Taylor & Francis, London (2002)

    Google Scholar 

  28. Peirce, C.S.: Collected Papers of Charles Sanders Peirce. In: Hartshorne, C., Weiss, P., Burks, A.W. (eds.), vol. 1-8, Harvard University Press, Cambridge (1931-1966)

    Google Scholar 

  29. Atkin, A.: Peirce’s Theory of Signs. In: Stanford Encyclopedia of Philosophy (2010), http://plato.stanford.edu/entries/peirce-semiotics/

  30. Govers, P.C.M., Schoormans, J.P.L.: Intangible Product Attributes of Watches. In: EMAC 2000, Rotterdam (2000)

    Google Scholar 

  31. Govers, P.C.M., Hekkert, P.L., Schoormans, J.P.L.: Happy, Cute and Tough: Can Designers Create a Product Personality that Consumers Understand? In: McDonagh, D., Hekkert, P., Van Erp, J., Gyi, D. (eds.) Design and Emotion: The Experience of Everyday Things, pp. 345–349. Taylor & Francis, London (2003)

    Chapter  Google Scholar 

  32. Vihma, S.: Design Semantics and Aesthetics. In: the basic PARADOX - foundations for a groundless discipline (2003), http://home.snafu.de/jonasw/PARADOXVihmaE.html

  33. Kuniavsky, M.: Observing the User Experience: a practitioner’s guide to user research. Morgan Kaufmann Publishers, San Francisco (2003)

    Google Scholar 

  34. Kuniavsky, M.: User Experience and HCI (draft). In: HCI Handbook (2007), http://www.orangecone.com/hci_UX_chapter_0.7a.pdf

  35. Akner-Koler, C.: Form and Formlessness. Chalmers University of Technology, Gothenburg (2007)

    Google Scholar 

  36. Hirschman, E.C., Holbrook, M.B.: Hedonic Consumption: emerging concepts, methods and propositions. J. Marketing 46(3), 92–101 (1982), http://www.jstor.org/stable/1251707

    Article  Google Scholar 

  37. Graham, L.: Gestalt Theory in Interactive Media Design. J. Humanities & Social Sciences 2(1) (2008), http://www.scientificjournals.org/journals2008/articles/1288.pdf

  38. Wertheimer, M.: Gestalt Theory. In: Ellis, W.D. (ed.) A Source Book of Gestalt Psychology. Harcourt Brace & Co., New York (1938)

    Google Scholar 

  39. Ijsselsteijn, W., Riva, G.: Being There: the experience of presence in mediated environments. In: Riva, G., Davide, F., IJsselsteijn, W. (eds.) Being There: Concepts, Effects and Measurement of User Presence in Synthetic Environments, vol. 2(1), IOS Press, Amsterdam (2003), http://www8.informatik.umu.se/~jwworth/4_01RIVA.pdf

    Google Scholar 

  40. Kelly, G.: The Psychology of Personal Constructs. Norton, New York (1955)

    Google Scholar 

  41. Green, B.: Personal Construct Psychology and Content Analysis. Personal Construct Theory and Practice 1, 82–91 (2004), http://www.pcp-net.org/journal/pctp04/green04.pdf

    Google Scholar 

  42. Forceville, C., Hekkert, P., Tan, E.: The Adaptive Value of Metaphors. In: Klein, U., Mellman, K., Metzger, S. (eds.) Heuristiken der Literaturwissenschaft. Einladung zu disziplinexternen Perspektiven auf Literatur, Mentis, Paderborn (2006)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Computer Science and Information Systems, University of Jyväskylä, Finland

    Rebekah Rousi

Authors
  1. Rebekah Rousi
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Institute of Information Systems, University of Liechtenstein, Fürst-Franz-Josef-Strasse 21, 9490, Vaduz, Liechtenstein

    Jan vom Brocke

  2. Department of Information and Service Economy, Aalto University, Chydenia (Runeberginkatu 22-24), P.O. Box 21220, 00076, Aalto, Finland

    Riitta Hekkala  & Matti Rossi  & 

  3. Department of Management Information Systems, Eller College of Management, University of Arizona, 430J McClelland Hall, 85721, Tucson, AZ, USA

    Sudha Ram

Rights and permissions

Reprints and permissions

Copyright information

© 2013 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Rousi, R. (2013). Formidable Bracelet, Beautiful Lantern. In: vom Brocke, J., Hekkala, R., Ram, S., Rossi, M. (eds) Design Science at the Intersection of Physical and Virtual Design. DESRIST 2013. Lecture Notes in Computer Science, vol 7939. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-38827-9_13

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-38827-9_13

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-38826-2

  • Online ISBN: 978-3-642-38827-9

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation