Skip to main content
SpringerLink
Log in

Situated and mobile displays for reflection on shopping and nutritional choices

  • Original Article
  • Published:
Personal and Ubiquitous Computing Aims and scope Submit manuscript

Abstract

In this paper, we explore the use of peoples’ shopping data to raise awareness and to enable reflection about nutrition. In order to ground our Nutriflect approach, we conducted 125 structured interviews in grocery stores. Informed by the results of this exploratory study, we designed a system that shows a household’s collective food consumption patterns via situated displays in the home and through mobile devices in-store. The system aimed to minimize the need for manual entry of nutrition-related data by the users. To evaluate our system, we conducted a 4-week field study in eight households with 21 inhabitants and situated in-store shopping inquiries with a subset of 9 of these users, using actual shopping data from participants. In these studies, we identified issues regarding the interaction design of Internet of Things applications and explored the use of complementary distributed displays to provide tailored cues in context. The approach taken showed the potential to foster reflection about shopping and nutritional choices and for integration with people’s everyday practices.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6

Similar content being viewed by others

References

  1. Duhigg C (2012) How companies learn your secrets. The New York Times, New York

    Google Scholar 

  2. Kimokoti RW, Millen BE (2011) Diet, the global obesity epidemic, and prevention. J Am Diet Assoc 111:1137–1140

    Article  Google Scholar 

  3. World Health Organization (2004) Global strategy on diet, physical activity and health. WHO, Geneva. http://www.who.int/dietphysicalactivity/publications/en/

  4. Broll G, Rukzio E, Paolucci M, Wagner M, Schmidt A, Hussmann H (2009) Perci: pervasive service interaction with the internet of things. Internet Comput IEEE 13:74–81

    Article  Google Scholar 

  5. Ailisto H, Isomursu M, Tuikka T, Häikiö J (2009) Experiences from interaction design for NFC applications. J Ambient Intell Smart Environ 1:351–364

    Google Scholar 

  6. http://moonshot.barkleyus.com/post/27503501953/moonshot-created-the-wine-tap-concept-to

  7. http://vimeo.com/channels/thinkandgonfc/

  8. http://www.nfcworld.com/2013/01/23/322047/samsung-tests-nfc-window-shopping-in-amsterdam

  9. Möller A, Diewald S, Roalter L, Kranz M (2012) MobiMed: comparing object identification techniques on smart phones. Proceedings of the 7th Nordic conference on human–computer interaction: making sense through design (NordiCHI ‘12). ACM, New York, NY, USA, pp 31–40

    Google Scholar 

  10. Ceipidor UB, Medaglia CM, Opromolla A, Volpi V, Moroni A, Sposato S (2012) A survey about user experience improvement in mobile proximity payment. 2012 4th International Workshop on near field communication (NFC), pp 51–56

  11. Hang A, Broll G, Wiethoff A (2010) Visual design of physical user interfaces for NFC-based mobile interaction. Proceedings of the 8th ACM conference on designing interactive systems (DIS ‘10). ACM, New York, NY, pp 292–301

    Chapter  Google Scholar 

  12. Wisneski C, Ishii H, Dahley A, Gorbet MG, Brave S, Ullmer B, Yarin P (1998) Ambient displays: turning architectural space into an interface between people and digital information. Proceedings of CoBuild ‘98, pp 22–32

  13. Reitberger W, Obermair C, Ploderer B, Meschtscherjakov A, Tscheligi M (2007) Enhancing the shopping experience with ambient displays: a field study in a retail store. Ambient intelligence, vol 4794/2007. Springer, Berlin, pp 314–331

  14. Alt F, Muller J, Schmidt A (2012) Advertising on public display networks. Computer 45:50–56

    Article  Google Scholar 

  15. Kalnikaite V, Kreitmayer S, Rogers Y, Bird J, Villar N, Bachour K, Payne S, Todd PM, Schöning J, Krüger A (2011) How to nudge in situ: designing lambent devices to deliver salient information in supermarkets. UbiComp ‘11. ACM Press, New York, p 11

  16. von Reischach F, Dubach E, Michahelles F, Schmidt A (2010) An evaluation of product review modalities for mobile phones. Proceedings of the 12th international conference on Human computer interaction with mobile devices and services. ACM, Lisbon, Portugal

  17. Gaver W, Boucher A, Law A, Pennington S, Bowers J, Beaver J, Humble J, Kerridge T, Villar N, Wilkie A (2008) Threshold devices: looking out from the home. Proceedings of the SIGCHI conference on human factors in computing systems. ACM, Florence, Italy, pp 1429–1438

  18. Gustafsson A, Gyllenswärd M (2005) The power-aware cord: energy awareness through ambient information display. In: CHI ‘05 extended abstracts on human factors in computing systems. ACM, New York, pp 1423–1426

  19. Kjeldskov J, Skov MB, Paay J, Pathmanathan R (2012) Using mobile phones to support sustainability: a field study of residential electricity consumption. Proceedings of the 2012 ACM annual conference on human factors in computing systems, pp 2347–2356. ACM, Austin, Texas

  20. Erickson T, Podlaseck M, Sahu S, Dai JD, Chao T, Naphade M (2012) The dubuque water portal: evaluation of the uptake, use and impact of residential water consumption feedback. Proceedings of the SIGCHI conference on human factors in computing systems. ACM, Austin, pp 675–684

  21. Terrenghi L, Quigley A, Dix A (2009) A taxonomy for and analysis of multi-person-display ecosystems. Personal Ubiquitous Comput 13:583–598

    Article  Google Scholar 

  22. Huang EM, Mynatt ED, Trimble JP (2006) Displays in the wild: understanding the dynamics and evolution of a display ecology. Proceedings of the 4th international conference on pervasive computing. Springer, Berlin

  23. Wigdor D (2010) Architecting next-generation user interfaces. Proceedings of the international conference on advanced visual interfaces. ACM, New York, NY

  24. Fogg BJ (2003) Persuasive technology: using computers to change what we think and do. Morgan Kaufmann Publishers Inc., San Francisco

  25. Oinas-Kukkonen H (2013) A foundation for the study of behavior change support systems. Pers Ubiquitous Comput 17(6):1223–1235

  26. Reitberger W, Ploderer B, Obermair C, Tscheligi M (2007) The perCues framework and its application for sustainable mobility. Persuasive, vol 4744. Springer, Palo Alto, California, pp. 92–95

  27. Fogg BJ (2006) The six most powerful persuasion strategies. Persuasive, vol 3962. Springer, Eindhoven, p 6

  28. Zajonc RB (1965) Social facilitation. Science 149:269–274

    Article  Google Scholar 

  29. Festinger L (1954) A theory of social comparison processes. Hum Relat 7(2):117–140

    Article  Google Scholar 

  30. Lin J, Mamykina L, Lindtner S, Delajoux G, Strub H (2006) Fish‘n’Steps: encouraging physical activity with an interactive computer game. In: Dourish P, Friday A (eds) UbiComp 2006: ubiquitous computing, vol 4206. Springer, Berlin, pp. 261-278

  31. Consolvo S, McDonald DW, Toscos T, Chen MY, Froehlich J, Harrison B, Klasnja P, LaMarca A, LeGrand L, Libby R, Smith I, Landay JA (2008) Activity sensing in the wild: a field trial of ubifit garden. Proceedings of the twenty-sixth annual SIGCHI conference on human factors in computing systems. ACM, Florence, pp. 1797–1806

  32. Froehlich J, Findlater L, Ostergren M, Ramanathan S, Peterson J, Wragg I, Larson E, Fu F, Bai M, Patel S, Landay JA (2012) The design and evaluation of prototype eco-feedback displays for fixture-level water usage data. Proceedings of the SIGCHI conference on human factors in computing systems. ACM, Austin, Texas, pp 2367–2376

  33. Fox S, Duggan M (2013) Tracking for health report. Pew Research Center, Washington

    Google Scholar 

  34. Thaler RH, Sunstein CR (2008) Nudge: improving decisions about health, wealth, and happiness. Yale University Press, New Haven

    Google Scholar 

  35. Lee MK, Kiesler S, Forlizzi J (2011) Mining behavioral economics to design persuasive technology for healthy choices. Proceedings of the SIGCHI conference on human factors in computing systems. ACM, Vancouver, BC, pp 325–334

  36. Siek KA, Connelly KH, Rogers Y, Rohwer P, Lambert D, Welch JL (2006) When do we eat? An evaluation of food items input into an electronic food monitoring application. In: Pervasive health conference and workshops, pp 1–10

  37. Tsai CC, Lee G, Raab F, Norman GJ, Sohn T, Griswold WG, Patrick K (2007) Usability and feasibility of PmEB: a mobile phone application for monitoring real time caloric balance. Mob Netw Appl 12:173–184

    Article  Google Scholar 

  38. Andrew AH, Borriello G, Fogarty J (2013) Simplifying mobile phone food diaries. PervasiveHealth. Venice, Italy, pp 260–263

  39. Kong F, Tan J (2012) DietCam: automatic dietary assessment with mobile camera phones. Pervasive Mobile Comput 8:147–163

    Article  Google Scholar 

  40. Noronha J, Hysen E, Zhang H, Gajos KZ (2011) Platemate: crowdsourcing nutritional analysis from food photographs. Proceedings of the 24th annual ACM symposium on User interface software and technology. ACM, Santa Barbara, pp 1–12

  41. Pässler S, Wolff M, Fischer W-J (2011) Food intake recognition conception for wearable devices. Proceedings of the first ACM MobiHoc workshop on pervasive wireless healthcare. ACM, Paris, pp 1–4

  42. Mansour A, Barve M, Bhat S, Do EY-L (2009) MunchCrunch. Proceedings of the 8th international conference on interaction design and children—IDC ‘09. ACM Press, New York, p 166

  43. Grimes A, Landry BM, Grinter RE (2010) Characteristics of shared health reflections in a local community. Proceedings of the 2010 ACM conference on computer supported cooperative work—CSCW ‘10. ACM Press, New York, NY, p 435

  44. Ganglbauer E, Fitzpatrick G, Molzer G (2012) Creating visibility: understanding the design space for food waste. In Proceedings of the 11th international conference on mobile and ubiquitous multimedia. ACM, New York, pp 1–10

  45. Adams M, Winter R (2012) Shopper engagement study. POPAI the global association for marketing at retail

  46. Die Ernährungspyramide im Detail—7 Stufen zur Gesundheit. Bundesministerium für Gesundheit. http://bmg.gv.at/home/Schwerpunkte/Ernaehrung/Empfehlungen/

  47. Reitberger W, Spreicer W, Fitzpatrick G (2014) Nutriflect: reflecting collective shopping behavior and nutrition. Proceedings of the 2014 SIGCHI conference on human factors in computing systems, ACM, Vancouver, pp 3309–3318

  48. Comber R, Hoonhout J, Halteren AV, Moynihan P, Olivier P (2013) Food practices as situated action: exploring and designing for everyday food practices with households. Proceedings of the SIGCHI conference on human factors in computing systems. ACM, Paris, pp 2457–2466

Download references

Author information

Authors and Affiliations

  1. Institute for Design and Assessment of Technology, Vienna University of Technology, Argentinierstraße 8, 1040, Vienna, Austria

    Wolfgang Reitberger, Wolfgang Spreicer & Geraldine Fitzpatrick

Authors
  1. Wolfgang Reitberger
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Wolfgang Spreicer
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Geraldine Fitzpatrick
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Wolfgang Reitberger.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Reitberger, W., Spreicer, W. & Fitzpatrick, G. Situated and mobile displays for reflection on shopping and nutritional choices. Pers Ubiquit Comput 18, 1721–1735 (2014). https://doi.org/10.1007/s00779-014-0781-4

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00779-014-0781-4

Keywords

Search

Navigation