ABSTRACT
We describe the design of SelfReflector an internet-connected mirror that uses online facial recognition to estimate your age and play music from when it thinks you were 14 years old. The mirror was created for a specific shop (SPeX PisTOls optical boutique), within a research through design project centered on the high street as a space of vital social, economic and environmental exchange that offers a myriad of psychosocial support for people beyond a place to purchase goods. We present in detail how the design emerged as our research interests developed related to IoT and how people use the high street to experiment with, and support sense of self. We discuss SelfReflector in relation to challenges for IoT, facial recognition and surveillance technologies, mirrorness and the values of a craft approach to designing technology centering on the nature of the bespoke and 'one-off'.
- Algorithmic Justice League. Retrieved September 17th 2017 from https://www.ajlunited.org/Google Scholar
- Apple i-phone X detail of facial recognition. Retrieved September 17th 2017 from https://www.apple.com/uk/iphone-x/Google Scholar
- Arnold, M.J. and Reynolds, K.E., 2003. Hedonic shopping motivations. Journal of retailing, 79(2), pp.77--95.Google ScholarCross Ref
- Babar, S., Mahalle, P., Stango, A., Prasad, N. and Prasad, R., 2010. Proposed security model and threat taxonomy for the Internet of Things (IoT). Recent Trends in Network Security and Applications, pp.420429.Google Scholar
- Boucher, A. and Gaver, W., 2017. Designing and Making the Datacatchers: Batch Producing LocationAware Mobile Devices.Google Scholar
- Crabtree, A., Lodge, T., Colley, J., Greenghalgh, C. and Mortier, R., 2017, June. Accountable internet of things? Outline of the IoT databox model. In A World of Wireless, Mobile and Multimedia Networks (WoWMoM), 2017 IEEE 18th International Symposium on (pp. 1--6). IEEE.Google Scholar
- Dalsgaard, P. and Halskov, K., 2012, June. Reflective design documentation. In Proceedings of the Designing Interactive Systems Conference (pp. 428--437). ACM. Google ScholarDigital Library
- Daniele, A., 2016, May. This Is Not Private. In Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems(pp. 3831--3834). ACM. Google ScholarDigital Library
- De Luca, A., Hang, A., Von Zezschwitz, E. and Hussmann, H., 2015, April. I Feel Like I'm Taking Selfies All Day!: Towards Understanding Biometric Authentication on Smartphones. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (pp. 1411--1414). ACM. Google ScholarDigital Library
- De Lucchi "Appliances". Retrieved September 17th 2017 from http://mondoblogo.blogspot.co.uk/2012/08/mo-memphis-blues.htmlGoogle Scholar
- Durrant, A.C., Vines, J., Wallace, J. and Yee, J.S., 2017. Research Through Design: Twenty-First Century Makers and Materialities.Google Scholar
- DXC press release. Retrieved September 17th from https://www.dxc.technology/uk/press_releases/133753new_csc_research_reveals_where_shoppers_and_retail ers_stand_on_next_generation_in_store_technology?m erger=trueGoogle Scholar
- Face++ cognitive services. Retrieved September 17th 2017 from https://www.faceplusplus.com/Google Scholar
- Fairfield, J.A., 2017. Owned: Property, Privacy, and the New Digital Serfdom. Cambridge University Press.Google ScholarCross Ref
- Fairfield, J. A., Retrieved September 17th 2017 from https://theconversation.com/the-internet-of-things-issending-us-back-to-the-middle-ages-81435Google Scholar
- Feng, R. and Prabhakaran, B., 2016, June. On the Face of Things. In Proceedings of the 2016 ACM on International Conference on Multimedia Retrieval (pp. 3--4). ACM. Google ScholarDigital Library
- Fiala, M., 2007, March. Magic mirror system with hand-held and wearable augmentations. In Virtual Reality Conference, 2007. VR'07. IEEE (pp. 251--254). IEEE.Google ScholarCross Ref
- Fortuny lamps. Retrieved September 17th 2017 from http://www.fortunyshop.com/fortuny-studio-76-tripodfloor-lamp-black-gold-leaf/Google Scholar
- Frohlich, D.M., Smith, K., Blum-Ross, A., Egglestone, P., Mills, J., Smith, S., Rogers, J., Shorter, M., Marshall, J., Olivier, P. and Woods, J., 2011. Crossing the digital divide in the other direction: communitycentred design on the Bespoke project. Proc. Include 2011.Google Scholar
- Gaver, W., 2012, May. What should we expect from research through design?. In Proceedings of the SIGCHI conference on human factors in computing systems (pp. 937--946). ACM. Google ScholarDigital Library
- Geneiatakis, D., Kounelis, I., Neisse, R., Nai-Fovino, I., Steri, G. and Baldini, G., 2017, May. Security and privacy issues for an IoT based smart home. In Information and Communication Technology, Electronics and Microelectronics (MIPRO), 2017 40th International Convention on (pp. 1292--1297). IEEE.Google Scholar
- Grimsey Review. Retrieved September 17th 2017 from http://www.vanishinghighstreet.com/wpcontent/upload s/2013/09/GrimseyReview04.092.pdfGoogle Scholar
- Frey, C. Retrieved September 17th 2017 from https://www.theguardian.com/cities/2016/mar/03/revea led-facial-recognition-software-infiltrating-cities-sakstorontoGoogle Scholar
- Hajdu, D., Forever young? In some ways, yes. New York Times. Retrieved September 17th 2017 from http://www.nytimes.com/2011/05/24/opinion/24hajdu. html?mcubz=0Google Scholar
- Hern, A. Retrieved September 17th 2017 from https://www.theguardian.com/technology/2016/apr/05/ revolv-devices-bricked-google-nest-smart-homeGoogle Scholar
- Kefalidou, G., Hoang, V., Padiyil, M.H. and Bedwell, B., 2015, August. Retroflection: Self-Reflection for Knowledge and Culture Sustainability. In Proceedings of the 17th International Conference on HumanComputer Interaction with Mobile Devices and Services Adjunct (pp. 1046--1049). ACM. Google ScholarDigital Library
- Koskinen, I., Binder, T. and Redström, J., 2008. Lab, field, gallery, and beyond. Artifact, 2(1), pp.46--57.Google ScholarCross Ref
- Lobo, N., 2016, January. Intelli-mirror: An augmented reality based IoT system for clothing and accessory display. In Internet of Things and Applications (IOTA), International Conference on (pp. 95--100). IEEE.Google Scholar
- Memphis design. Retrieved September 17th 2017 from https://designmuseum.org/memphisGoogle Scholar
- Merriam-Webster https://www.merriamwebster.com/dictionary/brick Retrieved September 17th 2017.Google Scholar
- Miller, D. 1998. A Theory of Shopping. Cambridge and Oxford: Polity Press.Google Scholar
- Mirrorforyou product. Retrieved September 17th from http://www.mirrorforyou.co.uk/p221,mirrorsmart-i-mirror-2.html?gclid=EAIaIQobChMI_4D7_qm1gIVRrXtCh23cQDUEAQYASABEgIJS_D_B wEGoogle Scholar
- Moon, Y.B., Oh, S.W., ng Kang, H.J., Lee, H.S., Kim, S.J. and Ban, H.C., 2015, September. Smart mirror health management services based on iot platform. In Proceedings of the 14th International Conference on Applications of Computer Engineering (ACE'15) (pp. 87--89).Google Scholar
- Moreno, M.A., Goniu, N., Moreno, P.S. and Diekema, D., 2013. Ethics of social media research: common concerns and practical considerations. Cyberpsychology, Behavior, and Social Networking, 16(9), pp.708--713.Google ScholarCross Ref
- Mysmartmirror product. Retrieved September 17th 2017 from http://mysmartmirror.co.uk/smart_mirror_store/ug/blac k-frame-smart-mirror%2CGoogle Scholar
- Nelson, H.G. and Stolterman, E., 2003. The design way: Intentional change in an unpredictable world: Foundations and fundamentals of design competence. Educational Technology. Google ScholarDigital Library
- O'Neil, C., 2017. Weapons of math destruction: How big data increases inequality and threatens democracy. Broadway Books. Google Scholar
- Pierce, J., 2014, June. On the presentation and production of design research artifacts in HCI. In Proceedings of the 2014 conference on Designing interactive systems (pp. 735--744). ACM. Google ScholarDigital Library
- Portas, M. 2011. Portas Review. Retrieved September 17th 2017 from https://www.gov.uk/government/uploads/system/uploa ds/attachment_data/file/6292/2081646.pdfGoogle Scholar
- Privacy International Charity. Retrieved September 17th 2017 from https://www.privacyinternational.org/node/1423Google Scholar
- Rogers, J., Thomas, P., Thorne, M. Eds., Ding: A magazine about the Internet and things. Issue 1. Mozilla Foundation. 2017Google Scholar
- Schmidt, A., 2016. Cloud-based ai for pervasive applications. IEEE Pervasive Computing, 15(1), pp.1418. Google ScholarDigital Library
- Shiffman, D 2014 Rekognition-for-Processing https://github.com/shiffman/Rekognition-forProcessing, Retrieved September 17th 2017.Google Scholar
- Skirpan, M. and Yeh, T., 2017, July. Designing a Moral Compass for the Future of Computer Vision using Speculative Analysis. In Computer Vision and Pattern Recognition Workshops (CVPRW), 2017 IEEE Conference on(pp. 1368--1377). IEEE.Google Scholar
- Tauber, E.M., 1972. Why do people shop? The Journal of Marketing, pp 46 -- 49.Google Scholar
- Lafrance, A. Retrieved September 17th 2017 from https://www.theatlantic.com/technology/archive/2017/ 03/who-owns-your-face/520731/Google Scholar
- Thubron, R. Retrieved September 17th 2017 from https://www.techspot.com/news/64358-amazonquietly-acquired-ai-image-analysis-startup-orbeus.htmlGoogle Scholar
- Wallace, J., Wright, P., McCarthy, J., Green, D., Thomas, J. and Olivier, P., 2013. A design-led inquiry into personhood in dementia. In Conference on Human Factors in Computing Systems-Proceedings (pp. 26172626). ACM. Google ScholarDigital Library
- Wallace, J., Dearden, A. and Fisher, T., 2007. The significant other: the value of jewellery in the conception, design and experience of body focused digital devices. Ai & Society, 22(1), pp.53--62. Google ScholarDigital Library
- Zimmerman, J., Stolterman, E. and Forlizzi, J., 2010, August. An analysis and critique of Research through Design: towards a formalization of a research approach. In Proceedings of the 8th ACM Conference on Designing Interactive Systems (pp. 310--319). ACM. Google ScholarDigital Library
Index Terms
- The SelfReflector: Design, IoT and the High Street
Recommendations
Translating experience
This paper describes research investigating the significance of physical experience and materiality in creative digital visual art and design practice. Findings are presented from a recent phenomenological study, which indicates the ways in which memory ...
Reflections on craft research for and through design
NordiCHI '14: Proceedings of the 8th Nordic Conference on Human-Computer Interaction: Fun, Fast, FoundationalAs design practice has become more integrated in HCI research, there are on-going discussions around the role of design in research. Design research may take different forms, among which 'Research for Design' and 'Research through Design'. While, by ...
User curated augmented reality art exhibitions
NordiCHI '14: Proceedings of the 8th Nordic Conference on Human-Computer Interaction: Fun, Fast, FoundationalCreating mobile augmented reality applications to display gallery artworks or museum content is a well-established concept within the research community. However, the focus of these systems is generally technologically driven and primarily addresses the ...
Comments