skip to main content
10.1145/3410670.3410859acmconferencesArticle/Chapter ViewAbstractPublication PagesmobicomConference Proceedingsconference-collections
research-article

Design and Implementation of a Privacy-Aware Smart Mirror System

Published:21 September 2020Publication History

ABSTRACT

The vision of the Internet-of-Things is rapidly changing the way we interact with everyday life objects, which can become not only data producers but also means for displaying information. This paper describes the design and implementation of such an object, a Smart Mirror that can be used to display personalised information to users in its proximity. An Android-based application is used to let users register to the Smart Mirror service, personalise the content they want to display and select whether such contents are public or private. To protect user's privacy and avoiding to disclose sensitive information to potential shoulder-surfers, the system is enriched with a BLE-based presence detection module following a device-free approach (i.e., without making use of any information from devices carried by users), which hides automatically private contents upon the detection of multiple people. The whole system is described in details and its performance are evaluated in realistic environments. In order to allow for reproducible research, the dataset used in this paper is made publicly available.

References

  1. Anderson Araújo, Rubem Kalebe, Gustavo Giraõ, Kayo Gonçalves, Bianor Neto, et al. 2017. Reliability analysis of an IoT-based smart parking application for smart cities. In 2017 IEEE International Conference on Big Data (Big Data). IEEE, 4086--4091.Google ScholarGoogle ScholarCross RefCross Ref
  2. Daniel Besserer, Johannes Bäurle, Alexander Nikic, Frank Honold, Felix Schüssel, and Michael Weber. 2016. Fitmirror: a smart mirror for positive affect in everyday user morning routines. In Proceedings of the Workshop on Multimodal Analyses enabling Artificial Agents in Human-Machine Interaction. ACM, 48--55. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Frederik Brudy, David Ledo, Saul Greenberg, and Andreas Butz. 2014. Is anyone looking? Mitigating shoulder surfing on public displays through awareness and protection. In Proceedings of The International Symposium on Pervasive Displays. ACM, 1. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Claude Castelluccia, Mathieu Cunche, Daniel Le Métayer, and Victor Morel. 2018. Enhancing transparency and consent in the IoT. In 2018 IEEE European Symposium on Security and Privacy Workshops (EuroS&PW). IEEE, 116--119.Google ScholarGoogle ScholarCross RefCross Ref
  5. Biljana Cvetkoska, Ninoslav Marina, Dijana Capeska Bogatinoska, and Zhanko Mitreski. 2017. Smart mirror E-health assistantâĂŤPosture analyze algorithm proposed model for upright posture. In IEEE EUROCON 2017-17th International Conference on Smart Technologies. IEEE, 507--512.Google ScholarGoogle ScholarCross RefCross Ref
  6. Nigel Davies, Marc Langheinrich, Sarah Clinch, Ivan Elhart, Adrian Friday, Thomas Kubitza, and Bholanathsingh Surajbali. 2014. Personalisation and privacy in future pervasive display networks. In Proceedings of the 32nd annual ACM conference on Human factors in computing systems. ACM, 2357--2366. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Saandeep Depatla, Arjun Muralidharan, and Yasamin Mostofi. 2015. Occupancy estimation using only WiFi power measurements. IEEE Journal on Selected Areas in Communications 33, 7 (2015), 1381--1393.Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Ivette Cristina Araujo García, Eduardo Rodrigo Linares Salmón, Rosario Villalta Riega, and Alfredo Barrientos Padilla. 2017. Implementation and customization of a smart mirror through a facial recognition authentication and a personalized news recommendation algorithm. In 2017 13th International Conference on Signal-Image Technology & Internet-Based Systems (SITIS). IEEE, 35--39.Google ScholarGoogle Scholar
  9. Franca Garzotto and Mirko Gelsomini. 2018. Magic Room: A Smart Space for Children with Neurodevelopmental Disorder. IEEE Pervasive Computing 17, 1 (2018), 38--48. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. Derrick Gold, David Sollinger, et al. 2016. SmartReflect: A modular smart mirror application platform. In 2016 IEEE 7th Annual Information Technology, Electronics and Mobile Communication Conference (IEMCON). IEEE, 1--7.Google ScholarGoogle Scholar
  11. Oihane Gomez-Carmona and Diego Casado-Mansilla. 2017. SmiWork: An interactive smart mirror platform for workplace health promotion. In 2017 2nd International Multidisciplinary Conference on Computer and Energy Science (SpliTech). IEEE, 1--6.Google ScholarGoogle Scholar
  12. Yejun Liu, Jia Jia, Jingtian Fu, Yihui Ma, Jie Huang, and Zijian Tong. 2016. Magic mirror: A virtual fashion consultant. In Proceedings of the 24th ACM international conference on Multimedia. ACM, 680--683. Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. Zhaojun Liu, Wing Cheung Chong, Ka Ming Wong, and Kei May Lau. 2015. GaN-based LED micro-displays for wearable applications. Microelectronic Engineering 148 (2015), 98--103. Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. Nicolai Marquardt, Robert Diaz-Marino, Sebastian Boring, and Saul Greenberg. 2011. The proximity toolkit: prototyping proxemic interactions in ubiquitous computing ecologies. In Proceedings of the 24th annual ACM symposium on User interface software and technology. ACM, 315--326. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Young Bag Moon, Se Won Oh, Hyun Joong Kang, Ho Sung Lee, Sun Jin Kim, and Hyo Chan Bang. 2015. Smart mirror health management services based on IoT platform. In Proceedings of the 14th International Conference on Applications of Computer Engineering (ACE âĂŸ15). 87--89.Google ScholarGoogle Scholar
  16. Koushiki Mukhopadhyay, Chandrava Sinha, Himadri Nath Saha, Sukanya Rakshit, and Supratim Auddy. 2018. Smart Mirror-a Secured Application of Artificial Intelligence Recognizing Human Face and Voice. In 2018 IEEE 9th Annual Information Technology, Electronics and Mobile Communication Conference (IEMCON). IEEE, 1279--1289.Google ScholarGoogle Scholar
  17. Adokiye Charles Njaka, Na Li, and Lin Li. 2018. Voice Controlled Smart Mirror with Multifactor Authentication. In 2018 IEEE International Smart Cities Conference (ISC2). IEEE, 1--8.Google ScholarGoogle Scholar
  18. Maya Samaha and Nazir S Hawi. 2016. Relationships among smartphone addiction, stress, academic performance, and satisfaction with life. Computers in Human Behavior 57 (2016), 321--325. Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. Garth Shoemaker. 2000. Supporting private information on public displays. In CHI'00 Extended Abstracts on Human Factors in Computing Systems. ACM, 349--350. Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. Garth BD Shoemaker and Kori M Inkpen. 2001. Single display privacyware: augmenting public displays with private information. In Proceedings of the SIGCHI conference on Human factors in computing systems. ACM, 522--529. Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. Han Zou, Yuxun Zhou, Jianfei Yang, Weixi Gu, Lihua Xie, and Costas Spanos. 2017. Freecount: Device-free crowd counting with commodity WiFi. In GLOBECOM 2017-2017 IEEE Global Communications Conference. IEEE, 1--6.Google ScholarGoogle ScholarCross RefCross Ref
  22. Han Zou, Yuxun Zhou, Jianfei Yang, Weixi Gu, Lihua Xie, and Costas Spanos. 2017. Freedetector: Device-free occupancy detection with commodity WiFi. In 2017 IEEE International Conference on Sensing, Communication and Networking (SECON Workshops). IEEE, 1--5.Google ScholarGoogle ScholarCross RefCross Ref

Recommendations

Comments

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Sign in
  • Published in

    cover image ACM Conferences
    FRUGALTHINGS'20: Proceedings of the 1st Workshop on Experiences with the Design and Implementation of Frugal Smart Objects
    September 2020
    47 pages
    ISBN:9781450380782
    DOI:10.1145/3410670

    Copyright © 2020 ACM

    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    • Published: 21 September 2020

    Permissions

    Request permissions about this article.

    Request Permissions

    Check for updates

    Qualifiers

    • research-article
    • Research
    • Refereed limited

    Acceptance Rates

    FRUGALTHINGS'20 Paper Acceptance Rate7of17submissions,41%Overall Acceptance Rate7of17submissions,41%
  • Article Metrics

    • Downloads (Last 12 months)31
    • Downloads (Last 6 weeks)3

    Other Metrics

PDF Format

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader