Lien-Wu Chen
ABSTRACT
In this paper, we design and implement a deep advertising signage system, called DeepAd, with context-aware advertisement and cyber-physical interaction based on Internet of Things (IoT) technologies. In the DeepAd system, instant sensing and diverse interacting features are integrated with an IoT signage, which can (1) transmit multimedia contents and receive specific messages to/from smartphone users, (2) sense and interact with nearby individuals through image sensors, (3) embed context-aware advertisement information in sound waves, and (4) customize the on-screen 3D doll with an audience's face on demand. Through built-in sensors and smartphone interfaces, DeepAd can interact with nearby audiences via real-time multimedia services on the IoT signage in a click-and-drag manner. In addition, DeepAd investigates data-over-sound techniques to send embedded status-related advertisement via background music/voice. Furthermore, DeepAd explores deep learning based face changing and recognition to provide innovative and customized services to smartphone users. This paper demonstrates our current prototype consisting of the Android App, advertising server, and IoT signage.
- L.-W. Chen, Y.-F. Ho, M.-F. Tsai, H.-M. Chen, and C.-F. Huang. Cyber-Physical Signage Interacting with Gesture-Based Human-Machine Interfaces through Mobile Cloud Computing. IEEE Access, 4(8):3951--3960, Aug. 2016.Google Scholar
Cross Ref
- L.-W. Chen, C.-R. Chen, and Y.-E. Li. Cyber-Physical Ad: An Audience-Aware Signage Sensing and Interacting System Based on Internet of Things Technologies. ACM/IEEE International Conference on Information Processing in Sensor Networks (IPSN), Apr. 2017.Google Scholar
- J. She, J. Crowcroft, H. Fu, and P.-H. Ho. Smart Signage: A Draggable Cyber-Physical Broadcast/Multicast Media System. IEEE Transactions on Emerging Topics in Computing, 1(2):232--243, Dec. 2013.Google ScholarCross Ref
- G. Kim, S. Lee, J. Park, S. Jung, S. Kim, and Y.-C. Shin. Thumbnail Selection: Delivering Digital Signage Contents to Mobile Phone. In International Conference on Advanced Communication Technology (ICACT), pages 396--400, Jan. 2013.Google Scholar
- J. Lee and K. Yoon. The Application of Digital Signage System Using Smart Device. In International Conference on Advanced Communication Technology (ICACT), pages 675--677, Feb. 2014.Google Scholar
- G. E. Santagati and T. Melodia. A Software-Defined Ultrasonic Networking Framework for Wearable Devices. IEEE/ACM Transactions on Networking, 25(2):960--973, Apr. 2017.Google ScholarDigital Library
- Python: General-Purpose Interpreted, Interactive, Object-Oriented, and High-Level Programming Language. https://www.python.org/.Google Scholar
- Dlib: Machine Learning Algorithms and Tools. http://dlib.net/.Google Scholar
- Open Computer Vision Library (OpenCV). https://opencv.org/.Google Scholar
Index Terms
- DeepAd: a deep advertising signage system with context-aware advertisement based on IoT technologies
Recommendations
Designing the Interaction with the Internet of Tangible Things: A Card Set
TEI '18: Proceedings of the Twelfth International Conference on Tangible, Embedded, and Embodied InteractionCurrent interactions for the Internet of Things are often constrained behind a screen. With the Internet of Tangible Things (IoTT) we aim at promoting the design of richer interactions, embodied in physical IoT objects. To this purpose, we propose a ...
Internet of Tangible Things: Workshop on Tangible Interaction with the Internet of Things
CHI EA '18: Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing SystemsThe rise of the Internet of Things (IoT) brings abundant new opportunities to create more effective and pleasing tangible user interfaces that capitalize on intuitive interaction in the physical world, whilst utilizing capabilities of sensed data and ...
Internet of Tangibles: Exploring the Interaction-Attention Continuum
TEI '18: Proceedings of the Twelfth International Conference on Tangible, Embedded, and Embodied InteractionThere is an increasing interest in the HCI research community to design richer user interactions with the Internet of Things (IoT). This studio will allow exploring the design of tangible interaction with the IoT, what we call Internet of Tangibles. In ...
Comments