Abstract
The concept of frame plays a significant role in art design. However, traditional picture frames do not offer human interaction. To create a new dimension of graphic artwork demonstration, we utilize the Internet of Things (IoT) technology to develop human and digital frame interaction. Specifically, this paper uses IoTtalk, an application-layer IoT device management platform, to quickly establish connections and meaningful interactions between IoT devices. The interaction between human and frame is accomplished by implementing an output device of IoTtalk called FrameTalk, which allows the input devices to control the dynamic graphics on a digital frame. The FrameTalk device can be exhibited in specific frame hardware or the screen of any computing device. We illustrate the functional block diagram of the FrameTalk device and its default applications. Then we demonstrate two FrameTalk application examples. The first example is CalligraphyTalk, where an audience can interact with the frame to write Chinese poems. The second example is PortraitGuess that allows an audience to play the historical figures portrait painting guess game by the frame. We measure the delays between the smartphone and the FrameTalk device, and develop both analytic and simulation models to investigate the user experience of the FrameTalk applications. Our study indicates that good user experience can be achieved in FrameTalk.
Similar content being viewed by others
References
Nixplay (2018) https://www.nixplay.com. Accessed 7 May 2018
Meural (2018) https://meural.com. Accessed 7 May 2018
Yiiisu (2018) http://yiiisu.com. Accessed 7 May 2018
FRAMED (2018) https://frm.fm. Accessed 7 May 2018
Lin YB, Lin YW, Chih CY, Li TY, Tai CC, Wang YC, Lin FJ, Kuo HC, Huang CC, Hsu SC (2015) EasyConnect: A Management System for IoT Devices and Its Applications for Interactive Design and Art. IEEE Internet Things J 2(6):551–561
Lin YB, Lin YW, Huang CM, Chih CY, Lin P (2017) IoTtalk: A Management Platform for Reconfigurable Sensor Devices. IEEE Internet Things J 4(5):1552–1562
Lin YW, Lin YB, Hsiao CY, Wang YY (2017) IoTtalk-RC: Sensors as Universal Remote Control for Aftermarket Home Appliances. IEEE Internet Things J 4(4):1104–1112
Processing (2018) https://processing.org. Accessed 7 May 2018
Hsiao CY, Chen LK, Lin YB (2017) Interacting with Paintings using IoTtalk. In: IoT’17 Proceedings of the Seventh International Conference on the Internet of Things. doi: https://doi.org/10.1145/3131542.3140269
Hsiao CY, Huang CC, Lin YB, Lin YW (2018) Flower Sermon: An Interactive Visual Design using IoTtalk. Mobile Networks and Applications Journal. https://doi.org/10.1007/s11036-018-1086-z
Human Benchmark (2018) https://www.humanbenchmark.com/tests/reactiontime/statistics. Accessed 7 May 2018
Asia Digital Art Award FUKUOKA (2018) https://adaa.jp/en/winners/winners2017. Accessed 7 May 2018
PortraitGuess demo video (2018) https://www.youtube.com/watch?v=j7V7Xa0hf30&feature=youtu.be. Accessed 9 Oct 2018
CalligraphyTalk demo video (2018) https://www.youtube.com/watch?time_continue=2&v=1KGgCiFVwPK. Accessed 9 Oct 2018
Lai WS, Lin YB, Hsiao CY, Chen LK, Wu CF, Lin SM (2018) FrameTalk: Human and Picture Frame Interaction through the IoT Technology. In: 4th EAI International Conference on IoT as a Service, Xi’an
Acknowledgments
This work was supported in part by the Ministry of Science and Technology (MOST) under Grant 106-2221-E-009-049- MY2, Grant 107-2622-8-009-020 and Grant 106-2911-I-009- 508, in part by Academia Sinica AS-105-TP-A07, in part by the Center for Open Intelligent Connectivity from the Featured Areas Research Center Program within the framework of the Higher Education Sprout Project by the Ministry of Education (MOE) in Taiwan.
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Lai, WS., Lin, YB., Hsiao, CY. et al. FrameTalk: Human and Picture Frame Interaction through the IoT Technology. Mobile Netw Appl 24, 1475–1485 (2019). https://doi.org/10.1007/s11036-019-01269-9
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11036-019-01269-9