Skip to main content

FrameTalk: Human and Picture Frame Interaction Through the IoT Technology

  • Conference paper
  • First Online:
IoT as a Service (IoTaaS 2018)

Abstract

The concept of frame plays a significant role in art design. However, traditional picture frames do not allow interaction with human. To provide another dimension of artwork demonstration of picture frames, we utilize the Internet of Things (IoT) technology to create human and picture frame interaction. Specifically, an application-layer IoT device management platform called IoTtalk is used to quickly establish connections and meaningful interactions between IoT devices. The frame and human interaction is achieved by implementing an output device of IoTtalk called FrameTalk, which provides animation in a digital frame to be controlled by the input devices (typically a smartphone). The FrameTalk device can be displayed in specific frame hardware or the screen of any computing device. We describe the functional block diagram of the FrameTalk device and its default applications. Then we show two FrameTalk application examples. The first example is CalligraphyTalk that allows the audience to interact with the frame to write the poems. The second example is PortraitGuess that allows the audience to guess historical figures through the frame.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Nixplay. https://www.nixplay.com. Accessed 7 May 2018

  2. Meural. https://meural.com. Accessed 7 May 2018

  3. Yiiisu. http://yiiisu.com. Accessed 7 May 2018

  4. FRAMED. https://frm.fm. Accessed 7 May 2018

  5. Lin, Y.B., et al.: EasyConnect: a management system for IoT devices and its applications for interactive design and art. IEEE IoT J. 2(6), 551–561 (2015)

    Google Scholar 

  6. Lin, Y.B., Lin, Y.W., Huang, C.M., Chih, C.Y., Lin, P.: IoTtalk: a management platform for reconfigurable sensor devices. IEEE IoT J. 4(5), 1552–1562 (2017)

    Google Scholar 

  7. Lin, Y.W., Lin, Y.B., Hsiao, C.Y., Wang, Y.Y.: IoTtalk-RC: sensors as universal remote control for aftermarket home appliances. IEEE IoT J. 4(4), 1104–1112 (2017)

    Google Scholar 

  8. Processing. http://www.processing.org. Accessed 7 May 2018

  9. Hsiao, C.Y., Chen, L.K., Lin, Y.B.: Interacting with paintings using IoTtalk. In: IoT 2017, Proceedings of the Seventh International Conference on the Internet of Things. ACM, New York (2017). https://doi.org/10.1145/3131542.3140269

  10. Hsiao, C.Y., Huang, C.C., Lin, Y.B., Lin, Y.W.: Flower sermon: an interactive visual design using IoTtalk. Mobile Netw. Appl. J. (2018). https://doi.org/10.1007/s11036-018-1086-z

  11. Asia Digital Art Award FUKUOKA. https://adaa.jp/en/winners/winners2017.html. Accessed 7 May 2018

  12. PortraitGuess demo video. https://www.youtube.com/watch?v=j7V7Xa0hf30&feature=youtu.be. Accessed 9 Oct 2018

  13. CalligraphyTalk demo video. https://www.youtube.com/watch?time_continue=2&v=1KGgCiFVwPK. Accessed 9 Oct 2018

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Chung-Yun Hsiao .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2019 ICST Institute for Computer Sciences, Social Informatics and Telecommunications Engineering

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Lai, WS., Lin, YB., Hsiao, CY., Chen, LK., Wu, CF., Lin, SM. (2019). FrameTalk: Human and Picture Frame Interaction Through the IoT Technology. In: Li, B., Yang, M., Yuan, H., Yan, Z. (eds) IoT as a Service. IoTaaS 2018. Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering, vol 271. Springer, Cham. https://doi.org/10.1007/978-3-030-14657-3_1

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-14657-3_1

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-14656-6

  • Online ISBN: 978-3-030-14657-3

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics