skip to main content
10.1145/3374920.3374973acmconferencesArticle/Chapter ViewAbstractPublication PagesteiConference Proceedingsconference-collections
Work in Progress

BulkScreen: Saliency-Based Automatic Shape Representation of Digital Images with a Vertical Pin-Array Screen

Published: 09 February 2020 Publication History

Abstract

Digital images appearing on displays in everyday activities (e.g., photos on a smartphone) are automatically and instantly rendered without manual intervention such that we can seamlessly appreciate them. In contrast, shape displays require manual designs of outputs upon actuation of input images to render 3D shapes. In this work, we aim to achieve automatic and on-the-spot actuation of digital images so that we can seamlessly see 3D physical images. To this end, we developed BulkScreen, an image projection system that can automatically render 3D shapes of input images on a vertical pin-array screen. Our approach is based on a deep-neural-network saliency estimation coupled with our post-processing algorithm. We believe this spontaneous actuation mechanism facilitates applications with shape displays such as real-time picture browsing and display advertisement, building on the benefit of representing physical shapes; tangibility.

Supplementary Material

MP4 File (teiwp1035.mp4)
Supplemental video

References

[1]
Radhakrishna Achanta, Francisco Estrada, Patricia Wils, and Sabine Süsstrunk. 2008. Salient region detection and segmentation. In International conference on computer vision systems. Springer, 66--75.
[2]
LOOKING GLASS FACTORY. 2018. The Looking Glass. Retrieved July 6, 2019 from https://lookingglassfactory.com/
[3]
Sean Follmer, Daniel Leithinger, Alex Olwal, Akimitsu Hogge, and Hiroshi Ishii. 2013. inFORM. In Proceedings of the 26th annual ACM symposium on User interface software and technology - UIST '13. ACM Press. https://doi.org/10.1145/2501988. 2502032
[4]
Clement Godard, Oisin Mac Aodha, and Gabriel J. Brostow. 2017. Unsupervised Monocular Depth Estimation with Left-Right Consistency. In 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). IEEE. https: //doi.org/10.1109/cvpr.2017.699
[5]
Qibin Hou, Ming-Ming Cheng, Xiaowei Hu, Ali Borji, Zhuowen Tu, and Philip H. S. Torr. 2019. Deeply Supervised Salient Object Detection with Short Connections. IEEE Transactions on Pattern Analysis and Machine Intelligence 41, 4 (April 2019), 815--828. https://doi.org/10.1109/tpami.2018.2815688
[6]
H+Technology. 2015. Holus. Retrieved July 6, 2019 from https://hplustech.com/
[7]
Hiroo Iwata, Hiroaki Yano, Fumitaka Nakaizumi, and Ryo Kawamura. 2001. Project FEELEX. In Proceedings of the 28th annual conference on Computer graphics and interactive techniques - SIGGRAPH '01. ACM Press. https://doi.org/10.1145/ 383259.383314
[8]
Abigail Sellen. 1995. Remote Conversations: The Effects of Mediating Talk With Technology. Human-Computer Interaction 10, 4 (Dec. 1995), 401--444. https://doi.org/10.1207/s15327051hci1004_2
[9]
Shuran Song and Jianxiong Xiao. 2016. Deep Sliding Shapes for Amodal 3D Object Detection in RGB-D Images. In 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). IEEE. https://doi.org/10.1109/cvpr.2016.94
[10]
Ryo Suzuki, Junichi Yamaoka, Daniel Leithinger, Tom Yeh, Mark D. Gross, Yoshihiro Kawahara, and Yasuaki Kakehi. 2018. Dynablock. In The 31st Annual ACM Symposium on User Interface Software and Technology - UIST '18. ACM Press. https://doi.org/10.1145/3242587.3242659
[11]
Junichi Yamaoka and Yasuaki Kakehi. 2017. ProtoMold. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems - CHI '17. ACM Press. https://doi.org/10.1145/3025453.3025498

Cited By

View all
  • (2024)ProgrammableGrass: A Shape-Changing Artificial Grass Display Adapted for Dynamic and Interactive Display FeaturesIEEE Access10.1109/ACCESS.2024.338091112(45654-45673)Online publication date: 2024

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
TEI '20: Proceedings of the Fourteenth International Conference on Tangible, Embedded, and Embodied Interaction
February 2020
978 pages
ISBN:9781450361071
DOI:10.1145/3374920
  • General Chairs:
  • Elise van den Hoven,
  • Lian Loke,
  • Program Chairs:
  • Orit Shaer,
  • Jelle van Dijk,
  • Andrew Kun
Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 09 February 2020

Check for updates

Author Tags

  1. image projection
  2. saliency detection
  3. shape display

Qualifiers

  • Work in progress

Conference

TEI '20
Sponsor:

Acceptance Rates

TEI '20 Paper Acceptance Rate 37 of 132 submissions, 28%;
Overall Acceptance Rate 393 of 1,367 submissions, 29%

Upcoming Conference

TEI '25

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)8
  • Downloads (Last 6 weeks)2
Reflects downloads up to 13 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2024)ProgrammableGrass: A Shape-Changing Artificial Grass Display Adapted for Dynamic and Interactive Display FeaturesIEEE Access10.1109/ACCESS.2024.338091112(45654-45673)Online publication date: 2024

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media