research-article

A New Projection-based Exhibition System for a Museum

Authors:

Kwan H. LeeAuthors Info & Claims

Journal on Computing and Cultural Heritage (JOCCH), Volume 12, Issue 2

Article No.: 10, Pages 1 - 17

https://doi.org/10.1145/3275522

Published: 07 May 2019 Publication History

Abstract

In this article, we propose a new projection-based system to exhibit a realistic virtual cultural object in a museum. We introduce a new design by combining the multi-projection mapping technology with an optical see-through display that overcomes the limitations of the conventional projection-based exhibition by resolving the problems of ambient light and the occlusion by obstacles. We also introduce a mechanically moving projection surface that increases the degree of freedom of the projection content. Both geometric and radiometric calibration methods are used to correctly project a high-quality texture onto the moving 3D projection surface without perspective distortion. To evaluate the strength of the system and a potential for deployment in a general museum context, we conduct a user study that includes both the visitors and museum staff. The result shows that the proposed system can enrich the museum exhibition by creating a virtual cultural object with substantial 3D effect and high-fidelity appearance. We also demonstrate various applications of the system that provide dynamic content of a virtual cultural object by changing its appearance as well as the viewpoint.

Supplementary Material

lee (lee.zip)

Supplemental movie, appendix, image and software files for, A New Projection-based Exhibition System for a Museum

Download
40.69 MB

References

[1]

Dror Aiger, Niloy J. Mitra, and Daniel Cohen-Or. 2008. 4points congruent sets for robust pairwise surface registration. ACM Trans. Graphics 27, 3, Article 85 (Aug. 2008), 10 pages.

Digital Library

[2]

Daniel G. Aliaga, Yu Hong Yeung, Alvin Law, Behzad Sajadi, and Aditi Majumder. 2012. Fast high-resolution appearance editing using superimposed projections. ACM Trans. Graphics 31, 2, Article 13 (April 2012), 13 pages.

Digital Library

[3]

David Baraff. 1997. An introduction to physically based modeling: Rigid body simulation i—Unconstrained rigid body dynamics. In An Introduction to Physically Based Modeling, (SIGGRAPH’97) Course Notes. 97.

[4]

Peter C. Barnum, Srinivasa G. Narasimhan, and Takeo Kanade. 2010. A multi-layered display with water drops. ACM Trans. Graphics 29, 4, Article 76 (July 2010), 7 pages.

Digital Library

[5]

Ditte Amund Basballe and Kim Halskov. 2010. Projections on museum exhibits: Engaging visitors in the museum setting. In Proceedings of the 22nd Conference of the Computer-Human Interaction Special Interest Group of Australia on Computer-Human Interaction (OZCHI’10). ACM, New York, NY, 80--87.

Digital Library

[6]

Mafkereseb Kassahun Bekele, Roberto Pierdicca, Emanuele Frontoni, Eva Savina Malinverni, and James Gain. 2018. A survey of augmented, virtual, and mixed reality for cultural heritage. J. Comput. Cult. Heritage 11, 2, Article 7 (March 2018), 36 pages.

Digital Library

[7]

Amit Bermano, Philipp Brüschweiler, Anselm Grundhöfer, Daisuke Iwai, Bernd Bickel, and Markus Gross. 2013. Augmenting physical avatars using projector-based illumination. ACM Trans. Graph. 32, 6, Article 189 (Nov. 2013), 10 pages.

Digital Library

[8]

Amit Haim Bermano, Markus Billeter, Daisuke Iwai, and Anselm Grundhöfer. 2017. Makeup lamps: Live augmentation of human faces via projection. Computer Graphics Forum (2017).

Digital Library

[9]

Mark Billinghurst, Adrian Clark, and Gun Lee. 2015. A survey of augmented reality. Found. Trends Hum.-Comput. Interact. 8, 2--3 (March 2015), 73--272.

Digital Library

[10]

O. Bimber, B. Frohlich, D. Schmalsteig, and L. M. Encarnacao. 2001. The virtual showcase. IEEE Comput. Graphics Appl. 21, 6 (Nov. 2001), 48--55.

Digital Library

[11]

Oliver Bimber, Daisuke Iwai, Gordon Wetzstein, and Anselm Grundhöfer. 2008. The visual computing of projector-camera systems. In ACM SIGGRAPH 2008 Classes (SIGGRAPH’08). ACM, New York, NY, Article 84, 25 pages.

Digital Library

[12]

Oliver Bimber and Ramesh Raskar. 2005. Spatial Augmented Reality: Merging Real and Virtual Worlds. A. K. Peters, Ltd., Natick, MA.

[13]

Marcello Carrozzino and Massimo Bergamasco. 2010. Beyond virtual museums: Experiencing immersive virtual reality in real museums. J. Cult. Heritage 11, 4 (2010), 452--458.

[14]

Junho Choi, Yong Yi Lee, Yong Hwi Kim, Bilal Ahmed, Jong Hun Lee, Moon Gu Son, Junbum Kim, and Kwan H. Lee. 2017. Curvature-aware adaptive capture of 3D geometry and appearance. In ACM SIGGRAPH 2017 Posters (SIGGRAPH’17). ACM, New York, NY, Article 40, 2 pages.

Digital Library

[15]

Peter Dalsgaard and Kim Halskov. 2010. Designing urban media FaçAdes: Cases and challenges. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI’10). ACM, New York, NY, 2277--2286.

Digital Library

[16]

Paul E. Debevec and Jitendra Malik. 1997. Recovering high dynamic range radiance maps from photographs. In Proceedings of the 24th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH’97). ACM Press/Addison-Wesley Publishing Co., New York, NY, 369--378.

Digital Library

[17]

Neil A. Dodgson. 2005. Autostereoscopic 3D displays. Computer 38, 8 (Aug. 2005), 31--36.

Digital Library

[18]

A. Dolce, J. Nasman, and B. Cutler. 2012. ARmy: A study of multi-user interaction in spatially augmented games. In 2012 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops. 43--50.

[19]

Ashish Doshi, Ross T. Smith, Bruce H. Thomas, and Con Bouras. 2017. Use of projector based augmented reality to improve manual spot-welding precision and accuracy for automotive manufacturing. Int. J. Adv. Manuf. Technol. 89, 5 (01 Mar 2017), 1279--1293.

[20]

M. D. Grossberg, H. Peri, S. K. Nayar, and P. N. Belhumeur. 2004. Making one object look like another: Controlling appearance using a projector-camera system. In Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, (CVPR’04), Vol. 1. I--452--I--459.

[21]

Andrew Jones, Ian McDowall, Hideshi Yamada, Mark Bolas, and Paul Debevec. 2007. Rendering for an interactive 360° light field display. ACM Trans. Graph. 26, 3, Article 40 (July 2007).

Digital Library

[22]

Andrew V. Jones, Koki Nagano, Jing Liu, Jay Busch, Xueming Yu, Mark T. Bolas, and Paul Debevec. 2014. Interpolating vertical parallax for an autostereoscopic three-dimensional projector array. J. Electron. Imaging 23, 1 (2014), 23--23--13.

[23]

Brett Jones, Rajinder Sodhi, Michael Murdock, Ravish Mehra, Hrvoje Benko, Andrew Wilson, Eyal Ofek, Blair MacIntyre, Nikunj Raghuvanshi, and Lior Shapira. 2014. RoomAlive: Magical experiences enabled by scalable, adaptive projector-camera units. In Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology (UIST’14). ACM, New York, NY, 637--644.

Digital Library

[24]

L. L. Lapin. 1983. Probability and Statistics for Modern Engineering. Brooks/Cole Engineering Division. Retrieved from https://books.google.co.kr/books?id=ZYhRAAAAMAAJ.

[25]

Jaewoon Lee, Yeonjin Kim, Myeong-Hyeon Heo, Dongho Kim, and Byeong-Seok Shin. 2015. Real-time projection-based augmented reality system for dynamic objects in the performing arts. Symmetry 7, 1 (2015), 182--192.

[26]

Y. Y. Lee, J. Choi, B. Ahmed, Y. H. Kim, J. H. Lee, M. G. Son, J. D. Yoo, and K. H. Lee. 2015. A SAR-based interactive digital exhibition of Korean cultural artifacts. In 2015 Digital Heritage, Vol. 2. 655--658.

[27]

Daniel Leithinger, Sean Follmer, Alex Olwal, and Hiroshi Ishii. 2014. Physical telepresence: Shape capture and display for embodied, computer-mediated remote collaboration. In Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology (UIST’14). ACM, New York, NY, 461--470.

Digital Library

[28]

B. Lord and G. D. Lord. 2002. The Manual of Museum Exhibitions. Rowman 8 Littlefield Pub Incorporated. Retrieved from https://books.google.co.kr/books?id=dTKb1kk88McC.

[29]

Aditi Majumder, Duy-Quoc Lai, and Mahdi Abbaspour Tehrani. 2015. A multi-projector display system of arbitrary shape, size and resolution. In ACM SIGGRAPH 2015 Emerging Technologies (SIGGRAPH’15). ACM, New York, NY, Article 2, 1 page.

Digital Library

[30]

M. R. Marner, S. Haren, M. Gardiner, and B. H. Thomas. 2012. Exploring interactivity and augmented reality in theater: A case study of Half Real. In 2012 IEEE International Symposium on Mixed and Augmented Reality--Arts, Media, and Humanities (ISMAR-- AMH). 81--86.

[31]

I. Miyagawa, Y. Sugaya, H. Arai, and M. Morimoto. 2014. An iterative compensation approach without linearization of projector responses for multiple-projector system. IEEE Trans. Image Process. 23, 6 (June 2014), 2676--2687.

Digital Library

[32]

Leo Miyashita, Kota Ishihara, Yoshihiro Watanabe, and Masatoshi Ishikawa. 2016. ZoeMatrope: A system for physical material design. ACM Trans. Graph. 35, 4, Article 66 (July 2016), 11 pages.

Digital Library

[33]

D. Moreno and G. Taubin. 2012. Simple, accurate, and robust projector-camera calibration. In 2012 2nd International Conference on 3D Imaging, Modeling, Processing, Visualization Transmission. 464--471.

Digital Library

[34]

Ken Nakagaki, Luke Vink, Jared Counts, Daniel Windham, Daniel Leithinger, Sean Follmer, and Hiroshi Ishii. 2016. Materiable: Rendering dynamic material properties in response to direct physical touch with shape changing interfaces. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI’16). ACM, New York, NY, 2764--2772.

Digital Library

[35]

Tobias Nöll, Johannes Köhler, Gerd Reis, and Didier Stricker. 2015. Fully automatic, omnidirectional acquisition of geometry and appearance in the context of cultural heritage preservation. J. Comput. Cult. Heritage 8, 1, Article 2 (Feb. 2015), 28 pages.

Digital Library

[36]

Yoichi Ochiai, Kota Kumagai, Takayuki Hoshi, Jun Rekimoto, Satoshi Hasegawa, and Yoshio Hayasaki. 2016. Fairy lights in femtoseconds: Aerial and volumetric graphics rendered by focused femtosecond laser combined with computational holographic fields. ACM Trans. Graph. 35, 2, Article 17 (Feb. 2016), 14 pages.

Digital Library

[37]

Min Ki Park, Kyu Je Lim, Myoung Kook Seo, Soon Jong Jung, and Kwan H. Lee. 2015. Spatial augmented reality for product appearance design evaluation. J. Comput. Des. Eng. 2, 1 (2015), 38--46.

[38]

Soon-Yong Park and Murali Subbarao. 2003. An accurate and fast point-to-plane registration technique. Pattern Recognit. Lett. 24, 16 (2003), 2967--2976.

Digital Library

[39]

Isabel Pedersen, Nathan Gale, Pejman Mirza-Babaei, and Samantha Reid. 2017. More than meets the eye: The benefits of augmented reality and holographic displays for digital cultural heritage. J Comput. Cult. Heritage 10, 2, Article 11 (March 2017), 15 pages.

Digital Library

[40]

Rosa Peral, Diego Sagasti, and Sara Sillaurren. 2005. Virtual restoration of cultural heritage through real-time 3D models projection. In Proceedings of the 6th International Symposium on Virtual Reality, Archaeology and Cultural Heritage (VAST’05).

[41]

Ramesh Raskar, Greg Welch, Kok-Lim Low, and Deepak Bandyopadhyay. 2001. Shader lamps: Animating real objects with image-based illumination. Rendering Techniques 2001: Proceedings of the Eurographics Workshop in London, United Kingdom, June 25--27, 2001, 89--102.

Digital Library

[42]

C. Resch, P. Keitler, and G. Klinker. 2014. Sticky projections—A new approach to interactive shader lamp tracking. In 2014 IEEE International Symposium on Mixed and Augmented Reality (ISMAR). 151--156.

[43]

Brett Ridel, Patrick Reuter, Jérémy Laviole, Nicolas Mellado, Nadine Couture, and Xavier Granier. 2014. The revealing flashlight: Interactive spatial augmented reality for detail exploration of cultural heritage artifacts. JOCCH 7 (2014), 6:1--6:18.

Digital Library

[44]

Christian Siegl, Matteo Colaianni, Lucas Thies, Justus Thies, Michael Zollhöfer, Shahram Izadi, Marc Stamminger, and Frank Bauer. 2015. Real-time pixel luminance optimization for dynamic multi-projection mapping. ACM Trans. Graph. 34, 6, Article 237 (Oct. 2015), 11 pages.

Digital Library

[45]

Antonio De Stefano, Reimar Tausch, Pedro Santos, Arjan Kuijper, Giuseppe Di Gironimo, Dieter W. Fellner, and Bruno Siciliano. 2016. Modeling a virtual robotic system for automated 3D digitization of cultural heritage artifacts. J. Cult. Heritage 19 (2016), 531--537.

[46]

Jürgen Steimle, Andreas Jordt, and Pattie Maes. 2013. Flexpad: Highly flexible bending interactions for projected handheld displays. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI’13). ACM, New York, NY, 237--246.

Digital Library

[47]

Antonio E. Uva, Michele Gattullo, Vito M. Manghisi, Daniele Spagnulo, Giuseppe L. Cascella, and Michele Fiorentino. 2018. Evaluating the effectiveness of spatial augmented reality in smart manufacturing: A solution for manual working stations. Int. J. Adv. Manuf. Technol. 94, 1 (01 Jan 2018), 509--521.

[48]

Y. Watanabe, T. Kato, and M. ishikawa. 2018. Extended dot cluster marker for high-speed 3D tracking in dynamic projection mapping. In 2017 IEEE International Symposium on Mixed and Augmented Reality (ISMAR), Vol. 00. 52--61.

[49]

G. Wetzstein and O. Bimber. 2007. Radiometric compensation through inverse light transport. In 15th Pacific Conference on Computer Graphics and Applications (PG’07). 391--399.

Digital Library

[50]

Gordon Wetzstein, Douglas Lanman, Matthew Hirsch, and Ramesh Raskar. 2012. Tensor displays: Compressive light field synthesis using multilayer displays with directional backlighting. ACM Trans. Graphics 31, 4, Article 80 (July 2012), 11 pages.

Digital Library

[51]

Changchang Wu. 2013. Towards linear-time incremental structure from motion. In Proceedings of the 2013 International Conference on 3D Vision (3DV’13). IEEE Computer Society, Washington, DC, 127--134.

Digital Library

[52]

Shunsuke Yoshida. 2016. fVisiOn: 360-degree viewable glasses-free tabletop 3D display composed of conical screen and modular projector arrays. Opt. Express 24, 12 (June 2016), 13194--13203.

[53]

Hwang Rok Yun, Dae Woong Kim, and Tatsuro Ishii. 2013. A study of digital media art utilizing the contents of the architecture cultural property. International Journal of Asia Digital Art 8 Design 17, 2 (2013), 77--84.

[54]

Z. Zhang. 2000. A flexible new technique for camera calibration. IEEE Trans. Pattern Anal. Mach. Intell. 22, 11 (Nov 2000), 1330--1334.

Digital Library

Cited By

Böhmer MKuehnel SDamarowsky J(2024)Bridging the Gap Between Augmentation and CognitionImpact of Digital Solutions for Improved Healthcare Delivery10.4018/979-8-3693-5237-3.ch016(409-444)Online publication date: 18-Oct-2024
https://doi.org/10.4018/979-8-3693-5237-3.ch016
Kore RDurmus D(2024)Optimizing Light Source Spectra for Art Conservation: Exploring Basic Color GroupsLEUKOS10.1080/15502724.2024.2366479(1-13)Online publication date: 29-Jul-2024
https://doi.org/10.1080/15502724.2024.2366479
Bitter JSpierling U(2024)Against Isolation in the Museum: Playful Co-presence with Immersive Augmented RealitySerious Games10.1007/978-3-031-74138-8_20(281-297)Online publication date: 7-Nov-2024
https://dl.acm.org/doi/10.1007/978-3-031-74138-8_20
Show More Cited By

Index Terms

A New Projection-based Exhibition System for a Museum
1. Computing methodologies
  1. Computer graphics
    1. Graphics systems and interfaces
      1. Mixed / augmented reality
2. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction devices
      1. Displays and imagers

Recommendations

An Interactive 3D Exhibition System with Global Illumination for Digital Museum
Edutainment '09: Proceedings of the 4th International Conference on E-Learning and Games: Learning by Playing. Game-based Education System Design and Development

Interactive exhibition of three-dimensional models in digital museums can significantly impact learning and understanding. Current 3D exhibition systems commonly provide viewers with local illumination effects. Interactive exhibition with high realistic ...
Effective contents creation for spatial AR exhibition
VRCAI '10: Proceedings of the 9th ACM SIGGRAPH Conference on Virtual-Reality Continuum and its Applications in Industry

In this paper, we propose the exhibition system using the spatial augmented reality technology for the digital museum. This exhibition system can represent the atmosphere around the exhibits, for example, the bustle of town, a lifestyle of people, and ...
Augmenting Indigenous Sámi Exhibition - Interactive Digital Heritage in Museum Context
Human-Computer Interaction – INTERACT 2023
Abstract
Museums and cultural heritage institutions have an important role in presenting accurate information and sharing cultural knowledge, and new technologies are increasingly implemented. For the best results, the appropriateness of a specific ...

Comments

Information & Contributors

Information

Published In

cover image Journal on Computing and Cultural Heritage

Journal on Computing and Cultural Heritage Volume 12, Issue 2

June 2019

153 pages

ISSN:1556-4673

EISSN:1556-4711

DOI:10.1145/3328727

Editor:
Franco Niccolucci
VAST-LAB at PIN, University of Florence, Italy

Issue’s Table of Contents

Copyright © 2019 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 07 May 2019

Accepted: 01 September 2018

Revised: 01 August 2018

Received: 01 March 2018

Published in JOCCH Volume 12, Issue 2

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed

Funding Sources

National IT Industry Promotion Agency (NIPA)
Ministry of Culture, Sports, and Tourism (MCST)
Korea Creative Content Agency (KOCCA) in the Culture Technology Research 8 Development Program
Korean government (MSIP)

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

12
Total Citations
View Citations
966
Total Downloads

Downloads (Last 12 months)111
Downloads (Last 6 weeks)5

Reflects downloads up to 25 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Böhmer MKuehnel SDamarowsky J(2024)Bridging the Gap Between Augmentation and CognitionImpact of Digital Solutions for Improved Healthcare Delivery10.4018/979-8-3693-5237-3.ch016(409-444)Online publication date: 18-Oct-2024
https://doi.org/10.4018/979-8-3693-5237-3.ch016
Kore RDurmus D(2024)Optimizing Light Source Spectra for Art Conservation: Exploring Basic Color GroupsLEUKOS10.1080/15502724.2024.2366479(1-13)Online publication date: 29-Jul-2024
https://doi.org/10.1080/15502724.2024.2366479
Bitter JSpierling U(2024)Against Isolation in the Museum: Playful Co-presence with Immersive Augmented RealitySerious Games10.1007/978-3-031-74138-8_20(281-297)Online publication date: 7-Nov-2024
https://dl.acm.org/doi/10.1007/978-3-031-74138-8_20
Zhang RPeng F(2023)Connection: Digitally Representing Australian Aboriginal Art through the Immersive Virtual Museum ExhibitionArts10.3390/arts1301000913:1(9)Online publication date: 27-Dec-2023
https://doi.org/10.3390/arts13010009
Liu J(2023)A Critical Review of Digital Experiences in Cultural Institutions: Is Digital Experience a Traction or Distraction Strategy?Proceedings of the 11th International Conference on Digital and Interactive Arts10.1145/3632776.3632784(1-6)Online publication date: 28-Nov-2023
https://dl.acm.org/doi/10.1145/3632776.3632784
Komarac TOzretić Došen Đ(2023)Understanding virtual museum visits: generation Z experiencesMuseum Management and Curatorship10.1080/09647775.2023.226912939:3(357-376)Online publication date: 16-Oct-2023
https://doi.org/10.1080/09647775.2023.2269129
Zhou D(2023)Research on Intelligent Digital Management Model of Metropolitan Museum of Art in the Era of “Cloud Exhibition-Visit”Proceedings of the 6th International Conference on Economic Management and Green Development10.1007/978-981-19-7826-5_92(955-972)Online publication date: 28-Jun-2023
https://doi.org/10.1007/978-981-19-7826-5_92
Nikolakopoulou VPrintezis PManiatis VKontizas DVosinakis SChatzigrigoriou PKoutsabasis P(2022)Conveying Intangible Cultural Heritage in Museums with Interactive Storytelling and Projection Mapping: The Case of the Mastic VillagesHeritage10.3390/heritage50200565:2(1024-1049)Online publication date: 18-May-2022
https://doi.org/10.3390/heritage5020056
Li QWang JLuo T(2022)Evaluating Interactive Digital Exhibit Characteristics in Science Museums and Their Effects on Child EngagementInternational Journal of Human–Computer Interaction10.1080/10447318.2022.212658440:3(838-849)Online publication date: 14-Oct-2022
https://doi.org/10.1080/10447318.2022.2126584
Böhmer MDamarowsky JParschat SMahn V(2021)ALiS: Entwicklung einer Designtheorie für Augmented Living Spaces zur erweiterten Autonomie älterer und kognitiv eingeschränkter MenschenALiS: Development of a Design Theory for Augmented Living Spaces to Enhance Autonomy of the Elderly and Cognitively ImpairedHMD Praxis der Wirtschaftsinformatik10.1365/s40702-021-00830-zOnline publication date: 23-Dec-2021
https://doi.org/10.1365/s40702-021-00830-z
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Figures

Tables

Media

View Issue’s Table of Contents