skip to main content
research-article

A New Projection-based Exhibition System for a Museum

Published: 07 May 2019 Publication History

Abstract

In this article, we propose a new projection-based system to exhibit a realistic virtual cultural object in a museum. We introduce a new design by combining the multi-projection mapping technology with an optical see-through display that overcomes the limitations of the conventional projection-based exhibition by resolving the problems of ambient light and the occlusion by obstacles. We also introduce a mechanically moving projection surface that increases the degree of freedom of the projection content. Both geometric and radiometric calibration methods are used to correctly project a high-quality texture onto the moving 3D projection surface without perspective distortion. To evaluate the strength of the system and a potential for deployment in a general museum context, we conduct a user study that includes both the visitors and museum staff. The result shows that the proposed system can enrich the museum exhibition by creating a virtual cultural object with substantial 3D effect and high-fidelity appearance. We also demonstrate various applications of the system that provide dynamic content of a virtual cultural object by changing its appearance as well as the viewpoint.

Supplementary Material

lee (lee.zip)
Supplemental movie, appendix, image and software files for, A New Projection-based Exhibition System for a Museum

References

[1]
Dror Aiger, Niloy J. Mitra, and Daniel Cohen-Or. 2008. 4points congruent sets for robust pairwise surface registration. ACM Trans. Graphics 27, 3, Article 85 (Aug. 2008), 10 pages.
[2]
Daniel G. Aliaga, Yu Hong Yeung, Alvin Law, Behzad Sajadi, and Aditi Majumder. 2012. Fast high-resolution appearance editing using superimposed projections. ACM Trans. Graphics 31, 2, Article 13 (April 2012), 13 pages.
[3]
David Baraff. 1997. An introduction to physically based modeling: Rigid body simulation i—Unconstrained rigid body dynamics. In An Introduction to Physically Based Modeling, (SIGGRAPH’97) Course Notes. 97.
[4]
Peter C. Barnum, Srinivasa G. Narasimhan, and Takeo Kanade. 2010. A multi-layered display with water drops. ACM Trans. Graphics 29, 4, Article 76 (July 2010), 7 pages.
[5]
Ditte Amund Basballe and Kim Halskov. 2010. Projections on museum exhibits: Engaging visitors in the museum setting. In Proceedings of the 22nd Conference of the Computer-Human Interaction Special Interest Group of Australia on Computer-Human Interaction (OZCHI’10). ACM, New York, NY, 80--87.
[6]
Mafkereseb Kassahun Bekele, Roberto Pierdicca, Emanuele Frontoni, Eva Savina Malinverni, and James Gain. 2018. A survey of augmented, virtual, and mixed reality for cultural heritage. J. Comput. Cult. Heritage 11, 2, Article 7 (March 2018), 36 pages.
[7]
Amit Bermano, Philipp Brüschweiler, Anselm Grundhöfer, Daisuke Iwai, Bernd Bickel, and Markus Gross. 2013. Augmenting physical avatars using projector-based illumination. ACM Trans. Graph. 32, 6, Article 189 (Nov. 2013), 10 pages.
[8]
Amit Haim Bermano, Markus Billeter, Daisuke Iwai, and Anselm Grundhöfer. 2017. Makeup lamps: Live augmentation of human faces via projection. Computer Graphics Forum (2017).
[9]
Mark Billinghurst, Adrian Clark, and Gun Lee. 2015. A survey of augmented reality. Found. Trends Hum.-Comput. Interact. 8, 2--3 (March 2015), 73--272.
[10]
O. Bimber, B. Frohlich, D. Schmalsteig, and L. M. Encarnacao. 2001. The virtual showcase. IEEE Comput. Graphics Appl. 21, 6 (Nov. 2001), 48--55.
[11]
Oliver Bimber, Daisuke Iwai, Gordon Wetzstein, and Anselm Grundhöfer. 2008. The visual computing of projector-camera systems. In ACM SIGGRAPH 2008 Classes (SIGGRAPH’08). ACM, New York, NY, Article 84, 25 pages.
[12]
Oliver Bimber and Ramesh Raskar. 2005. Spatial Augmented Reality: Merging Real and Virtual Worlds. A. K. Peters, Ltd., Natick, MA.
[13]
Marcello Carrozzino and Massimo Bergamasco. 2010. Beyond virtual museums: Experiencing immersive virtual reality in real museums. J. Cult. Heritage 11, 4 (2010), 452--458.
[14]
Junho Choi, Yong Yi Lee, Yong Hwi Kim, Bilal Ahmed, Jong Hun Lee, Moon Gu Son, Junbum Kim, and Kwan H. Lee. 2017. Curvature-aware adaptive capture of 3D geometry and appearance. In ACM SIGGRAPH 2017 Posters (SIGGRAPH’17). ACM, New York, NY, Article 40, 2 pages.
[15]
Peter Dalsgaard and Kim Halskov. 2010. Designing urban media FaçAdes: Cases and challenges. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI’10). ACM, New York, NY, 2277--2286.
[16]
Paul E. Debevec and Jitendra Malik. 1997. Recovering high dynamic range radiance maps from photographs. In Proceedings of the 24th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH’97). ACM Press/Addison-Wesley Publishing Co., New York, NY, 369--378.
[17]
Neil A. Dodgson. 2005. Autostereoscopic 3D displays. Computer 38, 8 (Aug. 2005), 31--36.
[18]
A. Dolce, J. Nasman, and B. Cutler. 2012. ARmy: A study of multi-user interaction in spatially augmented games. In 2012 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops. 43--50.
[19]
Ashish Doshi, Ross T. Smith, Bruce H. Thomas, and Con Bouras. 2017. Use of projector based augmented reality to improve manual spot-welding precision and accuracy for automotive manufacturing. Int. J. Adv. Manuf. Technol. 89, 5 (01 Mar 2017), 1279--1293.
[20]
M. D. Grossberg, H. Peri, S. K. Nayar, and P. N. Belhumeur. 2004. Making one object look like another: Controlling appearance using a projector-camera system. In Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, (CVPR’04), Vol. 1. I--452--I--459.
[21]
Andrew Jones, Ian McDowall, Hideshi Yamada, Mark Bolas, and Paul Debevec. 2007. Rendering for an interactive 360° light field display. ACM Trans. Graph. 26, 3, Article 40 (July 2007).
[22]
Andrew V. Jones, Koki Nagano, Jing Liu, Jay Busch, Xueming Yu, Mark T. Bolas, and Paul Debevec. 2014. Interpolating vertical parallax for an autostereoscopic three-dimensional projector array. J. Electron. Imaging 23, 1 (2014), 23--23--13.
[23]
Brett Jones, Rajinder Sodhi, Michael Murdock, Ravish Mehra, Hrvoje Benko, Andrew Wilson, Eyal Ofek, Blair MacIntyre, Nikunj Raghuvanshi, and Lior Shapira. 2014. RoomAlive: Magical experiences enabled by scalable, adaptive projector-camera units. In Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology (UIST’14). ACM, New York, NY, 637--644.
[24]
L. L. Lapin. 1983. Probability and Statistics for Modern Engineering. Brooks/Cole Engineering Division. Retrieved from https://books.google.co.kr/books?id=ZYhRAAAAMAAJ.
[25]
Jaewoon Lee, Yeonjin Kim, Myeong-Hyeon Heo, Dongho Kim, and Byeong-Seok Shin. 2015. Real-time projection-based augmented reality system for dynamic objects in the performing arts. Symmetry 7, 1 (2015), 182--192.
[26]
Y. Y. Lee, J. Choi, B. Ahmed, Y. H. Kim, J. H. Lee, M. G. Son, J. D. Yoo, and K. H. Lee. 2015. A SAR-based interactive digital exhibition of Korean cultural artifacts. In 2015 Digital Heritage, Vol. 2. 655--658.
[27]
Daniel Leithinger, Sean Follmer, Alex Olwal, and Hiroshi Ishii. 2014. Physical telepresence: Shape capture and display for embodied, computer-mediated remote collaboration. In Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology (UIST’14). ACM, New York, NY, 461--470.
[28]
B. Lord and G. D. Lord. 2002. The Manual of Museum Exhibitions. Rowman 8 Littlefield Pub Incorporated. Retrieved from https://books.google.co.kr/books?id=dTKb1kk88McC.
[29]
Aditi Majumder, Duy-Quoc Lai, and Mahdi Abbaspour Tehrani. 2015. A multi-projector display system of arbitrary shape, size and resolution. In ACM SIGGRAPH 2015 Emerging Technologies (SIGGRAPH’15). ACM, New York, NY, Article 2, 1 page.
[30]
M. R. Marner, S. Haren, M. Gardiner, and B. H. Thomas. 2012. Exploring interactivity and augmented reality in theater: A case study of Half Real. In 2012 IEEE International Symposium on Mixed and Augmented Reality--Arts, Media, and Humanities (ISMAR-- AMH). 81--86.
[31]
I. Miyagawa, Y. Sugaya, H. Arai, and M. Morimoto. 2014. An iterative compensation approach without linearization of projector responses for multiple-projector system. IEEE Trans. Image Process. 23, 6 (June 2014), 2676--2687.
[32]
Leo Miyashita, Kota Ishihara, Yoshihiro Watanabe, and Masatoshi Ishikawa. 2016. ZoeMatrope: A system for physical material design. ACM Trans. Graph. 35, 4, Article 66 (July 2016), 11 pages.
[33]
D. Moreno and G. Taubin. 2012. Simple, accurate, and robust projector-camera calibration. In 2012 2nd International Conference on 3D Imaging, Modeling, Processing, Visualization Transmission. 464--471.
[34]
Ken Nakagaki, Luke Vink, Jared Counts, Daniel Windham, Daniel Leithinger, Sean Follmer, and Hiroshi Ishii. 2016. Materiable: Rendering dynamic material properties in response to direct physical touch with shape changing interfaces. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI’16). ACM, New York, NY, 2764--2772.
[35]
Tobias Nöll, Johannes Köhler, Gerd Reis, and Didier Stricker. 2015. Fully automatic, omnidirectional acquisition of geometry and appearance in the context of cultural heritage preservation. J. Comput. Cult. Heritage 8, 1, Article 2 (Feb. 2015), 28 pages.
[36]
Yoichi Ochiai, Kota Kumagai, Takayuki Hoshi, Jun Rekimoto, Satoshi Hasegawa, and Yoshio Hayasaki. 2016. Fairy lights in femtoseconds: Aerial and volumetric graphics rendered by focused femtosecond laser combined with computational holographic fields. ACM Trans. Graph. 35, 2, Article 17 (Feb. 2016), 14 pages.
[37]
Min Ki Park, Kyu Je Lim, Myoung Kook Seo, Soon Jong Jung, and Kwan H. Lee. 2015. Spatial augmented reality for product appearance design evaluation. J. Comput. Des. Eng. 2, 1 (2015), 38--46.
[38]
Soon-Yong Park and Murali Subbarao. 2003. An accurate and fast point-to-plane registration technique. Pattern Recognit. Lett. 24, 16 (2003), 2967--2976.
[39]
Isabel Pedersen, Nathan Gale, Pejman Mirza-Babaei, and Samantha Reid. 2017. More than meets the eye: The benefits of augmented reality and holographic displays for digital cultural heritage. J Comput. Cult. Heritage 10, 2, Article 11 (March 2017), 15 pages.
[40]
Rosa Peral, Diego Sagasti, and Sara Sillaurren. 2005. Virtual restoration of cultural heritage through real-time 3D models projection. In Proceedings of the 6th International Symposium on Virtual Reality, Archaeology and Cultural Heritage (VAST’05).
[41]
Ramesh Raskar, Greg Welch, Kok-Lim Low, and Deepak Bandyopadhyay. 2001. Shader lamps: Animating real objects with image-based illumination. Rendering Techniques 2001: Proceedings of the Eurographics Workshop in London, United Kingdom, June 25--27, 2001, 89--102.
[42]
C. Resch, P. Keitler, and G. Klinker. 2014. Sticky projections—A new approach to interactive shader lamp tracking. In 2014 IEEE International Symposium on Mixed and Augmented Reality (ISMAR). 151--156.
[43]
Brett Ridel, Patrick Reuter, Jérémy Laviole, Nicolas Mellado, Nadine Couture, and Xavier Granier. 2014. The revealing flashlight: Interactive spatial augmented reality for detail exploration of cultural heritage artifacts. JOCCH 7 (2014), 6:1--6:18.
[44]
Christian Siegl, Matteo Colaianni, Lucas Thies, Justus Thies, Michael Zollhöfer, Shahram Izadi, Marc Stamminger, and Frank Bauer. 2015. Real-time pixel luminance optimization for dynamic multi-projection mapping. ACM Trans. Graph. 34, 6, Article 237 (Oct. 2015), 11 pages.
[45]
Antonio De Stefano, Reimar Tausch, Pedro Santos, Arjan Kuijper, Giuseppe Di Gironimo, Dieter W. Fellner, and Bruno Siciliano. 2016. Modeling a virtual robotic system for automated 3D digitization of cultural heritage artifacts. J. Cult. Heritage 19 (2016), 531--537.
[46]
Jürgen Steimle, Andreas Jordt, and Pattie Maes. 2013. Flexpad: Highly flexible bending interactions for projected handheld displays. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI’13). ACM, New York, NY, 237--246.
[47]
Antonio E. Uva, Michele Gattullo, Vito M. Manghisi, Daniele Spagnulo, Giuseppe L. Cascella, and Michele Fiorentino. 2018. Evaluating the effectiveness of spatial augmented reality in smart manufacturing: A solution for manual working stations. Int. J. Adv. Manuf. Technol. 94, 1 (01 Jan 2018), 509--521.
[48]
Y. Watanabe, T. Kato, and M. ishikawa. 2018. Extended dot cluster marker for high-speed 3D tracking in dynamic projection mapping. In 2017 IEEE International Symposium on Mixed and Augmented Reality (ISMAR), Vol. 00. 52--61.
[49]
G. Wetzstein and O. Bimber. 2007. Radiometric compensation through inverse light transport. In 15th Pacific Conference on Computer Graphics and Applications (PG’07). 391--399.
[50]
Gordon Wetzstein, Douglas Lanman, Matthew Hirsch, and Ramesh Raskar. 2012. Tensor displays: Compressive light field synthesis using multilayer displays with directional backlighting. ACM Trans. Graphics 31, 4, Article 80 (July 2012), 11 pages.
[51]
Changchang Wu. 2013. Towards linear-time incremental structure from motion. In Proceedings of the 2013 International Conference on 3D Vision (3DV’13). IEEE Computer Society, Washington, DC, 127--134.
[52]
Shunsuke Yoshida. 2016. fVisiOn: 360-degree viewable glasses-free tabletop 3D display composed of conical screen and modular projector arrays. Opt. Express 24, 12 (June 2016), 13194--13203.
[53]
Hwang Rok Yun, Dae Woong Kim, and Tatsuro Ishii. 2013. A study of digital media art utilizing the contents of the architecture cultural property. International Journal of Asia Digital Art 8 Design 17, 2 (2013), 77--84.
[54]
Z. Zhang. 2000. A flexible new technique for camera calibration. IEEE Trans. Pattern Anal. Mach. Intell. 22, 11 (Nov 2000), 1330--1334.

Cited By

View all

Recommendations

Comments

Information & Contributors

Information

Published In

cover image Journal on Computing and Cultural Heritage
Journal on Computing and Cultural Heritage   Volume 12, Issue 2
June 2019
153 pages
ISSN:1556-4673
EISSN:1556-4711
DOI:10.1145/3328727
Issue’s Table of Contents
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 07 May 2019
Accepted: 01 September 2018
Revised: 01 August 2018
Received: 01 March 2018
Published in JOCCH Volume 12, Issue 2

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. Projection-based exhibition
  2. digital cultural heritage
  3. digital museum
  4. projection mapping
  5. spatial augmented reality

Qualifiers

  • Research-article
  • Research
  • Refereed

Funding Sources

  • National IT Industry Promotion Agency (NIPA)
  • Ministry of Culture, Sports, and Tourism (MCST)
  • Korea Creative Content Agency (KOCCA) in the Culture Technology Research 8 Development Program
  • Korean government (MSIP)

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)111
  • Downloads (Last 6 weeks)5
Reflects downloads up to 25 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2024)Bridging the Gap Between Augmentation and CognitionImpact of Digital Solutions for Improved Healthcare Delivery10.4018/979-8-3693-5237-3.ch016(409-444)Online publication date: 18-Oct-2024
  • (2024)Optimizing Light Source Spectra for Art Conservation: Exploring Basic Color GroupsLEUKOS10.1080/15502724.2024.2366479(1-13)Online publication date: 29-Jul-2024
  • (2024)Against Isolation in the Museum: Playful Co-presence with Immersive Augmented RealitySerious Games10.1007/978-3-031-74138-8_20(281-297)Online publication date: 7-Nov-2024
  • (2023)Connection: Digitally Representing Australian Aboriginal Art through the Immersive Virtual Museum ExhibitionArts10.3390/arts1301000913:1(9)Online publication date: 27-Dec-2023
  • (2023)A Critical Review of Digital Experiences in Cultural Institutions: Is Digital Experience a Traction or Distraction Strategy?Proceedings of the 11th International Conference on Digital and Interactive Arts10.1145/3632776.3632784(1-6)Online publication date: 28-Nov-2023
  • (2023)Understanding virtual museum visits: generation Z experiencesMuseum Management and Curatorship10.1080/09647775.2023.226912939:3(357-376)Online publication date: 16-Oct-2023
  • (2023)Research on Intelligent Digital Management Model of Metropolitan Museum of Art in the Era of “Cloud Exhibition-Visit”Proceedings of the 6th International Conference on Economic Management and Green Development10.1007/978-981-19-7826-5_92(955-972)Online publication date: 28-Jun-2023
  • (2022)Conveying Intangible Cultural Heritage in Museums with Interactive Storytelling and Projection Mapping: The Case of the Mastic VillagesHeritage10.3390/heritage50200565:2(1024-1049)Online publication date: 18-May-2022
  • (2022)Evaluating Interactive Digital Exhibit Characteristics in Science Museums and Their Effects on Child EngagementInternational Journal of Human–Computer Interaction10.1080/10447318.2022.212658440:3(838-849)Online publication date: 14-Oct-2022
  • (2021)ALiS: Entwicklung einer Designtheorie für Augmented Living Spaces zur erweiterten Autonomie älterer und kognitiv eingeschränkter MenschenALiS: Development of a Design Theory for Augmented Living Spaces to Enhance Autonomy of the Elderly and Cognitively ImpairedHMD Praxis der Wirtschaftsinformatik10.1365/s40702-021-00830-zOnline publication date: 23-Dec-2021
  • Show More Cited By

View Options

Login options

Full Access

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media