skip to main content
research-article

Space-adaptive Artwork Placement Based on Content Similarities for Curating Thematic Spaces in a Virtual Museum

Published:13 January 2024Publication History
Skip Abstract Section

Abstract

Virtual Reality (VR) provides curators with the tools to design immersive 3D exhibition spaces. However, manually positioning artworks in VR is labor-intensive, and most existing automated methods are limited in considering both artwork content and spatial characteristics, as well as accommodating curators’ design preferences. To address these challenges, we present a virtual exhibition authoring system that automatically generates optimized artwork placements for thematic space layouts, where exhibits are grouped by conceptual themes and arranged as clusters. Our approach clusters artworks based on five content similarity factors—color, material, description, artist, and production date—and allows curators to adjust the importance of each factor and set limits on cluster sizes according to their design goals. A genetic optimization algorithm is employed to determine the placement of artworks, using four cost functions—intra-cluster distance, inter-cluster distance, intra-cluster intervisibility, and occupancy—to evaluate the arrangement with respect to spatial characteristics. The effectiveness of our approach is demonstrated through a series of practical scenarios and an expert evaluation with curators.

REFERENCES

  1. [1] Aletras Nikolaos and Stevenson Mark. 2012. Computing similarity between cultural heritage items using multimodal features. In Proceedings of the 6th Workshop on Language Technology for Cultural Heritage, Social Sciences, and Humanities. 8593.Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. [2] Alghofaili Rawan, Solah Michael S., Huang Haikun, Sawahata Yasuhito, Pomplun Marc, and Yu Lap-Fai. 2019. Optimizing visual element placement via visual attention analysis. In Proceedings of the IEEE Conference on Virtual Reality and 3D User Interfaces (VR’19). IEEE, 464473.Google ScholarGoogle ScholarCross RefCross Ref
  3. [3] Bingham Andrea J. and Witkowsky Patricia. 2021. Deductive and inductive approaches to qualitative data analysis. Anal. Interpret. Qual. Data: After Interview (2021), 133146.Google ScholarGoogle Scholar
  4. [4] Castellano Giovanna, Digeno Vincenzo, Sansaro Giovanni, and Vessio Gennaro. 2022. Leveraging knowledge graphs and deep learning for automatic art analysis. Knowl.-Based Syst. 248 (2022), 108859.Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. [5] Chittaro Luca, Ieronutti Lucio, Ranon Roberto, Siotto Eliana, and Visintini Domenico. 2010. A high-level tool for curators of 3D virtual visits and its application to a virtual exhibition of renaissance frescoes. In Proceedings of the International Conference on Virtual Reality, Archaeology and Cultural Heritage (VAST’10).Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. [6] Council British. 2016. Guidelines for Museum Display. Retrieved from https://www.britishcouncil.in/sites/default/files/guidelines_for_museum_display.pdf[Accessed 10 April 2023].Google ScholarGoogle Scholar
  7. [7] Davis Lawrence et al. 1985. Applying adaptive algorithms to epistatic domains. In Proceedings of the International Joint Conference on Artificial Intelligence (IJCAI’85). Citeseer, 162164.Google ScholarGoogle Scholar
  8. [8] Dean David. 2002. Museum Exhibition: Theory and Practice. Routledge.Google ScholarGoogle ScholarCross RefCross Ref
  9. [9] Defays Daniel. 1977. An efficient algorithm for a complete link method. Comput. J. 20, 4 (1977), 364366.Google ScholarGoogle ScholarCross RefCross Ref
  10. [10] Dernie David. 2006. Exhibition Design. Laurence King Publishing.Google ScholarGoogle Scholar
  11. [11] Díaz-Agudo Belén, Jimenez-Diaz Guillermo, and Jorro-Aragoneses Jose Luis. 2021. User evaluation to measure the perception of similarity measures in artworks. In Proceedings of the International Conference on Case-based Reasoning. Springer, 4863.Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. [12] Dubey Rohit K., Khoo Wei Ping, Morad Michal Gath, Hölscher Christoph, and Kapadia Mubbasir. 2020. AUTOSIGN: A multi-criteria optimization approach to computer aided design of signage layouts in complex buildings. Comput. Graph. 88 (2020), 1323.Google ScholarGoogle ScholarCross RefCross Ref
  13. [13] Falk John H.. 1993. Assessing the impact of exhibit arrangement on visitor behavior and learning. Curator: Museum J. 36, 2 (1993), 133146.Google ScholarGoogle ScholarCross RefCross Ref
  14. [14] Fisher Bob, Dawson-Howe Kenneth, O’Sullivan Carol, Eckel Gerhard, and Beckhaus Steffi. 2001. ExViz: A virtual exhibition design environment. In Proceedings of the International Symposium on Virtual and Augmented Architecture (VAA’01)-. Springer, 171182.Google ScholarGoogle ScholarCross RefCross Ref
  15. [15] Fujita Takayuki and Osana Yuko. 2018. Artwork retrieval based on similarity of touch using convolutional neural network. In Proceedings of the International Conference on Artificial Neural Networks. Springer, 235243.Google ScholarGoogle ScholarCross RefCross Ref
  16. [16] Golberg David E.. 1989. Genetic Algorithms in Search, Optimization, and Machine Learning, 1st ed. Addison Wesley.Google ScholarGoogle Scholar
  17. [17] Graham Daniel J., Friedenberg Jay D., Rockmore Daniel N., and Field David J.. 2010. Mapping the similarity space of paintings: Image statistics and visual perception. Visual Cogn. 18, 4 (2010), 559573.Google ScholarGoogle ScholarCross RefCross Ref
  18. [18] Grieser Karl, Baldwin Timothy, Bohnert Fabian, and Sonenberg Liz. 2011. Using ontological and document similarity to estimate museum exhibit relatedness. J. Comput. Cult. Herit. 3, 3 (2011), 120.Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. [19] Hayashi Masaki, Bachelder Steven, and Nakajima Masayuki. 2020. Automatic generation of art exhibitions from the internet resources. In Proceedings of the IEEE 9th Global Conference on Consumer Electronics (GCCE’20). IEEE, 642643.Google ScholarGoogle ScholarCross RefCross Ref
  20. [20] Hillier Bill and Tzortzi Kali. 2006. Space syntax: The language of museum space. Comp. Museum Studies (2006), 282301.Google ScholarGoogle ScholarCross RefCross Ref
  21. [21] Holland John H.. 1992. Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence. MIT Press.Google ScholarGoogle ScholarCross RefCross Ref
  22. [22] Ishizaka Alessio and Lusti Markus. 2004. An expert module to improve the consistency of AHP matrices. Int. Trans. Oper. Res. 11, 1 (2004), 97105.Google ScholarGoogle ScholarCross RefCross Ref
  23. [23] Jin Sam and Lee Sung-Hee. 2019. Lighting layout optimization for 3D indoor scenes. In Proceedings of the Computer Graphics Forum, Vol. 38. Wiley Online Library, 733743.Google ScholarGoogle ScholarCross RefCross Ref
  24. [24] Kán Peter and Kaufmann Hannes. 2018. Automatic furniture arrangement using greedy cost minimization. In Proceedings of the IEEE Conference on Virtual Reality and 3D User Interfaces (VR’18). IEEE, 491498.Google ScholarGoogle ScholarCross RefCross Ref
  25. [25] Kim Suzi and Choi Sunghee. 2021. Dynamic closest color warping to sort and compare palettes. ACM Trans. Graph. 40, 4 (2021), 115.Google ScholarGoogle ScholarDigital LibraryDigital Library
  26. [26] Krukar Jakub. 2014. Walk, look, remember: The influence of the gallery’s spatial layout on human memory for an art exhibition. Behav. Sci. 4, 3 (2014), 181201.Google ScholarGoogle ScholarCross RefCross Ref
  27. [27] Krukar Jakub and Dalton Ruth Conroy. 2020. How the visitors’ cognitive engagement is driven (but not dictated) by the visibility and co-visibility of art exhibits. Front. Psychol. 11 (2020), 350.Google ScholarGoogle ScholarCross RefCross Ref
  28. [28] Lewis Clayton. 1982. Using the “Thinking-aloud” Method in Cognitive Interface Design. IBM TJ Watson Research Center Yorktown Heights, NY.Google ScholarGoogle Scholar
  29. [29] Lu Yi and Peponis John. 2014. Exhibition visitors are sensitive to patterns of display covisibility. Environ. Plan. B: Plan. Design 41, 1 (2014), 5368.Google ScholarGoogle ScholarCross RefCross Ref
  30. [30] Meinecke Christofer, Hall Chris, and Jänicke Stefan. 2022. Towards enhancing virtual museums by contextualizing art through interactive visualizations. ACM J. Comput. Cult. Herit. 15, 4 (2022), 126.Google ScholarGoogle ScholarDigital LibraryDigital Library
  31. [31] Merrell Paul, Schkufza Eric, Li Zeyang, Agrawala Maneesh, and Koltun Vladlen. 2011. Interactive furniture layout using interior design guidelines. ACM Trans. Graph. 30, 4 (2011), 110.Google ScholarGoogle ScholarDigital LibraryDigital Library
  32. [32] Monaco Daniele, Pellegrino Maria Angela, Scarano Vittorio, and Vicidomini Luca. 2022. Linked open data in authoring virtual exhibitions. J. Cult. Herit. 53 (2022), 127142.Google ScholarGoogle ScholarCross RefCross Ref
  33. [33] Motamedi Ali, Wang Zhe, Yabuki Nobuyoshi, Fukuda Tomohiro, and Michikawa Takashi. 2017. Signage visibility analysis and optimization system using BIM-enabled virtual reality (VR) environments. Adv. Eng. Info. 32 (2017), 248262.Google ScholarGoogle ScholarDigital LibraryDigital Library
  34. [34] Oliver I. M., Smith D. J., and Holland JRC. 1987. A study of permutation crossover operators on the TSP, genetic algorithms and their applications. In Proceedings of the 2nd International Conference on Genetic Algorithms. 224230.Google ScholarGoogle Scholar
  35. [35] Peponis John, Dalton Ruth Conroy, Wineman Jean, and Dalton Nick. 2004. Measuring the effects of layout upon visitors’ spatial behaviors in open plan exhibition settings. Environ. Plan. B: Plan. Design 31, 3 (2004), 453473.Google ScholarGoogle ScholarCross RefCross Ref
  36. [36] Pilegaard Ane. 2021. Object/Display/Architecture: Integrating scales in museum exhibition design. Nordes 1, 9 (2021).Google ScholarGoogle Scholar
  37. [37] Kaufmann Leonard and Rousseeuw Peter J.. 1987. Clustering by means of medoids. In Proceedings of the Statistical Data Analysis Based on the L1 Norm Conference, Vol. 31.Google ScholarGoogle Scholar
  38. [38] Saaty Thomas L.. 1988. What is the analytic hierarchy process? In Mathematical Models for Decision Support. Springer, 109121.Google ScholarGoogle ScholarCross RefCross Ref
  39. [39] Salton Gerard and McGill Michael J.. 1983. Introduction to Modern Information Retrieval. McGraw-Hill.Google ScholarGoogle ScholarDigital LibraryDigital Library
  40. [40] Scarano Vittorio, Andreoli Roberto, Monaco Daniele, Negro Alberto, Santangelo Gianluca, and Vicidomini Luca. 2019. Re-using open data by automatically building immersive virtual reality worlds as personal museums. In Proceedings of the 20th Annual International Conference on Digital Government Research. 297305.Google ScholarGoogle ScholarDigital LibraryDigital Library
  41. [41] Sheldon Julie. 2018. Picturing the installation shot. Comp. Mod. Art (2018), 125143.Google ScholarGoogle ScholarCross RefCross Ref
  42. [42] Stuer Peter, Meersman Robert, and Bruyne Steven De. 2001. The HyperMuseum theme generator system: Ontology-based Internet support for the active use of digital museum data for teaching and presentation. In Museums and the Web 2001: Selected Papers from an International Conference (5th, Seattle, Washington, March 15-17, 2001). Available from https://eric.ed.gov/?id=ED482082Google ScholarGoogle Scholar
  43. [43] Tröndle Martin, Greenwood Steven, Bitterli Konrad, and Berg Karen van den. 2014. The effects of curatorial arrangements. Museum Manage. Curator. 29, 2 (2014), 140173.Google ScholarGoogle ScholarCross RefCross Ref
  44. [44] Turner Alasdair, Doxa Maria, O’sullivan David, and Penn Alan. 2001. From isovists to visibility graphs: A methodology for the analysis of architectural space. Environ. Plan. B: Plan. Design 28, 1 (2001), 103121.Google ScholarGoogle ScholarCross RefCross Ref
  45. [45] Tzortzi Kali. 2007. Museum building design and exhibition layout. In Proceedings of the 6th International Space Syntax Symposium, Vol. 1215. 072.Google ScholarGoogle Scholar
  46. [46] Webler Jaderson Rafael. 2019. A Semantic Search Engine for Tagged Artworks Based on Word Embeddings. Master’s Thesis. Ludwig-Maximilians-Universität München.Google ScholarGoogle Scholar
  47. [47] Wineman Jean D. and Peponis John. 2010. Constructing spatial meaning: Spatial affordances in museum design. Environ. Behav. 42, 1 (2010), 86109.Google ScholarGoogle ScholarCross RefCross Ref
  48. [48] Xiuchuan He. 2020. The role of narrative thinking in design taking the mathematical hall of the London science Museum as an example. In Proceedings of the Design Research Society Conference on Synergy (DRS’20). DOI: DOI: https://doi.org/10.21606/drs.2020.154Google ScholarGoogle ScholarCross RefCross Ref
  49. [49] Yu Lap Fai, Yeung Sai Kit, Tang Chi Keung, Terzopoulos Demetri, Chan Tony F., and Osher Stanley J.. 2011. Make it home: Automatic optimization of furniture arrangement. ACM Trans. Graph. 30, 4 (2011).Google ScholarGoogle ScholarDigital LibraryDigital Library
  50. [50] Zappia Luke and Oshlack Alicia. 2018. Clustering trees: A visualization for evaluating clusterings at multiple resolutions. Gigascience 7, 7 (2018), giy083.Google ScholarGoogle ScholarCross RefCross Ref
  51. [51] Zidianakis Emmanouil, Partarakis Nikolaos, Kontaki Eirini, Kopidaki Stella, Xhako Aldo, Pervolarakis Zacharias, Agapakis Antonis, Foukarakis Michalis, Ntoa Stavroula, Barbounaki Ioanna et al. 2022. Web-based authoring tool for virtual exhibitions. In Proceedings of the 24th International Conference on Human-Computer Interaction (HCI’22). Springer, 378385.Google ScholarGoogle ScholarCross RefCross Ref
  52. [52] Zidianakis Emmanouil, Partarakis Nikolaos, Ntoa Stavroula, Dimopoulos Antonis, Kopidaki Stella, Ntagianta Anastasia, Ntafotis Emmanouil, Xhako Aldo, Pervolarakis Zacharias, Kontaki Eirini et al. 2021. The invisible museum: A user-centric platform for creating virtual 3D exhibitions with VR support. Electronics 10, 3 (2021), 363.Google ScholarGoogle ScholarCross RefCross Ref

Index Terms

  1. Space-adaptive Artwork Placement Based on Content Similarities for Curating Thematic Spaces in a Virtual Museum

        Recommendations

        Comments

        Login options

        Check if you have access through your login credentials or your institution to get full access on this article.

        Sign in

        Full Access

        • Published in

          cover image Journal on Computing and Cultural Heritage
          Journal on Computing and Cultural Heritage   Volume 17, Issue 1
          March 2024
          312 pages
          ISSN:1556-4673
          EISSN:1556-4711
          DOI:10.1145/3613493
          • Editor:
          • Franco Niccolucci
          Issue’s Table of Contents

          Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

          Publisher

          Association for Computing Machinery

          New York, NY, United States

          Publication History

          • Published: 13 January 2024
          • Online AM: 30 October 2023
          • Accepted: 11 September 2023
          • Revised: 3 September 2023
          • Received: 14 April 2023
          Published in jocch Volume 17, Issue 1

          Permissions

          Request permissions about this article.

          Request Permissions

          Check for updates

          Qualifiers

          • research-article
        • Article Metrics

          • Downloads (Last 12 months)359
          • Downloads (Last 6 weeks)62

          Other Metrics

        PDF Format

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader

        Full Text

        View this article in Full Text.

        View Full Text