Barbara Leporini
Skip Abstract Section
Abstract
Being able to explore and familiarise themselves with the structure and details of a cultural site before actually visiting it is fundamental for orienting visually impaired people during the visit; otherwise, it is particularly difficult to gain a global understanding of the structure and an overall impression of a square, a church, or a large monument. Our project addressed this problem by using low cost 3D models combined with audio descriptions to enable visually impaired users to explore the cultural site autonomously. Audio descriptions are organised into three groups (for historical, practical, and architectural information), and for each group, several tracks are recorded giving increasing levels of details. Users can easily navigate through the audio tracks to follow their tactile exploration by listening to the information they are most interested in. Relevant details are reproduced separately and linked to the main model via the audio tracks. A goal of our model is to enhance the understanding of the cultural site also for partially sighted as well as sighted people, making them able to appreciate the details of the architectural design using both visual and auditory senses. We exploited low-cost and partially open-source technologies, thus rendering our system easily replicable. We evaluated the interactive system with blind, partially sighted, and sighted users. Our user test confirmed the validity of our approach: (1) the 3D models and the tactile reproduction of details obtained via a low-cost 3D printing solution are well perceived by touch; (2) the semantic auditory information activated via perceptible buttons on demand and the different content levels for the audio tracks are suitable for an interactive, autonomous, and satisfying exploration; and (3) relevant details are well perceived. Finally, we propose guidelines to use in the 3D reproduction of buildings or large sites based on our experience.
- 3D Photoworks. 2019. Accessed on July 5. http://www.3dphotoworks.com.Google Scholar
- G. Anagnostakis, M. Antoniou, E. Kardamitsi, T. Sachinidis, P. Koutsabasis, M. Stavrakis, and D. Zissis. 2016. Accessible museum collections for the visually impaired: Combining tactile exploration, audio descriptions and mobile gestures. In Proceedings of the 18th International Conference on Human-Computer Interaction with Mobile Devices and Services Adjunct. ACM, New York, 1021--1025.Google Scholar
- K. K. Arcand, A. Jubett, M. Watzke, S. Price, K. T. Williamson, and P. Edmonds. 2019. Touching the stars: Improving NASA 3D printed data sets with blind and visually impaired audiences. Arxiv Preprint Arxiv:1906.06457.Google Scholar
- Balabolka. 2018. Accessed on January 18. http://www.cross-plus-a.com/balabolka.htm.Google Scholar
- BANA and CBA. 2010. Guidelines and Standards for Tactile Graphics. Web Version - February 2012, http://www.brailleauthority.org/tg/web-manual/index.html.Google Scholar
- J. Bornschein, D. Bornschein, and G. Weber. 2018. Comparing computer-based drawing methods for blind people with real-time tactile feedback. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. ACM, New York, 115.Google Scholar
- A. Brock. 2013. Touch the map! Designing interactive maps for visually impaired people. In Proceedings of ACM SIGACCESS Accessibility and Computing, 105, 9--14.Google ScholarDigital Library
- A. M. Brock, J. E. Froehlich, J. Guerreiro, B. Tannert, A. Caspi, J. Schöning, and S. Landau. 2018. SIG: Making maps accessible and putting accessibility in maps. In Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems (SIG03). ACM, New York.Google Scholar
- E. Buehler, N. Comrie, M. Hofmann, S. McDonald, and A. Hurst. 2016. Investigating the implications of 3D printing in special education. ACM Transactions on Accessible Computing (TACCESS) 8, 3 (2016), 11.Google ScholarDigital Library
- F. Buonamici, M. Carfagni, R. Furferi, L. Governi, and Y. Volpe. 2016. Are we ready to build a system for assisting blind people in tactile exploration of bas-reliefs? Sensors 16, 9 (2016), 1361.Google ScholarCross Ref
- J. Carter and D. Fourney. 2005. Research based tactile and haptic interaction guidelines. In Guidelines on Tactile and Haptic Interaction (GOTHI’05), 84--92.Google Scholar
- F. D'Agnano, C. Balletti, F. Guerra, and P. Vernier. 2015. Tooteko: A case study of augmented reality for an accessible cultural heritage. Digitization, 3D printing and sensors for an audio-tactile experience. Int. Arch. Photogramm. Remote Sens. Spatial Inf. Sci. XL-5/W4, 207--213.Google Scholar
- P. Dalgaard. 2008. Analysis of variance and the Kruskal-Wallis test. In Introductory Statistics with R, Statistics and Computing. Springer, New York, 127--143.Google Scholar
- E. Demetrescu. 2015. Archaeological stratigraphy as a formal language for virtual reconstruction. Theory and practice. Journal of Archaeological Science 57, 42--55.Google ScholarCross Ref
- DSpeech. 2018. Accessed on January 18. http://dimio.altervista.org/ita/.Google Scholar
- S. Giraud, A. M. Brock, M. J.-M. Macé and C. Jouffrais. 2017. Map learning with a 3D printed interactive small scale model: Improvement of space and text memorization in visually impaired students. Frontiers in Psychology 8, 930.Google ScholarCross Ref
- T. Götzelmann. 2014. Interactive tactile maps for blind people using smartphones’ integrated cameras. In Proceedings of ITS 2014, Dresda, 381--385.Google ScholarDigital Library
- T. Götzelmann and A. Pavkovic. 2014. Towards automatically generated tactile detail maps by 3D printers for blind persons. In Proceedings of the 14th International Conference on Computers Helping People with Special Needs (ICCHP’14). Springer International Publishing, vol. 8548, 1--7.Google Scholar
- T. Götzelmann and K. Winkler. 2015. SmartTactMaps: A smartphone-based approach to support blind persons in exploring tactile maps. In Proceedings of the 8th ACM International Conference on Pervasive Technologies Related to Assistive Environments (2). ACM, New York.Google Scholar
- J. Gual, M. Puyuelo, and J. Lloveras. 2011. Universal design and visual impairment: Tactile products for heritage access. In Proceedings of the 18th International Conference on Engineering Design (ICED 11), Impacting Society through Engineering Design. Vol. 5, Design for X/Design to X, Lyngby/Copenhagen, Denmark, 155--164.Google Scholar
- J. Gual, M. Puyuelo, and J. Lloveras. 2014. Three-dimensional tactile symbols produced by 3D printing: Improving the process of memorizing a tactile map key. British Journal of Visual Impairment 32, 3 (2014), 263--278.Google ScholarCross Ref
- J. Guerreiro, D. Ahmetovic, K. M. Kitani, and C. Asakawa. 2017. Virtual navigation for blind people: Building sequential representations of the real-world. In Proceedings of the 19th International ACM SIGACCESS Conference on Computers and Accessibility. ACM, New York, 280--289.Google Scholar
- G. Haus. 2016. Cultural heritage and ICT: State of the art and perspectives. DigitCult-Scientific Journal on Digital Cultures 1, 1 (2016), 9--20.Google Scholar
- S. Heo, S. Song, J. Kim, and H. Kim. 2017. RT-IFTTT: Real-time IOT framework with trigger condition-aware flexible polling intervals. In Proceedings of the IEEE Real-Time Systems Symposium (RTSS). 266--276.Google Scholar
- S. Hayhoe. 2008. Arts, Culture and Blindness: Studies of Blind Students in the Visual Arts. Cambria Press, Youngstown, PA.Google Scholar
- Hi-Storia. 2019. Accessed on July 5. https://www.hi-storia.it/.Google Scholar
- L. Holloway, K. Marriot, and M. Butler. 2018. Accessible maps for the blind: Comparing 3D printed models with tactile graphics. In Proceedings of CHI 2018, N° 198. Montreal, Canada.Google Scholar
- S. Invitto. 2013. Neuroestetica e ambiente percettivo: Pensare strutture interattive a tre dimensioni. SCIRES-IT, 3, 1 (2013), 35--46.Google Scholar
- T. H. Jung and M. C. Tom Dieck. 2017. Augmented reality, virtual reality and 3D printing for the co-creation of value for the visitor experience at cultural heritage places. Journal of Place Management and Development 10, 2 (2017), 140--151.Google ScholarCross Ref
- H. Koenig, J. Schneider, and T. Strothotte. 2000. Haptic exploration of virtual buildings using non-realistic rendering. In Proceedings of the International Conference on Cumputers Helping People with Special Needs. Karlsruhe, 377--384.Google Scholar
- P. Kosmas, G. Galanakis, V. Constantinou, G. Drossis, M. Christofi, I. Klironomos, and C. Stephanidis. 2019. Enhancing accessibility in cultural heritage environments: Considerations for social computing. Universal Access in the Information Society, 1--12.Google Scholar
- O. Lahav and D. Mioduser. 2008. Haptic-feedback support for cognitive mapping of unknown spaces by people who are blind. International Journal of Human-Computer Studies 66, 1 (2008), 23--35.Google ScholarDigital Library
- R. McMillen. 2015. Museum disability access: Social inclusion opportunities through innovative new media practices. Pacific Journal 10 (2015), 95--107.Google Scholar
- C. Mircioiu and J. Atkinson. 2017. A comparison of parametric and non-parametric methods applied to a Likert scale. Pharmacy 5, 2 (2017), 1--12.Google ScholarCross Ref
- B. A. Morrongiello, G. K. Humphrey, B. Timney, J. Choi, and P. T. Rocca. 1994. Tactual object exploration and recognition in blind and sighted children. Perception 23, 7 (1994), 833--848.Google ScholarCross Ref
- F. S. Nahm. 2016. Nonparametric statistical tests for the continuous data: The basic concept and the practical use. Korean Journal of Anesthesiology 69, 1 (2016), 8--14.Google ScholarCross Ref
- M. Neumüller, A. Reichinger, F. Rist, and C. Kern. 2014. 3D printing for cultural heritage: Preservation, accessibility, research and education. In 3D Research Challenges in Cultural Heritage. Springer, Berlin, 119--134.Google Scholar
- N. Papazafiropulos, L. Fanucci, B. Leporini, S. Pelagatti, and R. Roncella. 2016. Haptic models of arrays through 3D printing for computer science education. In Proceedings of the International Conference on Computers Helping People with Special Needs. Springer, Cham, 491--498.Google Scholar
- A. Polianytsia, O. Starkova, and K. Herasymenko. 2016. Survey of hardware IoT platforms. In Proceedings of the 3rd International Scientific-Practical Conference Problems of Infocommunications Science and Technology (PIC S8T). 152--153.Google Scholar
- B. Poppinga, C. Magnusson, M. Pielot, and K. Rassmus-Gröhn. 2011. TouchOver map: Audio-tactile exploration of interactive maps. In Proceedings of the 13th International Conference on Human Computer Interaction with Mobile Devices and Services. 545--550.Google Scholar
- L. C. Quero, J. L. Bartolomé, S. Lee, E. Han, S. Kim, and J. Cho. 2018. An interactive multimodal guide to improve art accessibility for blind people. In Proceedings of ASSETS’18. Galway, Ireland, 346--348.Google Scholar
- A. Reichinger, A. Fuhrmann, S. Maierhofer, and W. Purgathofer. 2016. Gesture-based interactive audio guide on tactile reliefs. In Proceedings of the 18th International ACM SIGACCESS Conference on Computers and Accessibility. Reno, Nevada, USA, 91--100.Google Scholar
- V. Rossetti, F. Furfari, B. Leporini, S. Pelagatti, and A. Quarta. 2018. Enabling access to cultural heritage for the visually impaired: An interactive 3D model of a cultural site. In Procedia Computer Science. Vol. 130, 383--391.Google ScholarDigital Library
- V. Rossetti, F. Furfari, B. Leporini, S. Pelagatti, and A. Quarta. 2018. Smart cultural site: An interactive 3D model accessible to people with visual impairment. In Proceedings of the IOP Conference Series: Materials Science and Engineering. Vol. 364, IOP Publishing, 012019.Google Scholar
- R. Scopigno, P. Cignoni, N. Pietroni, M. Callieri, and M. Dellepiane. 2014. Digital fabrication technologies for cultural heritage (STAR). In Proceedings of the 12th Eurographics Workshops on Graphics and Cultural Heritage. 75--85.Google Scholar
- C. Senette, M. C. Buzzi, M. Buzzi, B. Leporini, and L. Martusciello. 2013. Enriching graphic maps to enable multimodal interaction by blind people. In Proceedings of the 7th International Conference on Universal Access in Human-Computer Interaction (UAHCI’13), C. Stephanidis and M. Antona (Eds.). Lecture Notes in Computer Science, vol. 8009. Springer, New York, 2013, 576--583.Google Scholar
- L. Shi, H. Lawson, Z. Zhang, and S. Azenkot. 2019. Designing interactive 3d printed models with teachers of the visually impaired. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. 1--14.Google Scholar
- L. Shi, I. Zelzer, C. Feng, and S. Azenkot. 2016. Tickers and talker: An accessible labeling toolkit for 3D printed models. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. ACM, New York, 4896--4907.Google Scholar
- C. Springsguth and G. Weber. 2003. Design issues of relief maps for haptic display. In Proceedings of the 10th International Conference on Human-Computer Interaction, C. Stephanidis (Ed.). Crete, Greece, 1477--1481.Google Scholar
- A. F. Tatham. 1991. The design of tactile maps: Theoretical and practical considerations. mapping the nations. In Proceedings of the 15th International Cartographic Conference. Vol. 1, London ICA, 157--166.Google Scholar
- Touch Graphics. 2019. Accessed on July 5. http://touchgraphics.com/.Google Scholar
- R. Urbas, M. Pivar, and U. S. Elesini. 2016. Development of tactile floor plan for the blind and the visually impaired by 3D printing technique. Journal of Graphic Engineering and Design 7, 1 (2016), 19--26.Google ScholarCross Ref
- R. Vaz, P. O. Fernandes, and A. C. R. Veiga. 2018. Designing an interactive exhibitor for assisting blind and visually impaired visitors in tactile exploration of original museum pieces. Procedia Computer Science 138, 561--570.Google ScholarCross Ref
- Z. Wang, B. Li, T. Hedgpeth, and T. Haven. 2009. Instant tactile-audio map: enabling access to digital maps for people with visual impairment. In Proceedings of the 11th International ACM SIGACCESS Conference on Computers and Accessibility. 43--50.Google Scholar
Index Terms
- Design Guidelines for an Interactive 3D Model as a Supporting Tool for Exploring a Cultural Site by Visually Impaired and Sighted People
Recommendations
Visually Augmented Audio-Tactile Graphics for Visually Impaired People
Paper from ASSETS 2016 and Regular PapersTactile graphics play an essential role in knowledge transfer for blind people. The tactile exploration of these graphics is often challenging because of the cognitive load caused by physiological constraints and their complexity. The coupling of ...
Skim-reading Strategies in Sighted and Visually-Impaired Individuals: A Comparative Study
PETRA '18: Proceedings of the 11th PErvasive Technologies Related to Assistive Environments ConferenceAs the amount of readily available reading material increases, the ability to read selectively, or to skim-read, is becoming an important skill. In this paper, we report a comparative study of existing skim-reading strategies in sighted and visually ...
Enabling Access to Cultural Heritage for the visually impaired: an Interactive 3D model of a Cultural Site
AbstractWe have developed low cost interactive 3D models that improve access to architectural details of cultural sites for all, including people with vision impairments. Our approach uses rapid prototyping and 3D printing along with a very small single-...
Comments