research-article

The Cross-Sensory Globe: Participatory Design of a 3D Audio-Tactile Globe Prototype for Blind and Low-Vision Users to Learn Geography

Authors:

Sowmya Somanath,

Peter CoppinAuthors Info & Claims

DIS '19: Proceedings of the 2019 on Designing Interactive Systems Conference

Pages 399 - 412

https://doi.org/10.1145/3322276.3323686

Published: 18 June 2019 Publication History

Abstract

We present our participatively and iteratively designed 3D audio-tactile globe that enables blind and low-vision users to perceive geo-spatial information. Blind and low-vision users rely on learning aids such as 2D-tactile graphics, braille maps and 3D models to learn about geography. We employed participatory design as an approach to prototyping and evaluating four different iterations of a cross-sensory globe that uses 3D detachable continents to provide geo-spatial haptic information in combination with audio labels. Informed by our participatory design and evaluation, we discuss cross-sensory educational aids as an alternative to visually-oriented globes. Our findings reveal affordances of 3D-tactile models for conveying concrete features of the Earth (such as varying elevations of landforms) and audio labels for conveying abstract categories about the Earth (such as continent names). We highlight the advantages of longitudinal participatory design that includes the lived experiences and DIY innovations of blind and low-vision users and makers.

References

[1]

1858. American Printing House for the Blind, Inc.https://www.aph.org/. (1858). {Online; accessed 2018}.

[2]

2018. ALAIN MIKLI, A HANDS-ON EXPERIENCE OF ART.http://www.luxottica.com/en/alain-mikli-hands-experience-art. (2018). {Online;accessed 2018}.

[3]

2018. American Foundation for the Blind. http://elearn.afb.org/section.aspx?FolderID=23&TopicID=346.(2018).

[4]

2018. APH Interactive U.S. Map with Talking Tactile Pen.http://shop.aph.org/webapp/wcs/stores/servlet/Product_Interactive%20U.S.%20Map%20with%20Talking%20Tactile%20Pen_35920773P_10001_11051.

[5]

2018. DZB. https://www.dzb.de/index.php'site_id=8.6.3.

[6]

2100.1181.4F5/la1t2i3c5on. https://www.flaticon.com/.

[7]

2018. Instructable. https://www.instructables.com/.

[8]

2018. Intelliglobe.http://www.replogleglobes.com/

[9]

2018. PenFriend2-Voice-Labeling-System. https://www.maxiaids.com/penfriend2-voice-labeling-system.\

[10]

2018. Perkins School for the Blind.https://www.perkins.org/. (2018). {Online; accessed2018}.

[11]

2018. Smellmap.https://sensorymaps.com/portfolio/smellmap-amsterdam/.(2018). {Online; accessed 2018}.

[12]

2018. Tactile-Graphics-Illustrations-for-the-blind.https://www.behance.net/gallery/8459127/Tactile-Graphics-Illustrations-for-the-blind. (2018).

[13]

2018. Touch responsive 3D maps. https://phys.org/news/2014--11-touch-responsive-independence-visually-impaired.html. (2018). {Online; accessed 2018}.

[14]

2019. NASA-Task-Load-Index.https://humansystems.arc.nasa.gov/groups/tlx/. (2019).{Online; accessed 2019}

[15]

Jérémy Albouys-Perrois, Jérémy Laviole, Carine Briant,and Anke M Brock. 2018. Towards a multisensory augmented reality map for blind and low vision people: A participatory design approach. In Proceedings of the 2018CHI Conference on Human Factors in Computing Systems. ACM, 629.

Digital Library

[16]

Liam Bannon, Jeffrey Bardzell, and Susanne Bødker.2018. Reimagining Participatory Design.Interactions26,1 (Dec. 2018), 26--32.

Digital Library

[17]

Susanne Bødker, Christian Dindler, Kim Halskov, and Ole Sejer Iversen. 2016. Advances in Participatory Design. In Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA '16). ACM, New York, NY, USA, 984--987.

Digital Library

[18]

Nizar Bouhlel and Anis Rojbi. 2014. New Tools for Automating Tactile Geographic Map Translation. In Proceedings of the 16th International ACM SIGACCESS Conference on Computers & Accessibility (ASSETS '14). ACM, New York, NY, USA, 313--314.

Digital Library

[19]

Megen Brittell, Michal Young, and Amy Lobben. 2013. The MGIS: A Minimal Geographic Information System Accessible to Users Who Are Blind. In Proceedings of the 21st ACM SIGSPATIAL International Conference on Advances in Geographic Information Systems (SIGSPATIAL'13). ACM, New York, NY, USA, 564--567.

Digital Library

[20]

Anke Brock, Philippe Truillet, Bernard Oriola, and Christophe Jouffrais. 2010. Usage of Multimodal Maps for Blind People: Why and How. In ACM International Conference on Interactive Tabletops and Surfaces (ITS '10). ACM, New York, NY, USA, 247--248.

Digital Library

[21]

Craig Brown and Amy Hurst. 2012. VizTouch: automatically generated tactile visualizations of coordinate spaces. In Proceedings of the Sixth International Conference on Tangible, Embedded and Embodied Interaction. ACM, 131--138.

Digital Library

[22]

Emeline Brule, Gilles Bailly, Anke Brock, Frédéric Valentin, Grégoire Denis, and Christophe Jouffrais. 2016. MapSense: multi-sensory interactive maps for children living with visual impairments. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. ACM, 445--457.

Digital Library

[23]

Susan Ciccantelli and Jason Magidson. 1993. Consumer idealized design: involving consumers in the product development process. Journal of Product Innovation Management: AN INTERNATIONAL PUBLICATION OF THE PRODUCT DEVELOPMENT & MANAGEMENT ASSOCIATION 10, 4 (1993), 341--347.

[24]

Peter Coppin. 2015. What is lost in translation from visual graphics to text for accessibility. (2015).

[25]

Peter Coppin, Abrose Li, and Michael Carnevale. 2016. Iconic properties are lost when translating visual graphics to text for accessibility. Cognitive Semiotics (2016).

[26]

J Dixon. 2010. Size and Spacing of Braille Characters. Technical Report. Technical report, Braille Authority of North America (Pittsburgh, PA).

[27]

Feng Feng, Tony Stockman, Nick Bryan-Kinns, and Dena AI-Thani. 2015. An Investigation into the Comprehension of Map Information Presented in Audio. In Proceedings of the XVI International Conference on Human Computer Interaction (Interacción '15). ACM, New York, NY, USA, Article 29, 8 pages.

Digital Library

[28]

R Chris Fraley and Nathan W Hudson. 2014. Review of intensive longitudinal methods an introduction to diary and experience sampling research. (2014).

[29]

Brian Frey, Kate Rosier, Caleb Southern, and Mario Romero. 2012. From Texting App to Braille Literacy. In CHI '12 Extended Abstracts on Human Factors in Computing Systems (CHI EA '12). ACM, New York, NY, USA, 2495--2500.

Digital Library

[30]

John A Gardner. 1996. Tactile graphics: an overview and resource guide. Information Technology and Disabilities 3, 4 (1996).

[31]

Reginald G Golledge. 1993. Geography and the disabled: a survey with special reference to vision impaired and blind populations. Transactions of the Institute of British Geographers (1993), 63--85.

[32]

Timo Götzelmann and Klaus Winkler. 2015. SmartTactMaps: A Smartphone-based Approach to Support Blind Persons in Exploring Tactile Maps. In Proceedings of the 8th ACM International Conference on PErvasive Technologies Related to Assistive Environments (PETRA '15). ACM, New York, NY, USA, Article 2, 8 pages.

Digital Library

[33]

J. Guerreiro, D. Gonçalves, D. Marques, T. Guerreiro, H. Nicolau, and K. Montague. 2013. The Today and Tomorrow of Braille Learning. In Proceedings of the 15th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS '13). ACM, New York, NY, USA, Article 71, 2 pages.

Digital Library

[34]

Douglas Hagedorn. 2012. Exploring New Directions In Multi-Modal Spatial Data Access. Ph.D. Dissertation. University of Calgary.

[35]

Simon Holland, David R. Morse, and Henrik Gedenryd. 2002. AudioGPS: Spatial Audio Navigation with a Minimal Attention Interface. Personal and Ubiquitous Computing 6, 4 (01 Sep 2002), 253--259.

Digital Library

[36]

Leona Holloway, Kim Marriott, and Matthew Butler. 2018. Accessible Maps for the Blind: Comparing 3D Printed Models with Tactile Graphics. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). ACM, New York, NY, USA, Article 198, 13 pages.

Digital Library

[37]

Michele Hu. 2015. Exploring new paradigms for accessible 3D printed graphs. In Proceedings of the 17th International ACM SIGACCESS Conference on Computers & Accessibility. ACM, 365--366.

Digital Library

[38]

Aaron Karp and Bryan Pardo. 2017. HaptEQ: A Collaborative Tool For Visually Impaired Audio Producers. In Proceedings of the 12th International Audio Mostly Conference on Augmented and Participatory Sound and Music Experiences (AM '17). ACM, New York, NY, USA, Article 39, 4 pages.

Digital Library

[39]

Jeeeun Kim and Tom Yeh. 2015. Toward 3D-Printed Movable Tactile Pictures for Children with Visual Impairments. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15). ACM, New York, NY, USA, 2815--2824.

Digital Library

[40]

Martin Kurze. 1996. TDraw: A Computer-based Tactile Drawing Tool for Blind People. In Proceedings of the Second Annual ACM Conference on Assistive Technologies (Assets '96). ACM, New York, NY, USA, 131--138.

Digital Library

[41]

Steven Landau and Karen Gourgey. 2001. Development of a talking tactile tablet. Information Technology and Disabilities 7, 2 (2001).

[42]

Jack M Loomis, Reginald G Golledge, and Roberta L Klatzky. 2001. Systems for the visually impaired. Fundamentals of wearable computers and augmented reality 429 (2001).

[43]

Jack M Loomis and Susan J Lederman. 1986. Tactual perception. Handbook of perception and human performances 2 (1986), 2.

[44]

Lochlan E Magee and John M Kennedy. 1980. Exploring pictures tactually. Nature 283, 5744 (1980), 287.

[45]

Charlotte Magnusson, Konrad Tollmar, Stephen Brewster, Tapani Sarjakoski, Tiina Sarjakoski, and Samuel Roselier. 2009. Exploring Future Challenges for Haptic, Audio and Visual Interfaces for Mobile Maps and Location Based Services. In Proceedings of the 2Nd International Workshop on Location and the Web (LOCWEB '09). ACM, New York, NY, USA, Article 8, 4 pages.

Digital Library

[46]

Dorota Majchrzak, Julia Eberhard, Barbara Kalaus, and Karl-Heinz Wagner. 2017. Do Visually Impaired People Develop Superior Smell Ability? Perception 46, 10 (2017), 1171--1182.

[47]

James McCrae, Igor Mordatch, Michael Glueck, and Azam Khan. 2009. Multiscale 3D navigation. In Proceedings of the 2009 symposium on Interactive 3D graphics and games. ACM, 7--14.

Digital Library

[48]

Stephen W. Mereu and Rick wKazman. 1997. Audio Enhanced 3D Interfaces for Visually Impaired Users. SIGCAPH Comput. Phys. Handicap. 57 (Jan. 1997), 10--15.

Digital Library

[49]

Helen Petrie and Sarah Morley. 1998. The use of non-speech sounds in non-visual interfaces to the MS Windows GUI for blind computer users.Georgia Institute of Technology.

Digital Library

[50]

JeanLouis Renteux. Mentelle 3D relief globe.The passage between the Atlantic and Pacific Oceans.

[51]

Nuzhah Gooda Sahib, Tony Stockman, Anastasios Tombros, and Oussama Metatla. 2013. Participatory Design with Blind Users: A Scenario-Based Approach. In Human-Computer Interaction -- INTERACT 2013, Paula Kotzé, Gary Marsden, Gitte Lindgaard, Janet Wesson, and Marco Winckler (Eds.). Springer Berlin Heidelberg, Berlin, Heidelberg, 685--701.

[52]

Daniel TL Shek and Catalina SM Ng. 2016. Longitudinal research design in adolescent developmental research. International Journal on Disability and Human Development 15, 4 (2016), 349--358.

[53]

Brandon Taylor, Anind Dey, Dan Siewiorek, and Asim Smailagic. 2016. Customizable 3D Printed Tactile Maps As Interactive Overlays. In Proceedings of the 18th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS '16). ACM, New York, NY, USA, 71--79.

Digital Library

[54]

Radim vStampach and Eva Mul'ivckov'a. 2016.Automated generation of tactile maps. Journal of Maps 12, sup1 (2016), 532--540.

[55]

Agnieszka Walczak. 2017. Audio description on smartphones: making cinema accessible for visually impaired audiences. Universal Access in the Information Society (01 Aug 2017).

Digital Library

[56]

Zheshen Wang, Baoxin Li, Terri Hedgpeth, and Teresan Haven. 2009. Instant Tactile-audio Map: Enabling Access to Digital Maps for People with Visual Impairment. In Proceedings of the 11th International ACM SIGACCESS Conference on Computers and Accessibility (Assets '09). ACM, New York, NY, USA, 43--50.

Digital Library

[57]

Takako Yoshida, Ayumi Yamaguchi, Hideomi Tsutsui,n and Tenji Wake. 2015. Tactile search for change has less memory than visual search for change. Attention, Perception, & Psychophysics 77, 4 (01 May 2015), 1200--1211.

[58]

Limin Zeng and Gerhard Weber. 2010. Audio-haptic browser for a geographical information system. In International Conference on Computers for Handicapped Persons. Springer, 466--473.

Digital Library

[59]

Limin Zeng and Gerhard Weber. 2011. Accessible maps for the visually impaired. In Proceedings of IFIP INTERACT 2011 Workshop on ADDW, CEUR, Vol. 792. 54--60.

Cited By

Vargas PTrevisan D(2024)Revisiting visual accessibility with non-textual content: challenges and solutions for human-computer interactionProceedings of the XXIII Brazilian Symposium on Human Factors in Computing Systems10.1145/3702038.3702105(1-18)Online publication date: 7-Oct-2024
https://dl.acm.org/doi/10.1145/3702038.3702105
Zhang SLin WLi ZJiang RLiang CFan MMasu R(2024)Beadwork Bridge: Understanding and Exploring the Opportunities of Beadwork in Enriching School Education for Blind and Low Vision (BLV) PeopleProceedings of the 26th International ACM SIGACCESS Conference on Computers and Accessibility10.1145/3663548.3675623(1-14)Online publication date: 27-Oct-2024
https://dl.acm.org/doi/10.1145/3663548.3675623
Lu LCrispin CGirouard A(2024)"We Musicians Know How to Divide and Conquer": Exploring Multimodal Interactions To Improve Music Reading and Memorization for Blind and Low Vision LearnersProceedings of the 26th International ACM SIGACCESS Conference on Computers and Accessibility10.1145/3663548.3675604(1-14)Online publication date: 27-Oct-2024
https://dl.acm.org/doi/10.1145/3663548.3675604
Show More Cited By

Index Terms

The Cross-Sensory Globe: Participatory Design of a 3D Audio-Tactile Globe Prototype for Blind and Low-Vision Users to Learn Geography
1. Human-centered computing
  1. Accessibility
    1. Accessibility design and evaluation methods
  2. Interaction design
    1. Interaction design process and methods
      1. Participatory design

Recommendations

Towards a Multisensory Augmented Reality Map for Blind and Low Vision People: a Participatory Design Approach
CHI '18: Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems

Current low-tech Orientation & Mobility (O&M) tools for visually impaired people, e.g. tactile maps, possess limitations. Interactive accessible maps have been developed to overcome these. However, most of them are limited to exploration of existing maps,...
Blind tennis: extreme users and participatory design
PDC '14: Proceedings of the 13th Participatory Design Conference: Short Papers, Industry Cases, Workshop Descriptions, Doctoral Consortium papers, and Keynote abstracts - Volume 2

We explore questions related to materiality, participation, and inclusive design that arise from a series of events involving the design and prototyping of a tennis ball for use in 'blind tennis.' We observed that the blind user-designers were full ...
Low Vision Boxing: Participatory Design of Adaptive Kickboxing Experiences with Low Vision Person
ASSETS '24: Proceedings of the 26th International ACM SIGACCESS Conference on Computers and Accessibility

Visually impaired individuals often face challenges related to physical inactivity, stemming from limited accessibility to sports activities. While assistive technologies and adaptive sports have made progress, high-intensity contact sports remain ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

DIS '19: Proceedings of the 2019 on Designing Interactive Systems Conference

June 2019

1628 pages

ISBN:9781450358507

DOI:10.1145/3322276

General Chairs:
Steve Harrison
Virginia Tech, USA
,
Shaowen Bardzell
Indiana University, USA
,
Program Chairs:
Carman Neustaedter
Simon Fraser University, Canada
,
Deborah Tatar
Virginia Tech, USA

Copyright © 2019 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 18 June 2019

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

National Science and Engineering Council (NSERC)
Collaborative Research and Training Experience (CREATE) Program on Data Analytics and Visualization (DAV)

Conference

DIS '19

Sponsor:

SIGCHI

DIS '19: Designing Interactive Systems Conference 2019

June 23 - 28, 2019

CA, San Diego, USA

Acceptance Rates

DIS '19 Paper Acceptance Rate 105 of 415 submissions, 25%;

Overall Acceptance Rate 1,158 of 4,684 submissions, 25%

Upcoming Conference

DIS '25

Sponsor:
sigchi

Designing Interactive Systems Conference

July 5 - 9, 2025

Funchal , Portugal

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

20
Total Citations
View Citations
763
Total Downloads

Downloads (Last 12 months)96
Downloads (Last 6 weeks)6

Reflects downloads up to 05 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Vargas PTrevisan D(2024)Revisiting visual accessibility with non-textual content: challenges and solutions for human-computer interactionProceedings of the XXIII Brazilian Symposium on Human Factors in Computing Systems10.1145/3702038.3702105(1-18)Online publication date: 7-Oct-2024
https://dl.acm.org/doi/10.1145/3702038.3702105
Zhang SLin WLi ZJiang RLiang CFan MMasu R(2024)Beadwork Bridge: Understanding and Exploring the Opportunities of Beadwork in Enriching School Education for Blind and Low Vision (BLV) PeopleProceedings of the 26th International ACM SIGACCESS Conference on Computers and Accessibility10.1145/3663548.3675623(1-14)Online publication date: 27-Oct-2024
https://dl.acm.org/doi/10.1145/3663548.3675623
Lu LCrispin CGirouard A(2024)"We Musicians Know How to Divide and Conquer": Exploring Multimodal Interactions To Improve Music Reading and Memorization for Blind and Low Vision LearnersProceedings of the 26th International ACM SIGACCESS Conference on Computers and Accessibility10.1145/3663548.3675604(1-14)Online publication date: 27-Oct-2024
https://dl.acm.org/doi/10.1145/3663548.3675604
Wang XKayukawa STakagi HAsakawa C(2024)BentoMuseum: 3D and Layered Interactive Museum Map for Blind VisitorsCommunications of the ACM10.1145/361767867:11(93-102)Online publication date: 3-Oct-2024
https://dl.acm.org/doi/10.1145/3617678
Reinhardt DHolloway LThogersen JGuerry EDiaz CHavellas WPoronnik P(2024)The Museum of Touch: Tangible Models for Blind and Low Vision Audiences in MuseumsMultimodality in Architecture10.1007/978-3-031-49511-3_8(135-155)Online publication date: 13-Jan-2024
https://doi.org/10.1007/978-3-031-49511-3_8
Reinders SAnanthanarayan SButler MMarriott K(2023)Designing Conversational Multimodal 3D Printed Models with People who are BlindProceedings of the 2023 ACM Designing Interactive Systems Conference10.1145/3563657.3595989(2172-2188)Online publication date: 10-Jul-2023
https://dl.acm.org/doi/10.1145/3563657.3595989
Sargsyan EOriola BMacé MSerrano MJouffrais C(2023)3D Printed Interactive Multi-Storey Model for People with Visual ImpairmentsProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581304(1-15)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3581304
Wang XKayukawa STakagi HAsakawa C(2022)BentoMuseum: 3D and Layered Interactive Museum Map for Blind VisitorsProceedings of the 24th International ACM SIGACCESS Conference on Computers and Accessibility10.1145/3517428.3544811(1-14)Online publication date: 23-Oct-2022
https://dl.acm.org/doi/10.1145/3517428.3544811
Darin TAndrade RSánchez J(2022)Usability evaluation of multimodal interactive virtual environments for learners who are blindInternational Journal of Human-Computer Studies10.1016/j.ijhcs.2021.102732158:COnline publication date: 3-Jan-2022
https://dl.acm.org/doi/10.1016/j.ijhcs.2021.102732
Barter DCoppin P(2022)A Diagram Must Never Be Ten Thousand Words: Text-Based (Sentential) Approaches to Diagrams Accessibility Limit Users’ Potential for Normative AgencyDiagrammatic Representation and Inference10.1007/978-3-031-15146-0_7(86-93)Online publication date: 7-Sep-2022
https://doi.org/10.1007/978-3-031-15146-0_7
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten