research-article

”I can’t name it, but I can perceive it” Conceptual and Operational Design of ”Tactile Accuracy” Assisting Tactile Image Cognition

Authors:

Yingqing XuAuthors Info & Claims

ASSETS '20: Proceedings of the 22nd International ACM SIGACCESS Conference on Computers and Accessibility

Article No.: 18, Pages 1 - 12

https://doi.org/10.1145/3373625.3417015

Published: 29 October 2020 Publication History

ASSETS '20: Proceedings of the 22nd International ACM SIGACCESS Conference on Computers and Accessibility

”I can’t name it, but I can perceive it” Conceptual and Operational Design of ”Tactile Accuracy” Assisting Tactile Image Cognition

Pages 1 - 12

Abstract
References

Abstract

Designing a tactile image for blind people is a significant challenge due to the difficulty of recognizing objects on a 2D line drawing image by touch compared to vision. In this paper, we proposed ”tactile accuracy”, a new criterion to evaluate the performance of recognizing 242 raised line images of common objects for 30 subjects (10 blindfolded sighted subjects, 10 congenitally blind subjects, and 10 late blind subjects), instead of the conventional ”naming accuracy” used in the visual image recognition tasks. We used multi-level evaluation criteria including ”tactile accuracy” to systematically analyze the design factors in tactile images. The results showed that using multi-level evaluate criteria could help unveil the tactile cognitive preferences of different types of subjects for personalized learning. Moreover, we reported important design factors that affect tactile image recognition, thus providing guidelines on the design of tactile images.

References

[1]

Yacine Bellik and Celine Clavel. 2017. Geometrical shapes rendering on a dot-matrix display. In International Conference on Intelligent Human Computer Interaction. Springer, Cham, 8–18.

[2]

Cynthia L Bennett, Martez E Mott, Edward Cutrell, Meredith Ringel Morris, 2018. How teens with visual impairments take, edit, and share photos on social media. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. ACM, 76.

Digital Library

[3]

Stephen Brewster and Lorna M Brown. 2004. Tactons: structured tactile messages for non-visual information display. In Proceedings of the fifth conference on Australasian user interface-Volume 28. Australian Computer Society, Inc., 15–23.

Digital Library

[4]

Stefano Cecchetto and Rebecca Lawson. 2017. Regularity detection by haptics and vision.Journal of Experimental Psychology: Human Perception and Performance 43, 1(2017), 103.

[5]

Giovanni Fusco and Valerie S Morash. 2015. The tactile graphics helper: providing audio clarification for tactile graphics using machine vision. In Proceedings of the 17th International ACM SIGACCESS Conference on Computers & Accessibility. 97–106.

Digital Library

[6]

Susan A Gelman. 1988. The development of induction within natural kind and artifact categories. Cognitive psychology 20, 1 (1988), 65–95.

[7]

Martin Grunwald, Manivannan Muniyandi, Hyun Kim, Jung Kim, Frank Krause, Stephanie Mueller, and Mandayam A Srinivasan. 2014. Human haptic perception is interrupted by explorative stops of milliseconds. Frontiers in psychology 5 (2014), 292.

[8]

Yvette Hatwell, Arlette Streri, and Edouard Gentaz. 2003. Touching for knowing: cognitive psychology of haptic manual perception. Vol. 53. John Benjamins Publishing.

[9]

Morton A Heller, Deneen D Brackett, Eric Scroggs, Heather Steffen, Kim Heatherly, and Shana Salik. 2002. Tangible pictures: Viewpoint effects and linear perspective in visually impaired people. Perception 31, 6 (2002), 747–769.

[10]

Morton A Heller, John M Kennedy, Ashley Clark, Melissa McCarthy, Amber Borgert, Lindsay Wemple, Erin Fulkerson, Nicole Kaffel, Amy Duncan, and Tara Riddle. 2006. Viewpoint and orientation influence picture recognition in the blind. Perception 35, 10 (2006), 1397–1420.

[11]

Morton A Heller, Melissa McCarthy, and Ashley Clark. 2005. Pattern perception and pictures for the blind. Psicologica 26, 1 (2005), 161–171.

[12]

Morton A Heller, Tara Riddle, Erin Fulkerson, Lindsay Wemple, Anne McClure Walk, Stephanie Guthrie, Crystal Kranz, and Patricia Klaus. 2009. The influence of viewpoint and object detail in blind people when matching pictures to complex objects. Perception 38, 8 (2009), 1234–1250.

[13]

Chandrika Jayant, Matt Renzelmann, Dana Wen, Satria Krisnandi, Richard Ladner, and Dan Comden. 2007. Automated tactile graphics translation: in the field. In Proceedings of the 9th international ACM SIGACCESS conference on Computers and accessibility. 75–82.

Digital Library

[14]

Tong Qu Ye Liu Xiaolan Fu Jiangtao Gong, Wenyuan Yu and Yingqing Xu. 2018. Quantitative analysis of factors affecting tactile image recognition. Journal of Computer-Aided Design & Computer Graphics2018 year 08 (2018), 1438–1445.

[15]

Amy Kalia, Rose Hopkins, David Jin, Lindsay Yazzolino, Svena Verma, Lotfi Merabet, Flip Phillips, and Pawan Sinha. 2014. Perception of tactile graphics: Embossings versus cutouts. Multisensory research 27, 2 (2014), 111–125.

[16]

Amy A Kalia and Pawan Sinha. 2011. Tactile picture recognition: Errors are in shape acquisition or object matching. Seeing and Perceiving 24(2011), 1–16.

[17]

John M Kennedy and Paul Gabias. 1986. Metaphoric devices in drawings of motion mean the same to the blind and the sighted. Perception 15, 2 (1986), 189–195.

[18]

John M Kennedy and Igor Juricevic. 2006. Foreshortening, convergence and drawings from a blind adult. Perception 35, 6 (2006), 847–851.

[19]

Simon Lacey and Krishnankutty Sathian. 2014. Visuo-haptic multisensory object recognition, categorization, and representation. Frontiers in psychology 5 (2014), 730.

[20]

Samuel Lebaz, Christophe Jouffrais, and Delphine Picard. 2012. Haptic identification of raised-line drawings: High visuospatial imagers outperform low visuospatial imagers. Psychological Research 76, 5 (2012), 667–675.

[21]

Susan J Lederman, Roberta L Klatzky, Cynthia Chataway, and Craig D Summers. 1990. Visual mediation and the haptic recognition of two-dimensional pictures of common objects. Perception & psychophysics 47, 1 (1990), 54–64.

[22]

Matthew R Longo and Olga Golubova. 2017. Mapping the internal geometry of tactile space.Journal of Experimental Psychology: Human Perception and Performance 43, 10(2017), 1815.

[23]

Jack M Loomis, Roberta L Klatzky, and Susan J Lederman. 1991. Similarity of tactual and visual picture recognition with limited field of view. Perception 20, 2 (1991), 167–177.

[24]

Haley MacLeod, Cynthia L Bennett, Meredith Ringel Morris, and Edward Cutrell. 2017. Understanding blind people’s experiences with computer-generated captions of social media images. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. ACM, 5988–5999.

Digital Library

[25]

Lochlan E Magee and John M Kennedy. 1980. Exploring pictures tactually. Nature 283, 5744 (1980), 287.

[26]

Anaïs Mazella, Jean-Michel Albaret, and Delphine Picard. 2018. The development of haptic processing skills from childhood to adulthood by means of two-dimensional materials.Canadian Journal of Experimental Psychology/Revue canadienne de psychologie expérimentale 72, 1 (2018), 48.

[27]

Ken McRae, Virginia R De Sa, and Mark S Seidenberg. 1997. On the nature and scope of featural representations of word meaning.Journal of Experimental Psychology: General 126, 2 (1997), 99.

[28]

Giuseppe Melfi, Karin Müller, Thorsten Schwarz, Gerhard Jaworek, and Rainer Stiefelhagen. 2020. Understanding what you feel: A Mobile Audio-Tactile System for Graphics Used at Schools with Students with Visual Impairment. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. 1–12.

Digital Library

[29]

Valerie S Morash, Allison E Connell Pensky, Steven TW Tseng, and Joshua A Miele. 2014. Effects of using multiple hands and fingers on haptic performance in individuals who are blind. Perception 43, 6 (2014), 569–588.

[30]

Meredith Ringel Morris, Annuska Zolyomi, Catherine Yao, Sina Bahram, Jeffrey P Bigham, and Shaun K Kane. 2016. With most of it being pictures now, I rarely use it: Understanding Twitter’s Evolving Accessibility to Blind Users. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. ACM, 5506–5516.

Digital Library

[31]

Krista E Overvliet and Ralf Th Krampe. 2018. Haptic two-dimensional shape identification in children, adolescents, and young adults. Journal of experimental child psychology 166 (2018), 567–580.

[32]

Krista E Overvliet, Johan Wagemans, and Ralf T Krampe. 2013. The effects of aging on haptic 2D shape recognition.Psychology and aging 28, 4 (2013), 1057.

[33]

D Picard, JM Albaret, and A Mazella. 2013. Haptic identification of raised-line drawings by children, adolescents and young adults: An age-related skill. Haptics-e 5, 2 (2013), 24–8.

[34]

Delphine Picard, Jean-Michel Albaret, and Anaïs Mazella. 2014. Haptic identification of raised-line drawings when categorical information is given: A comparison between visually impaired and sighted children.Psicologica: International Journal of Methodology and Experimental Psychology 35, 2 (2014), 277–290.

[35]

Delphine Picard, Samuel Lebaz, Christophe Jouffrais, and Catherine Monnier. 2010. Haptic recognition of two-dimensional raised-line patterns by early-blind, late-blind, and blindfolded sighted adults. Perception 39, 2 (2010), 224–235.

[36]

Delphine Picard and Catherine Monnier. 2009. Short-term memory for spatial configurations in the tactile modality: A comparison with vision. Memory 17, 8 (2009), 789–801.

[37]

Linda Pring and J Rusted. 1985. Pictures for the blind: An investigation of the influence of pictures on recall of text by blind children. British Journal of Developmental Psychology 3, 1 (1985), 41–45.

[38]

Zhang Qingfang and Yang Yufang. 2003. THE DETERMINERS OF PICTURE-NAMING LATENCY [J]. Acta Psychologica Sinica 4 (2003).

[39]

Elliot Salisbury, Ece Kamar, and Meredith Ringel Morris. 2017. Toward scalable social alt text: conversational crowdsourcing as a tool for refining vision-to-language technology for the blind. In Fifth AAAI Conference on Human Computation and Crowdsourcing.

[40]

Lei Shi, Ross McLachlan, Yuhang Zhao, and Shiri Azenkot. 2016. Magic touch: Interacting with 3D printed graphics. In Proceedings of the 18th International ACM SIGACCESS Conference on Computers and Accessibility. 329–330.

Digital Library

[41]

Joan G Snodgrass and Mary Vanderwart. 1980. A standardized set of 260 pictures: norms for name agreement, image agreement, familiarity, and visual complexity.Journal of experimental psychology: Human learning and memory 6, 2(1980), 174.

[42]

Abigale Stangl, Jeeeun Kim, and Tom Yeh. 2014. 3D printed tactile picture books for children with visual impairments: a design probe. In Proceedings of the 2014 conference on Interaction design and children. 321–324.

Digital Library

[43]

Anne Theurel, Arnaud Witt, Philippe Claudet, Yvette Hatwell, and Edouard Gentaz. 2013. Tactile picture recognition by early blind children: the effect of illustration technique.Journal of experimental psychology: Applied 19, 3 (2013), 233.

[44]

Iuliana Toderita, Stéphanie Bourgeon, Julien IA Voisin, and C Elaine Chapman. 2014. Haptic two-dimensional angle categorization and discrimination. Experimental brain research 232, 2 (2014), 369–383.

[45]

Fernando Vidal-Verdú and Moustapha Hafez. 2007. Graphical tactile displays for visually-impaired people. IEEE Transactions on neural systems and rehabilitation engineering 15, 1(2007), 119–130.

[46]

Annie Vinter, Viviane Fernandes, Oriana Orlandi, and Pascal Morgan. 2012. Exploratory procedures of tactile images in visually impaired and blindfolded sighted children: How they relate to their consequent performance in drawing. Research in Developmental Disabilities 33, 6 (2012), 1819–1831.

[47]

Thorsten Völkel, Gerhard Weber, and Ulrich Baumann. 2008. Tactile graphics revised: the novel brailledis 9000 pin-matrix device with multitouch input. In International Conference on Computers for Handicapped Persons. Springer, 835–842.

Digital Library

[48]

Violeta Voykinska, Shiri Azenkot, Shaomei Wu, and Gilly Leshed. 2016. How blind people interact with visual content on social networking services. In Proceedings of the 19th ACM Conference on Computer-Supported Cooperative Work & Social Computing. ACM, 1584–1595.

Digital Library

[49]

Maarten WA Wijntjes and Astrid ML Kappers. 2007. Angle discrimination in raised-line drawings. Perception 36, 6 (2007), 865–879.

[50]

Maarten WA Wijntjes, Thijs Van Lienen, Ilse M Verstijnen, and Astrid ML Kappers. 2008. The influence of picture size on recognition and exploratory behaviour in raised-line drawings. Perception 37, 4 (2008), 602–614.

[51]

Takako Yoshida, Ayumi Yamaguchi, Hideomi Tsutsui, and Tenji Wake. 2015. Tactile search for change has less memory than visual search for change. Attention, Perception, & Psychophysics 77, 4 (2015), 1200–1211.

[52]

Jiabin Yu, Qiong Wu, Jiajia Yang, Satoshi Takahashi, Yoshimichi Ejima, and Jinglong Wu. 2017. A study of shape discrimination for tactile guide maps. In 2017 IEEE International Conference on Mechatronics and Automation (ICMA). IEEE, 565–570.

Digital Library

[53]

Yuhang Zhao, Shaomei Wu, Lindsay Reynolds, and Shiri Azenkot. 2017. The Effect of Computer-Generated Descriptions on Photo-Sharing Experiences of People with Visual Impairments. Proceedings of the ACM on Human-Computer Interaction 1, CSCW(2017), 121.

Digital Library

[54]

Yuhang Zhao, Shaomei Wu, Lindsay Reynolds, and Shiri Azenkot. 2018. A Face Recognition Application for People with Visual Impairments: Understanding Use Beyond the Lab. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. ACM, 215.

Digital Library

Cited By

Vargas PTrevisan D(2024)Revisiting visual accessibility with non-textual content: challenges and solutions for human-computer interactionProceedings of the XXIII Brazilian Symposium on Human Factors in Computing Systems10.1145/3702038.3702105(1-18)Online publication date: 7-Oct-2024
https://dl.acm.org/doi/10.1145/3702038.3702105
Bhatnagar TUpadhyay VSharma ARao PMiodownik MMarquardt NHolloway C(2023)Pixelated Interactions: Exploring Pixel Art for Graphical Primitives on a Pin Array Tactile DisplayProceedings of the 2023 ACM Designing Interactive Systems Conference10.1145/3563657.3596044(1194-1208)Online publication date: 10-Jul-2023
https://dl.acm.org/doi/10.1145/3563657.3596044
Chang RYong SLiao FTsao CChen B(2023)Understanding (Non-)Visual Needs for the Design of Laser-Cut ModelsProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580684(1-20)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3580684
Show More Cited By

Index Terms

”I can’t name it, but I can perceive it” Conceptual and Operational Design of ”Tactile Accuracy” Assisting Tactile Image Cognition

Index terms have been assigned to the content through auto-classification.

Recommendations

Comparison of reading accuracy between tactile pie charts and tactile band charts
ASSETS '13: Proceedings of the 15th International ACM SIGACCESS Conference on Computers and Accessibility

We compared the accuracy of reading tactile pie charts and reading tactile band charts with sighted and blind students as participants. They were presented with a set of tactile pie charts and band charts with individual division ratios and asked to ...
Tactile graphics with a voice: using QR codes to access text in tactile graphics
ASSETS '14: Proceedings of the 16th international ACM SIGACCESS conference on Computers & accessibility

Textbook figures are often converted into a tactile format for access by blind students. These figures are not truly accessible unless the text within the figures is also made accessible. A common solution to access text in a tactile image is to use ...
Interactive audio-tactile maps for visually impaired people

Visually impaired people face important challenges related to orientation and mobility. Indeed, 56% of visually impaired people in France declared having problems concerning autonomous mobility [10]. These problems often mean that visually impaired ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

ASSETS '20: Proceedings of the 22nd International ACM SIGACCESS Conference on Computers and Accessibility

October 2020

764 pages

ISBN:9781450371032

DOI:10.1145/3373625

Editors:
Tiago Guerreiro
University of Lisbon, Portugal
,
Hugo Nicolau
INESC-ID, Portugal
,
Karyn Moffatt
McGill University, Canada

Copyright © 2020 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

SIGACCESS: ACM Special Interest Group on Accessible Computing

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 29 October 2020

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tag

Tactile accuracy;Blind users;Tactile image design;User evaluation

Qualifiers

Research-article
Research
Refereed limited

Funding Sources

the National Natural Science Foundation of China
the National Key Research and Development Plan
the grant of the National Natural Science Foundation of China
the German Research Foundation (DFG) and the National Natural Science Foundation of China in project Crossmodal Learning

Conference

ASSETS '20

Sponsor:

SIGACCESS

ASSETS '20: The 22nd International ACM SIGACCESS Conference on Computers and Accessibility

October 26 - 28, 2020

Virtual Event, Greece

Acceptance Rates

ASSETS '20 Paper Acceptance Rate 46 of 167 submissions, 28%;

Overall Acceptance Rate 436 of 1,556 submissions, 28%

Upcoming Conference

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

5
Total Citations
View Citations
369
Total Downloads

Downloads (Last 12 months)32
Downloads (Last 6 weeks)2

Reflects downloads up to 08 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Vargas PTrevisan D(2024)Revisiting visual accessibility with non-textual content: challenges and solutions for human-computer interactionProceedings of the XXIII Brazilian Symposium on Human Factors in Computing Systems10.1145/3702038.3702105(1-18)Online publication date: 7-Oct-2024
https://dl.acm.org/doi/10.1145/3702038.3702105
Bhatnagar TUpadhyay VSharma ARao PMiodownik MMarquardt NHolloway C(2023)Pixelated Interactions: Exploring Pixel Art for Graphical Primitives on a Pin Array Tactile DisplayProceedings of the 2023 ACM Designing Interactive Systems Conference10.1145/3563657.3596044(1194-1208)Online publication date: 10-Jul-2023
https://dl.acm.org/doi/10.1145/3563657.3596044
Chang RYong SLiao FTsao CChen B(2023)Understanding (Non-)Visual Needs for the Design of Laser-Cut ModelsProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580684(1-20)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3580684
Lee JHerskovitz JPeng YGuo A(2022)ImageExplorer: Multi-Layered Touch Exploration to Encourage Skepticism Towards Imperfect AI-Generated Image CaptionsProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3501966(1-15)Online publication date: 29-Apr-2022
https://dl.acm.org/doi/10.1145/3491102.3501966
Jiao YWang QXu Y(2022)Graphical Tactile Display Application: Design of Digital Braille Textbook and Initial FindingsHaptic Interaction10.1007/978-3-031-46839-1_10(121-134)Online publication date: 12-Nov-2022
https://dl.acm.org/doi/10.1007/978-3-031-46839-1_10

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Figures

Tables

Media

View Table of Conten