Abstract
A mobile application that detects an item’s color is potentially very useful for visually impaired people. However, users could run into difficulties when centering the target item in the mobile device camera field of view. To address this problem, in this contribution we propose a mobile application that detects the color of the item pointed by the user with one finger. In its current version, the application requires the user to wear a marker on the finger used for pointing. A preliminary evaluation conducted with blind users confirms the usefulness of the application, and encourages further development.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
- 2.
- 3.
- 4.
- 5.
Examples are the “See Color” and “ColorVisor” apps, available on the AppStore.
- 6.
Henceforth we refer to these people as “blind people” or “blind users”.
- 7.
- 8.
References
Mascetti, S., Ahmetovic, D., Gerino, A., Bernareggi, C., Busso, M., Rizzi, A.: Robust traffic lights detection on mobile devices for pedestrians with visual impairment. Comput. Vis. Image Underst. (in press)
Mascetti, S., Picinali, L., Gerino, A., Ahmetovic, D., Bernareggi, C.: Sonification of guidance data during road crossing for people with visual impairments or blindness. Int. J. Hum.-Comput. Stud. 85, 16–26 (2015)
Ahmetovic, D., Manduchi, R., Coughlan, J., Mascetti, S.: Zebra crossing spotter: automatic population of spatial databases for increased safety of blind travelers. In: Proceedings of the 17th International ACM SIGACCESS Conference on Computers and Accessibility (2015)
Manduchi, R., Coughlan, J., Miesenberger, K., Coughlan, J.M., Shen, H.: Crosswatch: a system for providing guidance to visually impaired travelers at traffic intersection. J. Assist. Technol. 7(2), 131–142 (2013)
Hara, K., Azenkot, S., Campbell, M., Bennett, C.L., Le, V., Pannella, S., Moore, R., Minckler, K., Ng, R.H., Froehlich, J.E.: Improving public transit accessibility for blind riders by crowdsourcing bus stop landmark locations with google street view: an extended analysis. ACM Trans. Accessible Comput. (TACCESS) 6(2) (2015). (5)
Brady, E.L., Sato, D., Ruan, C., Takagi, H., Asakawa, C.: Exploring interface design for independent navigation by people with visual impairments. In: Proceedings of the 17th International ACM SIGACCESS Conference on Computers & Accessibility, pp. 387–388. ACM (2015)
Baldauf, M., Zambanini, S., Fröhlich, P., Reichl, P.: Markerless visual fingertip detection for natural mobile device interaction. In: Proceedings of the 13th International Conference on Human Computer Interaction with Mobile Devices and Services, pp. 539–544. ACM (2011)
Chun, W.H., Höllerer, T.: Real-time hand interaction for augmented reality on mobile phones. In: Proceedings of the 2013 International Conference on Intelligent User Interfaces, pp. 307–314. ACM (2013)
Tanuwidjaja, E., Huynh, D., Koa, K., Nguyen, C., Shao, C., Torbett, P., Emmenegger, C., Weibel, N.: Chroma: a wearable augmented-reality solution for color blindness. In: Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing, UbiComp 2014, pp. 799–810. ACM, New York (2014)
Popleteev, A., Louveton, N., McCall, R.: Colorizer: smart glasses aid for the colorblind. In: Proceedings of the 2015 Workshop on Wearable Systems and Applications, WearSys 2015, pp. 7–8. ACM, New York (2015)
Manaf, A.S., Sari, R.F.: Color recognition system with augmented reality concept and finger interaction: case study for color blind aid system. In: 2011 9th International Conference on ICT and Knowledge Engineering (ICT & Knowledge Engineering), pp. 118–123. IEEE (2012)
Abboud, S., Hanassy, S., Levy-Tzedek, S., Maidenbaum, S., Amedi, A.: Eyemusic: introducing a visual colorful experience for the blind using auditory sensory substitution. Restorative Neurol. Neurosci. 32(2), 247–257 (2014)
Bologna, G., Gomez, J.D., Pun, T.: Vision substitution experiments with see colOr. In: Ferrández Vicente, J.M., Álvarez Sánchez, J.R., de la Paz López, F., Toledo Moreo, F.J. (eds.) IWINAC 2013, Part I. LNCS, vol. 7930, pp. 83–93. Springer, Heidelberg (2013)
Findlater, L., Stearns, L., Du, R., Oh, U., Ross, D., Chellappa, R., Froehlich, J.: Supporting everyday activities for persons with visual impairments through computer vision-augmented touch. In: Proceedings of the 17th International ACM SIGACCESS Conference on Computers & #38; Accessibility, ASSETS 2015, pp. 383–384. ACM, New York (2015)
Berlin, B., Kay, P.: Basic Color Terms: Their Universality and Evolution. University of California Press, Berkeley (1991)
Acknowledgments
The work of Andrea Gerino, Cristian Bernareggi and Sergio Mascetti was partially supported by grant “fondo supporto alla ricerca 2015” under project “Assistive technologies on mobile devices”. The work of Alessandro Rizzi was partially supported by grant “fondo supporto alla ricerca 2015” under project “Discovering Patterns in Multi-Dimensional Data”.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2016 Springer International Publishing Switzerland
About this paper
Cite this paper
Mascetti, S., Rossetti, C., Gerino, A., Bernareggi, C., Picinali, L., Rizzi, A. (2016). Towards a Natural User Interface to Support People with Visual Impairments in Detecting Colors. In: Miesenberger, K., Bühler, C., Penaz, P. (eds) Computers Helping People with Special Needs. ICCHP 2016. Lecture Notes in Computer Science(), vol 9758. Springer, Cham. https://doi.org/10.1007/978-3-319-41264-1_23
Download citation
DOI: https://doi.org/10.1007/978-3-319-41264-1_23
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-41263-4
Online ISBN: 978-3-319-41264-1
eBook Packages: Computer ScienceComputer Science (R0)