Alexander J. Medeiros
Jon E. Froehlich
ABSTRACT
We investigate clothing color and visual texture recognition using images from a finger-mounted camera to support people with visual impairments. Our approach mitigates issues with distance and lighting that can impact the accuracy of existing color and texture recognizers and allows for easy touch-based interrogation to better understand clothing appearance. We classify image textures by combining two off-the-shelf techniques commonly used for object recognition achieving 99.4% accuracy on a dataset of 520 clothing images across 9 texture categories. We close with a discussion of potential applications, user evaluation plans, and open questions.
- Achanta, R., et al.. 2012. SLIC Superpixels Compared to State-of-the-Art Superpixel Methods. TPAMI. 34, 11: 2274-2282. Google Scholar
Digital Library
- Brytech Color Teller: http://www.brytech.com/colorteller/.Google Scholar
- Burton, M.A., et al.. 2012. Crowdsourcing Subjective Fashion Advice Using VizWiz: Challenges and Opportunities. Proc. ASSETS 2012, 135-142. Google ScholarDigital Library
- Cimpoi, M., et al.. 2014. Describing Textures in the Wild. Proc. CVPR 2014, 3606-3613. Google ScholarDigital Library
- GreenGar Studios. Color Identifier: https://itunes.apple.com/ us/app/color-identifier/id363346987?mt=8.Google Scholar
- Findlater, L., et al.. 2015. Supporting Everyday Activities for Persons with Visual Impairments Through Computer Vision-Augmented Touch. Proc. ASSETS 2015, 383-384. Google ScholarDigital Library
- Krizhevsky, A., et al.. 2012. ImageNet classification with deep convolutional neural networks. Proc. NIPS 2012, 1097-1105. Google ScholarDigital Library
- Lowe, D.G. 2004. Distinctive image features from scale-invariant keypoints. IJCV. 60, 2 (2004), 91-110. Google ScholarDigital Library
- Perronnin, F., Sánchez, J. and Mensink, T. 2010. Improving the Fisher Kernel for Large-Scale Image Classification. Springer, Berlin, Heidelberg. 143-156. Google ScholarDigital Library
- Stearns, L., et al. 2016. Evaluating Haptic and Auditory Directional Guidance to Assist Blind People in Reading Printed Text Using Finger-Mounted Cameras. TACCESS. 9, 1: 1-38. Google ScholarDigital Library
- Tian, Y. and Yuan, S. 2010. Clothes Matching for Blind and Color Blind People. Computers Helping People with Special Needs SE - 48. Springer Berlin Heidelberg. 324-331. Google ScholarDigital Library
- Yang, X.-D., et al.. 2012. Magic finger: always-available input through finger instrumentation. Proc. UIST 2012, 147-156. Google ScholarDigital Library
- Yuan, S., et al.. 2011. Clothing matching for visually impaired persons. Technology and Disability. 23, 2 (Jan. 2011), 75-85.Google ScholarCross Ref
Index Terms
- Recognizing Clothing Colors and Visual Textures Using a Finger-Mounted Camera: An Initial Investigation
Recommendations
Recognizing clothes patterns for blind people by confidence margin based feature combination
MM '11: Proceedings of the 19th ACM international conference on MultimediaClothes pattern recognition is a challenging task for blind or visually impaired people. Automatic clothes pattern recognition is also a challenging problem in computer vision due to the large pattern variations. In this paper, we present a new method ...
Investigating Cursor-based Interactions to Support Non-Visual Exploration in the Real World
ASSETS '18: Proceedings of the 20th International ACM SIGACCESS Conference on Computers and AccessibilityThe human visual system processes complex scenes to focus attention on relevant items. However, blind people cannot visually skim for an area of interest. Instead, they use a combination of contextual information, knowledge of the spatial layout of ...
Feature extraction based on co-occurrence of adjacent local binary patterns
PSIVT'11: Proceedings of the 5th Pacific Rim conference on Advances in Image and Video Technology - Volume Part IIIn this paper, we propose a new image feature based on spatial co-occurrence among micropatterns, where each micropattern is represented by a Local Binary Pattern (LBP). In conventional LBP-based features such as LBP histograms, all the LBPs of ...
Comments