Steve Mann
Jason Huang
ABSTRACT
We present a way finding system that uses a range camera and an array of vibrotactile elements which we built into a helmet.
The range camera is a Kinect 3D sensor from Microsoft that is meant to be kept stationary, and used to watch the user (i.e., to detect the person's gestures). Rather than using the camera to look at the user, we reverse the situation, by putting the Kinect range camera on a helmet for being worn by the user. In our case, the Kinect is in motion rather than stationary.
Whereas stationary cameras have previously been used for gesture recognition, which the Kinect does very well, in our new modality, we take advantage of the Kinect's resilience against rapidly changing background scenery, where the background in our case is now in motion (i.e., a conventional wearable camera would be presented with a constantly changing background that is difficult to manage by mere background subtraction).
The goal of our project is collision avoidance for blind or visually impaired individuals, and for workers in harsh environments such as industrial environments with significant 3-dimensional obstacles, as well as for use in low-light environments.
- S. Mann. Intelligent Image Processing. John Wiley and Sons, November 2 2001. ISBN: 0--471--40637--6. Google Scholar
Digital Library
- A. Shpunt. DEPTH MAPPING USING MULTI-BEAM ILLUMINATION, Jan. 21 2008. US Patent App. 12/522,172.Google Scholar
- A. Shpunt and B. Pesach. OPTICAL PATTERN PROJECTION, July 21 2010. US Patent App. 12/840,312.Google Scholar
- A. Shpunt and Z. Zalevsky. Depth-varying light fields for three dimensional sensing, Mar. 13 2007. US Patent App. 11/724,068.Google Scholar
- E. Spektor, Z. Mor, and D. Rais. INTEGRATED PROCESSOR FOR 3D MAPPING, Mar. 4 2009. US Patent App. 12/397,362.Google Scholar
- E. Weber, H. Ross, and D. Murray. EH Weber on the tactile senses. Psychology Press, 1996.Google Scholar
- Wikipedia. Ros (robot operating system) -- wikipedia, the free encyclopedia, 2011. {Online; accessed 12-April-2011}.Google Scholar
- P. B. y Rita, M. E. Tyler, and K. A. Kaczmarek. Seeing with the Brain, volume 15(2), pages 285--295. Hillsdale, NJ: Lawrence Erlbaum Associates Inc, 2003.Google Scholar
Index Terms
- Blind navigation with a wearable range camera and vibrotactile helmet
Recommendations
Hybrid model and appearance based eye tracking with kinect
ETRA '16: Proceedings of the Ninth Biennial ACM Symposium on Eye Tracking Research & ApplicationsExisting gaze estimation methods rely mainly on 3D eye model or 2D eye appearance. While both methods have validated their effectiveness in various fields and applications, they are still limited in practice, such as portable and non-intrusive system ...
An ontology for reasoning on body-based gestures
EICS '19: Proceedings of the ACM SIGCHI Symposium on Engineering Interactive Computing SystemsBody-based gestures, such as acquired by Kinect sensor, today benefit from efficient tools for their recognition and development, but less for automated reasoning. To facilitate this activity, an ontology for structuring body-based gestures, based on ...
WashInDepth: Lightweight Hand Wash Monitor Using Depth Sensor
MOBIQUITOUS 2016: Proceedings of the 13th International Conference on Mobile and Ubiquitous Systems: Computing, Networking and ServicesPersonnel working in health services and food preparation industries maintain hand hygiene by washing their hands. Often this follows the WHO hand hygiene guidelines. Systems exist to monitor and detect compliance with all stages of the guidelines. ...
Comments