Paper
12 March 2014 Feasibility of a touch-free user interface for ultrasound snapshot-guided nephrostomy
Simon Kotwicz Herniczek, Andras Lasso, Tamas Ungi, Gabor Fichtinger
Author Affiliations +
Abstract
PURPOSE: Clinicians are often required to interact with visualization software during image-guided medical interventions, but sterility requirements forbid the use of traditional keyboard and mouse devices. In this study we attempt to determine the feasibility of using a touch-free interface in a real time procedure by creating a full gesture-based guidance module for ultrasound snapshot-guided percutaneous nephrostomy. METHODS: The workflow for this procedure required a gesture to select between two options, a “back” and “next” gesture, a “reset” gesture, and a way to mark a point on an image. Using an orientation sensor mounted on the hand as input device, gesture recognition software was developed based on hand orientation changes. Five operators were recruited to train the developed gesture recognition software. The participants performed each gesture ten times and placed three points on predefined target positions. They also performed tasks unrelated to the sought-after gestures to evaluate the specificity of the gesture recognition. The orientation sensor measurements and the position of the marked points were recorded. The recorded data sets were used to establish threshold values and optimize the gesture recognition algorithm. RESULTS: For the “back”, “reset” and “select option” gesture, a 100% recognition accuracy was achieved. For the “next” gesture, a 92% recognition accuracy was obtained. With the optimized gesture recognition software no misclassified gestures were observed when testing the individual gestures or when performing actions unrelated to the sought-after gestures. The mean point placement error was 0.55 mm with a standard deviation of 0.30 mm. The mean placement time was 4.8 seconds. CONCLUSION: The system that was developed is promising and demonstrates potential for touch-free interfaces in the operating room.
© (2014) COPYRIGHT Society of Photo-Optical Instrumentation Engineers (SPIE). Downloading of the abstract is permitted for personal use only.
Simon Kotwicz Herniczek, Andras Lasso, Tamas Ungi, and Gabor Fichtinger "Feasibility of a touch-free user interface for ultrasound snapshot-guided nephrostomy", Proc. SPIE 9036, Medical Imaging 2014: Image-Guided Procedures, Robotic Interventions, and Modeling, 90362F (12 March 2014); https://doi.org/10.1117/12.2043564
Lens.org Logo
CITATIONS
Cited by 2 scholarly publications.
Advertisement
Advertisement
RIGHTS & PERMISSIONS
Get copyright permission  Get copyright permission on Copyright Marketplace
KEYWORDS
Ultrasonography

Gesture recognition

Human-machine interfaces

Sensors

Software development

Visualization

Detection and tracking algorithms

Back to Top