Abstract
The assessment of surgical skills for Minimally Invasive Surgery (MIS) has traditionally been conducted with visual observation and objective scoring. This paper presents a practical framework for the detection of instrument/tissue interaction from MIS video sequences by incorporating multiple visual cues. The proposed technique investigates the characteristics of four major events involved in MIS procedures including idle, retraction, cauterisation and suturing. Constant instrument tracking is maintained and multiple visual cues related to shape, deformation, changes in light reflection and other low level images featured are combined in a Bayesian framework to achieve an overall frame-by-frame classification accuracy of 77% and episode classification accuracy of 85%.
Chapter PDF
Similar content being viewed by others
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Muller-Wittig, W., Bockholt, U., Arcos, J.L.L., Vossl, G.: Enhanced training environment for minimally invasive surgery. In: Proceedings of the Tenth IEEE International Workshop on Enabling Technologies: Infrastructure for Collaborative Enterprises (WET ICE 2001), pp. 269–272 (2001)
Brown, I., Mayooran, Z., Seligman, C., Healy, D.L., Guglielmetti, M., Reston, M., Hart, S.: Engineering design of a virtual reality simulator for gynaecological endoscopy. In: The seventh Australian and New Zealand Intelligent Information Systems Conference, pp. 77–80 (2001)
Frank, A.O., Twombly, I.A., Barth, T.J., Smith, J.D.: Finite element methods for real-time haptic feedback of soft-tissue models in virtual reality simulators. In: Proceedings of the IEEE Virtual Reality, pp. 257–263 (2001)
Brown, J., Sorkin, S., Bruyns, C., Latombe, J.C., Montogomery, K., Stephanides, M.: Realtime simulation of deformable objects: tools and application. In: Proceedings of the fourteenth conference on Computer Animation 2001, pp. 228–258 (2001)
Gallagher, A.G., Satava, R.M.: Virtual reality as a metric for the assessment of laparoscopic psychomotor skills. In: Surgical Endoscopy, vol. 16, pp. 1746–1752. Springer, Heidelberg (2002)
Shah, J., Darzi, A.: Simulation and skills assessment. In: Proceedings of the International Workshop on Medical Imaging and Augmented Reality 2001, pp. 5–9 (2001)
Rosen, J., Brown, J.D., Chang, L., Barreca, M., Sinanan, M., Hannaford, B.: The BlueDRAGON - a system for measuring the kinematics and dynamics of minimally invasive surgical tools in-vivo. In: Proceedings of the ICRA 2002 IEEE International Conference on Robotics and Automation 2002, vol. 2, pp. 1876–1881 (2002)
Ang, W.T., Riviere, C.N., Khosla, P.K.: An Active Hand-held Instrument for Enhanced Microsurgical Accuracy. In: Proceedings of the Third International Conference on Medical Image Computing and Computer-Assisted Intervention 2000, October 2000, pp. 11–14 (2000)
Isard, M., Blake, A.: CONDENSATION - conditional density propagation for visual tracking. International Journal of Computer Vision 29(1), 5–28 (1998)
Black, M.J., Jepson, A.D.: Recognizing Temporal Trajectories using the Condensation Algorithm. In: Proceedings of the Third IEEE International Conference on Automatic Face and Gesture Recognition, pp. 16–21 (1998)
Tsai, P.S., Shah, M.: Shape From Shading Using Linear Approximation. Image and Vision Computing Journal (1994)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2003 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Lo, B.P.L., Darzi, A., Yang, GZ. (2003). Episode Classification for the Analysis of Tissue/Instrument Interaction with Multiple Visual Cues. In: Ellis, R.E., Peters, T.M. (eds) Medical Image Computing and Computer-Assisted Intervention - MICCAI 2003. MICCAI 2003. Lecture Notes in Computer Science, vol 2878. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-39899-8_29
Download citation
DOI: https://doi.org/10.1007/978-3-540-39899-8_29
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-20462-6
Online ISBN: 978-3-540-39899-8
eBook Packages: Springer Book Archive