Skip to main content

Advertisement

Log in

A hidden markov model-based analysis framework using eye-tracking data to characterise re-orientation strategies in minimally invasive surgery

  • Research Report
  • Published:
Cognitive Processing Aims and scope Submit manuscript

Abstract

Natural Orifice Translumenal Endoscopic Surgery (NOTES) represents a new paradigm in minimally invasive surgery whereby an operator uses a flexible instrument to navigate within an anatomical space. The flexible instrument is introduced via a natural body orifice such as the mouth to perform an operative intervention controlled by the surgeon without making incisions in the anterior abdominal wall. It differs from laparoscopic (traditional keyhole) surgery in two main ways: (1) the instruments used in NOTES are not rigid as in laparoscopic surgery and not specifically designed for this application; and (2) there are no incisions in the anterior abdominal wall. Disorientation during NOTES is a significant problem because as in laparoscopic surgery the operator typically uses a 2D camera-monitor interface for visualisation by the camera at the site of the operation. Furthermore, the positional cue offered by the external component (outside the body) of the camera is absent, and camera navigation is more cumbersome. When the operator is disorientated, it is important to be able to re-orientate quickly to minimise potential surgical errors. It is hypothesised that when surgeons become disorientated, there exist discrete patterns in psychophysical behaviour which are associated with effective re-orientation, and that these patterns are recognisable. In this study, we examine visual re-orientation behaviour in 18 subjects using eye-tracker data in a model comprised of selective image manipulation of everyday objects in a box trainer. We characterise effective behaviour using a fixation sequence similarity-based hidden Markov model. We show that the output of this algorithm is reliable in differentiating visual behavioural sequences, and that there are specific behavioural patterns and strategies associated with successful re-orientation in this model. Good re-orientation strategy appears to rely on identification and focus on a central object within the scene and judging position of its surrounding peripheral objects, suggesting integration of both geometric and feature information in a systematic way. Using selective, inconsistent feature cues for re-orientation were associated with less effective performance.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4

References

  • Atallah L, ElHelw M, Pansiot J, Stoyanov D, Wang L, Lo B et al (2007) Behaviour profiling with ambient and wearable sensing. 4th International Workshop on Wearable and Implantable Body Sensor Networks (BSN 2007), 13, 133–138

  • Baum LE, Petrie T, Soules G, Weiss N (1970) A maximization technique occurring in statistical analysis of probabilistic functions of markov chains. Ann Math Stat 41(1):164

    Article  Google Scholar 

  • Bicego M, Murino V, Figueiredo MAT (2003) Similarity-based clustering of sequences using hidden Markov models. Mach Learn Data Min Pattern Recognit Proc 2734:86–95

    Article  Google Scholar 

  • Bicego M, Murino V, Figueiredo MAT (2004) Similarity-based classification of sequences using hidden Markov models. Pattern Recognit 37(12):2281–2291

    Article  Google Scholar 

  • Cheung B, Hofer K (2003) Eye tracking, point of gaze, and performance degradation during disorientation. Aviat Space Environ Med 74(1):11–20

    PubMed  Google Scholar 

  • Dempere-Marco L, Hu XP, Ellis SM, Hansell DM, Yang GZ (2006) Analysis of visual search patterns with EMD metric in normalized anatomical space. IEEE Trans Med Imaging 25(8):1011–1021

    Article  PubMed  Google Scholar 

  • Hacisalihzade SS, Stark LW, Allen JS (1992) Visual-perception and sequences of eye-movement fixations—a stochastic modeling approach. IEEE Trans Syst Man Cybern 22(3):474–481

    Article  Google Scholar 

  • Hermer L, Spelke E (1996) Modularity and development: the case of spatial reorientation. Cognition 61(3):195–232

    Article  CAS  PubMed  Google Scholar 

  • Hu XP, Dempere-Marco L, Yang GZ (2003) Hot spot detection based on feature space representation of visual search. IEEE Trans Med Imaging 22(9):1152–1162

    Article  PubMed  Google Scholar 

  • Jacobs WJ, Thomas KGF, Laurance HE, Nadel L (1998) Place learning in virtual space II. Topographical relations as one dimension of stimulus control. Learn Motiv 29(3):288–308

    Article  Google Scholar 

  • Jain AK, Duin RPW, Mao JC (2000) Statistical pattern recognition: a review. IEEE Trans Pattern Anal Mach Intell 22(1):4–37

    Article  Google Scholar 

  • Palermo L, Iaria G, Guariglia C (2008) Mental imagery skills and topographical orientation in humans: a correlation study. Behav Brain Res 192(2):248–253

    Article  PubMed  Google Scholar 

  • Rabiner LR, Levinson SE, Sondhi MM (1983) On the application of vector quantization and hidden markov-models to speaker-independent, isolated word recognition. Bell Syst Tech J 62(4):1075–1105

    Google Scholar 

  • Sodergren MH, Clark J, Athanasiou T, Teare J, Yang GZ, Darzi A (2009) Natural orifice translumenal endoscopic surgery: critical appraisal of applications in clinical practice. Surg Endosc 23(4):680–687

    Article  PubMed  Google Scholar 

  • Yang GZ, Mylonas GP, Kwok KW, Chung A (2008) Perceptual docking for robotic control. Med Imaging Augment Real Proc 5128:21–30

    Article  Google Scholar 

Download references

Acknowledgments

This experiment complies with the current laws in the UK and has been granted ethical review board permission. Thanks to Dr Adam James, Dr Louis Attalah and Ka-Wai Kwok for their help with this research.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Mikael Hans Sodergren.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Sodergren, M.H., Orihuela-Espina, F., Clark, J. et al. A hidden markov model-based analysis framework using eye-tracking data to characterise re-orientation strategies in minimally invasive surgery. Cogn Process 11, 275–283 (2010). https://doi.org/10.1007/s10339-009-0350-3

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10339-009-0350-3

Keywords

Navigation