Skip to main content
SpringerLink
Log in

Image Based High-Level Control System Design for Steering and Controlling of an Active Capsule Endoscope

  • Published:
Journal of Intelligent & Robotic Systems Aims and scope Submit manuscript

Abstract

Using wireless capsule endoscopes for diagnosis and treatment of gastrointestinal tract disease has been increased in recent years. Due to the anatomical shape of the stomach, one of the most important challenges in capsule endoscopy is steering and controlling of the capsule inside the stomach to obtain the high-quality imaging. Another challenge is improving the accuracy of steering and controlling of the capsule, which is already highly dependent upon the operator’s knowledge and skill who acts as a high-level controller. To address these challenges, in this paper, a novel image based High-Level Control system (H-LC) is proposed for real-time autonomous control of an active capsule endoscope. In the proposed system, first, a new desired path planning method based on detecting the stomach folds is implemented using the acquired images. Then, various maneuvers are presented for following the desired path and adjusting the orientation of the capsule. The core of these maneuvers is based on geometric analysis and computer vision techniques. The results for path planning method show the averages of Sensitivity 94%, Specificity 88% and Accuracy 92% on 82 endoscopic images of the stomach. For evaluating the proposed maneuver planning method, simulation in MATLAB is used. Based on the results, the suggested H-LC system can be used accurately for planning and following the desired path to achieve a more accurate control and steering of a capsule endoscope in a stomach with an unknown size.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Slawinski, P.R., Obstein, K.L., Valdastri, P.: Emerging issues and future developments in capsule endoscopy. Tech. Gastrointest. Endosc. 17(1), 40–46 (2015)

    Article  Google Scholar 

  2. Ciuti, G., et al.: Frontiers of robotic endoscopic capsules: a review. J. Micro-Bio Robot. 11(1-4), 1–18 (2016)

    Article  Google Scholar 

  3. Ciuti, G., Menciassi, A., Dario, P.: Capsule endoscopy: from current achievements to open challenges. IEEE Rev. Biomed. Eng. 4, 59–72 (2011)

    Article  Google Scholar 

  4. Singeap, A.M., Stanciu, C., Trifan, A.: Capsule endoscopy: the road ahead. World J. Gastroenterol. 22 (1), 369 (2016)

    Article  Google Scholar 

  5. Menciassi, A., Ciuti, G., Cavallotti, C.: Future developments of video capsule endoscopy: hardware. In: Video Capsule Endoscopy: A Reference Guide and Atlas, pp. 543–556. Springer, New York (2015)

  6. Zabulis, X., Argyros, A.A., Tsakiris, D.P.: Lumen detection for capsule endoscopy. In: IROS, pp. 3921–3926, Nice (2008)

  7. Mura, M., et al.: Vision-based haptic feedback for capsule endoscopy navigation: a proof of concept. J. Micro-Bio Robot. 11(1–4), 35–45 (2016)

    Article  Google Scholar 

  8. Rahman, I., Afzal, N.A., Patel, P.: The role of magnetic assisted capsule endoscopy (MACE) to aid visualisation in the upper GI tract. Comput. Biol. Med. 65, 359–363 (2015)

    Article  Google Scholar 

  9. Carta, R., et al.: Wireless powering for a self-propelled and steerable endoscopic capsule for stomach inspection. Biosens. Bioelectron. 25(4), 845–851 (2009)

    Article  Google Scholar 

  10. De Falco, I.: An integrated system for wireless capsule endoscopy in a liquid-distended stomach. IEEE Trans. Biomed. Eng. 61(3), 794–804 (2014)

    Article  Google Scholar 

  11. Keller, J., et al.: Inspection of the human stomach using remote-controlled capsule endoscopy: a feasibility study in healthy volunteers (with videos). Gastrointest. Endosc. 73(1), 22–28 (2011)

    Article  Google Scholar 

  12. Rahman, I., et al.: Magnetic-assisted capsule endoscopy in the upper GI tract by using a novel navigation system (with video). Gastrointest. Endosc. 83(5), 889–895 (2016)

    Article  Google Scholar 

  13. Keller, H., et al.: In: BioRob, pp. 859–865. Method for navigation and control of a magnetically guided capsule endoscope in the human stomach, Rome (2012)

  14. Rey, J.F., et al.: Blinded nonrandomized comparative study of gastric examination with a magnetically guided capsule endoscope and standard videoendoscope. Gastrointest. Endosc. 75(2), 373–38 (2012)

    Article  Google Scholar 

  15. Carpi, F., Kastelein, N., Talcott, M., Pappone, C.: Magnetically controllable gastrointestinal steering of video capsules. IEEE Trans. Biomed. Eng. 58(8), 231–234 (2011)

    Article  Google Scholar 

  16. Carpi, F., Pappone, C.: Magnetic maneuvering of endoscopic capsules by means of a robotic navigation system. IEEE Trans. Biomed. Eng. 56(5), 1482–1490 (2009)

    Article  Google Scholar 

  17. Mahoney, A.W., Abbott, J.J.: Five-degree-of-freedom manipulation of an untethered magnetic device in fluid using a single permanent magnet with application in stomach capsule endoscopy. Int. J. Robot. Res. 35(1–3), 129–147 (2016)

    Article  Google Scholar 

  18. Abu-Khalil, Y., et al.: Vision and inertial-based image mapping for capsule endoscopy. In: ICTRC, pp. 84–87, Abu Dhabi (2015)

  19. Sehyuk, Y., Sitti, M.: 3-D localization method for a magnetically actuated soft capsule endoscope and its applications. IEEE Trans.Robot. 29(5), 1139–1151 (2013)

    Article  Google Scholar 

  20. Azizian, M., Khoshnam, M., Najmaei, N., Patel, R.V.: Visual servoing in medical robotics: a survey. part i: endoscopic and direct vision imaging techniques and applications. Int. J. Med. Robot. 10(3), 263–274 (2014)

    Article  Google Scholar 

  21. Wang, Y., et al.: Vision-based road detection by monte carlo method. Inf. Technol. J. 9(3), 481–487 (2010)

    Article  Google Scholar 

  22. Rasmussen, C., Lu, Y., Kocamaz. M.: Appearance contrast for fast, robust trail-following. In: IROS, pp. 3505–3512, St. Louis (2009)

  23. Kong, H., Audibert, J.Y., Ponce, J.: General road detection from a single image. IEEE Trans. Image Process. 19(8), 2211–2220 (2010)

    Article  MathSciNet  MATH  Google Scholar 

  24. Blas, M.R., et al.: Fast color/texture segmentation for outdoor robots. In: Intelligent Robots and Systems. IROS, pp. 4078–4085, Nice (2008)

  25. Ulrich, I., Nourbakhsh, I.: Appearance-based obstacle detection with monocular color vision. In: AAAI/IAAI. Austin, pp. 866–871 (2000)

  26. Santosh, D., Achar, S., Jawahar, C.V.: Autonomous image-based exploration for mobile robot navigation. In: ICRA, pp. 2717–2722, California (2008)

  27. De Cristóforis, P., et al.: Real-time monocular image-based path detection. J. Real-Time Image Proc. 11 (2), 335–348 (2016)

    Article  Google Scholar 

  28. Aghanori, M., Ghaffari, A., Dadashi, N.. In: BHI, pp. 13–16, Orlando (2017)

  29. Snell, R.S.: Clinical anatomy, 7th edn. Lippincott Williams & Wilkins (2004)

  30. Lam, M., Mintchev, M.: Diamagnetically stabilized levitation control of an intraluminal magnetic capsule. Physiol. Meas. 30(8), 763 (2009)

    Article  Google Scholar 

  31. Lee, S.H., et al.: Technical skills and training of upper gastrointestinal endoscopy for new beginners. World J. Gastroenterol.: WJG 21(3), 759–785 (2015)

    Article  Google Scholar 

  32. Gonzalez, R.C., Woods, R.E.: Digital image processing, 2nd edn. Prentice-Hall, Upper Saddle River (2002)

    Google Scholar 

  33. Chan, T.F., Vese, L.A.: Active contours without edges. IEEE Trans. Image Process 10(2), 266–277 (2001)

    Article  MATH  Google Scholar 

  34. National Research Council: Risk assessment of radon in drinking water. National Academy of Sciences, Washington (1999)

    Google Scholar 

  35. Gray, H., Standring, S.: Gray’s anatomy: the anatomical basis of clinical practice, 40th edn. In: Churchill-Livingstone, Spain (2008)

  36. Liao, D., et al: Analysis of surface geometry of the human stomach using real-time 3-D ultrasonography in vivo. Neurogastroenterol. Motil. 16(3), 315–324 (2004)

    Article  MathSciNet  Google Scholar 

  37. Reilink, R., Stramigioli, S., Misra, S.: Image-based flexible endoscope steering. In: IROS, pp. 2339–2344, Taipei (2010)

Download references

Author information

Authors and Affiliations

  1. Faculty of Mechanical Engineering, K. N. Toosi University of Technology, Tehran, Iran

    Mehrnaz Aghanouri & Ali Ghaffari

  2. Medical Image and Signal Processing Research Center (MISP), School of Advanced Technologies in Medicine, Isfahan University of Medical Sciences, Isfahan, Iran

    Mehrnaz Aghanouri & Nasim Dadashi Serej

Authors
  1. Mehrnaz Aghanouri
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Ali Ghaffari
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Nasim Dadashi Serej
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Mehrnaz Aghanouri.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Aghanouri, M., Ghaffari, A. & Dadashi Serej, N. Image Based High-Level Control System Design for Steering and Controlling of an Active Capsule Endoscope. J Intell Robot Syst 94, 115–134 (2019). https://doi.org/10.1007/s10846-018-0956-8

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10846-018-0956-8

Keywords

Search

Navigation