Skip to main content

Advertisement

SpringerLink
Log in

Robot-assisted mirror ultrasound scanning for deep venous thrombosis detection using RGB-D sensor

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Deep Venous Thrombosis (DVT) is a major cause of morbidity and mortality. Manually scanning with Ultrasound (US) probe brings heavy work load for the sonographers. This paper proposes a novel “Mirror robotic US scanning system. The system is composed of two-arm robot, linear US probes for master and slave side, Kinect sensor as a vision servo. On the master side, sonographers hold one robot arm and operate probe to inspect one leg. On the slave side, the robot follows the master probe on the navigation of Kinect and scans the other leg. 3D images of legs are segmented and register to get mirror matrix. Both Clustered Viewpoint Feature Histogram (CVFH) descriptors of segmented probe and CAD (Computer-Aided Design) training data were calculated to probe recognition. The leg phantom platform was built up. The mirror matrixes were obtained. The correlation coefficients between the two legs are calculated. Times of ICP (Iterative Closest Point) have been calculated for the platform. Results from the initial experiment indicate the idea is feasible and promising greatly by improving the inspection efficiently. Clinically, the method can be implemented for pre-operative procedures to predict the risk of DVT, and this may improve the US scanning efficacy.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6

Similar content being viewed by others

References

  1. “DVT overview”, WebMD, available online: http://www.webmd.com/dvt/ss/slideshow-deep-vein-thrombosis-overview. (accessed at 2014-12-17)

  2. Aalamifar F, Khurana R, Cheng A et al. (2014) Enabling technologies for robot assisted ultrasound tomography: system setup and calibration[C]//SPIE medical imaging. Int Soc Optics Photo 90401X–90401X-9

  3. Bauer S, Wasza J, Haase S et al. (2011) “Multi-modal suface registration for markerless initial patient setup in radiation therapy using Microsoft’s Kinect sensor”. IEEE Int Conf Comput Vision Workshops (ICCV), Barcelona, Spain 1175–1181

  4. Benavidez P, Jamshidi M (2011) “Mobile robot navigation and target tracking system”. Proc 6th Int Conf Syst Syst Eng: SoSE Cloud Comput, Smart Grid, Cyber Secur, SoSE 2011, Albuquerque, NM, USA 299–304

  5. Besl PJ, MacKay N (1992) A method for registration of 3-d shapes”. IEEE Trans Pattern Anal Mach Intell 14(2):239–256

    Article  Google Scholar 

  6. Boctor EM, Fischer G, Choti MA et al (2004) A dual-armed robotic system for intraoperative ultrasound guided hepatic ablative therapy: a prospective study[C]//robotics and automation, 2004. Proc ICRA'04 2004 IEEE Int Conf IEEE 3:2517–2522

    Google Scholar 

  7. Burgin W, Pantofaru C, Smart WD et al. (2011) “Using depth information to improve face detection”. Proc 6th Int Conf Human-Robot Interact, Lausanne, Switzerland 6–9

  8. De Martino RR, Beck AW, Edwards MW (2012) Impact of screening versus symptomatic measurement of deep vein thrombosis in a national quality improvement registry”. J Vasc Surg 10:1045–1051

    Article  Google Scholar 

  9. Drost B, Ulrich M, Navab N (2010) ” Model globally, match locally: efficient and robust 3D object recognition”. IEEE Conf Comput Vision Pattern Recognition(CVPR), 2010, San Francisco, CA, USA 998–1005

  10. Ensor J, Riley RD, Moore D et al (2013) Protocol for a systematic review of prognostic models for the recurrence of venous thromboembolism (VTE) following treatment for a first unprovoked VTE[J]. Syst Rev 2(91):10.1186

    Google Scholar 

  11. Gornik HL, Sharma AM (2014) Duplex ultrasound in the diagnosis of lower-extremity deep venous thrombosis”. Circulat, J Am Heart Assoc 129:917–921

    Google Scholar 

  12. Gupta S, Arbeláez P, Girshick R et al. Inferring 3D object pose in RGB-D images[J]. arXiv pr

  13. Izadi S, Kim D, Hilliges O et al. (2011) “KinectFusion: real-time 3D reconstruction and interaction using a moving depth camera”. UIST’11 Proc 24th Ann ACM Symp User Interface Software Technol, ACM New York, NY, USA 559–568

  14. Krupa A, Folio D, Novales C et al (2014) Robotized tele-echography: an assisting visibility tool to support expert diagnostic[J]. IEEE Syst J 99:1–10

    Google Scholar 

  15. Microsoft. Kinect for Windows. Available noline: (accessed at 2014-12-17)

  16. Motohashi M, Adachi A, Takigami K et al (2012) Deep vein thrombosis in orthopedic surgery of the lower extremities[J]. Ann Vasc Dis 5(3):328

    Article  Google Scholar 

  17. Mylonas GP, Giataganas P, Chaudery M et al. (2013) Autonomous eFAST ultrasound scanning by a robotic manipulator using learning from demonstrations[C]//Intelligent Robots and Systems (IROS), 2013 IEEE/RSJ International Conference on. IEEE 3251–3256

  18. Nadvoretskiy V, Ermilov S, Brecht HP et al. (2011) Image processing and analysis in a dual-modality optoacoustic/ultrasonic system for breast cancer diagnosis[C]//SPIE BiOS. Int Soc Optics Photon 789909–789909-6

  19. Patel AP, Koltz MT, Sansur CA (2013) “An analysis of deep vein thrombosis in 1277 consecutive neurosurgical patients undergoing routine weekly ultrasonography”. J Neurosurg 118:505–509

    Article  Google Scholar 

  20. Shen J, Cheung S (2013) Layer depth denoising and completion for structured-light rgb-d cameras[C]//Computer Vision and Pattern Recognition (CVPR), 2013 IEEE Conference on. IEEE 1187–1194

  21. Talbot S (1982) Use of real-time imaging in identifying deep venous obstruction: a preliminary report”. Bruit 7:41–42

    Google Scholar 

  22. Vanderpool HE, Friis EA, Smith BS, Harms KL (1993) Prevalence of carpal tunnel syndrome and other work-related musculoskeletal problems in cardiac sonographers”. JOEM: J Occupation Environ Med 35:97–113

    Google Scholar 

  23. Wen J, Zhu X, Li D (2013) Improved bounds on restricted isometry constant for orthogonal matching pursuit[J]. Electron Lett 49(23):1487–1489

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Northeast Dianli University, Jilin, China

    Bo Meng, Ying-ying Zhao & Xue-jun Liu

  2. Engineering Research Center, Johns Hopkins University, Baltimore, MD, USA

    Lei Chen

  3. Department of Electrical & Computer Engineering Johns Hopkins University, Baltimore, MD, USA

    Fereshteh Aalamifar & Emad Boctor

  4. Department of Radiology and Radiological Science, Johns Hopkins Medical Institutes, Baltimore, MD, USA

    Lei Chen & Emad Boctor

Authors
  1. Bo Meng
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Ying-ying Zhao
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Lei Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Fereshteh Aalamifar
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Xue-jun Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Emad Boctor
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Bo Meng.

Ethics declarations

Conflict of interest

Bo Meng, Ying-ying Zhao, Lei Chen, Fereshteh Aalamifar, Xue-jun Liu and Emad Boctor declare that they have no conflict of interest.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Meng, B., Zhao, Yy., Chen, L. et al. Robot-assisted mirror ultrasound scanning for deep venous thrombosis detection using RGB-D sensor. Multimed Tools Appl 75, 14247–14261 (2016). https://doi.org/10.1007/s11042-016-3516-x

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-016-3516-x

Keywords

Search

Navigation