Skip to main content

An Enhanced Object Tracking Algorithm Based on Augmented Reality Markup Language (ARML) for Medical Engineering

  • Conference paper
  • First Online:
Advanced Machine Learning Technologies and Applications (AMLTA 2021)

Abstract

The use of augmented reality technologies in the healthcare sector opens up renewed possibilities. AR in medicine consists predominantly of three technical components, including camera calibration, patient registration, and object tracking. Object tracking assesses the camera or marker's spatial location on surgical instruments and is an integral aspect of a medical RA device. The AR framework must be very accurate and must provide a simple structured procedure for storing metadata and different details for an AR model view. Many registration techniques lack specificity and display techniques cannot display on numerous browsers and platforms. This paper deals with the above drawbacks by introducing a marker-less medical AR method that uses intensity-based identification for liver lesions and Augmented Reality Markup Language (ARML) for the regular AR view. Morphological operations are used to promote identification and boost the environment. AR registration technique is then accompanied by the identification, which is applied using a mutual information algorithm. We suggest storing metadata and details in ARML tags in all system stages, including preprocessing. Finally, the method of tracking is regarded in previous phases for the relevant video frames. Results of the suggested method found to boost the vision of physicians with high specificity for targeted objects. Furthermore, the use of ARML to save metadata ensures standard AR show, it also increases patient safety and follow-up.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 229.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 299.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Kipper, G., Rampolla, J.: Augmented Reality: An Emerging Technologies Guide to AR, 1st edn. Elsevier, Amsterdam (2012)

    Google Scholar 

  2. Yang, R.: The study and improvement of augmented reality based on feature matching. In: Proceedings of the IEEE 2nd International Conference for Software Engineering and Service Science (ICSESS), China, pp. 586–589 (2011)

    Google Scholar 

  3. Nag, S.: Image registration techniques: a survey. Technical Report, Department of Electrical Engineering, Jadavpur University, India (2017)

    Google Scholar 

  4. Arora, N., Martolia, M., Ashok, A.: A comparative study of the image registration process on the multimodal medical images. Asia-Pacific J. Convergent Res. Interchange 3(1), 1–16 (2017)

    Article  Google Scholar 

  5. Souza, G.P., Cadeddu, J., Mariottini, G.: Toward long-term and accurate augmented-reality for monocular endoscopic videos. IEEE Trans. Biomed. Eng. 61(10), 2609–2620 (2014)

    Article  Google Scholar 

  6. Harders, M., Bianchi, G., Knoerlein, B.: Multimodal augmented reality in Medicine. In: Proceedings of the 4th International Conference on Universal Access in Human-Computer Interaction, China, pp. 652–658 (2007)

    Google Scholar 

  7. Macedo, M., Junior, A.: Improving on-patient medical data visualization in a markerless augmented reality environment by volume clipping. In: Proceeding of the 27th Graphics, Patterns and Images Conference (SIBGRAPI), pp. 149–156 (2014)

    Google Scholar 

  8. Fenais, A., Smilovsky, N., Ariaratnam, S., Ayer, S.: A meta-analysis of augmented reality challenges in the underground utility construction industry. In: Proceedings of the Construction Research Congress, Louisiana, pp. 80–89 (2018)

    Google Scholar 

  9. Klein, A., Assis, G.: A markerless augmented reality tracking for enhancing the user interaction during virtual rehabilitation. In: Proceedings of XV Symposium on Virtual and Augmented Reality (SVR), Brazil, pp. 117–124 (2013)

    Google Scholar 

  10. Lee, J., Huang, C.H., Huang, T., Hsieh, H., Lee, S.: Medical augment reality using a markerless registration framework. Expert Syst. Appl. 39(5), 5286–5294 (2012)

    Article  Google Scholar 

  11. Lechner, M.: ARML 2.0 in the context of existing AR data formats. In: Proceedings of the 6th Workshop of Software Engineering and Architectures for Realtime Interactive Systems (SEARIS), USA, pp. 41–47 (2013)

    Google Scholar 

  12. Hugues, O., Fuchs, P., Nannipieri, O.: New augmented reality taxonomy: technologies and features of augmented environment, pp. 47–63. Handbook of augmented reality, Springer (2011)

    Google Scholar 

  13. Furht, B.: Hand-Book of Augmented Reality. Springer, New York (2011)

    Book  Google Scholar 

  14. Ezzeldeen, R., Ramadan, H., Nazmy, T., Adel Yehia, M., Abdel-Wahab, M.: Comparative study for image registration techniques of remote sensing images. Egypt. J. Remote Sens. Space Sci. 13(1), 31–36 (2010)

    Google Scholar 

  15. Alam, F., Rahman, S., Ullah, S., Uddin, A., Khalil, A.: A review on extrinsic registration methods for medical images. Tech. J. Univ. Eng. Technol. 21(3), 110–119 (2016)

    Google Scholar 

  16. Wu, M., Chien, J., Wu, C., Lee, J.: An augmented reality system using improved-iterative closest point algorithm for on-patient medical image visualization. Sensors 18(8), 1–5 (2018)

    Article  Google Scholar 

  17. Cooper, C., Wise, K., Copper, J., Deo, M.: Wavelet compressed PCA models for real-time image registration in augmented reality applications. Int. J. Adv. Res. Artif. Intell. 4(8), 1–10 (2015)

    Article  Google Scholar 

  18. Dandachi, G., Assoum, A., Elhassan, B.A., Dornaika, F.: Machine learning schemes in augmented reality for features detection. In: Proceedings of the IEEE Fifth International Conference on Digital Information and Communication Technology and its Applications (DICTAP), Lebanon, pp. 101–105 (2015)

    Google Scholar 

  19. Soille, P.: Morphological Image Analysis Principles, and Applications. Springer, Heidelberg (2013)

    Google Scholar 

  20. Song, S., Herrmann, J.M., Si, B., Liu, K., Feng, X.: Two-dimensional forward-looking sonar image registration by maximization of peripheral mutual information. Int. J. Adv. Rob. 14(6), 17 (2017)

    Google Scholar 

  21. Rani, V., Dhenakaren, S.: Tumor intensity ratio model using support vector machine. In: Proceedings of the IEEE International Conference of Advanced Communication Control and Computing Technologies (ICACCCT), India, pp. 188–191 (2016)

    Google Scholar 

  22. Rajesh, G.: Liver cancer detection and classification based on optimum hierarchical feature fusion with PeSOA and PNN classifier. Biomed. Res. 29(1), 22–32 (2018)

    Google Scholar 

  23. Krishna, A., Edwin, D., Hariharan, S.: Classification of liver tumor using SFTA based naïve bayes classifier and support vector machine. In: Proceedings of the International Conference on Intelligent Computing, Instrumentation and Control Technologies (ICICICT), India, pp. 1066–1070 (2017)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Saad M. Darwish .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2021 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Ismail, A.A., Darwish, S.M., Mohallel, A.A. (2021). An Enhanced Object Tracking Algorithm Based on Augmented Reality Markup Language (ARML) for Medical Engineering. In: Hassanien, AE., Chang, KC., Mincong, T. (eds) Advanced Machine Learning Technologies and Applications. AMLTA 2021. Advances in Intelligent Systems and Computing, vol 1339. Springer, Cham. https://doi.org/10.1007/978-3-030-69717-4_26

Download citation

Publish with us

Policies and ethics