Skip to main content
SpringerLink
Log in

Tracking Registration Algorithm for Augmented Reality Based on Template Tracking

  • Research Article
  • Published:
International Journal of Automation and Computing Aims and scope Submit manuscript

Abstract

Tracking registration is a key issue in augmented reality applications, particularly where there are no artificial identifier placed manually. In this paper, an efficient markerless tracking registration algorithm which combines the detector and the tracker is presented for the augmented reality system. We capture the target images in real scenes as template images, use the random ferns classi- fier for target detection and solve the problem of reinitialization after tracking registration failures due to changes in ambient lighting or occlusion of targets. Once the target has been successfully detected, the pyramid Lucas-Kanade (LK) optical flow tracker is used to track the detected target in real time to solve the problem of slow speed. The least median of squares (LMedS) method is used to adaptively calculate the homography matrix, and then the three-dimensional pose is estimated and the virtual object is rendered and registered. Experimental results demonstrate that the algorithm is more accurate, faster and more robust.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. J. P. Lima, R. Roberto, F. Simões, M. Almeida, L. Figueiredo, J. M. Teixeira, V. Teichrieb. Markerless tracking system for augmented reality in the automotive industry. Expert Systems with Applications, vol. 82, pp. 100–114, 2017. DOI: https://doi.org/10.1016/j.eswa.2017.03.060.

    Article  Google Scholar 

  2. R. Frikha, R. Ejbali, M. Zaied. Camera pose estimation for augmented reality in a small indoor dynamic scene. Journal of Electronic Imaging, vol. 26, no. 5, Article number 053029, 2017. DOI: https://doi.org/10.1117/1.JEI.26.5.053029.

    Google Scholar 

  3. F. P. Vista IV, D. J. Lee, K. T. Chong. Remote activation and confidence factor setting of ARToolKit with data association for tracking multiple markers. International Journal of Control and Automation, vol. 6, no. 6, pp. 243–252, 2013. DOI: https://doi.org/10.14257/ijca.2013.6.6.23.

    Article  Google Scholar 

  4. M. Fiala. ARTag, An Improved Marker System Based on ARToolkit[J], NRC 47166/ERB-1111, National Research Council Canada, 2004. DOI: https://doi.org/10.4224/5763247.

    Google Scholar 

  5. Y. Y. Du, Z. J. Miao, Y. G. Cen. Markless augmented reality registration algorithm based on ORB. In Proceedings of the 12th International Conference on Signal Processing, IEEE, Hangzhou, China, 1236–1240, 2015. DOI: https://doi.org/10.1109/ICOSP.2014.7015197.

    Google Scholar 

  6. J. B. Shi, C. Tomasi. Good features to track. In Proceedings of Conference on Computer Vision and Pattern Recognition, IEEE, Seattle, USA, 593–600, 1994. DOI: https://doi.org/10.1109/CVPR.1994.323794.

    Google Scholar 

  7. J. Li, R. Laganiere, G. Roth. Online estimation of trifocal tensors for augmenting live video. In Proceedings of the 3rd IEEE and ACM International Symposium on Mixed and Augmented Reality, IEEE, Arlington, USA, 182–190, 2004. DOI: https://doi.org/10.1109/ISMAR.2004.42.

    Google Scholar 

  8. M. L. Yuan, S. K. Ong, A. Y. C. Nee. Registration using natural features for augmented reality systems. IEEE Transactions on Visualization and Computer Graphics, vol. 12, no. 4, pp. 569–580, 2006. DOI: https://doi.org/10.1109/TVCG.2006.79.

    Article  Google Scholar 

  9. B. Kang, P. Ren. Natural texture-based tracking algorithm for augmented reality. Systems Engineering and Electronics, vol. 31, no. 10, pp. 2480–2484, 2009. DOI: https://doi.org/10.3321/j.issn:1001-506X.2009.10.0440. (in Chinese)

    Google Scholar 

  10. Y. Hao, Z. J. Xu, Y. Liu, J. Wang, J. L. Fan. Effective Crowd Anomaly Detection Through Spatio-temporal Texture Analysis. International Journal of Automation and Computing, vol. 16, no. 1, pp. 27–39, 2019. DOI: https://doi.org/10.1007/s11633-018-1141-z.

    Article  Google Scholar 

  11. D. G. Lowe. Distinctive image features from scale-invariant keypoints. International Journal of Computer Vision, vol. 60, no. 2, pp. 91–110, 2004. DOI: https://doi.org/10.1023/B:VISI.0000029664.99615.94.

    Article  Google Scholar 

  12. M. Ozuysal, M. Calonder, V. Lepetit, P. Fua. Fast keypoint recognition using random ferns. IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 32, no. 3, pp. 448–461, 2010. DOI: https://doi.org/10.1109/TPAMI.2009.23.

    Article  Google Scholar 

  13. V. Lepetit, J. Pilet, P. Fua. Point matching as a classification problem for fast and robust object pose estimation. In Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition, IEEE, Washington DC, USA, pp. 244–250, 2004. DOI: https://doi.org/10.1109/CVPR.2004.1315170.

    Google Scholar 

  14. Y. Zhao, J. J. Li, H. P. Li, D. Yang. Real-time tracking and registration algorithm of scenarios of augmented reality based on improved random fern. Journal of Northeastern University (Natural Science), vol. 37, no. 5, pp. 614–618, 2016. DOI: https://doi.org/10.3969/j.issn.1005-3026.2016.05.002. (in Chinese)

    Google Scholar 

  15. C. H. Yang, S. D. Liu, Z. M. Wang, Y. F. Guo, H. Li. Real-time vehicle matching based on random ferns. Journal of Xiamen University (Natural Science), vol. 53, no. 2, pp. 206–211, 2014. DOI: https://doi.org/10.6043/j.issn.0438-0479.2014.02.011. (in Chinese)

    Article  Google Scholar 

  16. M. Villamizar, J. Andrade-Cetto, A. Sanfeliu, F. Moreno-Noguer. Bootstrapping boosted random ferns for discriminative and efficient object classification. Pattern Recognition, vol. 45, no. 9, pp. 3141–3153, 2012. DOI: https://doi.org/10.1016/j.patcog.2012.03.025.

    Article  Google Scholar 

  17. Y. Liu, D. G. Xi, Z. L. Li, Y. Hong. A new methodology for pixel-quantitative precipitation nowcasting using a pyramid Lucas Kanade optical flow approach. Journal of Hydrology, vol. 529, pp. 354–364, 2015. DOI: https://doi.org/10.1016/j.jhydrol.2015.07.042.

    Article  Google Scholar 

  18. T. D. Chen, J. Hu, D. Wu. Dynamic target detection and tracking based on fast computation using sparse optical flow. Journal of Image and Graphics, vol. 18, no. 12, pp. 1593–1600, 2013. DOI: https://doi.org/10.11834/jig.20131207. (in Chinese)

    Google Scholar 

  19. Y. Xie, X. D. Yang, Z. Liu, S. N. Ren, K. Chen. Method for visual localization of oil and gas wellhead based on distance function of projected features. International Journal of Automation and Computing, vol. 14, no. 2, pp. 147–158, 2017. DOI: https://doi.org/10.1007/s11633-017-1063-1.

    Article  Google Scholar 

  20. J. S. Xu, Y. J. Wang, X. Cheng, S. Li, S. Y. Chen. Adaptive method for homography matrix estimation. Computer Engineering and Applications, vol. 52, no. 5, pp. 160–164, 2016. DOI: https://doi.org/10.3778/j.issn.1002-8331.1409-0357. (in Chinese)

    Google Scholar 

  21. J. Lin, Y. T. Wang, Y. Liu, K. Yang. Real-time markerless registration algorithm for augmented reality based on template tracking. Journal of Image and Graphics, vol. 13, no. 9, pp. 1812–1819, 2008. DOI: https://doi.org/10.11834/jig.20080929. (in Chinese)

    Google Scholar 

  22. A. T. Erdem, A. O. Ercan. Fusing inertial sensor data in an extended Kalman filter for 3D camera tracking. IEEE Transactions on Image Processing, vol. 24, no. 2, pp. 538–548, 2015. DOI: https://doi.org/10.1109/TIP.2014.2380176.

    Article  MathSciNet  Google Scholar 

Download references

Acknowledgements

This work was supported by National Natural Science Foundation of China (No. 61125101).

Author information

Authors and Affiliations

  1. Lanzhou Institute of Physics, China Academy of Space Technology, Lanzhou, 730000, China

    Peng-Xia Cao, Wen-Xin Li & Wei-Ping Ma

Authors
  1. Peng-Xia Cao
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Wen-Xin Li
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Wei-Ping Ma
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Peng-Xia Cao.

Additional information

Recommended by Associate Editor Jangmyung Lee

Peng-Xia Cao received the B. Eng. degree in communication engineering from Hunan International Economics University, China in 2011, and the M. Eng. degree in circuits and systems from Hunan Normal University, China in 2015. Currently, she is a Ph. D. degree candidate in space electronics at Lanzhou Institute of Physics, China Academy of Space Technology (CAST), China.

Her research interests include space electronic technology, computer vision, and augmented reality.

Wen-Xin Li received the M. Eng. degree in applied mathematics from Northwestern Polytechnical University, China in 1993, and the Ph. D. degree in automatic control from Northwestern Polytechnical University, China in 2011. Currently, he is a researcher at Lanzhou Institute of Physics, CAST, China.

His research interests include space electronic technology, software reuse technology, system simulation and reconstruction technology.

Wei-Ping Ma received the B. Eng. and M. Eng. degrees in electronic information science and technology from Xi′an University of Science and technology, China in 2011 and 2015, respectively. Currently, she is a Ph. D. degree candidate in space electronics at Lanzhou Institute of Physics, CAST, China.

Her research interests include space electronic technology, computer vision and intelligent robotics.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Cao, PX., Li, WX. & Ma, WP. Tracking Registration Algorithm for Augmented Reality Based on Template Tracking. Int. J. Autom. Comput. 17, 257–266 (2020). https://doi.org/10.1007/s11633-019-1198-3

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11633-019-1198-3

Keywords

Search

Navigation