Skip to main content
Log in

A robust optical/inertial data fusion system for motion tracking of the robot manipulator

  • Published:
Journal of Zhejiang University SCIENCE C Aims and scope Submit manuscript

Abstract

We present an optical/inertial data fusion system for motion tracking of the robot manipulator, which is proved to be more robust and accurate than a normal optical tracking system (OTS). By data fusion with an inertial measurement unit (IMU), both robustness and accuracy of OTS are improved. The Kalman filter is used in data fusion. The error distribution of OTS provides an important reference on the estimation of measurement noise using the Kalman filter. With a proper setup of the system and an effective method of coordinate frame synchronization, the results of experiments show a significant improvement in terms of robustness and position accuracy.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  • Aristidou, A., Cameron, J., Lasenby, J., 2008. Real-time estimation of missing markers in human motion capture. 2nd Int. Conf. on Bioinformatics and Biomedical Engineering, p. 1343–1346. [doi:10.1109/ICBBE.2008.665]

    Google Scholar 

  • Bleser, G., Stricker, D., 2009. Advanced tracking through efficient image processing and visual-inertial sensor fusion. Comput. & Graph., 33(1):59–72. [doi:10.1016/j.cag.2008.11.004]

    Article  Google Scholar 

  • Caron, F., Duflos, E., Pomorski, D., et al., 2006. GPS/IMU data fusion using multisensor Kalman filtering: introduction of contextual aspects. Inform. Fus., 7(2): 221–230. [doi:10.1016/j.inffus.2004.07.002]

    Article  Google Scholar 

  • Claasen, G.C., Martin, P., Picard, F., 2011. Tracking and control for handheld surgery tools. IEEE Biomedical Circuits and Systems Conf., p.428–431. [doi:10.1109/BioCAS.2011.6107819]

    Google Scholar 

  • Dong, Y., Zwahlen, P., Nguyen, A.M., et al., 2010. High performance inertial navigation grade sigma-delta MEMS accelerometer. IEEE/ION Position Location and Navigation Symp., p.32–36. [doi:10.1109/PLANS.2010.5507135]

    Chapter  Google Scholar 

  • Foxlin, E., Altshuler, Y., Naimark, L., et al., 2004. Flighttracker: a novel optical/inertial tracker for cockpit enhanced vision. Proc. 3rd IEEE/ACM Int. Symp. on Mixed and Augmented Reality, p.212–221. [doi:10.1109/ISMAR.2004.32]

    Chapter  Google Scholar 

  • Park, I., Lee, B., Cho, S., et al., 2012. Laser-based kinematic calibration of robot manipulator using differential kinematics. IEEE/ASME Trans. Mechatron., 17(6):1059–1067. [doi:10.1109/TMECH.2011.2158234]

    Article  Google Scholar 

  • Ren, H., Rank, D., Merdes, M., et al., 2012. Multisensor data fusion in an integrated tracking system for endoscopic surgery. IEEE Trans. Inform. Technol. Biomed., 16(1): 106–111. [doi:10.1109/TITB.2011.2164088]

    Article  Google Scholar 

  • Shirinzadeh, B., Teoh, P., Tian, Y., et al., 2010. Laser interferometry-based guidance methodology for high precision positioning of mechanisms and robots. Robot. Comput.-Integr. Manuf., 26(1):74–82. [doi:10.1016/j.rcim.2009.04.002]

    Article  Google Scholar 

  • Soroush, A., Farahmand, F., Salarieh, H., 2012. Design and implementation of an improved real-time tracking system for navigation surgery by fusion of optical and inertial tracking methods. Appl. Mech. Mater., 186:273–279. [doi:10.4028/www.scientific.net/AMM.186.273]

    Article  Google Scholar 

  • Su, L., Shi, L., Yu, Y., 2009. Collaborative assembly operation between two modular robots based on the optical position feedback. J. Robot., Article ID 214154. [doi:10.1155/2009/214154]

    Google Scholar 

  • Sukkarieh, S., Nebot, E.M., Durrant-Whyte, H.F., 1999. A high integrity IMU/GPS navigation loop for autonomous land vehicle applications. IEEE Trans. Robot. Autom., 15(3):572–578. [doi:10.1109/70.768189]

    Article  Google Scholar 

  • Syed, Z.F., Aggarwal, P., Niu, X., et al., 2008. Civilian vehicle navigation: required alignment of the inertial sensors for acceptable navigation accuracies. IEEE Trans. Veh. Technol., 57(6):3402–3412. [doi:10.1109/TVT.2008.921616]

    Article  Google Scholar 

  • Tao, Y., Hu, H., 2008. A novel sensing and data fusion system for 3-D arm motion tracking in telerehabilitation. IEEE Trans. Instrum. Meas., 57(5):1029–1040. [doi:10.1109/TIM.2007.913828]

    Article  Google Scholar 

  • Wiles, A.D., Thompson, D.G., Frantz, D.D., 2004. Accuracy assessment and interpretation for optical tracking systems. SPIE, 5367:421–432. [doi:10.1117/12.536128]

    Article  Google Scholar 

  • Xiong, N., Svensson, P., 2002. Multisensor management for information fusion: issues and approaches. Inform. Fus., 3(2):163–186. [doi:10.1016/S1566-2535(02)00055-6]

    Article  Google Scholar 

  • Yun, X., Calusdian, J., Bachmann, E.R., et al., 2012. Estimation of human foot motion during normal walking using inertial and magnetic sensor measurements. IEEE Trans. Instrum. Meas., 61(7):2059–2072. [doi:10.1109/TIM.2011.2179830]

    Article  Google Scholar 

  • Zhang, P., Gu, J., Milios, E.E., et al., 2005. Navigation with IMU/GPS/digital compass with unscented Kalman filter. IEEE Int. Conf. on Mechatronics and Automation, p.1497–1502. [doi:10.1109/ICMA.2005.1626777]

    Google Scholar 

  • Zhang, Z.Q., Wu, J.K., 2011. A novel hierarchical information fusion method for three-dimensional upper limb motion estimation. IEEE Trans. Instrum. Meas., 60(11):3709–3719. [doi:10.1109/TIM.2011.2135070]

    Article  Google Scholar 

  • Zhou, H., Hu, H., 2010. Reducing drifts in the inertial measurements of wrist and elbow positions. IEEE Trans. Instrum. Meas., 59(3):575–585. [doi:10.1109/TIM.2009.2025065]

    Article  MathSciNet  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Can-jun Yang.

Additional information

Project supported by the National Natural Science Foundation of China (No. 51221004) and Sponsored Research between ABB Research Ltd. and Zhejiang University

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Chen, J., Yang, Cj., Hofschulte, J. et al. A robust optical/inertial data fusion system for motion tracking of the robot manipulator. J. Zhejiang Univ. - Sci. C 15, 574–583 (2014). https://doi.org/10.1631/jzus.C1300302

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1631/jzus.C1300302

Key words

CLC number

Navigation