Skip to main content
Springer Nature Link
Log in

Tracking projection method for 3D space by a mobile robot with camera and projector based on a structured-environment approach

  • Original Article
  • Published:
Artificial Life and Robotics Aims and scope Submit manuscript

Abstract

In this paper, we discuss a mobile robot (Campro-RIS) that provides visual support for human activities by projecting information onto the surfaces of various objects in living spaces through a structured-environment approach. Campro-RIS employs a parallel two-wheeled vehicle system with a camera and a projector whose angle can be controlled with a pan/tilt actuator. By actively examining visual markers placed in the environment in advance, the robot projects distortion-free image onto surfaces located at arbitrary distances and orientations. To precisely project the image onto the target location while simultaneously avoiding obstacles around the robot and staying within the pan/tilt actuator’s movable range, we newly propose a robust projection control method built upon an image-based visual servoing technique based on actuator redundancy. The effectiveness of the proposed method is demonstrated in a three dimensional experimental system.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17
Fig. 18
Fig. 19
Fig. 20
Fig. 21

Similar content being viewed by others

Explore related subjects

Discover the latest articles, news and stories from top researchers in related subjects.

References

  1. Kobatake T, Matsuda I, Aomori H et al (2010) Image presentation system using a head-mounted projector. IEICE 34(32):25–28

    Google Scholar 

  2. Kashima T, Nakajima K (2010) Accuracy improvement of touch-screen by projector and camera. ITE Tech Rep 34(31):33–36

    Google Scholar 

  3. Iwaki S, Kawata H, Muto S et al (2008) Freetagpaper: a pen-and-paper-based collaboration system using visual tags printed on paper. CSTST 28(31):298–302

    Article  Google Scholar 

  4. Sugimoto M, Miyahara K, Inoue H et al (2006) Projecting displays of mobile devices based on 3D positions and intuitive manipulation techniques. IPSJ 47(6):1976–1985

    Google Scholar 

  5. Yamazaki M, Nishimura K, Tanikawa T et al (2010) A projection method with high presence using a handheld projector. IEICE 34(25):19–24

    Google Scholar 

  6. Tsuchiya T, Yamazawa K, Yokoya N (2011) Projection based remote control system for home appliances. IEICE 110(457):25–30

    Google Scholar 

  7. Inagaki H, Okamoto T (2014) Development of answer check support system using pocket projector. IEICE 114(82):73–76

    Google Scholar 

  8. Choi S, Kim W, Lee C (2013) Interactive display robot: projector robot with natural user interface. In: 2013 8th ACM/IEEE HRI, Proceedings, pp109–110

  9. Kasetani M, Noguchi T, Maegawa K, et al. (2014) Studies on information projection method for ubiquitous display to advertise a commercial in a large commercial building. In: Proceedings of the 2014 JSME, No.14-2, 2A1-L02(1)–(3)

  10. Yoshimi T, Katsuki R, Oga J (2009) Robot manipulation technology using environment and manipulation frameworks. Toshiba Rev 64(1):14–18

    Google Scholar 

  11. Luca AD, Ferri M, Oriolo G et al (2008) Visual sevoing with exploitation of redundancy: an experimental study. Robot Automation, pp 3231–3237. https://www.researchgate.net/publication/224318711_Visual_servoing_with_exploitation_of_redundancy_An_experimental_study

  12. Izumi T, Iwaki S, Tsuji K et al (2011) Robust projection method for a mobile robot with camera and projector based on a structured-environment approach. In: IEEE/SICE International Symposium on System Integration, pp 585–590. http://anothersample.net/robust-projection-method-for-a-mobile-robot-with-camera-and-projector-based-on-a-structured-environment-approach

  13. Kato H, Mark B, Asano K et al (1999) An augmented reality system and its calibration based on marker tracking. Virtual Real Soc Jpn 4(4):607–616

    Google Scholar 

  14. Furukawa R, Inose K, Kawasaki H (2008) Camera and projector calibration. Institute Image Info Telev Eng 62(12):1964–1968

    Google Scholar 

  15. Hutchinson S, Hager G, Corke P (1996) A tutorial on visual servo control. IEEE Robot Autom Soc 12(5):651–669

    Article  Google Scholar 

  16. Yoshikawa T (2010) Foundations of robot control. Corona sha, Tokyo, pp 208–219

    Google Scholar 

Download references

Acknowledgments

We would like to express our gratitude to alumnus of our research laboratory, Mr. Tomohiro Izumi and Mr. Kazuya Tsuji, who established the basic concept and essential formulation for our robust tracking projection method.

Author information

Authors and Affiliations

  1. Hiroshima City University, Hiroshima, Japan

    Kenji Tatsumoto, Satoshi Iwaki & Tetsushi Ikeda

Authors
  1. Kenji Tatsumoto
    View author publications

    You can also search for this author inPubMed Google Scholar

  2. Satoshi Iwaki
    View author publications

    You can also search for this author inPubMed Google Scholar

  3. Tetsushi Ikeda
    View author publications

    You can also search for this author inPubMed Google Scholar

Corresponding author

Correspondence to Kenji Tatsumoto.

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Tatsumoto, K., Iwaki, S. & Ikeda, T. Tracking projection method for 3D space by a mobile robot with camera and projector based on a structured-environment approach. Artif Life Robotics 22, 90–101 (2017). https://doi.org/10.1007/s10015-016-0312-7

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10015-016-0312-7

Keywords