Skip to main content
SpringerLink
Log in

Moving object detection by mobile Stereo Omni-directional System (SOS) using spherical depth image

  • Theoretical Advances
  • Published:
Pattern Analysis and Applications Aims and scope Submit manuscript

Abstract

Moving object detection with a mobile image sensor is an important task for mobile surveillance systems running in real environments. In this paper, we propose a novel method to effectively solve this problem by using a Stereo Omni-directional System (SOS), which can obtain both color and depth images of the environment in real time with a complete spherical field of view. Taking advantage of the SOS that the frame-out problem never occurs, we develop a method to detect the regions of moving objects stably under arbitrary movement and pose change of the SOS, by using the spherical depth image sequence obtained by the SOS. The method first predicts the depth image for the current time from that obtained at the previous time and the ego-motion of the SOS, and then detects moving objects by comparing the predicted depth image with the actual one obtained at the current time.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17
Fig. 18
Fig. 19
Fig. 20
Fig. 21
Figure
Figure
Figure
Figure

References

  1. Murray D, Basu A (1994) Motion tracking with an active camera. IEEE Trans Pattern Anal Mach Intell 16(5):449–459

    Article  Google Scholar 

  2. Nair D, Aggarwal J (1994) Detecting unexpected moving obstacles that appear in the path of navigation robot. In: Proceedings of the IEEE international conference on image processing, pp 311–315

  3. Odobez J, Bouthemy P (1994) Detection of multiple moving objects using multiscale MRF with camera motion compensation. In: Proceedings of the IEEE international conference on image processing Vol 2, pp 257–261

  4. Iraniand M, Rousso B, Peleg S (1992) Detecting and tracking multiple moving objects using temporal integration. In: Proceedings of European conference on computer vision, pp 282–287

  5. Araki S, Matsuoka T, Yokoya N, Takemura H (1999) Real-time tracking of multiple moving object contours in a moving Camera Image Sequence. Syst Comput Jpn 30(9):25–33

    Article  Google Scholar 

  6. Frazier J, Nevatia R (1992) Detecting moving objects from moving platform. In: Proceedings of the IEEE international conference on robotics and automation, pp 1627–1633

  7. Nagai A, Kuno Y, Shirai Y (1999) Detection of moving objects against a changing background. Syst Comput Jpn 30(11):107–116

    Article  Google Scholar 

  8. Watanabe M, Takeda N, Onoguchi K (1996) A Moving object recognition method by optical flow anaysis. In: Proceedings of the international conference on pattern recognition, pp 528–533

  9. Prassler E, Scholz J (2000) Tracking multiple moving objects for real-time robot navigation. Autonomous Robots 8(2):105–116

    Article  Google Scholar 

  10. Lindstrom M, Eklundh J-O (2001) Detecting and tracking moving objects from a mobile platform using a laser range scanner. In: Proceedings of the international conference on intelligent robots and systems, pp 1364–1369

  11. Lu F, Milios EE (1994) Robot pose estimation in unknown environments by matching 2d range scans. In: Proceedings of the international conference on pattern recognition, pp 935–938

  12. Koyasu H, Miura J, Shirai Y (2002) Recognizing moving obstacles for robot navigation using real-time omnidirectional stereo vision. Robotics Mecatron 14(2):147–156

    Google Scholar 

  13. Okada K, Kagami S, Inaba M, Inoue H (2001) Walking human avoidance and detection from a mobile robot using 3d depth flow. In: Proceedings of the IEEE international conference on robotics and automation, pp 2307–2312

  14. Beymer D, Konolige K (1999) Real-time tracking of multiple people using continuous detection. In: Proceedings of the IEEE international conference on computer vision

  15. Davis L, Philomin V, Duraiswami R (2000) Tracking humans from a moving platform. In: proceedings of the international conference on pattern recognition Vol 4, pp 171–178

  16. Fod A, Howard A, Mataric MJ (2002) A laser-based people tracker. In: Proceedings of the IEEE international conference on robotics and automation, pp 3024–3029

  17. Kluge B, Kohler C, Prassler E (2001) Fast and robust tracking of multiple objects with a laser range finder. In: Proceedings of the IEEE international conference on robotics and automation, pp 1683–1688

  18. Reid DB (1979) An algorithm for tracking multiple targets. IEEE Trans Automatic Control 24(6):843–854

    Article  Google Scholar 

  19. Bjorkman M, Eklundh J-O (2000) A Real-time system for epipolar geometry and ego-motion estimation. In: Proceedings of the IEEE computer vision and pattern recognition Vol 2, pp 506–513

  20. Zhang T, Tomasi C (1999) Fast, robust, and consistent camera motion estimation. In: Proceedings of the IEEE computer vision and pattern recognition Vol 1, pp 164–170

  21. Tanahashi H, Shimada D, Yamamoto K, Niwa Y (2001) Acquisition of three-dimensional information in a real environment by using the Stereo Omni-directional System (SOS). In: Proceedings of the IEEE third international conference on 3-d digital imaging and modeling, pp 365–371

  22. Wang C, Tanahashi H, Satoh Y, Hirayu H, Sato J, Niwa Y, Yamamoto K (2003) Slant estimation for active vision using edge directions in omni-directional images. In: Proceedings of the IEEE international conference on image processing, pp 841–844

  23. Wang C, Tanahashi H, Satoh Y, Hirayu H, Niwa Y, Yamamoto K (2004) Location and pose estimation for active vision using panoramic edge histograms. Syst Comput Jpn 35(12):32–43

    Article  MATH  Google Scholar 

  24. Shimizu S, Yamamoto K, Wang C, Satoh Y, Tanahashi H, Niwa Y (2004) Moving object detection using depth information obtained by mobile Stereo Omni-directional System (SOS). In: Proceedings of the asian conference on computer vision, pp 336–341

  25. Shimizu S, Yamamoto K, Wang C, Satoh Y, Tanahashi H, Niwa Y (2004) Moving object detection with mobile Stereo Omni-directional System (SOS) based on motion compensatory inter-frame depth subtraction. In: Proceedings of the international conference on pattern recognition Vol 3, pp 248–251

Download references

Author information

Authors and Affiliations

  1. Research and Development Division, Softopia Japan, 4-1-7 Kagano, Ogaki, Gifu, 503-8569, Japan

    Sanae Shimizu, Caihua Wang & Yoshinori Niwa

  2. Department of Information Science, Faculty of Engineering, Gifu University, 1-1 Yanaido, Gifu, 501-1193, Japan

    Sanae Shimizu & Kazuhiko Yamamoto

  3. Information Technology Research Institute, National Institute of Advanced Industrial Science and Technology (AIST), Central2, 1-1-1 Umezono, Tsukuba, Ibaraki, 305-8568, Japan

    Yutaka Satoh

  4. Information System Division, IMIT-Gifu, 4-179-19 Sue, Kakamigahara, Gifu, 509-0108, Japan

    Hideki Tanahashi

Authors
  1. Sanae Shimizu
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Kazuhiko Yamamoto
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Caihua Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Yutaka Satoh
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Hideki Tanahashi
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Yoshinori Niwa
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Sanae Shimizu.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Shimizu, S., Yamamoto, K., Wang, C. et al. Moving object detection by mobile Stereo Omni-directional System (SOS) using spherical depth image. Pattern Anal Applic 9, 113–126 (2006). https://doi.org/10.1007/s10044-005-0008-4

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10044-005-0008-4

Keywords

Search

Navigation