Skip to main content
SpringerLink
Log in

Microscopic vision system with all-in-focus and depth images

  • Published:
Machine Vision and Applications Aims and scope Submit manuscript

Abstract.

In this paper, a high-speed digital processed microscopic observational system for telemicrooperation is proposed with a dynamic focusing system and a high-speed digital-processing system using the “depth from focus” criterion. In our previous work [10], we proposed a system that could simultaneously obtain an “all-in-focus image” as well as the “depth” of an object. In reality, in a microoperation, it is not easy to obtain good visibility of objects with a microscope focused at a shallow depth, especially in microsurgery and DNA studies, among other procedures. In this sense, the all-in-focus image, which keeps an in-focus texture over the entire object, is useful for observing microenvironments with the microscope. However, one drawback of the all-in-focus image is that there is no information about the objects’ depth. It is also important to obtain a depth map and show the 3D microenvironments at any view angle in real time to actuate the microobjects. Our earlier system with a dynamic focusing lens and a smart sensor could obtain the all-in-focus image and the depth in 2 s. To realize real-time microoperation, a system that could process at least 30 frames per second (60 times faster than the previous system) would be required. This paper briefly reviews the depth from focus criterion to Simultaneously achieve the all-in-focus image and the reconstruction of 3D microenvironments. After discussing the problem inherent in our earlier system, a frame-rate system constructed with a high-speed video camera and FPGA (field programmable gate array) hardware is discussed. To adapt this system for use with the microscope, new criteria to solve the “ghost problem” in reconstructing the all-in-focus image are proposed. Finally, microobservation shows the validity of this system.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Brajovic V, Kanade T (1997) Sensory attention: computational sensor paradigm for low-latency adaptive vision. In: Proceedings of the DARPA image understanding workshop, New Orleans, May 1997

  2. Kaneko T, Ohmi T, Ohya N, Kawahara N, Hattori T (1997) A new, compact, and quick-response dynamic focusing lens. In: Proceedings of the 9th international conference on solid-state sensors and actuators (Transducers’97), Chicago, 16-19 June 1997, pp 63-66

  3. Kodama K, Aizawa K, Hatori M (1997) Acquisition of an all-focused image by the use of multiple differently focused images. Trans Inst Electron Inform Commun Eng Engineers D-II J80-D-II(9):2298-2307

  4. Kundur SR, Raviv D (1996) Novel active-vision-based visual-threat-cue for autonomous navigation tasks. In: Proceedings of CVPR’96, San Francisco, June 1996, pp 606-612

  5. MAPP (1997) User documentation MAPP2200 PCI system. IVP

  6. Moini A (1997) Vision chips or seeing silicon. http://www.iee.et.tu-dresden.de/iee/eb/analog/papers/mirror/visionchips/vision+_+chips/vision+_+chips.html

  7. Namiki A, Nakabo Y, Ishii I, Ishikawa M (2000) 1ms sensory-motor fusion system. IEEE Trans Mechatron 5(3):244-252

    Article  Google Scholar 

  8. Nayer SK, Nakagawa Y (1994) Shape from focus. IEEE Trans PAMI 16(8):824-831

    Google Scholar 

  9. Nayer SK, Watanabe M, Noguchi M (1995) Real-time focus range sensor. In: Proceedings of the international conference on computer vision (ICCV’95), Cambridge, MA, 20-23 June 1995, pp 995-1001

  10. Pedraza Ortega JC, Ohba K, Tanie K, Rin G, Dangi R, Takei Y, Kaneko T, Kawahara N (2000) Real-time VR camera system. In: Proceedings of the 4th Asian conference on computer vision, Taipei, Taiwan, 8-11 January 2000, pp 503-513

  11. Watanabe M, Nayer SK (1996) Minimal operator set for passive depth from defocus. In: Proceedings of CVPR’96, San Francisco, 18-20 June 1996, pp 431-438

Download references

Author information

Authors and Affiliations

  1. The National Institute of Advanced Industrial Science and Technology, 1-2 Namiki, 305-8564, Tsukuba, Japan

    Kohtaro Ohba

  2. Engineering and Industrial Development Center (CIDESI), Av. Playa Pie de la Cuesta 702, Desarrollo San Pablo, C.P. 76130, Santiago de Querataro, Qro. Mexico.

    Jesus Carlos Pedraza Ortega

  3. The National Institute of Advanced Industrial Science and Technology, 1-2 Namiki, 305-8564, Tsukuba, Japan

    Kazuo Tanie

  4. Photron Co., 1-9-8 Shibuya, Shibuya-ku, Tokyo, Japan

    Masataka Tsuji & Shigeru Yamada

Authors
  1. Kohtaro Ohba
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Jesus Carlos Pedraza Ortega
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Kazuo Tanie
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Masataka Tsuji
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Shigeru Yamada
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Kohtaro Ohba.

Additional information

Received: 12 August 2001, Accepted: 17 July 2002, Published online: 12 November 2003

Correspondence to: Kohtaro Ohba

Rights and permissions

Reprints and permissions

About this article

Cite this article

Ohba, K., Ortega, J.C.P., Tanie, K. et al. Microscopic vision system with all-in-focus and depth images. Machine Vision and Applications 15, 55–62 (2003). https://doi.org/10.1007/s00138-003-0125-2

Download citation

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00138-003-0125-2

Keywords:

Search

Navigation