Skip to main content
SpringerLink
Log in

A new software/hardware architecture for real time image processing of wide area airborne camera images

  • Special Issue
  • Published:
Journal of Real-Time Image Processing Aims and scope Submit manuscript

Abstract

This paper describes a new software/hardware architecture for processing wide area airborne camera images in real time. The images under consideration are acquired from the 3K-camera system developed at DLR (German Aerospace Center). It consists of three off-the-shelf cameras, each of it delivers 16 Mpixel three times a second. One camera is installed in nadir, whereas the other two cameras are looking in side direction. Main applications of our system are supposed to be automotive traffic monitoring, determining the workload of public road networks during mass events, or obtaining a survey of damages in disaster areas in real time. Altogether, this demands a fast image processing system on the aircraft, because the amount of original high resolution images can not be sent to ground by up-to-date transfer mode systems. The on-board image processing system is distributed over a local network. On each PC several modules are running concurrently. In order to synchronize several processes and to assure access to commonly used data, a new distributed middleware for real time image processing is introduced. Two sophisticated modules one for orthorectification of images and one for traffic monitoring are explained in more detail. The orthorectification and mosaicking is executed on the fast graphics processing unit on one PC, whereas the traffic monitoring module runs on another PC in the on-board network. The resulting image data and evaluated traffic parameters are sent to a ground station in near real time and are distributed to the involved users. Thus, with the here suggested software/hardware system it becomes possible to support rescue forces and security forces in disaster areas or during mass events in near real time.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17

Similar content being viewed by others

Notes

  1. DANAOS was king of ARGOS in the fifteenth century BC.

References

  1. Bernardini, F., Martin, I.M., Rushmeier, H.: High-quality texture reconstruction from multiple scans. IEEE Trans. Vis. Comput. Graph. 7, 318–332 (2001)

    Article  Google Scholar 

  2. Bornik, A., Karner, K., Bauer, J., Leberl, F., Mayer, H.: High-quality texture reconstruction from multiple views. J. Vis. Comput. Anim. 12, 263–276 (2002)

    Article  Google Scholar 

  3. Canny, J.F.: A computational approach to edge detection. IEEE Trans. Pattern Anal. Mach. Intell. 8(6), 679–698 (1986)

    Article  Google Scholar 

  4. Deriche, R.: Using cannys criteria to derive an optimal edge detector recursively implemented. Int. J. Comput. Vis. 1(2), 167–187 (1987)

    Article  Google Scholar 

  5. Diethers, K., Finkemeyer, B., Kohn, N.: Middleware zur realisierung einer offenen steuerungshardware fnr hochdynamische prozesse. it Inf. Technol. 1, 39–47 (2004)

    Article  Google Scholar 

  6. Emmerich, W.: The future of software engeneering, ACM Press, chap Software engineering and middleware: A roadmap, pp. 117–129 (2000)

  7. Ernst, I., Sujew, S., Thiessenhusen, K.U., Hetscher, M., Ramann, S., RuhT, M.: Lumos—airborne traffic monitoring system. In: 6th IEEE International Conference on Intelligent Transportation Systems, Shanghai, China (2003)

  8. Finkemeyer, B., Borchard, M., Wahl, F.: A robot control architecture based on an object server. In: IASTED International Conference Robotics and Manufacturing (2001)

  9. Henning, M.: A new approach to object-oriented middleware. IEEE Interenet Comput. (2004)

  10. Hinz, S., Kurz, F., Weihing, D., Suchandt, S., Meyer, F., Bamler, R.: Evaluation of traffic monitoring based on spatio-temporal co-registration of sar data and optical image sequences. PFG Photogramm. Fernerkundung Geoinf. 5, 309–325 (2007)

    Google Scholar 

  11. Kurz, F., Mueller, R., Stephani, M., Reinartz, P., Schroeder, M.: Calibration of a wide-angle digital camera system for near real time scenarios. In: ISPRS Hannover Workshop 2007—High Resolution Earth Imaging for Geospatial Information, Hannover, Germany (2007)

  12. Liu, C.H.: Fast georeferncing images through generalized photogrammetric algorithms. In: ISPRS 2004 Conference of Photogrammetry and Remote Sensing, Commission I, WG 1/6 (2004)

  13. Mueller, R., Lehner, M., Mueller, R., Reinartz, P., Schroeder, M., Vollmer, B. A program for direct georeferencing of airborne and spaceborne line scanner images. In: Conference of Photogrammetry and Remote Sensing, no. WG 1/5 in Commission I (2004)

  14. Myerson, J.M.: The Complete Book of Middleware. Auerbach (2002)

  15. Paillau, P.: Detecting step edges in noisy sar images: a new linear operator. IEEE Trans. Geosci. Remote Sens. 35, 191–196 (1997)

    Article  Google Scholar 

  16. Polze, A., Sha, L.: Real-time programming with corba. In: 24th Euromicro Conference, Network Computing Workshop (1998)

  17. Reinartz, P., Lachaise, M., Schmeer, E., Krauss, T., Runge, H.: Traffic monitoring with serial images from airborne cameras. ISPRS J. Photogramm. Remote Sens. 61:149–158 (2006)

    Article  Google Scholar 

  18. Schantz, R.E., Loyall, J.P., Schmidt, D.C., Rodrigues, C., Krishnamurthy, Y., Pyarali, I.: Flexible and adaptive qos control for distributed real-time and embedded middleware. In: Proceedings of Middleware 2003, 4th IFIP/ACM/USENIX International Conference on Distributed Systems Platforms, Rio de Janeiro, Brazil (2003)

  19. Schmidt, D.C.: Middleware for real-time and embedded systems. Commun. ACM 45(6), 43–48 (2002)

    Article  Google Scholar 

  20. Schmidt, D.C., Kuhns, F.: An overview of the real-time corba specification. Computer 33, 56–63 (2000)

    Article  Google Scholar 

  21. Schmidt, D.C., Levine, D.L., Mungee, S.: The design of the tao real-time object request broker. Comput. Commun. 21(4), 294–324 (1998)

    Article  Google Scholar 

  22. Shen, J., Castan, S. An optimal linear operator for step edge detection. CVGIP Graph. Models Image Process. 54(2), 112–133 (1992)

    Article  Google Scholar 

  23. Varchmin, J.U., Beckmann, G., Kohn, N.: Architecture of a realtime communication network for parallel robots. In: First International Colloquium Collaborative Research Centre 562—Robotic Systems for Handling and Assembly (2002)

  24. Woo, M., Neider, J., Davis, T., Shreiner, D.: OpenGL Programming Guide. Addision Wesley, Reading (1999)

  25. Wright, D.B., Yotsumata, T., El-Sheimy, N., Liu, C.H.: Real tim identification and location of forest fire hotspots from geo-referenced thermal images. In: Conference of Photogrammetry and Remote Sensing, Commission I, WG 1/6 (2004)

Download references

Author information

Authors and Affiliations

  1. Remote Sensing Technology Institute, German Aerospace Center, 82234, Wessling, Germany

    Ulrike Thomas, Dominik Rosenbaum, Franz Kurz, Sahil Suri & Peter Reinartz

Authors
  1. Ulrike Thomas
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Dominik Rosenbaum
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Franz Kurz
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Sahil Suri
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Peter Reinartz
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Ulrike Thomas.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Thomas, U., Rosenbaum, D., Kurz, F. et al. A new software/hardware architecture for real time image processing of wide area airborne camera images. J Real-Time Image Proc 4, 229–244 (2009). https://doi.org/10.1007/s11554-008-0109-6

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11554-008-0109-6

Keywords

Search

Navigation