Skip to main content
SpringerLink
Log in

Resource aware and incremental mosaics of wide areas from small-scale UAVs

  • Original Paper
  • Published:
Machine Vision and Applications Aims and scope Submit manuscript

Abstract

Small-scale unmanned aerial vehicles (UAVs) are an emerging research area and have been recently demonstrated in many applications including disaster response management, construction site monitoring and wide area surveillance where multiple UAVs impose various benefits. In this work we present a system composed of multiple networked UAVs for autonomously monitoring a wide area scenario. Each UAV is able to follow waypoints and capture high-resolution images. In order to overcome the strong resource limitations we implement an incremental approach for generating an orthographic mosaic from the individual images. Captured images are pre-processed on-board, annotated with other sensor data and transferred by a prioritized transmission scheme. The ultimate goal of our approach is to generate an overview mosaic as fast as possible and to improve its quality over time. The mosaicking exploits position and orientation data of the UAV to compute rough image projections which are incrementally refined by scene structure analysis when more image data is available. We evaluate our incremental mosaicking in the strongly resource limited UAV network composed of up to three concurrently flying UAVs. Our results are compared to state-of-the-art mosaicking methods and show a unique performance in our dedicated application scenarios.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17
Fig. 18
Fig. 19
Fig. 20

Similar content being viewed by others

Notes

  1. http://www.asctec.de/ last visited November 2013.

  2. http://microdrones.com/ last visited April 2013.

  3. Kakadu JPEG2000 Encoder, http://www.kakadusoftware.com; last visited on April 2nd 2013.

  4. http://enblend.sourceforge.net/ last visited on November 11th 2013.

  5. http://www.kolor.com/ visited on December 5th 2013.

  6. http://pix4d.com/ visited on December 5th 2013.

References

  1. Ahmad, A., Samad, A.: Aerial mapping using high resolution digital camera and unmanned aerial vehicle for Geographical Information System. In: Proceedings of the 6th International Colloquium on Signal Processing and Its Applications (CSPA), pp. 1–6 (2010)

  2. Akyildiz, I.F., Melodia, T., Chowdhury, K.R.: A survey on wireless multimedia sensor networks. J. Comput. Netw. 51(4), 921–960 (2007)

    Article  Google Scholar 

  3. Anderson, E., Bai, Z., Bischof, C., Blackford, S., Demmel, J., Dongarra, J., Du Croz, J., Greenbaum, A., Hammarling, S., McKenney, A., Sorensen, D.: LAPACK Users’ Guide, 3rd edn. In: Society for Industrial and Applied Mathematics. Philadelphia (1999)

  4. Arya, S., Mount, D.M.: Approximate nearest neighbor queries in fixed dimensions. In: Proceedings of the fourth annual ACM-SIAM Symposium on Discrete algorithms, pp. 271–280. Society for Industrial and Applied Mathematics (1993)

  5. Blackford, L.S., Petitet, A., Pozo, R., Remington, K., Whaley, R.C., Demmel, J., Dongarra, J., Duff, I., Hammarling, S., Henry, G.: An updated set of basic linear algebra subprograms (BLAS). ACM Trans. Math. Softw. 28(2), 135–151 (2002)

    Article  Google Scholar 

  6. Bradley, A.P., Stentiford, F.W.: JPEG 2000 and region of interest coding. In: Proceedings of Digital Image Computing Techniques and Applications (DICTA2002), pp. 1–6. Melbourne (2002)

  7. Burt, P.J., Adelson, E.H.: A multiresolution spline with application to image mosaics. ACM Trans. Graph. 2(4), 217–236 (1983)

    Article  Google Scholar 

  8. Caballero, F., Merino, L., Ferruz, J., Ollero, A.: Unmanned aerial vehicle localization based on monocular vision and online mosaicking. J. Intell. Robotic Syst. 55(4), 323–343 (2009)

    Article  MATH  Google Scholar 

  9. Cheng, Y., Xue, D., Li, Y.: A fast mosaic approach for remote sensing images. In: Proceedings of the International Conference on Mechatronics and Automation (ICMA), pp. 2009–2013 (2007)

  10. Colomina, I., Molina, P.: Unmanned aerial systems for photogrammetry and remote sensing: A review. ISPRS J. Photogramm. Remote Sens. 92, 79–97 (2014)

  11. Coopmans, C., Han, Y.: AggieAir: an integrated and effective small multi-UAV command, control and data collection architecture. In: Proceedings of the 5th ASME/IEEE International Conference on Mechatronic and Embedded Systems and Applications (MESA09), pp. 1–7 (2009)

  12. Daniel, K., Dusza, B., Lewandowski, A., Wietfeld, C.: AirShield: a system-of-systems MUAV remote sensing architecture for disaster response. In: Proceedings of the 3rd Annual IEEE Systems Conference, pp. 196–200 (2009)

  13. Elibol, A., Kim, J., Gracias, N., Garcia, R.: Efficient image mosaicing for multi-robot visual underwater mapping. Pattern Recognit. Lett. 46, 20–26 (2014)

    Article  Google Scholar 

  14. Fischler, M.A., Bolles, R.C.: Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography. Commun. ACM 24(6), 381–395 (1981)

    Article  MathSciNet  Google Scholar 

  15. Frescura, F., Giorni, M., Feci, C., Cacopardi, S.: JPEG2000 and MJPEG2000 transmission in 802.11 wireless local area networks. IEEE Trans. Consum. Electron. 49(4), 861–871 (2003)

    Article  Google Scholar 

  16. Friedman, J.H., Bentley, J.L., Finkel, R.A.: An algorithm for finding best matches in logarithmic expected time. ACM Trans. Math. Softw. 3(3), 209–226 (1977)

    Article  MATH  Google Scholar 

  17. Furukawa, Y., Ponce, J.: Accurate, dense, and robust multiview stereopsis. IEEE Trans. Pattern Anal. Mach. Intell. 32(8), 1362–1376 (2010)

    Article  Google Scholar 

  18. Hartley, R.I., Zisserman, A.: Multiple View Geometry in Computer Vision, 2nd edn. Cambridge University Press, Cambridge (2004). ISBN:0521540518

  19. Hui, J.W., Culler, D.E.: IP is dead, long live IP for wireless sensor networks. In: SenSys’08: Proceedings of the 6th ACM Conference on Embedded Network Sensor Systems. ACM Request Permissions (2008)

  20. Mersheeva, V., Friedrich, G.: Routing for continuous monitoring by multiple micro UAVs in disaster scenarios. In: Proceedings of the European Conference on Artificial Intelligence, pp. 588–593 (2012)

  21. Pratt, K.S., Murphy, R., Stover, S., Griffin, C.: CONOPS and autonomy recommendations for VTOL small unmanned aerial system based on Hurricane Katrina operations. J. Field Robotics 26(8), 636–650 (2009)

    Article  Google Scholar 

  22. Quaritsch, M., Kruggl, K., Wischounig-Strucl, D., Bhattacharya, S., Shah, M., Rinner, B.: Networked UAVs as aerial sensor network for disaster management applications. e & i Elektrotechnik und Informationstechnik 127(3), 56–63 (2010)

    Article  Google Scholar 

  23. Roßmann, J., Rast, M.: High-detail local aerial imaging using autonomous drones. In: Proceedings of 12th AGILE International Conference on Geographic Information Science: Advances in GIScience, pp. 1–8. Hannover (2009)

  24. Sturm, P.: Multi-view geometry for general camera models. In: Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition 2005 (CVPR’05), pp. 206–212 (2005)

  25. Sturm, P., Triggs, B.: A factorization based algorithm for multi-image projective structure and motion. In: Computer Vision—ECCV’96 1065(Chapter 61), 709–720 (1996)

  26. Thite, S.: Smallest enclosing circle of a set of points in the plane. Website. http://www.win.tue.nl/-sthite/mincircle/ (2000) last visited on July 3rd 2013

  27. Triggs, B., McLauchlan, P.F., Hartley, R.I., Fitzgibbon, A.W.: Bundle adjustment–a modern synthesis. Vis. Algorithms Theory Pract. 1883, 298–372 (2000)

    Article  Google Scholar 

  28. Turkbeyler, E., Harris, C., Evans, R.: Building aerial mosaics for visual MTI. In: Proceedings of the 5th EMRS DTC Technical Conference. Roke Manor Research, Romsey, Hampshire SO51 0ZN, Edinburgh (2008)

  29. Wischounig-Strucl, D., Quartisch, M., Rinner, B.: Prioritized data transmission in airborne camera networks for wide area surveillance and image mosaicking. In: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), pp. 17–24 (2011)

  30. Yahyanejad, S., Wischounig-Strucl, D., Quaritsch, M., Rinner, B.: Incremental mosaicking of images from autonomous, small-scale UAVs. In: Proceedings of the 7th IEEE International Conference on Advanced Video and Signal-Based Surveillance (2010)

  31. Yanmaz, E., Kuschnig, R., Bettstetter, C.: Channel measurements over 802.11a-based UAV-to-ground links. In: Proceedings of the IEEE GLOBECOM Workshops, pp. 1280–1284 (2011)

Download references

Acknowledgments

This work was performed in the project Collaborative Microdrones (cDrones) of the research cluster Lakeside Labs and was partly funded by the European Regional Development Fund, the Carinthian Economic Promotion Fund (KWF), and the state of Austria under grant KWF-20214/17095/24772.

Author information

Authors and Affiliations

  1. Institute of Networked and Embedded Systems, Alpen-Adria-Universität Klagenfurt, Klagenfurt, Austria

    Daniel Wischounig-Strucl & Bernhard Rinner

Authors
  1. Daniel Wischounig-Strucl
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Bernhard Rinner
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Daniel Wischounig-Strucl.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Wischounig-Strucl, D., Rinner, B. Resource aware and incremental mosaics of wide areas from small-scale UAVs. Machine Vision and Applications 26, 885–904 (2015). https://doi.org/10.1007/s00138-015-0699-5

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00138-015-0699-5

Keywords

Search

Navigation