Skip to main content
SpringerLink
Log in

A reconfigurable embedded vision system for advanced driver assistance

  • Special Issue Paper
  • Published:
Journal of Real-Time Image Processing Aims and scope Submit manuscript

Abstract

Computer vision technologies can contribute in many ways to the development of smart cities. In the case of vision applications for advanced driver assistance systems (ADAS), they can help to increase road traffic safety, which is a major concern nowadays. The design of an embedded vision system for driver assistance is not straightforward; several requirements must be addressed such as computational performance, cost, size, power consumption or time-to-market. This paper presents a novel reconfigurable embedded vision system that meets the requirements of ADAS applications. The developed PCB board contains a System on Chip composed of a programmable logic that supports parallel processing necessary for a fast pixel-level analysis, and a microprocessor suited for serial decision making. A lane departure warning system was implemented in the case study, obtaining a better computational performance than the rest of the works found in the literature. Moreover, thanks to the reconfiguration capability of the proposed system a more flexible and extensible solution is obtained.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8

Similar content being viewed by others

References

  1. Aggarwal, A.: Embedded vision system (EVS). In: 2008 IEEE/ASME International Conference on mechatronic and embedded systems and applications. MESA 2008, pp. 618–621 (2008)

  2. An, X., Shang, E., Song, J., Li, J., He, H.: Real-time lane departure warning system based on a single FPGA. EURASIP J. Image Video Process. 1, 1–18 (2013)

    Google Scholar 

  3. Anders, J., Mefenza, M., Bobda, C., Yonga, F., Aklah, Z., Gunn, K.: A hardware/software prototyping system for driving assistance investigations. J. Real Time Image Process. (2013). doi:10.1007/s11554-013-0351-4

  4. Aurigi, A.: Making the digital city: the early shaping of urban Internet space. Ashgate Publishing, Farnborough (2005)

    Google Scholar 

  5. Batty, M., Axhausen, K., Giannotti, F., Pozdnoukhov, A., Bazzani, A., Wachowicz, M., Ouzounis, G., Portugali, Y.: Smart cities of the future. Eur. Phys. J. Spec. Top. 214(1), 481–518 (2012)

    Article  Google Scholar 

  6. Buch, N., Velastin, S., Orwell, J.: A review of computer vision techniques for the analysis of urban traffic. IEEE Trans. Intell. Transp. Syst. 12(3), 920–939 (2011)

    Article  Google Scholar 

  7. Chakraborty, S., Lukasiewycz, M., Buckl, C., Fahmy, S., Chang, N., Park, S., Kim, Y., Leteinturier, P., Adlkofer, H.: Embedded systems and software challenges in electric vehicles. In: Proceedings of the Conference on design, automation and test in Europe, DATE ’12, pp. 424–429 (2012)

  8. Chang, S.L., Chen, L.S., Chung, Y.C., Chen, S.W.: Automatic license plate recognition. IEEE Trans. Intell. Transp. Syst. 5(1), 42–53 (2004)

    Article  MathSciNet  Google Scholar 

  9. Darouich, M., Guyetant, S., Lavenier, D.: A reconfigurable disparity engine for stereovision in advanced driver assistance systems. In: Sirisuk, P., Morgan, F., El-Ghazawi, T., Amano, H. (eds.) Reconfigurable Computing: Architectures, Tools and Applications. Lecture Notes in Computer Science, vol. 5992, pp. 306–317. Springer, Berlin (2010)

    Chapter  Google Scholar 

  10. Dong, Y., Hu, Z., Uchimura, K., Murayama, N.: Driver inattention monitoring system for intelligent vehicles: A review. IEEE Trans. Intell. Transp. Syst. 12(2), 596–614 (2011)

    Article  Google Scholar 

  11. Geronimo, D., Lopez, A., Sappa, A., Graf, T.: Survey of pedestrian detection for advanced driver assistance systems. IEEE Trans. Pattern Anal. Mach. Intell. 32(7), 1239–1258 (2010)

    Article  Google Scholar 

  12. Harrison, C., Eckman, B., Hamilton, R., Hartswick, P., Kalagnanam, J., Paraszczak, J., Williams, P.: Foundations for smarter cities. IBM J. Res. Dev. 54(4), 1–16 (2010)

    Article  Google Scholar 

  13. Hiraiwa, J., Amano, H.: An FPGA implementation of reconfigurable real-time vision architecture. In: 27th International Conference on advanced information networking and applications Workshops (WAINA), pp. 150–155 (2013)

  14. Hsiao, P.Y., Yeh, C.W.: A portable real-time lane departure warning system based on embedded calculating technique. In: IEEE 63rd Vehicular Technology Conference. VTC 2006-Spring 6:2982–2986 (2006)

  15. Jeng, M.J., Guo, C.Y., Shiau, B.C., Chang, L.B., Hsiao, P.Y.: Lane detection system based on software and hardware codesign. In: 4th International Conference on autonomous robots and agents. ICARA 2009, pp. 319–323 (2009)

  16. Lee, S., Son, H., Choi, J.C., Min, K.: High-performance hog feature extractor circuit for driver assistance system. In: 2013 IEEE International Conference on consumer electronics (ICCE), pp. 338–339 (2013)

  17. Lin, H.Y., Chen, L.Q., Lin, Y.H., Yu, M.S.: Lane departure and front collision warning using a single camera. In: 2012 International Symposium on intelligent signal processing and communications systems (ISPACS), pp. 64–69 (2012)

  18. Malinowski, A., Yu, H.: Comparison of embedded system design for industrial applications. IEEE Trans. Ind. Inform. 7(2), 244–254 (2011)

    Article  Google Scholar 

  19. Mielke, M., Schafer, A., Bruck, R.: Asic implementation of a gaussian pyramid for use in autonomous mobile robotics. In: 2011 IEEE 54th International Midwest Symposium on Circuits and Systems (MWSCAS), pp. 1–4 (2011)

  20. Nieto, M., Cortés, A., Otaegui, O., Arróspide, J., Salgado, L.: Real-time lane tracking using rao-blackwellized particle filter. J. Real Time Image Process. (2012). doi:10.1007/s11554-012-0315-0

  21. Pedre, S., Krajník, T., Todorovich, E., Borensztejn, P.: Accelerating embedded image processing for real time: a case study. J. Real Time Image Process. (2013). doi:10.1007/s11554-013-0353-2

  22. Samarawickrama, M., Pasqual, A., Rodrigo, R.: FPGA-based compact and flexible architecture for real-time embedded vision systems. In: 2009 International Conference on industrial and information systems (ICIIS), pp. 337–342 (2009)

  23. Sánchez-Oro, J., Fernández-López, D., Cabido, R., Montemayor, A.S., Pantrigo, J.J.: Urban traffic surveillance in smart cities using radar images. In: Ferrández Vicente, J.M., Álvarez Sánchez, J.R., Paz López, F., Toledo Moreo, F.J. (eds) Natural and artificial computation in engineering and medical applications, lecture notes in computer science, vol. 7931. Springer, Berlin, pp. 296–305 (2013)

  24. Sanders, L.: Secure boot of Zynq-7000 All programmable SoC. Application note XAPP1175 (v1.0), Xilinx (2013)

  25. Sandino, D., Matey, L.M., Vélez, G.: Design thinking methodology for the design of interactive real-time applications. In: Marcus, A. (ed.) Design, user experience, and usability. Design philosophy, methods, and tools, lecture notes in computer science, vol. 8012. Springer, Berlin, pp. 583–592 (2013)

  26. Schneiderman, R.: Car makers see opportunities in infotainment, driver-assistance systems [special reports]. IEEE Signal Process. Mag. 30(1), 11–15 (2013)

    Article  Google Scholar 

  27. Shaout, A., Colella, D., Awad, S.: Advanced driver assistance systems - past, present and future. In: 2011 Seventh International Computer Engineering Conference (ICENCO), pp. 72–82 (2011)

  28. Shreejith, S., Fahmy, S., Lukasiewycz, M.: Reconfigurable computing in next-generation automotive networks. IEEE Embed. Syst. Lett. 5(1), 12–15 (2013)

    Google Scholar 

  29. Souani, C., Faiedh, H., Besbes, K.: Efficient algorithm for automatic road sign recognition and its hardware implementation. J. Real Time Image Process. 9(1), 79–93 (2014). doi:10.1007/s11554-013-0348-z

  30. Stein, F.: The challenge of putting vision algorithms into a car. In: 2012 IEEE Computer Society Conference on computer vision and pattern recognition workshops (CVPRW), pp. 89–94 (2012)

  31. Stein, G., Rushinek, E., Hayun, G., Shashua, A.: A computer vision system on a chip: a case study from the automotive domain. In: IEEE Computer Society Conference on computer vision and pattern recognition-workshops, 2005. CVPR workshops, pp. 130–130 (2005)

  32. Teich, J.: Hardware/software codesign: the past, the present, and predicting the future. Proc. IEEE 100(Special Centennial Issue):1411–1430 (2012)

    Article  Google Scholar 

  33. Toral, S., Barrero, F., Vargas, M.: Development of an embedded vision based vehicle detection system using an ARM video processor. In: 11th International IEEE Conference on intelligent transportation systems, 2008. ITSC 2008, pp. 292–297 (2008)

  34. Turturici, M., Saponara, S., Fanucci, L., Franchi, E.: Low-power DSP system for real-time correction of fish-eye cameras in automotive driver assistance applications. J. Real Time Image Process. (2013). doi:10.1007/s11554-013-0330-9

  35. Vicomtech-IK4: Viulib: Computer Vision SDK. URL http://www.vicomtech.org/viulib/ (2013)

  36. Wójcikowski, M., Zaglewski, R., Pankiewicz, B.: FPGA-based real-time implementation of detection algorithm for automatic traffic surveillance sensor network. J. Signal Process. Syst. 68(1), 1–18 (2012)

    Article  Google Scholar 

  37. Wu, B.F., Huang, H.Y., Chen, C.J., Chen, Y.H., Chang, C.W., Chen, Y.L.: A vision-based blind spot warning system for daytime and nighttime driver assistance. Comput. Electr. Eng. 39(3), 846–862 (2013)

    Article  Google Scholar 

Download references

Acknowledgments

This work has been partially supported by the program ETORGAI 2011–2013 of the Basque Government under project IEB11. This work has been possible thanks to the cooperation with Datik-Irizar Group for their support in the installation, integration and testing stages of the project.

Author information

Authors and Affiliations

  1. Vicomtech-IK4, Paseo Mikeletegi 57, Donostia-San Sebastián, Spain

    Gorka Velez, Marcos Nieto & Oihana Otaegui

  2. CEIT and Tecnun (University of Navarra), Manuel de Lardizábal 15, Donostia-San Sebastián, Spain

    Ainhoa Cortés & Igone Vélez

Authors
  1. Gorka Velez
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Ainhoa Cortés
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Marcos Nieto
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Igone Vélez
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Oihana Otaegui
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Gorka Velez.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Velez, G., Cortés, A., Nieto, M. et al. A reconfigurable embedded vision system for advanced driver assistance. J Real-Time Image Proc 10, 725–739 (2015). https://doi.org/10.1007/s11554-014-0412-3

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11554-014-0412-3

Keywords

Search

Navigation