Skip to main content

Advertisement

SpringerLink
Log in

Real-Time Adaptive Background Modeling for Multicore Embedded Systems

  • Published:
Journal of Signal Processing Systems Aims and scope Submit manuscript

Abstract

Current trends in microprocessor design integrate several autonomous processing cores onto the same die. These multicore architectures are particularly well-suited for computer vision applications, where it is typical to perform the same set of operations repeatedly over large datasets. These memory- and computation-intensive applications can reap tremendous performance and accuracy benefits from concurrent execution on multi-core processors. However, cost-sensitive embedded platforms place real-time performance and efficiency demands on techniques to accomplish this task. Furthermore, parallelization and partitioning techniques that allow the application to fully leverage the processing capabilities of each computing core are required for multi-core embedded vision systems. In this paper, we evaluate background modeling techniques on a multicore embedded platform, since this process dominates the execution and storage costs of common video analysis workloads. We introduce a new adaptive backgrounding technique, multimodal mean, which balances accuracy, performance, and efficiency to meet embedded system requirements. Our evaluation compares several pixel-level background modeling techniques in terms of their computation and storage requirements, and functional accuracy for three representative video sequences, across a range of processing and parallelization configurations. We show that the multimodal mean algorithm delivers comparable accuracy of the best alternative (Mixture of Gaussians) with a 3.4× improvement in execution time and a 50% reduction in required storage for optimal block processing on each core. In our analysis of several processing and parallelization configurations, we show how this algorithm can be optimized for embedded multicore performance, resulting in a 25% performance improvement over the baseline processing method.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Figure 1
Figure 2
Figure 3
Figure 4
Figure 5

Similar content being viewed by others

References

  1. Bower, F. A., Sorin, D. J., & Cox, L. P. (2008). The impact of dynamically heterogeneous multicore processors on thread scheduling. IEEE Micro Magazine, 28(3), 17–25. May/Jun.

    Article  Google Scholar 

  2. Gschwind, M. (2007). The cell broadband engine: Exploiting multiple levels of parallelism in a chip multiprocessor. International Journal of Parallel Programming, 35(3), 233–262. June.

    Article  Google Scholar 

  3. Kongetira, P., Aingaran, K., & Olukotun, K. (2005). Niagara: A 32-way multithreaded Sparc processor. IEEE Micro Magazine, 25(2), 21–29. March–April.

    Article  Google Scholar 

  4. McNairy, C., & Bhatia, R. (2005). Montecito: A dual-core, dual-thread Itanium processor. IEEE Micro, 25(2), 10–20. March–April.

    Article  Google Scholar 

  5. Taylor, M. B., et al. (2002). The raw microprocessor: A computational fabric for software circuits and general purpose programs. IEEE Micro Magazine, 22(2), 25–35. March–April.

    Article  Google Scholar 

  6. Sankaralingam, K., et al. “Exploiting ILP, TLP, and DLP with the polymorphous TRIPS architecture,” in Proc. 30 th Annual Int. Symp. On Computer Architecture, pp. 422–433, June 2003.

  7. Chen, T. P., Haussecker, H., Bovyrin, A., Belenov, R., Rodyushkin, K., Kuranov, A., Eruhimov, V., “Computer Vision Workload Analysis: Case Study of Video Surveillance Systems”, Intel Tecnology Journal 2005.

  8. Cheung, S., & Kamath, C. (2004). Robust techniques for background subtraction in urban traffic video. Video Communications and Image Processing, 5308, 881–892. SPIE Electronic Imaging, San Jose, January.

    Google Scholar 

  9. Piccardi, M. (2004). Background subtraction techniques: A review. IEEE International Conference on Systems, Man and Cybernetics, 4, 3099–3104. October.

    Google Scholar 

  10. Toyama, K., Krumm, J., Brummitt, B., Meyers, B. (). Wallflower: principles and practices of background maintenance,” in Proc. of ICCV (1), pp. 255–261, 1999; Wallflower benchmarks available online at research.microsoft.com/~jckrumm/WallFlower/TestImages.htm

  11. McFarlane, N., & Schofield, C. (1995). Segmentation and tracking of piglets in images. Machine Vision and Applications, 8(3), 187–193.

    Article  Google Scholar 

  12. Jabri, S., Duric, Z., Wechsler, H., & Rosenfeld, A. (2000). Detection and location of people in video images using adaptive fusion of color and edge information. IEEE International Conference on Pattern Recognition, 4, 627–630 September.

    Google Scholar 

  13. Wren, C. R., Azarbayejani, A., Darell, T., & Pentland, A. P. (1997). Pfinder:real-time tracking of human body. IEEE Transactions on Pattern Analysis and Machine Intelligence, 19(7), 780–785. July.

    Article  Google Scholar 

  14. Stauffer, C. & Grimson, W. E. L. (1999). Adaptive background mixture models for real-time tracking”, Computer Vision and Pattern Recognition, pp 246–252, June.

  15. Stauffer, C., & Grimson, W. E. L. (2000). Learning patterns of activity using real-time tracking. IEEE Transactions on Pattern Analysis and Machine Intelligence, 22(8), 747–757. August.

    Article  Google Scholar 

  16. Appiah, K., Hunter, A. (2005). A single-chip FPGA implementation of real-time adaptive background model. IEEE International Conference on Field-Programmable Technology, pp. 95–102, December.

  17. Chen, T., Budnikov, D., Hughes, C., Chen, Y.-K. (2007). Computer vision workloads on multicore processors: articulated body tracking”, ICME 2007, Beijing, China, July.

  18. Zinner, C. & Kubinger, W. (2006). “ROS-DMA: A DMA double buffering method for embedded image processing with resource optimized slicing,” in Proc. 12 th IEEE Real-Time and Embedded Technology and Applications Symposium (RTAS), pp. 361–372, April.

  19. T.G. Lane. Using the IJG JPEG Library. Independent JPEG Group, 6b edition, March 1998.

  20. Cell Broadband Engine Programming Tutorial http://www-01.ibm.com/chips/techlib/techlib.nsf

  21. S. Apewokin, B. Valentine, S. Wills, L. Wills, A. Gentile, “Multimodal Mean Adaptive Backgrounding for Embedded Real-Time Video Surveillance,” Embedded Computer Vision Workshop (ECVW07),, June 2007.

Download references

Acknowledgements

We are grateful for the insightful comments of the anonymous reviewers.

Author information

Authors and Affiliations

  1. Georgia Institute of Technology, Atlanta, GA, USA

    Senyo Apewokin, Brian Valentine, Jee Choi, Linda Wills & Scott Wills

Authors
  1. Senyo Apewokin
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Brian Valentine
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Jee Choi
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Linda Wills
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Scott Wills
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Senyo Apewokin.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Apewokin, S., Valentine, B., Choi, J. et al. Real-Time Adaptive Background Modeling for Multicore Embedded Systems. J Sign Process Syst 62, 65–76 (2011). https://doi.org/10.1007/s11265-008-0298-z

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11265-008-0298-z

Keywords

Search

Navigation