Skip to main content
SpringerLink
Log in

Agent-based reconfigurable architecture for real-time object tracking

  • Original Research Paper
  • Published:
Journal of Real-Time Image Processing Aims and scope Submit manuscript

Abstract

Most conventional object tracking algorithms are implemented on general-purpose processors in software due to its great flexibility. However, the real-time performance is hard to achieve due to the inherent characteristics of the sequential processing of these processors. To tackle this issue, a reconfigurable system-on-chip (rSoC) platform with microprocessors and FPGAs is applied in this paper. To simplify the hardware/software interface, a Belief–Desire–Intention (BDI)-based multi-agent architecture is proposed as the unified framework. Then an agent-based task graph and two heuristic partitioning methods are proposed to partition the hardware and software on an rSoC platform. Compared to the module-based architecture, this BDI-based multi-agent architecture provides more efficiency, flexibility, autonomy, and scalability for the real-time tracking systems. A particle swarm optimization (PSO)-based object detection and tracking algorithm is applied to evaluate the proposed architecture. Extensive experimental results of object tracking demonstrate that the proposed architecture is efficient and highly robust with real-time performance.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9

Similar content being viewed by others

References

  1. Agent-Oriented Software Pty Ltd: JACK Manual (v4.1). http://www.agent-oriented.com, (2003)

  2. Baleani, M., Gennari, F., Jiang, Y., Patel, Y., Brayton, R.K., Sangiovanni-Vincentelli, A.: HW/SW partitioning and code generation of embedded control applications on a reconfigurable architecture platform. In: Proceedings of the Tenth International Symposium on HW/SW Codesign (2002)

  3. Brazier, F., Keplicz, B.D., Jennings, N., Treur, J.: Desire: modelling multi-agent systems in a compositional formal framework. Int. J. Cooperative Inf. Syst. 6(1), 67–94 (1997)

    Article  Google Scholar 

  4. Carrascosa, C., Bajo, J., Julian, V., Corchado, J.M., Botti, V.: Hybrid multi-agent architecture as a real-time problem solving model. Expert. Syst. Appl. 34(1), 2–17 (2008)

    Article  Google Scholar 

  5. Davis, J., Sharma, V.: Robust detection of people in thermal imaging, In: 17th International Conference on Pattern Recognition (ICPR’04), 713–716 (2004)

  6. d’Inverno, M., Kinny, D., Luck, M., Wooldridge, M.: A formal specification of dMARS. In: Proceedings of the 4th International Workshop on Agent Theories, Architecture, and Language, vol. 1365 of LNAI, pp. 155–176 (1998)

  7. Eberhart, R., Kennedy, J.: A new optimizer using particles swarm theory. In: Proc. Sixth International Symposium on Micro Machine and Human Science, IEEE Service Center, Piscataway, NJ (1995)

  8. Feyrer, S., Zell, A.: Detection, tracking, and pursuit of humans with an autonomous mobile robot. In: Proceedings of the International Conference on Intelligent Robots and Systems (IROS’99), pp. 864–869 (1999)

  9. Fleischmann, J., Buchenrieder, K., Kress, R.: Codesign of embedded systems based on java and reconfigurable hardware components. In: Design Automation and Test in Europe (1999)

  10. Froba, B., Kublbeck, C.: Face detection and tracking using edge orientation information, SPIE Vis. Commun. Image Process. 4310, 583–594 (2001)

    Google Scholar 

  11. Jennings, N.R., Wooldridge, M.: Agent-oriented software engineering. Handbook of Agent Technology. In: Bradshaw, J. (ed.) AAAI/MIT Press, Cambridge (2000)

  12. Kearney, D., Veldman, G.: A concurrent multi-bank memory arbiter for dynamic IP cores using idle skip round robin. In: Proceedings of IEEE International Conference on Field-Programmable Technology (FPT ‘03), pp. 411–414, Tokyo, Japan (2003)

  13. Kendall, E.A., Malkoun, M.T., Jiang, C.H.: A methodology for developing agent based systems. In: Proceedings of the First Australian Workshop on DAI: Distributed Artificial Intelligence: Architecture and Modeling, Lecture notes in Computer Science, vol. 1087, pp. 85-99 (1995)

  14. Kinny, D., Georgeff, M., Rao, A.: A methodology and modeling technique for systems of BDI agents. In: Proceedings of the 7th European workshop on modeling autonomous agents in a multi-agent world, pp. 56-71 (1996)

  15. Li, Y., Callahan, T., Darnell, E., Harr, R., Kurkure, U., Stockwood, J.: Hardware–software co-design of embedded reconfigurable architectures. In: Design Automation Conference (2000)

  16. Meng, Y.: A dynamic self-reconfiguration mobile Robot navigation system. In: IEEE/ASME International Conference on Advanced Intelligent Mechatronics, pp. 1541–1546 (2005)

  17. Meng, Y.: An agent-based reconfigurable system-on-chip architecture for real-time systems, In: 2nd International Conference on Embedded Software and Systems, Xian, China (2005)

  18. Micacchi, C., Cohen, R.: A multi-agent architecture for robotic systems in real-time environments. Int. J. Robot. Autom. 21(2), 82–90 (2006)

    Google Scholar 

  19. Niemann, R., Marwedel, P.: An algorithm for HW/SW partitioning using mixed integer linear programming. Des. Autom. Embed. Syst 2(2), 165–193 (1997)

    Article  Google Scholar 

  20. Osterling, A., Benner, T., Ernst, R., Hermann, D., Scholz, T., Ye, W.: Hadware/Software Co-Design: Principles and Practice. Kluwer Academic Publishers, Dortrecht (1997)

  21. Quinn, H., Leeser, M., King, L.: Dynamo: a runtime partitioning system for FPGA-based HW/SW image processing systems. Spec. Issue J. Real-Time Image Process. 2(4), 179–190 (2007)

    Article  Google Scholar 

  22. Raja, Y., McKenna, S.J., Gong, S.: Tracking and segmenting people in varying lighting conditions. In: Proc. 3rd Int. Conf. on Automatic Face and Gesture Recognition, pp. 228–233 (1998)

  23. Rohr, K.: Towards model-based recognition of human movements in image sequences. CVGIP Image Underst. 59(1), 94–115 (1994)

    Article  Google Scholar 

  24. Rowley, H.A., Baluja, S., Kanade, T.: Neural network-based face detection. IEEE Trans. Pattern Anal. Mach. Intell. 20(1), 23–38 (1998)

    Article  Google Scholar 

  25. Saha, D., Mitra, R.S., Basu, A.: HW/SW partitioning using genetic algorithm. In: Proc. of 10th Intern. Conference on VLSI Design, pp. 155–160 (1997)

  26. Scalcra, S.M., Vazques, J.R.: The design and implementation of a context switching FPGA. In: IEEE Symposium on FPGAs for Custom Computing Machines, pp. 78–85 (1998)

  27. Sckanina, L., Ruzicka, R.: Design of the special fast reconfigurable chip using common FPGA. In: IEEE Proc. of Design and Diagnostics of Electronic Circuits and Systems, pp. 161–168 (2000)

  28. Viola, P., Jones, M.: Robust real-time object detection. In: Proceedings of the Second International Workshop on Statistical and Computational Theories of Vision (2001)

  29. Walker, S.S., Brennan, R.W., Norrie, D.H.: Holonic job shop scheduling using a multiagent system. IEEE Intell. Syst. 20(1), 50–57 (2005)

    Article  Google Scholar 

  30. Wiangton, T., Cheung, P.Y.K., Luk, W.: Comparing three heuristic search methods for functional partitioning in hardware–software codesign. Des. Autom. Embed. Syst. 6(4), 425–449 (2002)

    Article  Google Scholar 

  31. Wood, M.R.: Multiagent Systems Engineering: A Methodology for Analy-sis and Design of Multiagent Systems. PhD thesis, Air Force Institute of Technology (2000)

  32. Zheng, Y., Meng, Y.: Adaptive object tracking using particle swarm optimization. In: IEEE International Symposium on Computational Intelligence in Robotics and Automation, Jacksonville, Florida, USA (2007)

Download references

Author information

Authors and Affiliations

  1. Department of Electrical and Computer Engineering, Stevens Institute of Technology, Hoboken, NJ, 07030, USA

    Yan Meng

Authors
  1. Yan Meng
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Yan Meng.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Meng, Y. Agent-based reconfigurable architecture for real-time object tracking. J Real-Time Image Proc 4, 339–351 (2009). https://doi.org/10.1007/s11554-009-0116-2

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11554-009-0116-2

Keywords

Search

Navigation