skip to main content
research-article

A novel software framework for embedded multiprocessor smart cameras

Published: 22 April 2009 Publication History

Abstract

Distributed smart cameras (DSC) are an emerging technology for a broad range of important applications including smart rooms, surveillance, entertainment, tracking, and motion analysis. By having access to many views and through cooperation among the individual cameras, these DSCs have the potential to realize many more complex and challenging applications than single-camera systems.
This article focuses on the system-level software required for efficient streaming applications on single smart cameras as well as on networks of DSCs. Embedded platforms with limited resources do not provide middleware services well known on general-purpose platforms. Our software framework supports transparent intra- and interprocessor communication while keeping the memory and computation overhead very low. The software framework is based on a publisher--subscriber architecture and provides mechanisms for dynamically loading and unloading software components as well as for graceful degradation in case of software- and hardware-related faults. The software framework has been completely implemented and tested on our embedded smart cameras consisting of an ARM-based network processor and several digital signal processors. Two case studies demonstrate the feasibility of our approach.

References

[1]
Aghajan, H. and Kleihorst, R., Eds. 2007. Proceedings of the ACM/IEEE International Conference on Distributed Smart Cameras (ICDSC'07). ACM, New York.
[2]
Akyildiz, I. F., Su, W., Sankarasubramaniam, Y., and Cayirci, E. 2002. Wireless sensor networks: a survey. Comput. Netw. 38, 4, 393--422.
[3]
Balasubramanian, K., Wang, N., Gill, C., and Schmidt, D. C. 2003. Towards composable distributed real-time and embedded software. In Proceedings of the 8th IEEE International Workshop on Object-Oriented Real-Time Dependable Systems. IEEE, Los Almitos, CA, 226--233.
[4]
Becker, C., Schiele, G., Gubbles, H., and Rothermel, K. 2003. BASE—a micro-brokerbased middleware for pervasive computing. In Proceedings of the 1st IEEE International Conference on Pervasive Computing and Communications. IEEE, Los Alamitos, CA, 443--451.
[5]
Bramberger, M. 2005. Distributed dynamic task allocation in clusters of embedded smart cameras. Ph.D. thesis, Institute for Technical Informatics, Graz University of Technology, Graz, Austria.
[6]
Bramberger, M., Brunner, J., Rinner, B., and Schwabach, H. 2004. Real-Time video analysis on an embedded smart camera for traffic surveillance. In Proceedings of the 10th IEEE Real-Time and Embedded Technology and Applications Symposium. IEEE, Los Alamitos, CA, 174--181.
[7]
Bramberger, M., Doblander, A., Maier, A., Rinner, B., and Schwabach, H. 2006. Distributed smart cameras for surveillance applications. Computer 39, 2, 68--75.
[8]
Bramberger, M., Rinner, B., and Schwabach, H. 2004. An embedded smart Camera on a scalable heterogeneous multi-DSP system. In Proceedings of the European DSP Education and Research Symposium.
[9]
Bramberger, M., Rinner, B., and Schwabach, H. 2005. A method for dynamic allocation of tasks in clusters of embedded smart cameras. In Proceedings of the International Conference on Systems, Man and Cybernetics. IEEE, Los Alamitos, CA, 2595--2600.
[10]
Clarke, M., Blair, G. S., Coulson, G., and Parlavantzas, N. 2001. An efficient component model for the construction of adaptive middleware. In Proceedings of the IFIP/ACM International Conference on Distributed Systems Platforms, R. Guerraoui, Ed. Lecture Notes in Computer Science. Vol. 2218. Springer, 160--178.
[11]
DeMichiel, L. G. 1995. The component object model specification. Tech. rep., Microsoft Corporation.
[12]
DeMichiel, L. G. 2002. Enterprise JavaBeans specification version 2.1. Tech. rep., SUN Microsystems.
[13]
Doblander, A., Rinner, B., Trenkwalder, N., and Zoufal, A. 2006a. A light-weight publisher-subscriber middleware for dynamic reconfiguration in networks of embedded smart cameras. In Proceedings of the 5th World Scientific and Engineering Academy and Society International Conference on Software Engineering, Parallel and Distributed Systems. ACM, New York.
[14]
Doblander, A., Rinner, B., Trenkwalder, N., and Zoufal, A. 2006b. A middleware framework for dynamic reconfiguration and component composition in embedded smart cmeras. WSEAS Trans. Comput. 5, 3, 574--581.
[15]
Fraga, J., Siqueira, F., and Favarim, F. 2003. An adaptive fault-tolerant component model. In Proceedings of the 9th IEEE International Workshop on Object-Oriented Real-Time Dependable Systems. IEEE, Los Alamitos, CA, 179--186.
[16]
Hansson, H., Åkerholm, M., Crnkovic, I., and Törngren, M. 2004. SaveCCM—a component model for safety-critical real-time systems. In Proceedings of the 30th EUROMICRO Conference. IEEE, Los Alamitos, CA, 627--635.
[17]
Karsai, G., Sztipanovits, J., Ledeczi, A., and Bapty, T. 2003. Model-integrated development of embedded software. Proc. IEEE 91, 1, 145--164.
[18]
Lin, C. H., Wolf, W., Dixon, A., Koutsoukos, X., and Sztipanovits, J. 2006. Design and implementation of ubiquitous smart cameras. In Proceedings of the IEEE International Conference on Sensor Networks, Ubiquitous, and Trustworthy Computing. IEEE, Los Alamitos, CA, 32--39.
[19]
Maier, A. 2006. Dynamic power-aware camera configuration in distributed embedded surveillance clusters. Ph.D. thesis, Institute for Technical Informatics, Graz University of Technology, Graz, Austria.
[20]
Maier, A., Rinner, B., and Schwabach, H. 2005. A hierarchical approach for energy-aware distributed embedded intelligent video surveillance. In Proceedings of the IEEE/IFIP International Workshop on Parallel and Distributed Embedded Systems. IEEE, Los Alamitos, CA, 12--16.
[21]
Mascolo, C., Capra, L., and Emmerich, W. 2002. Mobile computing middleware. In Advanced Lectures on Networking: NETWORKING 2002 Tutorials, E. Gregori, G. Anastasi, and S. Basagni, Eds. Lecture Notes in Computer Science, vol. 2497. Springer, Berlin, Germany, 20--52.
[22]
Microsoft. 2005. .Net Home Page. http://www.microsoft.com/net.
[23]
Mody, M. 2006. XDAIS-DM (XDM): A step towards the “plug and play” architecture for multimedia codecs. TI Developer Conference. http://www.s.ti.com/sc/techlit/sprp496.pdf.
[24]
Molla, M. M. and Ahamed, S. I. 2006. A survey of middleware for sensor Networks and Challenges. In Proceedings of the International Conference on Parallel Processing Workshops (ICPPW'06). IEEE, Los Alamitos, CA, 223--228.
[25]
Object Management Group. 2001. Real-Time CORBA 2.0. http://www.omg.org.
[26]
Object Management Group. 2002. Minimum CORBA 1.0. http://www.omg.org.
[27]
Object Management Group. 2005. http://www.omg.org/technology/documents/formal/components. htm.
[28]
Pitt, E. and McNiff, K. 2001. Java.rmi: The Remote Method Invocation Guide. Addison Wesley, Upper Saddle River, NJ.
[29]
Pope, A. 1998. The CORBA Reference Guide: Understanding the Common Oject Request Broker Architecture. Addison Wesley, Upper Saddle River, NJ.
[30]
Rinner, B., Jovanovic, M., and Quaritsch, M. 2007. Embedded middleware on distributed smart cameras. In Proceedings of the IEEE International Conference on Acoustics, Speech, Signal Processing (ICASSP'07). IEEE, Los Alamitos, CA, 1381--1384.
[31]
Rinner, B., Schriebl, W., Winkler, T., Quaritsch, M., and Wolf, W. 2008. The evolution from single to pervasive smart sameras. In Proceedings of the ACM/IEEE International Conference on Distributed Smart Cameras (ICDSC'08). ACM, New York.
[32]
Rinner, B. and Wolf, W. 2008a. A bright future for distributed smart cameras (guest editor's introduction). Proc. IEEE 96, 10, 1562--1564.
[33]
Rinner, B. and Wolf, W. 2008b. An introduction to distributed smart cameras. Proc. IEEE 96, 10, 1565--1575.
[34]
Schmidt, D. C. 2002. Middleware for real-time and embedded systems. Comm. ACM 45, 6, 43--48.
[35]
Sessions, R. 1997. COM and DCOM: Microsoft's Vision for Distributed Objects. John Wiley & Sons, New York, NY.
[36]
Systems, M. C. and Thales. 2003. Light Weight CORBA Component Model. Tech. rep., Object Management Group.
[37]
Texas Instruments. 2002. TMS320 Algorithm Standard—Rules and Guidelines. Literature Number: SPRU352E.
[38]
Wolf, W., Ozer, B., and Lv, T. 2002. Smart cameras as embedded systems. Computer 35, 9, 48--53.

Cited By

View all
  • (2021)One Solution of Memory Communication within Camera Framework2021 Zooming Innovation in Consumer Technologies Conference (ZINC)10.1109/ZINC52049.2021.9499286(81-84)Online publication date: 26-May-2021
  • (2018)A parallel middleware framework for vehicular network applicationsInternational Journal of High Performance Systems Architecture10.1504/IJHPSA.2016.0788026:2(82-97)Online publication date: 13-Dec-2018
  • (2016)Architecture for Dynamic Allocation of Computer Vision TasksProceedings of the 10th International Conference on Distributed Smart Camera10.1145/2967413.2967427(50-55)Online publication date: 12-Sep-2016
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Embedded Computing Systems
ACM Transactions on Embedded Computing Systems  Volume 8, Issue 3
April 2009
239 pages
ISSN:1539-9087
EISSN:1558-3465
DOI:10.1145/1509288
Issue’s Table of Contents
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Journal Family

Publication History

Published: 22 April 2009
Accepted: 01 September 2008
Revised: 01 January 2008
Received: 01 May 2007
Published in TECS Volume 8, Issue 3

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. Smart cameras
  2. distributed embedded systems
  3. fault tolerance
  4. publisher--subscriber
  5. video surveillance

Qualifiers

  • Research-article
  • Research
  • Refereed

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)3
  • Downloads (Last 6 weeks)1
Reflects downloads up to 25 Jan 2025

Other Metrics

Citations

Cited By

View all
  • (2021)One Solution of Memory Communication within Camera Framework2021 Zooming Innovation in Consumer Technologies Conference (ZINC)10.1109/ZINC52049.2021.9499286(81-84)Online publication date: 26-May-2021
  • (2018)A parallel middleware framework for vehicular network applicationsInternational Journal of High Performance Systems Architecture10.1504/IJHPSA.2016.0788026:2(82-97)Online publication date: 13-Dec-2018
  • (2016)Architecture for Dynamic Allocation of Computer Vision TasksProceedings of the 10th International Conference on Distributed Smart Camera10.1145/2967413.2967427(50-55)Online publication date: 12-Sep-2016
  • (2015)A lightweight middleware framework for vehicle networking applicationConcurrency and Computation: Practice & Experience10.1002/cpe.347827:17(4914-4937)Online publication date: 10-Dec-2015
  • (2014)Distributed Smart Cameras in the Age of Cloud Computing and the Internet-of-ThingsAdvances in Embedded Computer Vision10.1007/978-3-319-09387-1_11(239-248)Online publication date: 27-Nov-2014
  • (2014)Platforms and Architectures for Distributed Smart CamerasDistributed Embedded Smart Cameras10.1007/978-1-4614-7705-1_1(3-23)Online publication date: 5-Jun-2014
  • (2009)A pervasive smart camera network architecture applied for multi-camera object classification2009 Third ACM/IEEE International Conference on Distributed Smart Cameras (ICDSC)10.1109/ICDSC.2009.5289377(1-8)Online publication date: Aug-2009

View Options

Login options

Full Access

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media