Pradeep K. Atrey
Mohan S. Kankanhalli
John B. Oommen
Abstract
A multimedia analysis system utilizes a set of correlated media streams, each of which, we assume, has a confidence level and a cost associated with it, and each of which partially helps in achieving the system goal. However, the fact that at any instant, not all of the media streams contribute towards a system goal brings up the issue of finding the best subset from the available set of media streams. For example, a subset of two video cameras and two microphones could be better than any other subset of sensors at some time instance to achieve a surveillance goal (e.g. event detection). This article presents a novel framework that finds the optimal subset of media streams so as to achieve the system goal under specified constraints. The proposed framework uses a dynamic programming approach to find the optimal subset of media streams based on three different criteria: first, by maximizing the probability of achieving the goal under the specified cost and confidence; second, by maximizing the confidence in the achieved goal under the specified cost and probability with which the goal is achieved; and third, by minimizing the cost to achieve the goal with a specified probability and confidence. Each of these problems is proven to be NP-Complete. From an AI point of view, the solution we propose is heuristic-based, and for each criterion, utilizes a heuristic function which for a given problem, combines optimal solutions of small-sized subproblems to yield a potential near-optimal solution to the original problem. The proposed framework allows for a tradeoff among the aforementioned three criteria, and offers the flexibility to compare whether any one set of media streams of low cost would be better than any other set of higher cost, or whether any one set of media streams of high confidence would be better than any other set of low confidence. To show the utility of our framework, we provide the experimental results for event detection in a surveillance scenario.
- Atrey, P. K. and Kankanhalli, M. S. 2005. Goal based optimal selection of media streams. In Proceedings of the IEEE International Conference on Multimedia and Expo (Amsterdam, The Netherlands). 305--308.Google Scholar
- Atrey, P. K., Kankanhalli, M. S., and Jain, R. 2005. Timeline-Based information assimilation in multimedia surveillance and monitoring systems. In Proceedings of the 3rd ACM International Workshop on Video Surveillance and Sensor Networks (Singapore). 103--112. Google ScholarDigital Library
- Atrey, P. K., Maddage, N. C., and Kankanhalli, M. S. 2006. Audio based event detection for multimedia surveillance. In Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing. V813--816.Google Scholar
- Debouk, R., Lafortune, S., and Teneketzis, D. 2002. On an optimal problem in sensor selection. J. Discrete Event Dynamic Syst.: Theory Appl. 12, 417--445. Google ScholarDigital Library
- Isler, V. and Bajcsy, R. 2005. The sensor selection problem for bounded uncertainty sensing models. In Proceedings of the International Symposium on Information Processing in Sensor Networks (Los Angeles, CA). 151--158. Google ScholarDigital Library
- Jain, R. 2004. Refining the search engine. Ubiquity 5, 29 (Sept.). Google ScholarCross Ref
- Jiang, S., Kumar, R., and Garcia, H. E. 2003. Optimal sensor selection for discrete event systems with partial observation. IEEE Trans. Autom. Control 48, 369--381.Google ScholarCross Ref
- Lam, K.-Y., Cheng, R., Liang, B., and Chau, J. 2004. Sensor node selection for execution of continuous probabilistic queries in wireless sensor networks. In Proceedings of the ACM International Workshop on Video Surveillance and Sensor Networks (New York). 63--71. Google ScholarDigital Library
- Nevatia, R., Zhao, T., and Hongeng, S. 2003. Hierarchical language-based representation of events in video streams. In Proceedings of the IEEE Workshop on Event Mining (Madison, WI).Google Scholar
- Oommen, B. J. and Rueda, L. 2005. A formal analysis of why heuristic functions work. Artif. Intell. J. 164, 1--22. Google ScholarCross Ref
- Pahalawatta, P., Pappas, T. N., and Katsaggelos, A. K. 2004. Optimal sensor selection for video-based target tracking in a wireless sensor network. In IEEE International Conference on Image Processing. Singapore, V:3073--3076.Google Scholar
- Siegel, M. and Wu, H. 2004. Confidence fusion. In Proceedings of the IEEE International Workshop on Robot Sensing. 96--99.Google Scholar
- Stauffer, C. and Grimson, W. E. L. 1999. Adaptive background mixture models for real-time tracking. In Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, vol. 2 (Ft. Collins, CO). 252--258.Google Scholar
Index Terms
- Goal-oriented optimal subset selection of correlated multimedia streams
Recommendations
Enabling Goal Oriented Action Planning with Goal Net
WI-IAT '09: Proceedings of the 2009 IEEE/WIC/ACM International Joint Conference on Web Intelligence and Intelligent Agent Technology - Volume 02In this paper, we propose an agent planning system based on the Goal Net model. The agent’s goals are identified and organized in a composite goal hierarchy. Three kinds of relations between goals are defined: choice, concurrency and synchronization. ...
Implementation of a GOAL PROGRAM
SIGUCCS '75: Proceedings of the 3rd annual ACM SIGUCCS conference on User servicesWe all need specific goals to guide us. Goals give you direction. Recognizing that we need goals is the first step toward choosing and achieving those goals.
By making each goal specific, you have definite deadlines to aim for. Get a statement of your ...
The goal oriented teams (GORITE) framework
ProMAS'07: Proceedings of the 5th international conference on Programming multi-agent systemsGoal Oriented Teams (GORITE) is a Java framework for implementation of Goal Oriented Process Models in a Team Oriented Paradigm. The GORITE concept combines a Team Oriented view of software systems with Goal Oriented process modelling, and offers an ...
Comments