Context-based semantic labeling of human-vehicle interactions in persistent surveillance systems

Vinayak Elangovan; Amir Shirkhodaie

doi:10.1117/12.883505

3 June 2011 Context-based semantic labeling of human-vehicle interactions in persistent surveillance systems

Vinayak Elangovan, Amir Shirkhodaie

Proceedings Volume 8056, Visual Information Processing XX; 80560I (2011) https://doi.org/10.1117/12.883505
Event: SPIE Defense, Security, and Sensing, 2011, Orlando, Florida, United States

Abstract

The improved Situational awareness in Persistent Surveillance Systems (PSS) is an ongoing research effort of the Department of Defense. Most PSS generate huge volume of raw data and they heavily rely on human operators to interpret and inference data in order to detect potential threats. Many outdoor apprehensive activities involve vehicles as their primary source of transportation to and from the scene where a plot is executed. Vehicles are employed to bring in and take out ammunitions, supplies, and personnel. Vehicles are also used as a disguise, hide-out, a meeting place to execute threat plots. Analysis of the Human-Vehicle Interactions (HVI) helps us to identify cohesive patterns of activities representing potential threats. Identification of such patterns can significantly improve situational awareness in PSS. In our approach, image processing technique is used as the primary source of sensing modality. We use HVI taxonomy as a means for recognizing different types of HVI activities. HVI taxonomy may comprise multiple threads of ontological patterns. By spatiotemporal linking of ontological patterns, a HVI pattern is hypothesized to pursue a potential threat situation. The proposed technique generates semantic messages describing ontology of HVI. This paper also discusses a vehicle zoning technique for HVI semantic labeling and demonstrates efficiency and effectiveness of the proposed technique for identifying HVI.

Citation Download Citation

Vinayak Elangovan and Amir Shirkhodaie "Context-based semantic labeling of human-vehicle interactions in persistent surveillance systems", Proc. SPIE 8056, Visual Information Processing XX, 80560I (3 June 2011); https://doi.org/10.1117/12.883505

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available