Abstract
Many information fusion solutions work well in the intended scenarios; but the applications, supporting data, and capabilities change over varying contexts. One example is weather data for electro-optical target trackers of which standards have evolved over decades. The operating conditions of technology changes, sensor/target variations, and the contextual environment can inhibit performance if not included in the initial systems design. In this chapter, we seek to define and categorize different types of contextual information. We describe five contextual information categories that support target tracking: (1) domain knowledge from a user to aid the information fusion process through selection, cueing, and analysis, (2) environment-to-hardware processing for sensor management, (3) known distribution of entities for situation/threat assessment, (4) historical traffic behavior for situation awareness patterns of life (POL), and (5) road information for target tracking and identification. Appropriate characterization and representation of contextual information is needed for future high-level information fusion designs to take advantage of the large data content available for a priori knowledge target tracking algorithm construction, implementation, and application.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
E. Blasch, Book review: 3C vision: cues, context, and channels. IEEE Aerosp. Electron. Syst. Mag. 28(2) (2013)
E. Blasch, E. Bosse, D.A. Lambert, High-Level Information Fusion Management and Systems Design (Artech House, Norwood, 2012)
E. Blasch, S. Plano, DFIG level 5 (user refinement) issues supporting situational assessment reasoning, in International Conference on Information Fusion (2005)
E. Blasch, L. Hong, Simultaneous identification and track fusion, in IEEE Conference on Decision and Control (1998)
J. Salerno, E. Blasch, M. Hinman, D. Boulware, Evaluating algorithmic techniques in supporting situation awareness, in Proceedings of SPIE, vol. 5813 (2005)
E. Blasch, Situation, impact, and user refinement, in Proceedings of SPIE, vol. 5096 (2003)
D. Shen, G. Chen, E. Blasch, G. Tadda, Adaptive Markov game theoretic data fusion approach for cyber network defense, in IEEE Military Communications Conference (MILCOM) (2007)
E. Blasch, S Plano, JDL level 5 fusion model ‘user refinement’ issues and applications in group Tracking, in Proceedings of SPIE, vol. 4729 (2002)
E. Blasch, Sensor, user, mission (SUM) resource management and their interaction with level 2/3 fusion, in International Conference Information Fusion (2006)
E. Blasch, T. Connare, Group information feedback for objects under trees. National Symposium on Sensor and Data Fusion (2001)
A.N. Steinberg, C.L. Bowman, Revisions to the JDL data fusion model Ch 2, in Handbook of MultiSensor Data Fusion, ed. by D.L. Hall, J. Llinas (CRC Press, Boca Raton, LA, 2001)
E. Blasch, S. Plano, Cognitive fusion analysis based on context, in Proceedings of SPIE, vol. 5434 (2004)
E. Blasch, I. Kadar, J.J. Salerno, M.M. Kokar, S. Das, G.M. Powell, D.D. Corkill, et al. Issues and challenges in situation assessment (level 2 fusion). J. Adv. Inf. Fusion 1(2), 122–139 (2006)
E. Blasch, I. Kadar, K. Hintz, J. Biermann, C-Y. Chong, J. Salerno, S. Das, Resource management coordination with level 2/3 fusion issues and challenges. IEEE Aerosp. Electron. Syst. Mag. 23(3), 32–46 (2008)
E. Blasch, J. Llinas, D. Lambert, P. Valin, S. Das, C-Y. Chong, M.M. Kokar, E. Shahbazian, High level information fusion developments, issues, and grand challenges—fusion10 panel discussion, in International Conference Information Fusion (2010)
E. Blasch, D.A. Lambert, P. Valin, M.M. Kokar, J. Llinas, S. Das, C-Y. Chong, et al., High level information fusion (HLIF) survey of models, issues, and grand challenges. IEEE Aerosp. Electron. Syst. Mag. 27(9) (2012)
E. Blasch, A.N. Steinberg, S. Das, J. Llinas, C-Y. Chong, O. Kessler, E. Waltz, F. White, Revisiting the JDL model for information exploitation, in International Conference Information Fusion (2013)
J. García, L. Snidaro, I. Visentini, Exploiting context as binding element for multi-level fusion. Panel Discussion Paper, International Conference on Information Fusion (2012)
L. Snidaro, I. Visentini, J. Llinas, G.L. Foresti, Context in fusion: some considerations in a JDL perspective, in Proceedings of the 16th International Conference on Information Fusion (2013)
A.N. Steinberg, G.L. Rogova, Situation and context in data fusion and natural language understanding, in International Conference on Information Fusion (2008)
G. Ferrin, L. Snidaro, G.L. Foresti, Contexts, co-texts and situations in fusion domain, in International Conference on Information Fusion (2011)
L. Snidaro, J. Garcia, J. Llinas, Context-based information fusion: a survey and discussion. Inf. Fusion 25, 16–31 (2015). doi:10.1016/j.inffus.2015.01.002
A. Dey, G. Abowd, Towards a better understanding of context and context-awareness. Workshop on the What, Who, Where, When and How of Context-Awareness (2000)
I. Visentini, L. Snidaro, Integration of contextual information for tracking refinement, in International Conference on Information Fusion (2011)
E. Blasch, Assembling a distributed fused Information-based human-computer cognitive decision making tool. IEEE Aerosp. Electron. Syst. Mag. 15(5), 11–17 (2000)
B. Kahler, E. Blasch, Sensor management fusion using operating conditions, in IEEE National Aerospace Electronics Conference (2008)
M. Maziere, F. Chassaing, L. Garrido, P. Salembier, Segmentation and tracking of video objects for a content-based video indexing context, in IEEE International Conference on Multimedia and Expo (2000)
E. Blasch, T. Connare, Group tracking of occluded targets, in Proceedings of SPIE, vol. 4365 (2001)
E. Blasch, T. Connare, Improving track accuracy through Group Information Feedback, in International Conference on Information Fusion (2001)
W. Koch, Information fusion aspects related to GMTI convoy tracking, in International Conference on Information Fusion (2002)
C.M. Power, D.E. Brown, Context-based methods for track association, in International Conference on Information Fusion (2002)
S.M. Arulampalam, N. Gordon, M. Orton, B. Ristic, A variable structure multiple model particle filter for GMTI tracking, in International Conference on Information Fusion (2002)
J. García, J.A. Besada, J.R. Casar, Use of map information for tracking targets on airport surface. IEEE Trans. Aerosp. Electron. Syst. 39(2), 675–694 (2003)
J. Wang, P. Neskovic, L.N. Cooper, context-based tracking of object features, in IEEE International Joint Conference on Neural Networks (2004)
S.J. McKenna, H. Nait-Charif, Learning spatial context from tracking using penalised likelihoods, in International Conference on Pattern Recognition (2004)
L. Chen, R. Ravichandran, Automated track projection bias removal using Frechet distance and road networks, in International Conference on Information Fusion (2014)
C. Yang, E. Blasch, M. Bakich, Nonlinear constrained tracking of targets on roads, in International Conference on Information Fusion (2005)
J. García, J.M. Molina, G. de Miguel, A. Soto, Design of an A-SMGCS prototype at Barajas airport: data fusion algorithms, in International Conference on Info Fusion (2005)
A. Chella, H. Dindo, I. Infantino, A system for simultaneous people tracking and posture recognition in the context of human-computer interaction, in International Conference on Computer as a Tool, EUROCON (2005)
J.C. McCall, M.M. Trivedi, Performance evaluation of a vision based lane tracker designed for driver assistance systems, in IEEE Intelligent Vehicles Symposium (2005)
S.Y. Cheng, S. Park, M.M. Trivedi, Multiperspective thermal IR and video arrays for 3D body tracking and driver activity analysis, in IEEE Computer Vision and Pattern Recognition—Workshops (2005)
C. Yang, E. Blasch, Pose angular-aiding for maneuvering target tracking, in International Conference on Information Fusion (2005)
T. Brehard, J.P. Le Cadre, Closed-form posterior cramaer-rao bound for a maneuvering target in the bearings-only tracking context using best-fitting gaussian distribution, in International Conference on Information Fusion (2006)
H.T. Nguyen, Q. Ji, A.W.M. Smeulders, Robust multi-target tracking using spatio-temporal context, in IEEE Computer Society Conference on Computer Vision and Pattern Recognition (2006)
M. Lee, J. van Santen, B. Mobius, J. Olive, Formant tracking using context-dependent phonemic information. IEEE Trans. Speech Audio Process. Part: 2, 13(5), 741–750 (2005)
W-T. Chu, W-H. Cheng, J-L. Wu, Generative and discriminative modeling toward semantic context detection in audio tracks, in International Multimedia Modeling Conference (2005)
D.T. Toledano, J.G. Villardebo, L.H. Gomez, Initialization, training, and context-dependency in HMM-based formant tracking. IEEE Trans. Audio Speech Lang. Process. 14(2), 511–523 (2006)
M.E.P. Davies, M.D. Plumbley, Context-dependent beat tracking of musical audio. IEEE Trans. Audio Speech Lang. Process. 15(3), 1009–1020 (2007)
E. Blasch, C. Banas, M. Paul, B. Bussjager, G. Seetharaman, Pattern activity clustering and evaluation (PACE), in Proceedings of SPIE, vol. 8402 (2012)
A.M. Sanchez, M.A. Patricio, J. Garcia, M.A. Molina, Video tracking improvement using context-based information, in International Conference on Information Fusion (2007)
S. Ali, V. Reilly, M. Shah, Motion and appearance contexts for tracking and re-acquiring targets in aerial videos, in IEEE Conference on Computer Vision and Pattern Recognition (2007)
T. Gandhi, M.M. Trivedi, Pedestrian protection systems: issues, survey, and challenges. IEEE Trans. Intell. Transp. Syst. 8(3), 413–430 (2007)
H.T. Nguyen, J. Qiang, A.W. M. Smeulders, Spatio-temporal context for Robust multitarget tracking. IEEE Trans. Pattern Anal. Mach. Intell. 29(1), 52–64 (2007)
M. Feldmann, W. Koch, Road-map assisted convoy track maintenance using random matrices, in International Conference on Information Fusion (2008)
M. Mertens, M. Ulmke, Ground moving target tracking with context information and a refined sensor model, in International Conference on Information Fusion (2008)
C. Yang, E. Blasch, Fusion of tracks with road constraints. J. Adv. Inf. Fusion 3(1), 14–32 (2008)
C. Yang, E. Blasch, Kalman filtering with nonlinear state constraints. IEEE Trans. Aerosp. Electron. Syst. 45(1), 70–84 (2009)
M. Yang, Y. Wu, G. Hua, Context-aware visual tracking. IEEE Trans. Pattern Anal Mach. Intell. 31(7), 1195–1209 (2009)
A.M. Sanchez, M.A. Patricio, J. Garcia, J.M. Molina, A context model and reasoning system to improve object tracking in complex scenarios. Expert Syst. Appl. 36(8), 10995–11005 (2009)
J. Gomez-Romero, M.A. Patricio, J. Garcia, J.M. Molina, Context-based reasoning using ontologies to adapt visual tracking in surveillance, in IEEE International Conference on Advanced Video and Signal Based Surveillance (2009)
J. George, J.L. Crassidis, T. Singh, Threat assessment using context-based tracking in a maritime environment, in International Conference on Information Fusion (2009)
D. Balakrishnan, A. Nayak, P. Dhar, Adaptive and intelligent route learning for mobile assets using geo-tracking and context profiles, in International Conference on Computational Science and Engineering (2009)
E. Maggio, A. Cavallaro, Learning scene context for multiple object tracking. IEEE Trans. Image Process. 18(8), 1873–1884 (2009)
H. Ling, L. Bai, E. Blasch, X. Mei, Robust infrared vehicle tracking across target change using L1 regularization, in International Conference on Information Fusion (2010)
W. Koch, On Bayesian tracking and data fusion: a tutorial introduction with examples. IEEE Aerosp. Electron. Syst. Mag. Part: 2, 25(7), 29–52 (2010)
J. Gómez-Romero, J. García, M. Kandefer, J. Llinas, J. M. Molina, M.A. Patricio et al., Strategies and techniques for use and exploitation of contextual information in high-level fusion architectures, in International Conference on Information Fusion (2010)
J. Gomez-Romero, M.A. Patricio, J. Garcıa, J.M. Molina, Ontology-based context representation and reasoning for object tracking and scene interpretation in video. Expert Syst. Appl. 38(6), 7494–7510 (2011)
J. Garcia, J.M. Molina, T. Singh, J. Crassidis, J. Llinas, Research opportunities in contextualized fusion systems. The harbor surveillance case, in International Conference on Artificial Neural Networks (2011)
J. Garcia, J. Gomez-Romero, M.A. Patricio, J.M. Molina, G. Rogova, On the representation and exploitation of context knowledge in a harbor surveillance scenario, in International Conference on Information Fusion (2011)
P. Guha, A. Mukerjee, V.K. Subramanian, Formulation, detection and application of occlusion states (Oc-7) in the context of multiple object tracking, in IEEE International Advanced Video and Signal-Based Surveillance (AVSS) (2011)
X. Mei, H. Ling, Y. Wu, E. Blasch, L. Bai, Minimum error bounded efficient L1 tracker with occlusion detection, in IEEE Computer Vision and Pattern Recognition (2011)
D.P. Chau, F. Bremond, M. Thonnat, A multi-feature tracking algorithm enabling adaptation to context variations, in International Conference on Imaging for Crime Detection and Prevention (2011)
X. Peng, Z. Xing, X. Tan, Y. Yu, W. Zhao, Iterative context-aware feature location: (NIER track), in International Conference on Software Engineering (ICSE) (2011)
A. Rice, J. Vasquez, Context-aided tracking with an adaptive hyperspectral sensor, in International Conference on Information Fusion (2011)
Z. Sun, H. Yao, S. Zhang, X. Sun, Robust visual tracking via context objects computing, in IEEE International Conference on Image Processing (ICIP) (2011)
B. Pannetier, J. Dezert, Extended and multiple target tracking: evaluation of an hybridized solution, in International Conference on Informational Fusion (2011)
Y. Wu, E. Blasch, G. Chen, L. Bai, H. Ling, Multiple source data fusion via sparse representation for Robust visual tracking, in International Conference on Information Fusion (2011)
J. George, J.L. Crassidis, T. Singh, A.M. Fosbury, Anomaly detection using context-aided target tracking. J. Adv. Inf. Fusion 6(1) (2011)
S. Zhang, Y. Bar-Shalom, Track segment association for GMTI tracks of evasive move-stop-move maneuvering targets. IEEE Trans. Aerosp. Electron. Syst. 47(3), 1899–1914 (2011)
K.M. Han, H.T. Choi, Shape context based object recognition and tracking in structured underwater environment, in IEEE International Geoscience and Remote Sensing Symposium (IGARSS) (2011)
D. Qiu, R. Lynch, E. Blasch, C. Yang, Underwater navigation using location-dependent signatures, in IEEE-AIAA Aerospace Conference (2012)
L. Snidaro, I. Visentini, K. Bryan, G.L. Foresti, Markov logic networks for context integration and situation assessment in maritime domain, in International Conference on Information Fusion (2012)
L. Snidaro, I. Visentini, K. Bryan, Fusing uncertain knowledge and evidence for maritime situational awareness via Markov logic networks. Inf. Fusion 21, 159–172 (2015). doi:10.1016/j.inffus.2013.03.004
D. Balakrishnan, A. Nayak, An efficient approach for mobile asset tracking using contexts. IEEE Trans. Parallel Distrib. Syst. 23(2), 211–218 (2012)
E.D. Marti, J. Garcia, J.L. Crassidis, Improving multiple-model context-aided tracking through an autocorrelation approach, in International Conference on Information Fusion (2012)
L. Lamard, R. Chapuis, J-P. Boyer, Dealing with occlusions with multi targets tracking algorithms for the real road context, in IEEE Intelligent Vehicles Symposium (IV) (2012)
L. Cerman, V. Hlavac, Tracking with context as a semi-supervised learning and labeling problem, in International Conference on Pattern Recognition (ICPR) (2012)
X. Shi, H. Ling, E. Blasch, W. Hu, Context-driven moving vehicle detection in wide area motion imagery, in International Conference on Pattern Recognition (ICPR) (2012)
A. Borji, S. Frintrop, D.N. Sihite, L. Itti, Adaptive object tracking by learning background context, in IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) (2012)
C. Yang, L. Kaplan, E. Blasch, Performance measures of covariance and information matrices in resource management for target state estimation. IEEE Trans. Aerosp. Electron. Syst. 48(3), 2594–2613 (2012)
C. Yang, L.M. Kaplan, E. Blasch, M. Bakich, Optimal placement of heterogeneous sensors for targets with Gaussian priors. IEEE Trans. Aerosp. Electron. Syst. 49(3), 1637–1653 (2013)
M. Fanaswala, V. Krishnamurthy, Detection of anomalous trajectory patterns in target tracking via stochastic context-free grammars and reciprocal process models. IEEE J. Sel. Topics Signal Process. 7(1), 76–90 (2013)
P. Liang, H. Ling, E. Blasch, Encoding color information for visual tracking: algorithms and benchmark, in Submitted to IEEE Transaction on Pattern Analysis and Machine Intelligence, Aug 2014
Y. Yang, M. Li, F. Nian, H. Zhao, Y. He, Vision target tracker based on incremental dictionary learning and global and local classification, Abstr. Appl. Anal. (2013)
Z. Liu, E. Blasch, Z. Xue, R. Langaniere, W. Wu, Objective assessment of multiresolution image fusion algorithms for context enhancement in night vision: a comparative survey. IEEE Trans. Pattern Anal. Mach. Intell. 34(1), 94–109 (2012)
C. Yang, E. Blasch, Mutual aided target tracking and identification, in Proceedings of SPIE, vol. 5099 (2003)
E. Blasch, B. Kahler, Multi-resolution EO/IR Tracking and Identification, International Conference on Information Fusion (2005)
Y. Wu, E. Blasch, G. Chen, L. Bai, H. Ling, Multiple source data fusion via sparse representation for Robust visual tracking, in International Conference on Information Fusion (2011)
B. Kahler, E. Blasch, Decision-Level Fusion Performance Improvement from Enhanced HRR Radar Clutter Suppression, J. Adv. Inf. Fusion 6(2) (2011)
Y. Zheng, W. Dong, E. Blasch, Qualitative and quantitative comparisons of multispectral night vision colorization techniques. Opt. Eng. 51(8) (2012)
E. Blasch, Level 5 (User Refinement) issues supporting information fusion management, in International Conference on Information Fusion (2006)
E. Blasch, Modeling intent for a target tracking and identification scenario, in Proceedings of SPIE, vol. 5428 (2004)
M. Wei, G. Chen, J.B. Cruz, L.S. Haynes et al., Multi-Pursuer multi-evader pursuit-evasion games with jamming confrontation. AIAA J. Aerosp. Comput. Inf. Commun. 4(3), 693–706 (2007)
E. Blasch, J. Salerno, I. Kadar, S.J. Yang, L. Fenstermacher, M. Endsley, L. Grewe, Summary of human, social, cultural, behavioral (HCSB) modeling for information fusion, in Proceedings of SPIE, vol. 8745 (2013)
E. Blasch, L. Hong, Data association through fusion of target track and identification sets, in International Conference on Information Fusion (2000)
S. Alsing, E. Blasch, R. Bauer, Three-dimensional receiver operating characteristic (ROC) trajectory concepts for the evaluation of target recognition algorithms faced with the Unknown target detection problem, in Proceedings of SPIE, vol. 3718 (1999)
O. Mendoza-Schrock, J.A. Patrick, E. Blasch, Video image registration evaluation for a layered sensing environment, in Proceedings of IEEE National Aerospace Electronics Conference (NAECON) (2009)
E. Blasch, S. Russell, G. Seetharaman, Joint data management for MOVINT data-to-decision making, in International Conference on Information Fusion (2011)
H. Ling, Y. Wu, E. Blasch, G. Chen, L. Bai, Evaluation of visual tracking in extremely low frame rate wide area motion imagery, in International Conference on Information Fusion (2011)
E. Blasch, P.B. Deignan Jr, S. L. Dockstader et al., Contemporary concerns in geographical/geospatial information systems (GIS) processing, in Proceedings of IEEE National Aerospace Electronics Conference (NAECON) (2011)
E. Blasch, G. Seetharaman, K. Palaniappan, H. Ling, G. Chen, Wide-area motion imagery (WAMI) exploitation tools for enhanced situation awareness, in IEEE Applied Imagery Pattern Recognition Workshop (2012)
E. Blasch, T. Connare, Feature-aided JBPDAF group tracking and classification using an IFFN sensor, in Proceedings of SPIE, vol. 4728 (2002)
Y. Wu, J. Wang, L. Cheng, H. Lu et al., Real-time probabilistic covariance tracking with efficient model update. IEEE Trans. Image Process. 21(5), 2824–2837 (2012)
E. Blasch, J.J. Westerkamp et al., Identifying moving HRR signatures with an ATR belief filter, in Proceedings of SPIE, vol. 4053 (2000)
E. Blasch, T. Connare, Improving track maintenance through group tracking, in Proceedings Workshop on Estimation, Tracking, and Fusion; A Tribute to Yaakov Bar Shalom (2001), pp. 360–371
T. Connare, E. Blasch, J. Schmitz et al., Group IMM tracking utilizing track and identification fusion, in Proceedings of Workshop on Estimation, Tracking, and Fusion; A Tribute to Yaakov Bar Shalom, May 2001, pp. 205–220
E. Blasch, Derivation of a belief filter for simultaneous high range resolution radar tracking and identification, Ph.D. Thesis, Wright State University, 1999
P. Hanselman, C. Lawrence, E. Fortunano, B. Tenney et al., Dynamic tactical targeting, in Proceedings of SPIE, vol. 5441 (2004)
K. Palaniappan, F. Bunyak, P. Kumar et al., Efficient feature extraction and likelihood fusion for vehicle tracking in low frame rate airborne video, in International Conference on Information Fusion (2010)
E. Blasch, C. Banas, M. Paul et al., Pattern activity clustering and evaluation (PACE), in Proceedings of SPIE, vol. 8402 (2012)
X. Mei, H. Ling, Y. Wu, E. Blasch, L Bai, Efficient minimum error bounded particle resampling L1 tracker with occlusion detection. IEEE Trans. Image Process (T-IP) 22(7), 2661–2675 (2013)
P. Liang, G. Teodoro, H. Ling et al., Multiple Kernel learning for vehicle detection in wide area motion imagery, in International Conference on Information Fusion (2012)
X. Shi, P. Li, W. Hu, E. Blasch, H. Ling, Using maximum consistency context for multiple target association in wide area traffic scenes, in International Conference on Acoustics, Speech and Signal Processing (ICASSP) (2013)
J. Gao, H. Ling, E. Blasch, K. Pham, Z. Wang, G. Chen, Patterns of life from WAMI objects tracking. SPIE Newsroom (2013)
R.I. Hammoud, C.S. Sahin, E.P. Blasch, B.J. Rhodes, T. Wang, Automatic association of chats and video tracks for activity learning and recognition in aerial video surveillance. Sensors 14, 19843–19860 (2014)
Acknowledgments
This work is partly supported by the Air Force Office of Scientific Research (AFOSR) under the Dynamic Data Driven Application Systems program and the Air Force Research Lab.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2016 Springer International Publishing Switzerland (outside the USA)
About this chapter
Cite this chapter
Blasch, E., Yang, C., García, J., Snidaro, L., Llinas, J. (2016). Contextual Tracking Approaches in Information Fusion. In: Snidaro, L., García, J., Llinas, J., Blasch, E. (eds) Context-Enhanced Information Fusion. Advances in Computer Vision and Pattern Recognition. Springer, Cham. https://doi.org/10.1007/978-3-319-28971-7_4
Download citation
DOI: https://doi.org/10.1007/978-3-319-28971-7_4
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-28969-4
Online ISBN: 978-3-319-28971-7
eBook Packages: Computer ScienceComputer Science (R0)