Abstract
Driven by the underlying need for an as yet undeveloped framework for fusing heterogeneous data and information at different semantic levels coming from both sensory and human sources, we present some results of the research conducted within the NATO Research Task Group IST-106/RTG-051 on “Information Filtering and Multi Source Information Fusion.” As part of this ongoing effort, we discuss here a first outcome of our investigation on multi-level fusion. It deals with removing the first hurdle between data/information sources and processes being at different levels: representation. Our contention here is that a common representation and description framework is the premise for enabling processing overarching different semantic levels. To this end, we discuss here the use of the Battle Management Language (BML) as a way (“lingua franca”) to encode sensor- and text-based data and a priori and contextual knowledge, both as hard and soft data. We here expand on our previous works [1, 2] further detailing and exemplifying the use of BML and clarifying aspects related to the use of contextual information and the exploitation of uncertain soft input along with sensor readings.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsNotes
- 1.
p1: http://www.defenceimagery.mod.uk/fotoweb/Grid.fwx?search=%28IPTC020%20contains%20%28Sentry%29%29 file is available for reuse under the OGL (Open Government License) http://www.nationalarchives.gov.uk/doc/open-government-licence/.
p2: http://commons.wikimedia.org/wiki/File:F-14_Radar_TID.jpg#filelinks; public domain.
p3: http://commons.wikimedia.org/wiki/File:AN-APG-63V3.jpg, by ‘Raytheon’, freely reproducible.
p4: http://www.army.mil/media/226029/ by Staff Sgt John H. Johnson III 11042011-A-zv120-001) public domain.
p5: http://www.defenceimagery.mod.uk/fotoweb/Grid.fwx?position=65&archiveid=5036&columns=8&rows=1&sorting=ModifiedTimeAsc&search=%28IPTC020%20contains%28Royal%20Air%20Force%29%29 file is available for reuse under the OGL (Open Government License) http://www.nationalarchives.gov.uk/doc/open-government-licence/.
- 2.
p6: http://www.gps.gov/multimedia/images/IIF.jpg United States Government; public domain.
p7: http://en.wikipedia.org/wiki/Boeing_E-3_Sentry, public domain
p8: http://www.defenceimagery.mod.uk/fotoweb/Grid.fwx?archiveId=5042&search=45148329.jpg available for reuse under the OGL (Open Government License) http://www.nationalarchives.gov.uk/doc/open-government-licence/.
References
J. Garcia, L. Snidaro, I. Visentini, exploiting context as binding element for multi-level fusion, in 15th International Conference on Information Fusion (Singapore, July 2012)
L. Snidaro, J. Garcia, J. Llinas, Context-based information fusion: a survey and discussion. Inf. Fusion 25, 16–31 (2015). doi:10.1016/j.inffus.2015.01.002
E.E. White, A model for data fusion, in Proceedings of 1st National Symposium on Sensor Fusion, vol. 2, 1988
A.N. Steinberg, C.L. Bowman, F.E. White, revisions to the JDL data fusion model, presented at the Joint NATO/IRIS Conference (Quebec, October 1998)
A.N. Steinberg, C.L. Bowman, F.E. White, sensor fusion: architectures, algorithms, and applications, in Proceedings of the SPIE, vol. 3719, 1999
J. Llinas, C.L. Bowman, G.L. Rogova, A.N. Steinberg, E.L. Waltz, F.E. White, revisiting the JDL data fusion model II, in Proceedings of the Seventh International Conference on Information Fusion, vol. II (Stockholm, Sweden, June 2004), pp. 1218–1230
J. Biermann, P. Hörling, L. Snidaro, Experiences and challenges in automated support for intelligence in asymmetric operations. J. Adv. Inf. Fusion 8(2), 101–118 (2013)
M. Bedworth, J. O’Brien, The omnibus model: a new model of data fusion?, IEEE Aerosp. Electron. Syst. Mag., 15(4), (2000)
E.P. Blasch, S. Plano, Level 5: user refinement to aid the fusion process, in Multisensor, Multisource Information Fusion: Architectures, Algorithms, and Applications 2003, vol. 5099, ed by B. Dasarathy (Proceedings of the SPIE, 2003)
S.C. Shapiro, D.R. Schlegel, natural language understanding for soft information fusion, in 16th International Conference on Information Fusion (Istanbul, July 2013)
K. Date, G.A. Gross, S. Khopkar, R. Nagi, K. Sambhoos, Data association and graph analytical processing of hard and soft intelligence data, in 16th International Conference on Information Fusion (Istanbul, July 2013)
H. Köhler, D.A. Lambert, J. Richter, G. Burgess, T. Cawley, implementing soft fusion, in 16th International Conference on Information Fusion (Istanbul, July 2013)
B. Pietropaoli, M. Dominici, F. Weis, Virtual sensors and data fusion in a multi-level context computing architecture, in 16th International Conference on Information Fusion (Istanbul, July 2013)
M.A. Solano, J. Carbone, Systems engineering for information fusion: towards enterprise multi-level fusion integration, in 16th International Conference on Information Fusion (Istanbul, July 2013)
M. Haberjahn, K. Kozempel, Multi level fusion of competitive sensors for automotive environment perception, in 16th International Conference on Information Fusion (Istanbul, July 2013)
K. Krenc, Updating attribute fusion results with additional evidence using DSmT, in 15th International Conference on Information Fusion (Singapore, July 2012)
K. Krenc, F. Smarandache, application of new absolute and relative conditioning rules in threat assessment, in 16th International Conference on Information Fusion (Istanbul, July 2013)
J. Biermann, V. Nimier, J. Garcia, K. Rein, K. Krenc, L. Snidaro, Multi-level fusion of hard and soft information, in Proceedings of the 17th International Conference on Information Fusion (Salamanca, Spain, July 7–10, 2014)
J. Biermann, V. Nimier, J. Garcia, K. Rein, K. Krenc, L. Snidaro, Standardized representation via BML to support multi-level fusion of hard and soft information, in Proceedings of the NATO IST/SET-126 Symposium on “Information Fusion (Hard and Soft) for Intelligence, Surveillance & Reconnaissance (ISR)’’, Joint Symposium IST-106 and SET-189 (Norfolk, Virginia, US, May 04–05, 2015)
U. Schade, M. Hieb, M. Frey, K. Rein, Command and Control Lexicon Grammar (C2LG) Specification. ITF/2012/02, pp. 33–34
U. Schade, M.R. Hieb, Development of formal grammars to support coalition command and control: a battle management language for orders, requests, and reports, in 11th ICCRTS (Cambridge, UK, 2006)
U. Schade, M.R. Hieb, battle management language: a grammar for specifying reports, in 2007 Spring Simulation Interoperability Workshop (Paper 07S-SIW-036) (Norfolk, VA, Mar 2007)
L. Snidaro, I. Visentini, J. Llinas, G.L. Foresti, Context in fusion: some considerations in a JDL perspective, in 16th International Conference on Information Fusion (Istanbul, July 2013)
L. Snidaro, L. Vaci, J. García, E. Marti, A.-L. Jousselme, K. Bryan, D.D. Bloisi, D. Nardi, A framework for dynamic context exploitation, in Proceedings of the 17th International Conference on Information Fusion, July 6–9, 2015, (Washington, D.C., USA, 2015), pp. 1160–1167
E.P.Blasch, A. Steinberg, S. Das, J. Llinas, C. Chong, O. Kessler, E. Waltz, F. White, revisiting the JDL model for information exploitation, in 16th International Conference on Information Fusion (Istanbul, July 2013)
K. Rein, J. Biermann, Your high-level information is my low-level data. A new look at terminology for multi-level fusion, in 16th International Conference on Information Fusion, (Istanbul, July 2013)
J. Gómez-Romero, M.A. Serrano, J. García, J.M. Molina, G. Rogova, Context-based multi-level information fusion for harbor surveillance. Inf. Fusion 21, 173–186 (2015)
M. Richardson, P. Domingos, Markov logic netwoks. Mach. Learn. 62, 107–136 (2006)
L. Snidaro, I. Visentini, K. Bryan, Fusing uncertain knowledge and evidence for maritime situational awareness via Markov Logic Networks. Inf. Fusion 21, 159–172 (2015). doi:10.1016/j.inffus.2013.03.004
R. Glinton, J. Giampapa, K. Sycara, A markov random field model of context for high-level information fusion, in Proceedings of the 9th International Conference on Information Fusion (Florence, Italy, July, 2006)
A.N. Steinberg, C.L. Bowman, adaptive context discovery and exploitation, in Proceedings Of the 16th International Conference on Information Fusion (Istanbul, Turkey, July 9–12, 2013)
A.N. Steinberg, L. Snidaro, Levels?, in Proceedings of the 18th International Conference on Information Fusion, July 6–9, 2015, (Washington, D.C., USA, 2015), pp. 1985-1992
W.-O. Huijsen, Controlled language—an introduction, in proceedings of the Second International Work-shop on Controlled Language Applications (CLAW98) (Language Technologies Institute, Carnegie Mellon University, Pittsburgh, PA, May 1998), pp. 1–15
J. Bresnan, Lexical-Functional Syntax (Blackwell, Malden, MA, 2001)
C. Jenge, S. Kawaletz, U. Schade, Combining Different NLP Methods for HUMINT Report Analysis (NATO RTO IST Panel Symposium, Stockholm, Sweden, 2009)
S. Kawaletz, K. Rein, Methodology for standardizing content for fusion of military reports generated in different natural languages, in Proceedings of MCC 2010 (Wroclaw, Poland, 2010)
T. Remmersmann, B. Brüggemann, M. Frey, Robots to the ground, in Concepts and Implementations for Innovative Military Communications and Information Technologies (Military University of Technology, Sept 2010), pp. 61–68
T. Remmersmann, B. Brüggemann, reporting sensor information using battle management language, in Proceedings of MCC2011 (Amsterdam, 2011)
K. Rein, U. Schade, T. Remmersmann, using battle management language to support all source integration, in Proceedings of NATO Joint Symposium SET-183 and IST-112 (Quebec City, 2012)
Acknowledgments
This work was partially supported by ONRG Grant N62909-14-1-N061 and project MINECO TEC2014-57022-C2-2-R.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2016 Springer International Publishing Switzerland (outside the USA)
About this chapter
Cite this chapter
Biermann, J., García, J., Krenc, K., Nimier, V., Rein, K., Snidaro, L. (2016). Multi-level Fusion of Hard and Soft Information for Intelligence. In: Snidaro, L., García, J., Llinas, J., Blasch, E. (eds) Context-Enhanced Information Fusion. Advances in Computer Vision and Pattern Recognition. Springer, Cham. https://doi.org/10.1007/978-3-319-28971-7_17
Download citation
DOI: https://doi.org/10.1007/978-3-319-28971-7_17
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-28969-4
Online ISBN: 978-3-319-28971-7
eBook Packages: Computer ScienceComputer Science (R0)