Abstract
Attention is the critical resource for intelligence analysts, so tools that provide focus are useful. One way to determine focus is by computing significance. In the context of a known model, new data can be placed on a spectrum defined by: normal, anomalous, interesting, novel, or random; and significance is greatest towards the middle of this spectrum. However, significance also depends on the mental state of the analyst (and the organization). A framework for understanding significance is defined, and its impact on the knowledge–discovery process is explored.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsNotes
- 1.
This is the random walk Laplacian.
References
Abdulsalam, H., Skillicorn, D., Martin, P.: Classification using streaming random forests. In: {IEEE Transactions on Knowledge and Data Engineering}, vol. 22. (2010)
Bourassa, M., Skillicorn, D.: Hardening adversarial prediction with anomaly tracking. In: IEEE Intelligence and Security Informatics 2009, pp. 43–48. (2009)
Breiman, L.: Random forests. Mach. Learn. 45(1), 5–32 (2001)
Brin, S., Page, L., Motwani, R., Winograd, T.: The pagerank citation ranking: Bringing order to the web. Stanford Digital Libraries Working Paper, 1998
Bryan, K., Leise, T.: The $25,000,000,000 eigenvector: The linear algebra behind. Google SIAM Rev. 48(3), 569–581 (2006)
Davies, E., Gladwell, G., Leydold, J., Stadler, P.: Discrete nodal domain theorems. Linear Algebr. Appl. 336(51) (2001)
Galloway, J., Simoff, S.: Digging in the details: A case study in network data mining. In: Intelligence and Security Informatics. Lecture Notes in Computer Science 3495, pp. 14–26. Springer, Berlin (2005)
Galloway, J., Simoff, S.: Network data mining: Discovering patterns of interaction between attributes. In: Advances in Knowledge Discovery and Data Mining. Lecture Notes in Computer Science 3918, pp. 410–414. Springer, Berlin (2006)
Jonas, J., Sokol, L.: Data Finds Data, chapter 9. O’Reilly Media, New York (2009)
Laloux, L., Cizeau, P., Potters, M., Bouchaud, J.-P.: Random Matrix Theory and Financial Correlations. World Scientific, Singapore (1999)
Liben-Nowell, D., Kleinberg, J.: The link prediction problem for social networks. In: Proceedings of the Twelfth International Conference on Information and Knowledge Management, pp.~556–559 (2003)
Schmidhuber, J.: Developmental robotics, optimal artifical curiosity, creativity, music, and the fine arts. Conn. Sci. 18(2), 173–187 (2006)
Schmidhuber, J.: Simple algorithmic principles of discovery, subjective beauty, selective attention, curiosity & creativity. In: Corruble, V., Takeda, M., Suzuki, E. (eds.) Proceedings of the 10th International Conference on Discovery Science (DS 2007), LNAI 4755, pp. 26–38. (2007)
Skillicorn, D.: Detecting anomalies in graphs. In: 2007 IEEE International Conference on Intelligence and Security Informatics, pp. 209–216. (2007)
Skillicorn, D.: Understanding Complex Datasets: Data Mining with Matrix Decompositions. CRC, Boca Raton (2007)
Tax, D.: One Class Classification. Ph.D. thesis, Technical University Delft (2000)
Treverton, G.: Reshaping National Intelligence for an Age of Information. Cambridge University Press, Cambridge (2001)
Treverton, G.: Risks and riddles. Smithsonian Magazine, June 2007
Türker, A., Görgün, I., Conlan, O.: The challenge of content creation to facilitate personalized elearning experiences. Int. J. E-Learning 5(1), 11–17 (2006)
von Luxburg, U.: A tutorial on spectral clustering. Technical Report 149, Max Plank Institute for Biological Cybernetics, Aug 2006
Zhu, X., Goldberg, A.: Introduction to Semi-Supervised Learning. Synthesis Lectures on Artifical Intelligence and Machine Learning 6. Morgan & Claypool, San Rafael, CA (2009)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer-Verlag/Wien
About this chapter
Cite this chapter
Skillicorn, D., Bourassa, M.A.J. (2011). A Framework for Analyst Focus from Computed Significance. In: Wiil, U.K. (eds) Counterterrorism and Open Source Intelligence. Lecture Notes in Social Networks. Springer, Vienna. https://doi.org/10.1007/978-3-7091-0388-3_3
Download citation
DOI: https://doi.org/10.1007/978-3-7091-0388-3_3
Published:
Publisher Name: Springer, Vienna
Print ISBN: 978-3-7091-0387-6
Online ISBN: 978-3-7091-0388-3
eBook Packages: Computer ScienceComputer Science (R0)