Abstract
Attention is the critical resource for intelligence analysts, so tools that provide focus are useful. One way to determine focus is by computing significance. In the context of a known model, new data can be placed on a spectrum defined by: normal, anomalous, interesting, novel, or random; and significance is greatest towards the middle of this spectrum. However, significance also depends on the mental state of the analyst (and the organization). A framework for understanding significance is defined, and its impact on the knowledge–discovery process is explored.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
Notes
- 1.
This is the random walk Laplacian.
References
Abdulsalam, H., Skillicorn, D., Martin, P.: Classification using streaming random forests. In: {IEEE Transactions on Knowledge and Data Engineering}, vol. 22. (2010)
Bourassa, M., Skillicorn, D.: Hardening adversarial prediction with anomaly tracking. In: IEEE Intelligence and Security Informatics 2009, pp. 43–48. (2009)
Breiman, L.: Random forests. Mach. Learn. 45(1), 5–32 (2001)
Brin, S., Page, L., Motwani, R., Winograd, T.: The pagerank citation ranking: Bringing order to the web. Stanford Digital Libraries Working Paper, 1998
Bryan, K., Leise, T.: The $25,000,000,000 eigenvector: The linear algebra behind. Google SIAM Rev. 48(3), 569–581 (2006)
Davies, E., Gladwell, G., Leydold, J., Stadler, P.: Discrete nodal domain theorems. Linear Algebr. Appl. 336(51) (2001)
Galloway, J., Simoff, S.: Digging in the details: A case study in network data mining. In: Intelligence and Security Informatics. Lecture Notes in Computer Science 3495, pp. 14–26. Springer, Berlin (2005)
Galloway, J., Simoff, S.: Network data mining: Discovering patterns of interaction between attributes. In: Advances in Knowledge Discovery and Data Mining. Lecture Notes in Computer Science 3918, pp. 410–414. Springer, Berlin (2006)
Jonas, J., Sokol, L.: Data Finds Data, chapter 9. O’Reilly Media, New York (2009)
Laloux, L., Cizeau, P., Potters, M., Bouchaud, J.-P.: Random Matrix Theory and Financial Correlations. World Scientific, Singapore (1999)
Liben-Nowell, D., Kleinberg, J.: The link prediction problem for social networks. In: Proceedings of the Twelfth International Conference on Information and Knowledge Management, pp.~556–559 (2003)
Schmidhuber, J.: Developmental robotics, optimal artifical curiosity, creativity, music, and the fine arts. Conn. Sci. 18(2), 173–187 (2006)
Schmidhuber, J.: Simple algorithmic principles of discovery, subjective beauty, selective attention, curiosity & creativity. In: Corruble, V., Takeda, M., Suzuki, E. (eds.) Proceedings of the 10th International Conference on Discovery Science (DS 2007), LNAI 4755, pp. 26–38. (2007)
Skillicorn, D.: Detecting anomalies in graphs. In: 2007 IEEE International Conference on Intelligence and Security Informatics, pp. 209–216. (2007)
Skillicorn, D.: Understanding Complex Datasets: Data Mining with Matrix Decompositions. CRC, Boca Raton (2007)
Tax, D.: One Class Classification. Ph.D. thesis, Technical University Delft (2000)
Treverton, G.: Reshaping National Intelligence for an Age of Information. Cambridge University Press, Cambridge (2001)
Treverton, G.: Risks and riddles. Smithsonian Magazine, June 2007
Türker, A., Görgün, I., Conlan, O.: The challenge of content creation to facilitate personalized elearning experiences. Int. J. E-Learning 5(1), 11–17 (2006)
von Luxburg, U.: A tutorial on spectral clustering. Technical Report 149, Max Plank Institute for Biological Cybernetics, Aug 2006
Zhu, X., Goldberg, A.: Introduction to Semi-Supervised Learning. Synthesis Lectures on Artifical Intelligence and Machine Learning 6. Morgan & Claypool, San Rafael, CA (2009)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer-Verlag/Wien
About this chapter
Cite this chapter
Skillicorn, D., Bourassa, M.A.J. (2011). A Framework for Analyst Focus from Computed Significance. In: Wiil, U.K. (eds) Counterterrorism and Open Source Intelligence. Lecture Notes in Social Networks. Springer, Vienna. https://doi.org/10.1007/978-3-7091-0388-3_3
Download citation
DOI: https://doi.org/10.1007/978-3-7091-0388-3_3
Published:
Publisher Name: Springer, Vienna
Print ISBN: 978-3-7091-0387-6
Online ISBN: 978-3-7091-0388-3
eBook Packages: Computer ScienceComputer Science (R0)