Abstract
A methodology is presented for the assessment of human operator performance in a detection and identification task, using two sets of infrared images of natural outdoor scenes with everyday objects used as targets. It includes measures of effectiveness such as operator detection rate, identification rate, false alarm rate, response time, confidence levels and image quality ratings. This robust methodology could be used in the evaluation of any image improvement technique or to evaluate different imaging techniques or technologies.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
The National Research Council. Existing and Potential Standoff Explosives Detection Techniques. National Research Council ed. National Research Council. The National Academies Press, Washington, DC (2004)
Parmeter, J.E.: The Challenge of Standoff Explosives Detection, pp. 355–358. IEEE (2004)
Vollmerhausen, R., Driggers, R.G., O’Kane, B.L.: Influence of Sampling on Target Recognition and Identification. Optical Engineering 38(5), 763–772 (1999)
Hanton, K., Sunde, J., Butavicius, M., Burns, N.: Super-resolution of Infrared Images: Does it Improve Operator Object Detection Performance? Journal of Comp. and Inf. Technology (CIT) 18(2), 141–150 (2010)
Baker, S., Kanade, T.: Super-Resolution: Limits and Beyond. In: Chaudhuri, S. (ed.) Super-Resolution Imaging, pp. 243–276. Kluwer Academic Publishers, Boston (2001)
Wang, Z., Bovik, A.C.: Modern Image Quality Assessment, Synthesis Lectures on Image, Video and Multimedia Processing. Morgan and Claypool Publishers, USA (2006)
Tian, L., Suzuki, A., Koike, H.: Task-Oriented Evaluation of Super-Resolution Techniques. In: 20th International Conference on Pattern Recognition, Istanbul, pp. 493–498 (2010)
Li, J., Sheng, U.: Wavelet Domain Superresolution Reconstruction of Infrared Image Sequences. In: Proceedings of SPIE in Sensor Fusion: Architectures, Algorithms and Applications, vol. 4385, pp. 108–116 (2001)
Van Eekeren, A.W.M., Schutte, K., Oudegeest, O.R., Van Vliet, L.J.: Performance Evaluation of Super-Resolution Reconstruction Methods on Real-World Data. EURASIP Journal on Advances in Signal Processing, 1–11 (2007)
Choi, E., Choi, J., Kang, M.G.: Super-Resolution Approach to Overcome Physical Limitations of Imaging Sensors: An Overview. International Journal of Imaging Systems and Technology, Special Issue: High-Resolution Image Reconstruction 14(2), 36–46 (2004)
Park, S.C., Park, M.K., Kang, M.G.: Super-Resolution Image Reconstruction: A Technical Overview. IEEE Signal Processing Magazine 20(3), 21–36 (2003)
Hanton, K., Butavicius, M., Sunde, J., Lozo, P.: Operator Measures and Edge Sharpness Metrics to Assess Infrared Image Enhancement. In: Proc. of the 32nd International Convention on Information and Communication Technology, Electronics and Microelectronics (MIPRO), pp. 21–26. IEEE Press, Opatija (2009) (invited paper)
Hanton, K., Butavicius, M., Johnson, K., Sunde, J.: Improving Infrared Images for Standoff Object Detection. In: Proc. Information Tech. Interfaces (ITI 2009), pp. 641–646 (2009); also in Journal of Computing and Information Technology (CIT) Special Edition 18(2), 151–157 (2010)
Burningham, N., Pizlo, Z., Allebach, J.P.: Image Quality Metrics. In: Image Processing, Image Quality, Image Capture Systems Conference, pp. 598–616 (2003)
Frøkjær, E., Hertzum, M., Hornbæk, K.: Measuring Usability: Are Effectiveness, Efficiency, and Satisfaction Really Correlated? In: Proc. of Conference on Human Factors in Computing Systems, The Hague, The Netherlands, pp. 345–352. ACM, New York (2000)
Agarwal, S., Reddy, M., Hall, R., Woodard, T., Brown, J., Trang, A.: Evaluating Operator Performance in Aided Airborne Mine Detection. In: Proc. of SPIE Detection and Remediation Technologies for Mines and Minelike Targets X. SPIE, Orlando (2005)
Butavicius, M.A., Parsons, K.M., McCormac, A., Foster, R., Whittenbury, A., MacLeod, V.: Assessment of the ThruVision T4000 Passive Terahertz Camera: A Human Factors Case Study. In: Jain, L.C., Aidman, E.V., Abeynayake, C. (eds.) Innovations in Defence Support Systems -2. SCI, vol. 338, pp. 183–206. Springer, Heidelberg (2011)
Motulsky, H.: Intuitive Biostatistics. Oxford University Press, New York (2005)
Addinsoft, XLSTAT. Version 2011.4.02 (2011), http://www.xlstat.com/
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2012 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Hanton, K., Sunde, J., Butavicius, M., Jain, L.C., Burns, N. (2012). How to Assess Human Visual Performance on an Operational Task. In: Jezic, G., Kusek, M., Nguyen, NT., Howlett, R.J., Jain, L.C. (eds) Agent and Multi-Agent Systems. Technologies and Applications. KES-AMSTA 2012. Lecture Notes in Computer Science(), vol 7327. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-30947-2_45
Download citation
DOI: https://doi.org/10.1007/978-3-642-30947-2_45
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-30946-5
Online ISBN: 978-3-642-30947-2
eBook Packages: Computer ScienceComputer Science (R0)