Abstract
X-ray inspection by control officers is not always consistent when inspecting baggage since this task are monotonous, tedious and tiring for human inspectors. Thus, a semi-automatic inspection makes sense as a solution in this case. In this perspective, the study presents a novel feature learning model for object classification in luggage dual X-ray images in order to detect explosives objects and firearms. We propose to use supervised feature learning by autoencoders approach. Object detection is performed by a modified YOLOv3 to detect all the presented objects without classification. The features learning is carried out by labeled adversarial autoencoders. The classification is performed by a support vector machine to classify a new object as explosive, firearms or non-threatening objects. To show the superiority of our proposed system, a comparative analysis was carried out to several methods of deep learning. The results indicate that the proposed system leads to efficient objects classification in complex environments, achieving an accuracy of 98.00% and 96.50% in detection of firearms and explosive objects respectively.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Abadi, M., Barham, P., Chen, J., Chen, Z., Davis, A., Dean, J., et al. (2016). Tensorflow: A system for large-scale machine learning. In 12th Symposium on operating systems design and implementation (pp. 265–283). GA, USA: Savannah.
Ahuja, Y., & Yadav, S. K. (2012). Multiclass classification and support vector machine. Global Journal of Computer Science and Technology Interdisciplinary, 12(11), 14–20.
Ba, J. L., Kiros, J. R., & Hinton, G. E. (2016). Layer normalization. arXiv preprint arXiv:1607.06450.
Baum, P. (2016). Violence in the skies: A history of aircraft hijacking and bombing. Chichester: Summersdale Publishers LTD.
Clevert, D.-A., Unterthiner, T., & Hochreiter, S. (2015). Fast and accurate deep network learning by exponential linear units (elus). arXiv preprint arXiv:1511.07289.
Cortes, C., & Vapnik, V. (1995). Support-vector networks. Machine Learning, 20(3), 273–297. https://doi.org/10.1023/A:1022627411411.
Dai, J., Li, Y., He, K., & Sun, J. (2016). R-FCN: Object detection via region-based fully convolutional networks. In Advances in neural information processing systems, Barcelona, Spain, pp. (379–387).
Gao, Y., Gao, L., Li, X., & Zheng, Y. (2019). A zero-shot learning method for fault diagnosis under unknown working loads. Journal of Intelligent Manufacturing,. https://doi.org/10.1007/s10845-019-01485-w.
Gehring, J., Miao, Y., Metze, F., & Waibel, A. (2013). Extracting deep bottleneck features using stacked auto-encoders. In 2013 IEEE international conference on acoustics, speech and signal processing (pp. 3377–3381). Canada: Vancouver.
Gillen, D., & Morrison, W. G. (2015). Aviation security: Costing, pricing, finance and performance. Journal of Air Transport Management, 48, 1–12. https://doi.org/10.1016/j.jairtraman.2014.12.005.
Girshick, R. (2015). Fast R-CNN. In Proceedings of the IEEE international conference on computer vision, Santiago, Chile, (pp. 1440–1448).
Jones, T. L. (2003). Court security: a guide for post 9–11 environments. Springfield: Charles C Thomas Publisher. ISBN: 978-0398074203.
Kingma, D. P., & Ba, J. (2014). Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980.
Koller, S., & Schwaninger, A. (2006). Assessing x-ray image interpretation competency of airport security screeners. In Proceedings of the 2nd international conference on research in air transportation, ICRAT 2006, Belgrade, Serbia, pp. 399–402. https://doi.org/10.13140/RG.2.1.1037.2086.
Koller, S. M., Drury, C. G., & Schwaninger, A. (2009). Change of search time and non-search time in x-ray baggage screening due to training. Ergonomics, 52(6), 644–656. https://doi.org/10.1080/00140130802526935.
Latif, S., Rana, R., Qadir, J., & Epps, J. (2017). Variational autoencoders for learning latent representations of speech emotion: A preliminary study. arXiv preprint arXiv:1712.08708.
Li, R., Wang, P., & Chen, Z. (2016). A feature extraction method based on stacked auto-encoder for telecom churn prediction. Theory, methodology, tools and applications for modeling and simulation of complex systems (pp. 568–576). Beijing: Springer.
Liu, W., Anguelov, D., Erhan, D., Szegedy, C., Reed, S., Fu, C.-Y., & Berg, A. C. (2016). SSD: Single shot multibox detector. In European conference on computer vision (pp. 21–37). Amsterdam: Springer.
Makhzani, A., Shlens, J., Jaitly, N., Goodfellow, I., & Frey, B. (2015). Adversarial autoencoders. arXiv preprint arXiv:1511.05644.
Mouton, A., & Breckon, P. T. (2015). A review of automated image understanding within 3d baggage computed tomography security screening. Journal of X-ray Science and Technology, 23(5), 531–555. https://doi.org/10.3233/XST-150508.
Organization, I. C. A. (2017). Air transport, passengers carried. https://data.worldbank.org/indicator/IS.AIR.PSGR. Civil Aviation Statistics of the World and ICAO staff estimates. Accessed 1 Aug 2018.
Pekoske, D. (2018). Advanced integrated passenger and baggage screening technologies. DHS congressional appropriations reports, United States. Department of Homeland Security.
Pinho, E. & Costa, C. (2018). Feature learning with adversarial networks for concept detection in medical images: UA.PT bioinformatics at imageCLEF 2018. In CLEF2018 Working notes. CEUR workshop proceedings, Avignon, France, (pp. 10–14).
Redmon, J., Divvala, S., Girshick, R., & Farhadi, A. (2016). You only look once: Unified, real-time object detection. In The IEEE conference on computer vision and pattern recognition (CVPR), Nevada, USA.
Redmon, J. & Farhadi, A. (2017). Yolo9000: Better, faster, stronger. In The IEEE conference on computer vision and pattern recognition (CVPR), Hawaï, USA.
Redmon, J. & Farhadi, A. (2018). YOLOv3: An incremental improvement. arXiv preprint arXiv:1804.02767.
Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., et al. (2015). Imagenet large scale visual recognition challenge. International Journal of Computer Vision, 115(3), 211–252. https://doi.org/10.1007/s11263-015-0816-y.
Schwaninger, A. (2005). Increasing efficiency in airport security screening. WIT Transactions on the Built Environment, 82, 407–416. https://doi.org/10.2495/SAFE050401.
Singh, S., & Singh, M. (2003). Explosives detection systems (EDS) for aviation security. Signal Processing, 83(1), 31–55. https://doi.org/10.1016/S0165-1684(02)00391-2.
South China Morning Post. (2015). No survivors in ’tragic scene’: A russian airliner crashes into Sinai killing all 224 people on board. https://www.scmp.com/news/world/article/1874381/russian-airliner-crashes-egypts-sinai-peninsula-carrying-224-people. Accessed 31 Oct 2015.
START. (2017). Global terrorism database. National Consortium for the Study of Terrorism and Responses to Terrorism. https://www.start.umd.edu/gtd/. Accessed Aug 2018.
Sterchi, Y., & Schwaninger, A. (2015). A first simulation on optimizing eds for cabin baggage screening regarding throughput. In 2015 International Carnahan conference on security technology (ICCST) (pp. 55–60). Taiwan: Taipei.
Supratak, A., Li, L., & Guo, Y. (2014). Feature extraction with stacked autoencoders for epileptic seizure detection. In 2014 36th Annual international conference of the IEEE engineering in medicine and biology society (pp. 4184–4187). Chicago, IL, USA.
Tan, J., Ung, M., Cheng, C., & Greene, C. S. (2014). Unsupervised feature construction and knowledge extraction from genome-wide assays of breast cancer with denoising autoencoders. In Pacific symposium on biocomputing (pp. 132–143). Big Island, Hawaii: World Scientific.
Tom Westbrook, J. B. (2017). Islamic State behind Australians’ foiled Etihad meat-mincer bomb plot: Police. https://www.reuters.com/article/us-australia-security-raids/islamic-state-behind-australians-foiled-etihad-meat-mincer-bomb-plot-police-idUSKBN1AJ367. Accessed 4 Aug 2017.
Wetzel, S. J. (2017). Unsupervised learning of phase transitions: From principal component analysis to variational autoencoders. Physical Review E,. https://doi.org/10.1103/PhysRevE.96.022140.
Wiegmann, D., McCarley, J. S., Kramer, A. F., & Wickens, C. D. (2006). Age and automation interact to influence performance of a simulated luggage screening task. Aviation, Space, and Environmental Medicine, 77(8), 825–831.
Xing, C., Ma, L., & Yang, X. (2016). Stacked denoise autoencoder based feature extraction and classification for hyperspectral images. Journal of Sensors, 2016, 1–10. https://doi.org/10.1155/2016/3632943.
Yousefi-Azar, M., Varadharajan, V., Hamey, L., & Tupakula, U. (2017). Autoencoder-based feature learning for cyber security applications. In 2017 International joint conference on neural networks (IJCNN), Alaska, Anchorage, (pp. 3854–3861).
Zabalza, J., Ren, J., Zheng, J., Zhao, H., Qing, C., Yang, Z., et al. (2016). Novel segmented stacked autoencoder for effective dimensionality reduction and feature extraction in hyperspectral imaging. Neurocomputing, 185, 1–10. https://doi.org/10.1016/j.neucom.2015.11.044.
Zhang, C., Cheng, X., Liu, J., He, J., & Liu, G. (2018). Deep sparse autoencoder for feature extraction and diagnosis of locomotive adhesion status. Journal of Control Science and Engineering, 2018(2), 1–9. https://doi.org/10.1155/2018/8676387.
Zhang, Y., You, D., Gao, X., Wang, C., Li, Y., & Gao, P. P. (2019). Real-time monitoring of high-power disk laser welding statuses based on deep learning framework. Journal of Intelligent Manufacturing,. https://doi.org/10.1007/s10845-019-01477-w.
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Chouai, M., Merah, M., Sancho-Gómez, JL. et al. Supervised feature learning by adversarial autoencoder approach for object classification in dual X-ray image of luggage. J Intell Manuf 31, 1101–1112 (2020). https://doi.org/10.1007/s10845-019-01498-5
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10845-019-01498-5