Abstract
Automatic deception detection has been extensively studied considering their applicability in various real-life applications. Since humans will express the deception through non-verbal behavior that can be recorded in a non-intrusive manner, the deception detection from video using automatic techniques can be devised. In this paper, we present a novel technique for the video-based deception technique using Deep Recurrent Convolutional Neural Network. The proposed method uses the sequential input that can capture the spatiotemporal information to capture the non-verbal behavior from the video. The deep features are extracted from the sequence of frames using a pre-trained GoogleNet CNN. To effectively learn the extended sequence, the bi-directional LSTMs are connected to the GoogleNet and can be jointly trained to learn the perceptual representation. Extensive experiments are carried out on a publicly available dataset [5] with 121 deceptive and truthful video clips reflecting a real-life scenario. Obtained results demonstrate the outstanding performance of the proposed method when compared with the four different state-of-the-art techniques.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
DePaulo, B.M., Kashy, D.A., Kirkendol, S.E., Wyer, M.M., Epstein, J.A.: Lying in everyday life. J. Pers. Soc. Psychol. 70(5), 979 (1996)
Krishnamurthy, G., Majumder, N., Poria, S., Cambria, E.: A deep learning approach for multimodal deception detection. arXiv preprint arXiv:1803.00344 (2018)
Levine, T.R., et al.: Sender demeanor: individual differences in sender believability have a powerful impact on deception detection judgments. Hum. Commun. Res. 37(3), 377–403 (2011). https://doi.org/10.1111/j.1468-2958.2011.01407.x
Pérez-Rosas, V., Abouelenien, M., Mihalcea, R., Burzo, M.: Deception detection using real-life trial data. In: Proceedings of ACM on International Conference on Multimodal Interaction, pp. 59–66 (2015)
Pérez-Rosas, V., Abouelenien, M., Mihalcea, R., Xiao, Y., Linton, C., Burzo, M.: Verbal and nonverbal clues for real-life deception detection. In: Proceedings of Conference on Empirical Methods in Natural Language Processing (2015)
Su, L., Levine, M.: Does lie to me lie to you? An evaluation of facial clues to high-stakes deception. Comput. Vis. Image Underst. 147, 52–68 (2016)
Szegedy, C., et al.: Going deeper with convolutions. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1–9 (2015)
Venkatesh, S., Ramachandra, R., Bours, P.: Robust algorithm for multimodal deception detection. In: 2019 IEEE Conference on Multimedia Information Processing and Retrieval (MIPR), pp. 534–537, March 2019
Wu, Z., Singh, B., Davis, L.S., Subrahmanian, V.: Deception detection in videos. arXiv preprint arXiv:1712.04415 (2017)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Venkatesh, S., Ramachandra, R., Bours, P. (2020). Video Based Deception Detection Using Deep Recurrent Convolutional Neural Network. In: Nain, N., Vipparthi, S., Raman, B. (eds) Computer Vision and Image Processing. CVIP 2019. Communications in Computer and Information Science, vol 1148. Springer, Singapore. https://doi.org/10.1007/978-981-15-4018-9_15
Download citation
DOI: https://doi.org/10.1007/978-981-15-4018-9_15
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-15-4017-2
Online ISBN: 978-981-15-4018-9
eBook Packages: Computer ScienceComputer Science (R0)