Abstract
Crowd predictions have demonstrated powerful performance in predicting future events. We aim to understand crowd prediction efficacy in ascertaining the veracity of human emotional expressions. We discover that collective discernment can increase the accuracy of detecting emotion veracity from 63%, which is the average individual performance, to 80%. Constraining data to best-performers can further increase the result up to 92%. Neural networks can achieve an accuracy of 99.69% by aggregating participants’ answers. That is, assigning positive and negative weights to high and low human predictors, respectively. Furthermore, neural networks that are trained with one emotion data can also produce high accuracies on discerning the veracity of other emotion types: our crowdsourced transfer of emotion learning is novel. We find that our neural networks do not require a large number of participants, particularly, 30 randomly selected, to achieve high accuracy predictions, better than any individual participant. Our proposed method of assembling peoples’ predictions with neural networks can provide insights for applications such as fake news prevention and lie detection.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Aviezer, H., Hassin, R., Bentin, S., Trope, Y.: Putting facial expressions back in context. In: First Impressions, pp. 255–286 (2008)
Chen, L., Gedeon, T., Hossain, M.Z., Caldwell, S.: Are you really angry?: detecting emotion veracity as a proposed tool for interaction. In: Proceedings of the 29th Australian Conference on Computer-Human Interaction, pp. 412–416. ACM (2017)
Conroy, N.J., Rubin, V.L., Chen, Y.: Automatic deception detection: methods for finding fake news. Proc. Assoc. Inf. Sci. Technol. 52(1), 1–4 (2015)
Du, S., Martinez, A.M.: The resolution of facial expressions of emotion. J. Vis. 11(13), 24–24 (2011)
Frood, A.: Work the crowd. New Sci. 237(3166), 32–35 (2018)
Gagnon, M., Gosselin, P., Hudon-ven Der Buhs, I., Larocque, K., Milliard, K.: Children’s recognition and discrimination of fear and disgust facial expressions. J. Nonverbal Behav. 34(1), 27–42 (2010)
Hassin, R.R., Aviezer, H., Bentin, S.: Inherently ambiguous: facial expressions of emotions, in context. Emot. Rev. 5(1), 60–65 (2013)
Hossain, M.Z., Gedeon, T.: Classifying posed and real smiles from observers’ peripheral physiology. In: 11th International Conference on Pervasive Computing Technologies for Healthcare, Barcelona, Spain, pp. 177–186, May 2017
Manski, C.F.: Interpreting the predictions of prediction markets. Econ. Lett. 91(3), 425–429 (2006)
Mather, M., Knight, M.R.: Angry faces get noticed quickly: threat detection is not impaired among older adults. J. Gerontol. Ser. B Psychol. Sci. Soc. Sci. 61(1), 54–57 (2006)
McLellan, T., Johnston, L., Dalrymple-Alford, J., Porter, R.: Sensitivity to genuine versus posed emotion specified in facial displays. Cogn. Emot. 24(8), 1277–1292 (2010)
Mellers, B., et al.: Identifying and cultivating superforecasters as a method of improving probabilistic predictions. Perspect. Psychol. Sci. 10(3), 267–281 (2015)
Pan, S.J., Yang, Q.: A survey on transfer learning. IEEE Trans. Knowl. Data Eng. 22(10), 1345–1359 (2010)
Polgreen, P.M., Nelson, F.D., Neumann, G.R., Weinstein, R.A.: Use of prediction markets to forecast infectious disease activity. Clin. Infect. Dis. 44(2), 272–279 (2007)
Servan-Schreiber, E., Wolfers, J., Pennock, D.M., Galebach, B.: Prediction markets: does money matter? Electr. Markets 14(3), 243–251 (2004)
Surowiecki, J.: The Wisdom of Crowds. Anchor (2005)
Svozil, D., Kvasnicka, V., Pospichal, J.: Introduction to multi-layer feed-forward neural networks. Chemom. Intell. Lab. Syst. 39(1), 43–62 (1997)
Teixeira, T., Wedel, M., Pieters, R.: Emotion-induced engagement in internet video advertisements. J. Mark. Res. 49(2), 144–159 (2012)
Wolfers, J., Zitzewitz, E.: Prediction markets. J. Econ. Perspect. 18(2), 107–126 (2004)
Acknowledgements
The authors are grateful to Aaron Manson for access to the data, and particularly acknowledge his efforts in data collection.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2018 Springer Nature Switzerland AG
About this paper
Cite this paper
Qin, Z., Gedeon, T., Caldwell, S. (2018). Neural Networks Assist Crowd Predictions in Discerning the Veracity of Emotional Expressions. In: Cheng, L., Leung, A., Ozawa, S. (eds) Neural Information Processing. ICONIP 2018. Lecture Notes in Computer Science(), vol 11306. Springer, Cham. https://doi.org/10.1007/978-3-030-04224-0_18
Download citation
DOI: https://doi.org/10.1007/978-3-030-04224-0_18
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-04223-3
Online ISBN: 978-3-030-04224-0
eBook Packages: Computer ScienceComputer Science (R0)