skip to main content
10.1145/2783258.2783404acmconferencesArticle/Chapter ViewAbstractPublication PageskddConference Proceedingsconference-collections
research-article

Cinema Data Mining: The Smell of Fear

Published: 10 August 2015 Publication History

Abstract

While the physiological response of humans to emotional events or stimuli is well-investigated for many modalities (like EEG, skin resistance, ...), surprisingly little is known about the exhalation of so-called Volatile Organic Compounds (VOCs) at quite low concentrations in response to such stimuli. VOCs are molecules of relatively small mass that quickly evaporate or sublimate and can be detected in the air that surrounds us. The paper introduces a new field of application for data mining, where trace gas responses of people reacting on-line to films shown in cinemas (or movie theaters) are related to the semantic content of the films themselves. To do so, we measured the VOCs from a movie theater over a whole month in intervals of thirty seconds, and annotated the screened films by a controlled vocabulary compiled from multiple sources. To gain a better understanding of the data and to reveal unknown relationships, we have built prediction models for so-called forward prediction (the prediction of future VOCs from the past), backward prediction (the prediction of past scene labels from future VOCs), which is some form of abductive reasoning, and Granger causality. Experimental results show that some VOCs and some labels can be predicted with relatively low error, and that hint for causality with low p-values can be detected in the data. The data set is publicly available at: https://github.com/jorro/smelloffear.

Supplementary Material

MP4 File (p1295.mp4)

References

[1]
K. Ackerl, M. Atzmueller, and K. Grammer. The scent of fear. Neuroendocrinology Letters, 23(2):79--84, 2002.
[2]
A. Amann and D. Smith. Volatile biomarkers: non-invasive diagnosis in physiology and medicine. Newnes, 2013.
[3]
E. Apostolidis and V. Mezaris. Fast shot segmentation combining global and local visual descriptors. In 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pages 6583--6587. IEEE, 2014.
[4]
J. Bennett and S. Lanning. The netflix prize. In Proceedings of KDD cup and workshop, volume 2007, page 35. ACM, 2007.
[5]
M. M. Bradley and P. J. Lang. Measuring emotion: the self-assessment manikin and the semantic differential. Journal of Behavior Therapy and Experimental Psychiatry, 25(1):49--59, 1994.
[6]
C. Chatfield. Time-series forecasting. CRC Press, 2000.
[7]
D. Chen and J. Haviland-Jones. Human olfactory communication of emotion. Perceptual and Motor Skills, 91(3):771--781, 2000.
[8]
B. de Lacy Costello, A. Amann, H. Al-Kateb, C. Flynn, W. Filipiak, T. Khalid, D. Osborne, and N. Ratcliffe. A review of the volatiles from the healthy human body. Journal of Breath Research, 8:014001, 2014.
[9]
C. A. Frantzidis, C. Bratsas, M. A. Klados, E. Konstantinidis, C. D. Lithari, A. B. Vivas, C. L. Papadelis, E. Kaldoudi, C. Pappas, and P. D. Bamidis. On the classification of emotional biosignals evoked while viewing affective pictures: an integrated data-mining-based approach for healthcare applications. IEEE Transactions on Information Technology in Biomedicine, 14(2):309--318, 2010.
[10]
Y. Gong, W. Wang, S. Jiang, Q. Huang, and W. Gao. Detecting violent scenes in movies by auditory and visual cues. In Advances in Multimedia Information Processing-PCM 2008, pages 317--326. Springer, 2008.
[11]
C. W. Granger. Investigating causal relations by econometric models and cross-spectral methods. Econometrica: Journal of the Econometric Society, pages 424--438, 1969.
[12]
M. Hall, E. Frank, G. Holmes, B. Pfahringer, P. Reutemann, and I. H. Witten. The WEKA data mining software: an update. ACM SIGKDD explorations newsletter, 11(1):10--18, 2009.
[13]
J. D. Hamilton. Time series analysis, volume 2. Princeton University Press, 1994.
[14]
S. Moncrieff, S. Venkatesh, and C. Dorai. Horror film genre typing and scene labeling via audio analysis. In Proceedings of the International Conference on Multimedia and Expo 2003, volume 2, pages II--193. IEEE, 2003.
[15]
J. D. Morris. Observations: Sam: the self-assessment manikin; an efficient cross-cultural measurement of emotional response. Journal of Advertising Research, 35(6):63--68, 1995.
[16]
H. Nabeshima, K. Iwanuma, K. Inoue, and O. Ray. Solar: An automated deduction system for consequence finding. AI communications, 23(2):183--203, 2010.
[17]
J. Pearl. Causality: models, reasoning and inference, volume 29. Cambridge Univ Press, 2000.
[18]
C. S. Peirce. Abduction and induction. Philosophical Writings of Peirce, 11, 1955.
[19]
F. Riganello, A. Candelieri, M. Quintieri, D. Conforti, and G. Dolce. Heart rate variability: An index of brain processing in vegetative state, an artificial intelligence, data mining study. Clinical Neurophysiology, 121(12):2024--2034, 2010.
[20]
B. Salt. Statistical style analysis of motion pictures. Film Quarterly, pages 13--22, 1974.
[21]
P. Sidiropoulos, V. Mezaris, I. Kompatsiaris, H. Meinedo, M. Bugalho, and I. Trancoso. Temporal video segmentation to scenes using high-level audiovisual features. IEEE Transactions on Circuits and Systems for Video Technology, 21(8):1163--1177, 2011.
[22]
M. Soleymani, G. Chanel, J. J. Kierkels, and T. Pun. Affective ranking of movie scenes using physiological signals and content analysis. In Proceedings of the 2nd ACM workshop on Multimedia semantics, pages 32--39. ACM, 2008.
[23]
J. Van Berkel, J. Dallinga, G. Möller, R. Godschalk, E. Moonen, E. Wouters, and F. Van Schooten. Development of accurate classification method based on the analysis of volatile organic compounds from human exhaled air. Journal of Chromatography B, 861(1):101--107, 2008.
[24]
J. C. van Gemert, J.-M. Geusebroek, C. J. Veenman, C. G. Snoek, and A. W. Smeulders. Robust scene categorization by learning image statistics in context. In Conference on Computer Vision and Pattern Recognition Workshop 2006, pages 105--105. IEEE, 2006.
[25]
P. R. Veres, P. Faber, F. Drewnick, J. Lelieveld, and J. Williams. Anthropogenic sources of VOC in a football stadium: Assessing human emissions in the atmosphere. Atmospheric Environment, 77:1052--1059, 2013.
[26]
Y. Zhai, Z. Rasheed, and M. Shah. Semantic classification of movie scenes using finite state machines. In IEE Proceedings Vision, Image and Signal Processing, volume 152, pages 896--901. IET, 2005.
[27]
H. Zhou, T. Hermans, A. V. Karandikar, and J. M. Rehg. Movie genre classification via scene categorization. In Proceedings of the international conference on Multimedia, pages 747--750. ACM, 2010.

Cited By

View all
  • (2024)From What You See to What We Smell: Linking Human Emotions to Bio-Markers in BreathIEEE Transactions on Affective Computing10.1109/TAFFC.2023.327521615:2(465-477)Online publication date: Apr-2024
  • (2023)Overcoming Data Scarcity through Transfer Learning in CO2-Based Building Occupancy DetectionProceedings of the 10th ACM International Conference on Systems for Energy-Efficient Buildings, Cities, and Transportation10.1145/3600100.3623718(1-10)Online publication date: 15-Nov-2023
  • (2021)Study that finds good sex clears a stuffed nose as well as a decongestant wins Ig Nobel prize for medicineBMJ10.1136/bmj.n2230(n2230)Online publication date: 10-Sep-2021
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
KDD '15: Proceedings of the 21th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining
August 2015
2378 pages
ISBN:9781450336642
DOI:10.1145/2783258
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 10 August 2015

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. abductive reasoning
  2. application
  3. atmospheric chemistry
  4. breath analysis
  5. causality
  6. data mining
  7. emotional response analysis
  8. movie analysis

Qualifiers

  • Research-article

Conference

KDD '15
Sponsor:

Acceptance Rates

KDD '15 Paper Acceptance Rate 160 of 819 submissions, 20%;
Overall Acceptance Rate 1,133 of 8,635 submissions, 13%

Upcoming Conference

KDD '25

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)61
  • Downloads (Last 6 weeks)8
Reflects downloads up to 05 Mar 2025

Other Metrics

Citations

Cited By

View all
  • (2024)From What You See to What We Smell: Linking Human Emotions to Bio-Markers in BreathIEEE Transactions on Affective Computing10.1109/TAFFC.2023.327521615:2(465-477)Online publication date: Apr-2024
  • (2023)Overcoming Data Scarcity through Transfer Learning in CO2-Based Building Occupancy DetectionProceedings of the 10th ACM International Conference on Systems for Energy-Efficient Buildings, Cities, and Transportation10.1145/3600100.3623718(1-10)Online publication date: 15-Nov-2023
  • (2021)Study that finds good sex clears a stuffed nose as well as a decongestant wins Ig Nobel prize for medicineBMJ10.1136/bmj.n2230(n2230)Online publication date: 10-Sep-2021
  • (2020)Decoding the social volatilome by tracking rapid context-dependent odour changePhilosophical Transactions of the Royal Society B: Biological Sciences10.1098/rstb.2019.0259375:1800(20190259)Online publication date: 20-Apr-2020
  • (2020)Neurokommunikation im EventkontextEventpsychologie10.1007/978-3-658-28888-4_17(379-426)Online publication date: 15-Dec-2020
  • (2018)Proof of concept study: Testing human volatile organic compounds as tools for age classification of filmsPLOS ONE10.1371/journal.pone.020304413:10(e0203044)Online publication date: 11-Oct-2018
  • (2018)A Scalable Room Occupancy Prediction with Transferable Time Series Decomposition of CO2 Sensor DataACM Transactions on Sensor Networks10.1145/321721414:3-4(1-28)Online publication date: 27-Nov-2018
  • (2018)SD-HOC: Seasonal Decomposition Algorithm for Mining Lagged Time SeriesData Mining10.1007/978-981-13-0292-3_8(125-143)Online publication date: 14-Apr-2018
  • (2017)DA-HOCProceedings of the 4th ACM International Conference on Systems for Energy-Efficient Built Environments10.1145/3137133.3137146(1-10)Online publication date: 8-Nov-2017
  • (2016)Crowd-based breath analysis: assessing behavior, activity, exposures, and emotional response of people in groupsJournal of Breath Research10.1088/1752-7155/10/3/03200110:3(032001)Online publication date: 24-Jun-2016
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media