Abstract
This study demonstrated the effects of image brightness on brain activity in neuroscience research, in which the brightness of emotional images had not been taken into account. Electroencephalography recordings from 14 electrode sites of 31 healthy participants were examined during the presentation of original and bright versions of neutral, pleasant and unpleasant images. Power spectra of the recordings were obtained using the short time Fourier transform. The features were extracted from the power spectra for specific time–frequency windows and data obtained from features were classified using support vector machine (SVM), partial least squares regression (PLSR) and k-nearest neighbor (k-NN) algorithms between the original and bright groups for three emotional contents. New features were created with feature combinations providing high classification accuracy. The data obtained from new features were reclassified using SVM, PLSR, k-NN and voting methods between the original and bright groups for three emotional contents. The classification results revealed that the datasets obtained for the original and bright versions of neutral, pleasant and unpleasant images could be separated with 71–81% accuracy. The brightness effect occurred predominantly in the frontal and central regions. This effect was observed in the early time window of visual processing for pleasant and unpleasant images, and in the late time window for neutral images. The findings emphasize that image brightness of affects the power of brain activity and therefore, is an important parameter to be considered in neuroscience research.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
Availability of data
The EEG data used to support the findings of this study are available from the corresponding author upon request.
References
Aftanas, L. I., Varlamov, A. A., Pavlov, S. V., Makhnev, V. P., & Reva, N. V. (2002). Time-dependent cortical asymmetries induced by emotional arousal: EEG analysis of event-related synchronization and desynchronization in individually defined frequency bands. International Journal of Psychophysiology, 44, 67–82. https://doi.org/10.1016/S0167-8760(01)00194-5
Aydin, S., Demirtaş, S., Ateş, K., Tunga M.A. (2016) Emotion recognition with eigen features of frequency band activities embedded in induced brain oscillations mediated by affective pictures. Int. J Neural Syst https://doi.org/10.1142/S0129065716500131
Balconi, M., Brambilla, E., & Falbo, L. (2009). Appetitive vs defensive responses to emotional cues autonomic measures and brain oscillation modulation. Brain Research. https://doi.org/10.1016/j.brainres.2009.08.056
Balconi, M., Falbo, L., & Brambilla, E. (2009). BIS/BAS responses to emotional cues: Self report, autonomic measure and alpha band modulation. Personality and Individual Differences, 47, 858–863. https://doi.org/10.1016/j.paid.2009.07.004
Bamidis, P. D., Klados, M. A., Frantzidis, C., Vivas, A. B., Papadelis, C., Lithari, C., & Pappas, C. (2009). A framework combining delta event-related oscillations (EROs) and synchronisation effects (ERD/ERS) to study emotional processing. Comput. Math. Methods Med. Intell. Neurosci. https://doi.org/10.1155/2009/549419
Bekhtereva, V., Craddock, M., & Müller, M. M. (2015). Attentional bias to affective faces and complex IAPS images in early visual cortex follows emotional cue extraction. NeuroImage, 112, 254–266. https://doi.org/10.1016/j.neuroimage.2015.03.052
Boulesteix, A. L., & Strimmer, K. (2007). Partial least squares: A versatile tool for the analysis of high-dimensional genomic data. Briefings in Bioinformatics, 8, 32–44. https://doi.org/10.1093/bib/bbl016
Clayson, P. E., & Larson, M. J. (2019). The impact of recent and concurrent affective context on cognitive control: An ERP study of performance monitoring. International Journal of Psychophysiology, 143, 44–56. https://doi.org/10.1016/j.ijpsycho.2019.06.007
Costa, T., Cauda, F., Crini, M., Tatu, M. K., Celeghin, A., De Gelder, B., & Tamietto, M. (2014). Temporal and spatial neural dynamics in the perception of basic emotions from complex scenes. Soc. Cogn. Affect. Neurosci., 9, 1690–1703. https://doi.org/10.1093/scan/nst164
Cover, T. M., & Hart, P. E. (2012). Nearest Neighbor Pattern Classfication, I 1–28
Cuthbert, B. N., Schupp, H. T., Bradley, M. M., Birbaumer, N., & Lang, P. J. (2000). Brain potentials in affective picture processing: Covariation with autonomic arousal and affective report. Biological Psychology, 52, 95–111. https://doi.org/10.1016/S0301-0511(99)00044-7
Delplanque, S., N’diaye, K., Scherer, K., & Grandjean, D. (2007). Spatial frequencies or emotional effects?. A systematic measure of spatial frequencies for IAPS pictures by a discrete wavelet analysis. Journal of Neuroscience Methods, 165, 144–150. https://doi.org/10.1016/j.jneumeth.2007.05.030
Delplanque, S., Silvert, L., Hot, P., Rigoulot, S., & Sequeira, H. (2006). Arousal and valence effects on event-related P3a and P3b during emotional categorization. International Journal of Psychophysiology. https://doi.org/10.1016/j.ijpsycho.2005.06.006
Donchin, E., & Coles, M. G. H. (1988). Is the P300 component a manifestation of context updating? The Behavioral and Brain Sciences, 11, 357. https://doi.org/10.1017/S0140525X00058027
Eroğlu, K., Kayıkçıoğlu, T., & Osman, O. (2020). Eff ect of brightness of visual stimuli on EEG signals. Behavioral Brain Science. https://doi.org/10.1016/j.bbr.2020.112486
Feng, C., Wang, L., Liu, C., Zhu, X., Dai, R., Mai, X., & Luo, Y. J. (2012). The time course of the influence of valence and arousal on the implicit processing of affective pictures. PLoS ONE, 7, 1–9. https://doi.org/10.1371/journal.pone.0029668
Frantzidis, C. A., Bratsas, C., Klados, M. A., Konstantinidis, E., Lithari, C. D., Vivas, A. B., Papadelis, C. L., Kaldoudi, E., Pappas, C., & Bamidis, P. D. (2010). On the classification of emotional biosignals evoked while viewing affective pictures: An integrated data-mining-based approach for healthcare applications. IEEE Transactions on Information Technology in Biomedicine, 14, 309–318. https://doi.org/10.1109/TITB.2009.2038481
Ganin, I. P., Kosichenko, E. A., & Kaplan, A. Y. (2018). Properties of EEG Responses to Emotionally Significant Stimuli Using a P300 Wave-Based Brain-Computer Interface. Neuroscience and Behavioral Physiology, 48, 1093–1099. https://doi.org/10.1007/s11055-018-0672-7
Ghodrati, M., Ghodousi, M., & Yoonessi, A. (2016). Low-level contrast statistics of natural images can modulate the frequency of event-related potentials (ERP) in humans. Frontiers in Human Neuroscience, 10, 1–12. https://doi.org/10.3389/fnhum.2016.00630
Giannakopoulos, T., & Pikrakis, A. (2014). Signal transforms and filtering essentials. Introd. to Audio Anal. https://doi.org/10.1016/b978-0-08-099388-1.00003-0
Gianotti, L. R. R., Faber, P. L., Schuler, M., Pascual-Marqui, R. D., Kochi, K., & Lehmann, D. (2008). First valence, then arousal: The temporal dynamics of brain electric activity evoked by emotional stimuli. Brain Topography. https://doi.org/10.1007/s10548-007-0041-2
Goto, N., Lim, X. L., Shee, D., Hatano, A., Khong, K. W., Buratto, L. G., Watabe, M., & Schaefer, A. (2019). Can brain waves really tell If a product will be purchased? Inferring consumer preferences from single-item brain potentials. Frontiers in Integrative Neuroscience, 13, 1–13. https://doi.org/10.3389/fnint.2019.00019
Groen, I. I. A., Silson, E. H., & Baker, C. I. (2017). Contributions of low- and high-level properties to neural processing of visual scenes in the human brain. Transaction of the Royal Society B Biological Sciences Philos. https://doi.org/10.1098/rstb.2016.0102
Güntekin, B., & Başar, E. (2010a). A new interpretation of P300 responses upon analysis of coherences. Cognitive Neurodynamics. https://doi.org/10.1007/s11571-010-9106-0
Güntekin, B., & Başar, E. (2010b). Event-related beta oscillations are affected by emotional eliciting stimuli. Neuroscience Letters. https://doi.org/10.1016/j.neulet.2010.08.002
Güntekin, B., & Başar, E. (2010c). Event-related beta oscillations are affected by emotional eliciting stimuli. Neuroscience Letters, 483, 173–178. https://doi.org/10.1016/j.neulet.2010.08.002
Güntekin, B., & Başar, E. (2014). A review of brain oscillations in perception of faces and emotional pictures. Neuropsychologia. https://doi.org/10.1016/j.neuropsychologia.2014.03.014
Güntekin, B., Femir, B., Gölbaşı, B. T., Tülay, E., & Başar, E. (2017). Affective pictures processing is reflected by an increased long-distance EEG connectivity. Cognitive Neurodynamics, 11, 355–367. https://doi.org/10.1007/s11571-017-9439-z
Hansen, B. C., Jacques, T., Johnson, A. P., & Ellemberg, D. (2011). From spatial frequency contrast to edge preponderance: The differential modulation of early visual evoked potentials by natural scene stimuli. Visual Neuroscience, 28, 221–237. https://doi.org/10.1017/S095252381100006X
Hansen, B. C., Johnson, A. P., & Ellemberg, D. (2012). Different spatial frequency bands selectively signal for natural image statistics in the early visual system. Journal of Neurophysiology, 108, 2160–2172. https://doi.org/10.1152/jn.00288.2012
Harris, J. M., Ciorciari, J., & Gountas, J. (2019). Consumer neuroscience and digital/social media health/social cause advertisement effectiveness. Behavioral Science. https://doi.org/10.3390/bs9040042
Hess, R. F., & Plant, G. T. (1983). The effect of temporal frequency variation on threshold contrast sensitivity deficits in optic neuritis. Journal of Neurology, Neurosurgery and Psychiatry, 46, 322–330.
Huerta, M., Leiva, V., Lillo, C., & Rodríguez, M. (2018). A beta partial least squares regression model: Diagnostics and application to mining industry data. Applied Stochastic Models in Business and Industry, 34, 305–321. https://doi.org/10.1002/asmb.2278
Jing, K., Mei, Y., Song, Z., Wang, H., & Shi, R. (2019). How Do Price and Quantity Promotions Affect Hedonic Purchases? An ERPs Study. Frontiers in Neuroscience, 13, 1–9. https://doi.org/10.3389/fnins.2019.00526
Johannes, S., Münte, T. F., Heinze, H. J., & Mangun, G. R. (1995). Luminance and spatial attention effects on early visual processing. Cognitive Brain Research. https://doi.org/10.1016/0926-6410(95)90008-X
Keil, A., Stolarova, M., Moratti, S., & Ray, W. J. (2007). Adaptation in human visual cortex as a mechanism for rapid discrimination of aversive stimuli. NeuroImage, 36, 472–479. https://doi.org/10.1016/j.neuroimage.2007.02.048
M.G. Kounelakis, M. Zervakis, X. Kotsiakis, (2007) The Impact of Microarray Technology in Brain Cancer, Elsevier B.V. https://doi.org/10.1016/B978-044452855-1/50015-5.
Kurt, P., Eroğlu, K., & Bayram KGüntekin, T. B. (2017). The modulation of delta responses in the interaction of brightness and emotion. International Journal of Psychophysiology. https://doi.org/10.1016/j.ijpsycho.2016.11.013
Kutas, M., Mccarthy, G., & Donchin, E. (1977). Augmenting mental chronometry: the P300 as a measure of stimulus evaluation time, Science (80-). 197: 792–795.
Luck, S. J. (2005). An introduction to the event-related potential technique, MA: MIT Press, Cambridge.
Lakens, D., Fockenberg, D. A., Lemmens, K. P. H., Ham, J., & Midden, C. J. H. (2013). Brightness differences influence the evaluation of affective pictures. Cognition and Emotion, 27, 1225–1246. https://doi.org/10.1080/02699931.2013.781501
Lang, P. J., Bradley, M. M., & Cuthbert, B. N. (1997). International affective picture system (IAPS): Technical manual and affective ratings, NIMH Central Study Emotional Attention pp. 39–58.
Leyh, R., Heinisch, C., Kungl, M. T., & Spangler, G. (2016). Attachment Representation Moderates the Influence of Emotional Context on Information Processing. Frontiers in Human Neuroscience, 10, 1–12. https://doi.org/10.3389/fnhum.2016.00278
Li, W., & Liu, Z. (2011). A method of SVM with normalization in intrusion detection, Procedia. Environmental Sciences, 11, 256–262. https://doi.org/10.1016/j.proenv.2011.12.040
Liu, N., Wang, K., Jin, X., Gao, B., Dellandréa, E., & Chen, L. (2017). Visual affective classification by combining visual and text features. PLoS ONE, 12, 6–9. https://doi.org/10.1371/journal.pone.0183018
Ma, H., Mo, Z., Zhang, H., Wang, C., & Fu, H. (2018). The temptation of zero price: Event-related potentials evidence of how price framing influences the purchase of bundles. Frontiers in Neuroscience, 12, 1–8. https://doi.org/10.3389/fnins.2018.00251
Ma, Q., Wang, X., Shu, L., & Dai, S. (2008). P300 and categorization in brand extension. Neuroscience Letters. https://doi.org/10.1016/j.neulet.2007.11.022
Magliero, A., Bashore, T. R., Coles, M. G. H., & Donchin, E. (1984). On the Dependence of P300 Latency on Stimulus Evaluation Processes.pdf. Psychophysiology, 21, 171–186. https://doi.org/10.1111/j.1469-8986.1984.tb00201.x
Martini, N., Menicucci, D., Sebastiani, L., Bedini, R., Pingitore, A., Vanello, N., Milanesi, M., Landini, L., & Gemignani, A. (2012). The dynamics of EEG gamma responses to unpleasant visual stimuli: From local activity to functional connectivity. NeuroImage, 60, 922–932. https://doi.org/10.1016/j.neuroimage.2012.01.060
Mavratzakis, A., Herbert, C., & Walla, P. (2016). Emotional facial expressions evoke faster orienting responses, but weaker emotional responses at neural and behavioural levels compared to scenes: A simultaneous EEG and facial EMG study. NeuroImage. https://doi.org/10.1016/j.neuroimage.2015.09.065
McFarland, D. J., Parvaz, M. A., Sarnacki, W. A., Goldstein, R. Z., & Wolpaw, J. R. (2017). Prediction of subjective ratings of emotional pictures by EEG features. Journal of Neural Engineering, 14, 1–9. https://doi.org/10.1088/1741-2552/14/1/016009
Migliore, S., Curcio, G., Porcaro, C., Cottone, C., Simonelli, I., D’aurizio, G., Landi, D., Palmieri, M. G., Ghazaryan, A., Squitieri, F., Filippi, M. M., & Vernieri, F. (2019). Emotional processing in RRMS patients: Dissociation between behavioural and neurophysiological response. Multiple Sclerosis and Related Disorder, 27, 344–349. https://doi.org/10.1016/j.msard.2018.11.019
Miskovic, V., & Schmidt, L. A. (2010). Cross-regional cortical synchronization during affective image viewing. Brain Research, 1362, 102–111. https://doi.org/10.1016/j.brainres.2010.09.102
Montagu, J. D., & Coles, E. M. (1968). Mechanism and Measurement of the Galvanic Skin Response: An Addendum. Psychological Bulletin, 69, 74–76. https://doi.org/10.1037/h0025305
Müller, M. M., & Gundlach, C. (2017). Competition for attentional resources between low spatial frequency content of emotional images and a foreground task in early visual cortex. Psychophysiology, 54, 429–443. https://doi.org/10.1111/psyp.12792
Olofsson, J. K., Nordin, S., Sequeira, H., & Polich, J. (2008). Affective picture processing: An integrative review of ERP findings. Biological Psychology. https://doi.org/10.1016/j.biopsycho.2007.11.006
Olofsson, J. K., & Polich, J. (2007). Affective visual event-related potentials: Arousal, repetition, and time-on-task. Biological Psychology. https://doi.org/10.1016/j.biopsycho.2006.12.006
Peli, E. (1990). Contrast in complex images. Journal of the Optical Society of America, 7, 2032–2040. https://doi.org/10.1364/JOSAA.7.002032
Sánchez-Reolid, R., García, A., Vicente-Querol, M., Fernández-Aguilar, L., López, M., & González, A. (2018). Artificial Neural Networks to Assess Emotional States from Brain-Computer Interface. Electronics, 7, 384. https://doi.org/10.3390/electronics7120384
Schettino, A., Keil, A., Porcu, E., & Müller, M. M. (2016). Shedding light on emotional perception: Interaction of brightness and semantic content in extrastriate visual cortex. NeuroImage, 133, 341–353. https://doi.org/10.1016/j.neuroimage.2016.03.020
Singh, M. I., & Singh, M. (2017). Development of a real time emotion classifier based on evoked EEG, Biocybern. BioMedical Engineering, 37, 498–509. https://doi.org/10.1016/j.bbe.2017.05.004
Smith, N. K., Cacioppo, J. T., Larsen, J. T., & Chartrand, T. L. (2003). May I have your attention, please: Electrocortical responses to positive and negative stimuli.
Tian, Y., Zhang, H., Pang, Y., & Lin, J. (2018). Classification for Single-trial N170 during responding to facial picture with emotion. Frontiers in Computational Neuroscience. https://doi.org/10.3389/fncom.2018.00068
Torralba, A., & Oliva, A. (2003). Statistics of natural image categories. Network: Computation in Neural Systems, 14, 391–412. https://doi.org/10.1088/0954-898X_14_3_302
Valberg, A. (2005). Light Vision Color. Wiley.
Valdez, P., & Mehrabian, A. (1994). Effects of color on emotions. Journal of Experimental Psychology: General, 123, 394–409.
Vasilios, V., & Gasteratos, A. (2006). The Human Visual System. https://doi.org/10.1016/B978-0-12-405906-1.00002-7
Vogel, E. K., & Luck, S.J. (2000). The visual N1 component as an index of a discrimination process. Psychophysiology, 37, 190–203. https://doi.org/10.1111/1469-8986.3720190
Yusoff, N., Anuar, N. N., & Reza, M. F. (2018). The effect of sex on the electropsychological process of emotional arousal intensity. Malaysian Journal of Medical Science, 25, 103–110.
Zamuner, E. (2013). The Role of the Visual System in Emotion Perception. Acta Anal., 28, 179–187. https://doi.org/10.1007/s12136-012-0151-7
Zhang, Q., & Lee, M. (2012). Emotion development system by interacting with human EEG and natural scene understanding. Cognitive Systems Research. https://doi.org/10.1016/j.cogsys.2010.12.012
Zhang, W., Lu, J., Liu, X., Fang, H., Li, H., Wang, D., & Shen, J. (2013). Event-related synchronization of delta and beta oscillations reflects developmental changes in the processing of affective pictures during adolescence. International Journal of Psychophysiology. https://doi.org/10.1016/j.ijpsycho.2013.10.005
Z.H. Zhou, (2011) Cost-sensitive learning, Lect. Notes Comput. Sci. (Including Subser. Lect. Notes Artif. Intell. Lect. Notes Bioinformatics). 6820 LNAI https://doi.org/10.1007/978-3-642-22589-5_2.
Funding
This research received no external funding.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
None Declared.
Ethical approval
This study was conducted after the approval of the Ethics Committee of Istanbul Arel. University by decision no. 10432314–200.00.00–18.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Eroğlu, K., Osman, O., Kayıkçıoğlu, T. et al. Determining the effect of emotional images brightness on EEG signals by classification algorithms. Multidim Syst Sign Process 33, 835–861 (2022). https://doi.org/10.1007/s11045-022-00821-3
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11045-022-00821-3