Physiological Sensing for Media Perception & Activity Recognition
Pages 696 - 700
Abstract
Wearable sensors have the intriguing potential to continuously evaluate human physiological characteristics in real-time without being obtrusive. This thesis aims to incorporate physiological sensors data to investigate the Media Perception and Activity Recognition. Our primary research goals include (a) neural encoding-based psycho-acoustic attribute analysis for data sonification, (b) empirical evidence for perceptual subjectivity in neural encoding during human-media interactions, the impact of incorporating behavioral ratings, and (c) the efficacy of attention-based transformer models on physiological data on human activity recognition problems.
References
[1]
1988. Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research. In Human Mental Workload, Peter A. Hancock and Najmedin Meshkati (Eds.). Advances in Psychology, Vol. 52. North-Holland, 139–183. https://doi.org/10.1016/S0166-4115(08)62386-9
[2]
Djamila Romaissa Beddiar, Brahim Nini, Mohammad Sabokrou, and Abdenour Hadid. 2020. Vision-based human activity recognition: a survey. Multimedia Tools and Applications 79, 41-42 (2020), 30509 – 30555. https://doi.org/10.1007/s11042-020-09004-3 Cited by: 71; All Open Access, Hybrid Gold Open Access.
[3]
Maneesh Bilalpur, Mohan Kankanhalli, Stefan Winkler, and Ramanathan Subramanian. 2018. EEG-Based Evaluation of Cognitive Workload Induced by Acoustic Parameters for Data Sonification(ICMI ’18). Association for Computing Machinery, New York, NY, USA, 315–323. https://doi.org/10.1145/3242969.3243016
[4]
Liming Chen, Jesse Hoey, Chris D. Nugent, Diane J. Cook, and Zhiwen Yu. 2012. Sensor-Based Activity Recognition. IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews) 42, 6 (2012), 790–808. https://doi.org/10.1109/TSMCC.2012.2198883
[5]
Jamie Ferguson and Stephen A Brewster. 2017. Evaluation of psychoacoustic sound parameters for sonification. In Proceedings of the 19th ACM International Conference on Multimodal Interaction. 120–127.
[6]
Stelios K Hadjidimitriou and Leontios J Hadjileontiadis. 2012. Toward an EEG-based recognition of music liking using time-frequency analysis. IEEE Transactions on Biomedical Engineering 59, 12 (2012), 3498–3510.
[7]
Stelios K Hadjidimitriou and Leontios J Hadjileontiadis. 2013. EEG-based classification of music appraisal responses using time-frequency analysis and familiarity ratings. IEEE Transactions on Affective Computing 4, 2 (2013), 161–172.
[8]
Dan Hendrycks, Norman Mu, Ekin D. Cubuk, Barret Zoph, Justin Gilmer, and Balaji Lakshminarayanan. 2019. AugMix: A Simple Data Processing Method to Improve Robustness and Uncertainty. https://doi.org/10.48550/ARXIV.1912.02781
[9]
Yuiko Kumagai, Mahnaz Arvaneh, and Toshihisa Tanaka. 2017. Familiarity affects entrainment of EEG in music listening. Frontiers in human neuroscience 11 (2017), 384.
[10]
Prashant Lawhatre, Bharatesh R Shiraguppi, Esha Sharma, Krishna Prasad Miyapuram, and Derek Lomas. 2020. Classifying songs with EEG. arXiv preprint arXiv:2010.04087(2020).
[11]
Yande Li, Lulan Yu, Jun Liao, Guoxin Su, Hashmi Ammarah, Li Liu, and Shu Wang. 2022. A single smartwatch-based segmentation approach in human activity recognition. Pervasive and Mobile Computing 83 (2022), 101600. https://doi.org/10.1016/j.pmcj.2022.101600
[12]
Sylvie Nozaradan. 2014. Exploring how musical rhythm entrains brain activity with electroencephalogram frequency-tagging. Philosophical Transactions of the Royal Society B: Biological Sciences 369, 1658 (2014), 20130393.
[13]
Pankaj Pandey, Nashra Ahmad, Krishna Prasad Miyapuram, and Derek Lomas. 2021. Predicting Dominant Beat Frequency from Brain Responses While Listening to Music. In 2021 IEEE International Conference on Bioinformatics and Biomedicine (BIBM). IEEE, 3058–3064.
[14]
Pankaj Pandey, Gulshan Sharma, Krishna P Miyapuram, Ramanathan Subramanian, and Derek Lomas. 2022. Music Identification Using Brain Responses to Initial Snippets. In ICASSP 2022-2022 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). IEEE, 1246–1250.
[15]
Dhananjay Sonawane, Krishna Prasad Miyapuram, Bharatesh Rs, and Derek J Lomas. 2021. Guessthemusic: song identification from electroencephalography response. In 8th ACM IKDD CODS and 26th COMAD. 154–162.
[16]
Adam Tierney and Nina Kraus. 2014. Neural entrainment to the rhythmic structure of music. Journal of Cognitive Neuroscience 27, 2 (2014), 400–408.
[17]
Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, L ukasz Kaiser, and Illia Polosukhin. 2017. Attention is All you Need. In Advances in Neural Information Processing Systems, I. Guyon, U. Von Luxburg, S. Bengio, H. Wallach, R. Fergus, S. Vishwanathan, and R. Garnett (Eds.). Vol. 30. Curran Associates, Inc.https://proceedings.neurips.cc/paper/2017/file/3f5ee243547dee91fbd053c1c4a845aa-Paper.pdf
Recommendations
A multi-sensor deep learning approach for complex daily living activity recognition
DigiBiom '22: Proceedings of the 2022 Workshop on Emerging Devices for Digital BiomarkersWith the ever increasing elderly population, human activity trackers can help monitor the daily physical activities performed by the elderly in order to contribute towards improvements in independent living and quality of life.
Little activity ...
Human Activity Behavioural Pattern Recognition in Smart Home with Long-Hour Data Collection
AbstractThe research on human activity recognition has provided novel solutions to many applications like health care, sports, and user profiling. Considering the complex nature of human activities, it is still challenging even after effective and ...
A spanning tree-based human activity prediction system using life logs from depth silhouette-based human activity recognition
CAIP'11: Proceedings of the 14th international conference on Computer analysis of images and patterns - Volume Part IIn this work, we propose a Human Activity Prediction (HAP) system using activity sequence spanning trees constructed from a life-log created by a video sensor-based daily Human Activity Recognition (HAR) system using time-sequential Independent ...
Comments
Information & Contributors
Information
Published In
November 2022
830 pages
ISBN:9781450393904
DOI:10.1145/3536221
Copyright © 2022 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 07 November 2022
Check for updates
Author Tags
Qualifiers
- Short-paper
- Research
- Refereed limited
Conference
ICMI '22
Sponsor:
Acceptance Rates
Overall Acceptance Rate 453 of 1,080 submissions, 42%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 95Total Downloads
- Downloads (Last 12 months)20
- Downloads (Last 6 weeks)2
Reflects downloads up to 03 Mar 2025
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign inFull Access
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderHTML Format
View this article in HTML Format.
HTML Format