research-article

Toward a platform for collecting, mining, and utilizing behavior data for detecting students with depression risks

Authors:

Einoshin Suzuki,

Yutaka Deguchi,

Tetsu Matsukawa,

Masanori SugimotoAuthors Info & Claims

PETRA '15: Proceedings of the 8th ACM International Conference on PErvasive Technologies Related to Assistive Environments

Article No.: 26, Pages 1 - 8

https://doi.org/10.1145/2769493.2769538

Published: 01 July 2015 Publication History

Abstract

In this paper, we present our plan for constructing a platform for collecting, mining, and utilizing behavior data for detecting students with depression risks. Unipolar depression makes a large contribution to the burden of disease, being at the first place in middle- and high-income countries. We survey descriptors of depressions and then design a data collection platform in a classroom based on the assumption that such descriptors are also effective to students with depression risks. Visual, acoustic, and e-learning data are chosen for collection and various issues including devices, preprocessing, and consent agreements are investigated. We also show two kinds of utilization scenarios of the collected data and introduce several techniques and methods we developed for feature extraction and early detection.

References

[1]

E. Aarts and J. Encarnacao. Into Ambient Intelligence. In True Vision - The Emergence of Ambient Intelligence, pages 1--16. Springer, 2006.

[2]

S. Alghowinem, R. Goecke, M. Wagner, J. Epps, M. B., and G. Parker. From Joyous to Clinically Depressed: Mood Detection Using Spontaneous Speech. In Proc. FLAIRS, 2012.

[3]

N. B. Allen, B. Nicholas, and P. B. T. Badcock. The Social Risk Hypothesis of Depressed Mood: Evolutionary, Psychosocial, and Neurobiological Perspectives. Psychological Bull., 129(6):887--913, 2003.

[4]

American Psychiatric Association. Diagnostic and Statistical Manual of Mental Disorders, 4th ed. American Psychiatric Association, 1994.

[5]

S. Ando and E. Suzuki. Discriminative Learning on Exemplary Patterns of Sequential Numerical Data. In Proc. ICDM, pages 1--10, 2014.

Digital Library

[6]

S. Ando and E. Suzuki. Minimizing Response Time in Time Series Classification. Knowledge and Information Systems, (accepted for publication).

[7]

S. Ando, T. Thanomphongphan, D. Hoshino, Y. Seki, and E. Suzuki. Ensemble Anomaly Detection from Multi-resolution Trajectory Features. Data Mining and Knowledge Discovery, 29(1):39--83, 2015.

Digital Library

[8]

P. Boersma and D. Weenink. Praat: Doing Phonetics by Computer. http://www.fon.hum.uva.nl/praat/, 2015. (retrieved Feb. 11th, 2015).

[9]

J. F. Cohn et al. Detecting Depression from Facial Actions and Vocal Prosody. In Proc. ACII, 2009.

[10]

T. F. Cootes, G. J. Edwards, and C. J. Taylor. Active Appearance Models. IEEE Trans. PAMI, 23(6):681--685, 2001.

Digital Library

[11]

N. Cummins, J. Epps, M. Breakspear, and R. Goecke. An Investigation of Depressed Speech Detection: Features and Normalization. In Proc. INTERSPEECH, pages 2997--3000, 2011.

[12]

Y. Deguchi and E. Suzuki. Skeleton Clustering by Autonomous Mobile Robots for Subtle Fall Risk Discovery. In Foundations of Intelligent Systems (ISMIS), volume 8502 of LNCS, pages 500--505. Springer, 2014.

[13]

Y. Deguchi, D. Takayama, S. Takano, V.-M. Scuturici, J.-M. Petit, and E. Suzuki. Multiple-Robot Monitoring System Based on a Service-Oriented DBMS. In Proc. PETRA, 2014.

Digital Library

[14]

P. Ekman, W. V. Friesen, and J. C. Hager. Facial Action Coding System, 2nd ed. Research Nexus, Salt Lake City, Utah, 2002.

[15]

A. Erna, L. Yu, K. Zhao, W. Chen, and E. Suzuki. Facial Expression Data Constructed with Kinect and their Clustering Stability. In Active Media Technology (AMT), volume 8610 of LNCS, pages 421--431. Springer, 2014.

[16]

P. Gabriel, M. R. Liimatainen, and International Labour Organization. Mental Health in the Workplace, Introduction, Executive Summary. Report 92-2-112223-9 {ISBN}, ILO, 2000.

[17]

J. M. Girard and J. F. Cohn. Automated Audiovisual Depression Analysis. Current Opinion in Psychology (in press), 2014.

[18]

J. M. Girard, J. F. Cohn, M. H. Mahoor, S. Mavadati, and D. P. Rosenwald. Social Risk and Depression: Evidence from Manual and Automatic Facial Expression Analysis. In Proc. FG, 2013.

[19]

J. M. Girard, J. F. Cohn, M. H. Mahoor, S. M. Mavadati, Z. Hammal, and D. P. Rosenwald. Nonverbal Social Withdrawal in Depression: Evidence from Manual and Automatic Analyses. Image Vision Comput., 32(10):641--647, 2014.

[20]

M. Hamilton. A Rating Scale for Depression. Journal of Neurology and Neurosurgery, 23:56--61, 1960.

[21]

T. Ito, T. Sato, K. Tulathimutte, M. Sugimoto, and H. Hashizume. A Scalable Ultrasonic-Based Localization System Using the Phase Accordance Method. In In Recent Advances in Sensing Technology, volume 49 of LNEE, pages 35--54. Springer, 2009.

[22]

J. Joshi, A. Dhall, R. Goecke, M. Breakspear, and G. Parker. Neural-Net Classification for Spatio-Temporal Descriptor Based Depression Analysis. In Proc. ICPR, pages 2634--2638, 2012.

[23]

J. Joshi et al. Can Body Expression Contribute to Automatic Depression Analysis? In Proc. FG, 2013.

[24]

R. Kondo, Y. Deguchi, and E. Suzuki. Developing a Face Monitoring Robot for a Deskworker. In Ambient Intelligence (AmI), volume 8850 of LNCS, pages 226--241. Springer, 2014.

[25]

I. Laptev, M. Marszalek, C. Schmid, and B. Rozenfeld. Learning Realistic Human Actions from Movies. In Proc. CVPR, 2008.

[26]

G. Littlewort, J. Whitehill, T. Wu, I. Fasel, M. Frank, J. Movellan, and M. Bartle. The Computer Expression Recognition Toolbox (CERT). In Proc FG, pages 298--305, 2011.

[27]

M. Mizutani, T. Ito, M. Sugimoto, and H. Hashizume. TSaT-MUSIC: A Novel Algorithm for Rapid and Accurate Ultrasonic 3D Localization. EURASIP J. on Advances in Signal Processing, 2011(101), 2011.

[28]

T. Nguyen Huy, H. Shao, B. Tong, and E. Suzuki. A Feature-Free and Parameter-Light Multi-Task Clustering Framework. Knowledge and Information Systems, 36(1):251--276, 2013.

[29]

OECD. Sick on the Job? Myths and Realities about Mental Health and Work. OECD Publishing, 2012.

[30]

S. J. Pan and Q. Yang. A Survey on Transfer Learning. IEEE Trans. Knowl. Data Eng., 22(10):1345--1359, 2010.

Digital Library

[31]

P. Ruvolo and E. Eaton. ELLA: An Efficient Lifelong Learning Algorithm. In Proc. ICML, volume 1, pages 507--515, 2013.

[32]

S. Scherer, G. Stratou, G. M. Lucas, M. Mahmoud, J. Boberg, J. Gratch, A. A. Rizzo, and L.-P. Morency. Automatic Audiovisual Behavior Descriptors for Psychological Disorder Analysis. Image Vision Comput., 32(10):648--658, 2014.

[33]

S. Scherer, G. Stratou, M. Mahmoud, J. Boberg, J. Gratch, A. S. Rizzo, and L.-P. Morency. Automatic Behavior Descriptors for Psychological Disorder Analysis. In Proc. FG, 2013.

[34]

R. Schmidt. Multiple Emitter Location and Signal Parameter Estimation. IEEE Transactions on Antennas Propagation, 34(3):276--280, 1986.

[35]

N. Sebe, M. Lew, Y. Sun, I. Cohen, T. Geners, and T. Huang. Authentic Facial Expression Analysis. In Image and Vision Computing, volume 25, pages 1856--1863. Elsevier, 2007.

Digital Library

[36]

H. Shao, B. Tong, and E. Suzuki. Extended MDL Principle for Feature-Based Inductive Transfer Learning. Knowledge and Information Systems, 35(2):365--389, 2013.

[37]

G. Stratou, S. Scherer, J. Gratch, and L.-P. Morency. Automatic Nonverbal Behavior Indicators of Depression and PTSD: Exploring Gender Differences. In Proc. ACII, pages 147--152, 2013.

Digital Library

[38]

M. Sugimoto, N. Kanie, S. Nakamura, and H. Hashizume. An Accurate and Compact 3D Tracking System Using a Single Camera and Ultrasound. Journal of Location Based Services, 8(1):18--35, 2014.

Digital Library

[39]

D. Takayama, Y. Deguchi, S. Takano, V.-M. Scuturici, J.-M. Petit, and E. Suzuki. Multi-view Onboard Clustering of Skeleton Data for Fall Risk Discovery. In Ambient Intelligence (AmI), volume 8850 of LNCS, pages 258--273. Springer, 2014.

[40]

S. Tanoue and E. Suzuki. Experimental Evaluation of Lifelong Learning in Classification Problems of Human Facial Expressions. In Proc. JCEEE-Kyushu, pages 372--373, 2014. (in Japanese).

[41]

Y.-L. Tian, T. Kanade, and J. F. Cohn. Facial Expression Analysis. In Handbook of Face Recognition, pages 247--275. Springer, New York, 2005.

[42]

M. Valstar, B. W. Schuller, J. Krajewski, R. Cowie, and M. Pantic. AVEC 2014: the 4th International Audio/Visual Emotion Challenge and Workshop. In Proc. MM, pages 1243--1244, 2014.

Digital Library

[43]

V. N. Vapnik. The Nature of Statistical Learning Theory. Springer, 1995.

Digital Library

[44]

Y. Wang, J. Chen, and W. Fang. TST-MUSIC for joint DOA-delay estimation. IEEE Transactions on Signal Processing, 49(4):721--729, 2001.

Digital Library

[45]

World Health Organization. The Global Burden of Disease: 2004 Update. WHO Press, Geneva, 2008.

[46]

L. Ye and E. J. Keogh. Time Series Shapelets: a Novel Technique that Allows Accurate, Interpretable and Fast Classification. Data Minining and Knowledge Discovery, 22(1--2):149--182, 2011.

Digital Library

[47]

C. Yin, F. Okubo, A. Shimada, K. Kentaro, M. Yamada, H. Ogata, and N. Fujimura. Smart Phone based Data Collecting System for Analyzing Learning Behaviors. In Proc. ICCE, pages 575--577, 2014.

[48]

T. Zhang, R. Ramakrishnan, and M. Livny. BIRCH: A New Data Clustering Algorithm and its Applications. Data Mining and Knowledge Discovery, 1(2):141--182, 1997.

Digital Library

[49]

G. Zhao and M. Pietikäinen. Dynamic Texture Recognition Using Local Binary Patterns with an Application to Facial Expressions. IEEE Trans. Pattern Anal. Mach. Intell., 29(6):915--928, 2007.

Digital Library

Cited By

Gurusamy DChakrabarti PChakkaravarthy M(2022)Machine Learning in Student Health - A Review2022 3rd International Conference on Issues and Challenges in Intelligent Computing Techniques (ICICT)10.1109/ICICT55121.2022.10064532(1-6)Online publication date: 11-Nov-2022
https://doi.org/10.1109/ICICT55121.2022.10064532
Gooding PKariotis T(2021)Ethics and Law in Research on Algorithmic and Data-Driven Technology in Mental Health Care: Scoping ReviewJMIR Mental Health10.2196/246688:6(e24668)Online publication date: 10-Jun-2021
https://doi.org/10.2196/24668

Index Terms

Toward a platform for collecting, mining, and utilizing behavior data for detecting students with depression risks

Recommendations

Predictive Model and Analysis of Psychological Depression Based on College Students’ Behavior Data Mining
Contemporary college students face all kinds of pressure and are easy to cause psychological problems. In order to make students and schools do a good job in preventing psychological depression, this paper proposes a student depression prediction model ...
Facebook use, envy, and depression among college students

A survey of 736 college students found that Facebook use can trigger feelings of envy.Feelings of envy were found to predict depression symptoms.The effect of surveillance use of Facebook on depression is mediated by feelings of envy.Surveillance use of ...
Developing an affective working companion utilising GSR data
Proceedings of the 15th WSEAS international conference on Computers

Affective Computing field is in its second decade and is showing great achievements and promising results. Affective computing is mainly related to detecting and modifying a person's affective state. This paper presents a review on the fields of emotion ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

PETRA '15: Proceedings of the 8th ACM International Conference on PErvasive Technologies Related to Assistive Environments

July 2015

526 pages

ISBN:9781450334525

DOI:10.1145/2769493

Conference Chair:
Fillia Makedon
University of Texas Arlington
,
Program Chairs:
Gian-Luca Mariottini,
Oliver Korn,
Illias Maglogiannis,
Vangelis Metsis

Copyright © 2015 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

NSF: National Science Foundation
University of Texas at Austin: University of Texas at Austin
Univ. of Piraeus: University of Piraeus
NCRS: Demokritos National Center for Scientific Research
Ionian: Ionian University, GREECE

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 July 2015

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

JSPS-CNRS
Tateishi Foundation
Japan Society for the Promotion of Science
NICT

Conference

PETRA '15

Sponsor:

NSF
University of Texas at Austin
Univ. of Piraeus
NCRS
Ionian

PETRA '15: 8th PErvasive Technologies Related to Assistive Environments

July 1 - 3, 2015

Corfu, Greece

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
260
Total Downloads

Downloads (Last 12 months)17
Downloads (Last 6 weeks)0

Reflects downloads up to 03 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Gurusamy DChakrabarti PChakkaravarthy M(2022)Machine Learning in Student Health - A Review2022 3rd International Conference on Issues and Challenges in Intelligent Computing Techniques (ICICT)10.1109/ICICT55121.2022.10064532(1-6)Online publication date: 11-Nov-2022
https://doi.org/10.1109/ICICT55121.2022.10064532
Gooding PKariotis T(2021)Ethics and Law in Research on Algorithmic and Data-Driven Technology in Mental Health Care: Scoping ReviewJMIR Mental Health10.2196/246688:6(e24668)Online publication date: 10-Jun-2021
https://doi.org/10.2196/24668

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten