Evaluation of a workplace technology for mental health assessment: A meaning-making process

https://doi.org/10.1016/j.chb.2011.08.022Get rights and content

Abstract

This paper describes the results of a summative evaluation conducted to explore the usability and acceptability of an automated telephone-based technology, designed and developed as a screening tool for mental health disorders in the workplace. The system screens employees for symptoms and subsequently provides educational information and referrals to improve mental health and enhance productivity. The qualitative evaluation was a sub-study of a larger randomized controlled trial (RCT). We conducted in-depth interviews with 15 individuals who participated in the RCT and had used the system. A phenomenological theoretical framework was utilized to analyze the narrative data. Results indicated that participants had mostly positive experience with the system and perceived it as a confidential program that allowed them to reflect on their symptoms without inhibition, fear of judgment or embarrassment. We also learned that asking mere questions about mental health symptoms can be a positive, instructive and possibly a restorative experience. There is a likelihood that for many participants, exposure to questions about their emotional and mental distress validated their feelings about their symptoms and was sufficiently compelling to promote help-seeking behavior. This evaluation study demonstrates that computers can be utilized in the workplace as effective screening and educational tools to improve employees’ mental health.

Highlights

► Automated assessment of mental health in the workplace is an effective mental health care delivery. ► Computers are considered confidential and non-judgmental and are acceptable in the workplace. ► Employers should reassure employees of confidentiality to achieve sustained participation.

Section snippets

Introduction and background

Mental health disorders affect nearly 30% of American adults each year (Kessler, Kessler, Chiu, Demler, & Walters, 2005). Adults with a mental health disorders most commonly suffer from recurring illness, while half suffer from two or more disorders (Kessler et al., 2005). The negative impacts of undiagnosed, untreated, or mismanaged mental health disorders include family instability, lack of work productivity (Harnois and Gabriel, 2000, Kessler et al., 1997, Kessler and Frank, 1997) and

Theoretical framework

The qualitative evaluation used a phenomenological theoretical framework which is an examination of the lived experience or elucidation of the essence of a phenomenon (Creswell, 2007), in this case the users’ experience with the system. Moutakas’ empirical, transcendental phenomenological insight (Moustakas, 1994) was considered the most appropriate for the evaluation. Moustakas’ approach consists of: (1) identifying a phenomenon, (2) bracketing, (removing) one’s experiences from the data

Results

Two major themes and a few minor themes emerged from the data:

Discussion

An unanticipated but significant finding of this evaluation study was brought to light when participants described the effects of mental health screening questions on their perceptions and attitudes regarding their symptoms. Study participants reported that the mental health screening questions led to a meaningful awareness and understanding of their symptoms as well as creating a sense of validation and relief. This was a thought-provoking and novel phenomenon that we felt needed to be further

Acknowledgment

This research was funded by a grant from the Centers for Disease Control and Prevention.

References (50)

  • K.K. Bucholz et al.

    Performance of two forms of a computer psychiatric screening interview: Version I of the DISSI

    Journal of Psychiatric Research

    (1991)
  • H.P. Erdman et al.

    A comparison of two computer-administered versions of the NIMH diagnostic interview

    Journal of Psychiatric Research

    (1992)
  • L. Baer et al.

    Computer-assisted administration of a structured interview for obsessive–compulsive disorder

    American Journal of Psychiatry

    (1993)
  • L. Baer et al.

    Automated telephone screening for depression

    Journal of American Medical Association

    (1995)
  • Y. Ben-Porah et al.

    Computers in personality assessment: A brief past, an ebullient present and an expanding future

    Computers in Human Behavior

    (1986)
  • P. Corrigan

    How stigma interferes with mental health care

    American psychologist

    (2004)
  • J. Creswell

    Qualitative inquiry and research design: Choosing among five approaches

    (2007)
  • R. De Graaf et al.

    Negative and positive participant responses to the composite international diagnostic interview. Results of the Netherlands mental health survey and incidence study

    Social Psychiatry and Psychiatric Epidemiology

    (2004)
  • M. Evans et al.

    It doesn’t cost anything just to ask, does it? The ethics of questionnaire-based research

    Journal of Medical Ethics

    (2002)
  • R. Farzanfar et al.

    Workplace tele-communications technology to identify mental health disorders and facilitate self-help or professional referrals

    American Journal of Health Promotion

    (2011)
  • R. Farzanfar et al.

    Design and development of a workplace mental health assessment and intervention system

    Journal of Medical Systems

    (2007)
  • J. Feldman et al.

    Self-generated validity and other effects of measurement on belief, attitude, intention and behavior

    Journal of Applied Psychology

    (1988)
  • D.L. Finfgeld

    Computer-based mental health assessments: Panaceas, pariahs, or partners in research and practice?

    Computer Nursing

    (1999)
  • B. Fischhoff et al.

    Knowing what you want: Measuring labile values

  • M.T. French et al.

    Mental health, absenteeism and earnings at a large manufacturing worksite

    Journal of Mental Health Policy and Economics

    (1998)
  • B.N. Gaynes et al.

    Feasibility and diagnostic validity of the M-3 checklist. A brief, self-rated screen for depression, bipolar, anxiety and post-traumatic stress disorders in primary care

    Annals of Family medicine

    (2010)
  • B. Gerbert et al.

    When asked, patients tell: Disclosure of sensitive health-risk behaviors

    Medical Care

    (1999)
  • A.G. Greenwald et al.

    Increased voting behavior by asking people if they expect to vote?

    Journal of Applied Psychology

    (1987)
  • W.L. Gregory et al.

    Self-relevant scenarios as mediators of likelihood estimates and compliance: Does imagining make it so?

    Journal of Personality and Social Psychology

    (1982)
  • J.H. Greist et al.

    A computer interview for suicide risk prediction

    American Journal of Psychiatry

    (1973)
  • G. Harnois et al.

    Mental health at work: Impact, issues and good practices

    (2000)
  • M.F. Hilton et al.

    The association between mental disorders and productivity in treated and untreated employees

    Journal of Environmental medicine

    (2009)
  • P.A. Jacomb et al.

    Emotional response of participants to a mental health survey

    Social Psychiatry and Psychiatric Epidemiology

    (1999)
  • E. Kaltenthaler et al.

    Computerized cognitive behaviour therapy for depression and anxiety update: A systematic review and economic evaluation

    Health Technology Assessment

    (2006)
  • R.C. Kessler et al.

    The social consequences of psychiatric disorders

    American Journal of Psychiatry

    (1997)
  • View full text