skip to main content
10.1145/3581754.3584173acmconferencesArticle/Chapter ViewAbstractPublication PagesiuiConference Proceedingsconference-collections
extended-abstract

Reproducibility as a Stepping Stone to Intelligent Assistants for Data Analysis: Recreating a Study of Physical Activity, Sleep, and Work Shift in Nurses

Published: 27 March 2023 Publication History

Abstract

This paper presents our work in reproducing a published study with a framework and implemented system that are intended to support automation of future analyses. This automation will allow us to develop intelligent systems to assist non-experts in getting useful information out of their own data. Our framework takes high-level questions, automatically elaborates them, and run the necessary analyses on the data. Our TGN10+ system implements that framework and was used to reproduce an analysis of behavioral, psychological, and physiological data of healthcare workers to uncover differences in subjects that can help improve their work conditions. TGN10+ can also be used to update the results when new data becomes available, and could be used to analyze new data using the same method. Our ultimate goal is to develop intelligent systems that will empower healthcare workers to analyze their own data, and ultimately anyone who wants to understand their own health and wellbeing.

Supplementary Material

PDF File (P7230.pdf)
Short paper

References

[1]
Detravious Brinkley. 2023. TGN10+ software. https://github.com/Brinkley97/TGN10Plus
[2]
Detravious J Brinkley, Emmanuel Johnson, Tiantian Feng, and Yolanda Gil. 2022. Reproducibility as a Stepping Stone to Intelligent Assistants for Data Analysis: An Analysis of Physical Activity, Sleep, and Work Shift in Nurses. (2022).
[3]
Stuart Buck. 2015. Solving reproducibility., 1403–1403 pages.
[4]
Kevin C Elliott and David B Resnik. 2015. Scientific reproducibility, human error, and public policy. BioScience 65, 1 (2015), 5–6.
[5]
Tiantian Feng, Brandon M Booth, Brooke Baldwin-Rodríguez, Felipe Osorno, and Shrikanth Narayanan. 2021. A multimodal analysis of physical activity, sleep, and work shift in nurses with wearable sensor data. Scientific reports 11, 1 (2021), 8693.
[6]
Steven N Goodman, Daniele Fanelli, and John PA Ioannidis. 2016. What does research reproducibility mean?Science translational medicine 8, 341 (2016), 341ps12–341ps12.
[7]
Odd Erik Gundersen and Sigbjørn Kjensmo. 2018. State of the art: Reproducibility in artificial intelligence. In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 32.
[8]
Matthew S Krafczyk, A Shi, Adhithya Bhaskar, D Marinov, and Victoria Stodden. 2021. Learning from reproducing computational results: introducing three principles and the Reproduction Package. Philosophical Transactions of the Royal Society A 379, 2197 (2021), 20200069.
[9]
John W Mauger. 2018. Comment on the importance of data transparency, openness, and reproducibility in dissolution science and technology. Dissolution Technologies 25, 2 (2018), 6–8.
[10]
Karel Mundnich, Brandon M Booth, Michelle l’Hommedieu, Tiantian Feng, Benjamin Girault, Justin L’hommedieu, Mackenzie Wildman, Sophia Skaaden, Amrutha Nadarajan, Jennifer L Villatte, 2020. TILES-2018, a longitudinal physiologic and behavioral data set of hospital workers. Scientific Data 7, 1 (2020), 354.
[11]
David B Resnik and Adil E Shamoo. 2017. Reproducibility and research integrity. Accountability in research 24, 2 (2017), 116–123.
[12]
USC Sail. 2022. Tiles-day-night software. https://github.com/usc-sail/tiles-day-night
[13]
USC Sail. 2022. tiles tracking individual performance with sensors data set. https://tiles-data.isi.edu/
[14]
Victoria Stodden, Marcia McNutt, David H Bailey, Ewa Deelman, Yolanda Gil, Brooks Hanson, Michael A Heroux, John PA Ioannidis, and Michela Taufer. 2016. Enhancing reproducibility for computational methods. Science 354, 6317 (2016), 1240–1241.

Cited By

View all
  • (2024)Mixed-Initiative Methods for Co-Creation in Scientific ResearchProceedings of the 16th Conference on Creativity & Cognition10.1145/3635636.3664627(1-7)Online publication date: 23-Jun-2024

Index Terms

  1. Reproducibility as a Stepping Stone to Intelligent Assistants for Data Analysis: Recreating a Study of Physical Activity, Sleep, and Work Shift in Nurses

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    IUI '23 Companion: Companion Proceedings of the 28th International Conference on Intelligent User Interfaces
    March 2023
    266 pages
    ISBN:9798400701078
    DOI:10.1145/3581754
    Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 27 March 2023

    Check for updates

    Author Tag

    1. Reproducibility

    Qualifiers

    • Extended-abstract
    • Research
    • Refereed limited

    Conference

    IUI '23
    Sponsor:

    Acceptance Rates

    Overall Acceptance Rate 746 of 2,811 submissions, 27%

    Upcoming Conference

    IUI '25

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)15
    • Downloads (Last 6 weeks)3
    Reflects downloads up to 13 Feb 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)Mixed-Initiative Methods for Co-Creation in Scientific ResearchProceedings of the 16th Conference on Creativity & Cognition10.1145/3635636.3664627(1-7)Online publication date: 23-Jun-2024

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    HTML Format

    View this article in HTML Format.

    HTML Format

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media