skip to main content
research-article

Improving Office Workers’ Workspace Using a Self-adjusting Computer Screen

Published: 16 August 2022 Publication History

Abstract

With the rapid evolution of technology, computers and their users’ workspaces have become an essential part of our life in general. Today, many people use computers both for work and for personal needs, spending long hours sitting at a desk in front of a computer screen, changing their pose slightly from time to time. This phenomenon impacts people’s health negatively, adversely affecting their musculoskeletal and ocular systems. To mitigate these risks, several different ergonomic solutions have been suggested. This study proposes, demonstrates, and evaluates a technological solution that automatically adjusts the computer screen position and orientation to its user’s current pose, using a simple RGB camera and robotic arm. The automatic adjustment will reduce the physical load on users and better fit their changing poses. The user’s pose is extracted from images continuously acquired by the system’s camera. The most suitable screen position is calculated according to the user’s pose and ergonomic guidelines. Thereafter, the robotic arm adjusts the screen accordingly. The evaluation was done through a user study with 35 users who rated both the idea and the prototype system itself highly.

References

[1]
Chadia Abras, Diane Maloney-Krichmar, Jenny Preece, et al. 2004. User-centered design. Encycl. Hum.-comput. Interact. 37, 4 (2004), 445–456.
[2]
Smita Agarwal, Dishanter Goel, and Anshu Sharma. 2013. Evaluation of the factors which contribute to the ocular complaints in computer users. J. Clin. Diagn. Res. 7, 2 (2013), 331–335.
[3]
Layan Al Tawil, Sara Aldokhayel, Leena Zeitouni, Tala Qadoumi, Siham Hussein, and Shaik Shaffi Ahamed. 2020. Prevalence of self-reported computer vision syndrome symptoms and its associated factors among university students. Eur. J. Ophthalm. 30, 1 (2020), 189–195.
[4]
Paul Allie, Michael C. Bartha, Douglas Kokot, and Cynthia Purvis. 2010. A field observation of display placement requirements for presbyopic and prepresbyopic computer users. In Proceedings of the Human Factors and Ergonomics Society 54th Annual Meeting. SAGE Publications, Los Angeles, CA, 709–713.
[5]
American Optometric Association. 1995. Guide to the Clinical Aspects of Computer Vision Syndrome. American Optometric Association.
[6]
David Anton, Idoia Berges, Jesús Bermúdez, Alfredo Goñi, and Arantza Illarramendi. 2018. A telerehabilitation system for the selection, evaluation and remote management of therapies. Sensors 18, 5 (2018), 1459.
[7]
Gilles Bailly, Sidharth Sahdev, Sylvain Malacria, and Thomas Pietrzak. 2016. LivingDesktop: Augmenting desktop workstation with actuated devices. In Proceedings of the CHI Conference on Human Factors in Computing Systems. 5298–5310.
[8]
Aaron Bangor, Philip Kortum, and James Miller. 2009. Determining what individual SUS scores mean: Adding an adjective rating scale. J. Usab. Stud. 4, 3 (2009), 114–123.
[9]
Dinesh J. Bhanderi, Sushilkumar Choudhary, and Vikas G. Doshi. 2008. A community-based study of asthenopia in computer operators. Ind. J. Ophthalm. 56, 1 (2008), 51–55.
[10]
John Brooke. 2013. SUS: A retrospective. J. Usab. Stud. 8, 2 (2013), 29–40.
[11]
John Brooke et al. 1996. SUS-A quick and dirty usability scale. Usab. Eval. Industr. 189, 194 (1996), 4–7.
[12]
Adrian Bulat and Georgios Tzimiropoulos. 2017. How far are we from solving the 2D & 3D face alignment problem? (and a dataset of 230,000 3D facial landmarks). In Proceedings of the IEEE International Conference on Computer Vision. IEEE, 1021–1030.
[13]
Barbara Cagnie, Lieven Danneels, Damien Van Tiggelen, Veerle De Loose, and Dirk Cambier. 2007. Individual and work related risk factors for neck pain among office workers: A cross sectional study. Eur. Spine J. 16, 5 (2007), 679–686.
[14]
Alex Cao, Keshav K. Chintamani, Abhilash K. Pandya, and R. Darin Ellis. 2009. NASA TLX: Software for assessing subjective mental workload. Behavior Research Methods 41, 1 (2009), 113–117.
[15]
Lago-Peñas Carlos, Rey Ezequiel, and Kalén Anton. 2019. How does Video Assistant Referee (VAR) modify the game in elite soccer?Int. J. Perform. Anal. Sport 19, 4 (2019), 646–653.
[16]
Yucheng Chen, Yingli Tian, and Mingyi He. 2020. Monocular human pose estimation: A survey of deep learning-based methods. Comput. Vis. Image Underst. 192 (2020), 102897.
[17]
Bruno R. Da Costa and Edgar Ramos Vieira. 2010. Risk factors for work-related musculoskeletal disorders: A systematic review of recent longitudinal studies. Amer. J. Industr. Med. 53, 3 (2010), 285–323.
[18]
Kent M. Daum, Katherine A. Clore, Suzanne S. Simms, Jon W. Vesely, Dawn D. Wilczek, Brian M. Spittle, and Greg W. Good. 2004. Productivity associated with visual status of computer users. Optom.-J. Amer. Optom. Assoc. 75, 1 (2004), 33–47.
[19]
Gabriele Fanelli, Juergen Gall, and Luc Van Gool. 2011. Real time head pose estimation with random regression forests. In Proceedings of the Conference on Computer Vision and Pattern Recognition. IEEE, 617–624.
[20]
Kazuyuki Fujita, Aoi Suzuki, Kazuki Takashima, Kaori Ikematsu, and Yoshifumi Kitamura. 2021. TiltChair: Manipulative posture guidance by actively inclining the seat of an office chair. In Proceedings of the CHI Conference on Human Factors in Computing Systems. 1–14.
[21]
Weina Ge, Robert T. Collins, and R. Barry Ruback. 2012. Vision-based analysis of small groups in pedestrian crowds. IEEE Trans. Patt. Anal. Mach. Intell. 34, 5 (2012), 1003–1016.
[22]
David Geronimo, Antonio M. Lopez, Angel D. Sappa, and Thorsten Graf. 2009. Survey of pedestrian detection for advanced driver assistance systems. IEEE Trans. Patt. Anal. Mach. Intell. 32, 7 (2009), 1239–1258.
[23]
Wenjuan Gong, Xuena Zhang, Jordi Gonzàlez, Andrews Sobral, Thierry Bouwmans, Changhe Tu, and El-hadi Zahzah. 2016. Human pose estimation from monocular images: A comprehensive survey. Sensors 16, 12 (2016), 1966.
[24]
Sowjanya Gowrisankaran and James E. Sheedy. 2015. Computer vision syndrome: A review. Work 52, 2 (2015), 303–314.
[25]
Etienne Grandjean. 1986. Ergonomics in Computerized Offices. CRC Press.
[26]
Bart N. Green. 2008. A literature review of neck pain associated with computer use: Public health implications. J. Canad. Chirop. Assoc. 52, 3 (2008), 161–167.
[27]
John R. Hayes, James E. Sheedy, Joan A. Stelmack, and Catherine A. Heaney. 2007. Computer use, symptoms, and quality of life. Optom. Vis. Sci. 84, 8 (2007), E738–E755.
[28]
Alan R. Hevner, Salvatore T. March, Jinsoo Park, and Sudha Ram. 2004. Design science in information systems research. MIS Quart. 28, 1 (2004), 75–105.
[29]
Jeffrey A. Hoyle, William S. Marras, James E. Sheedy, and Dennis E. Hart. 2011. Effects of postural and visual stressors on myofascial trigger point development and motor unit rotation during computer work. J. Electromyog. Kinesiol. 21, 1 (2011), 41–48.
[30]
Wolfgang Jaschinski, Herbert Heuer, and Hannegret Kylian. 1998. Preferred position of visual displays relative to the eyes: A field study of visual strain and individual differences. Ergonomics 41, 7 (1998), 1034–1049.
[31]
Julio Cezar Silveira Jacques Junior, Soraia Raupp Musse, and Claudio Rosito Jung. 2010. Crowd analysis using computer vision techniques. IEEE Sig. Process. Mag. 27, 5 (2010), 66–77.
[32]
Ritva Ketola, Risto Toivonen, Marketta Häkkänen, Ritva Luukkonen, Esa-Pekka Takala, Eira Viikari-Juntura, and Expert Group in Ergonomics. 2002. Effects of ergonomic intervention in work with video display units. Scandin. J. Work, Environ. Health 28, 1 (2002), 18–24.
[33]
Rakhshaan Khan, Ambreen Surti, Rehana Rehman, and Umar Ali. 2012. Knowledge and practices of ergonomics in computer users. J. Pakist. Med. Assoc. 62, 3 (2012), 213–217.
[34]
Idsart Kingma and Jaap H. van Dieën. 2009. Static and dynamic postural loadings during computer work in females: Sitting on an office chair versus sitting on an exercise ball. Appl. Ergon. 40, 2 (2009), 199–205.
[35]
Martin Koestinger, Paul Wohlhart, Peter M. Roth, and Horst Bischof. 2011. Annotated facial landmarks in the wild: A large-scale, real-world database for facial landmark localization. In Proceedings of the IEEE International Conference on Computer Vision Workshops (ICCV Workshops). IEEE, 2144–2151.
[36]
Rotem Kronenberg and Tsvi Kuflik. 2019. Automatically adjusting computer screen. In Proceedings of the 27th Conference on User Modeling, Adaptation and Personalization. 51–56.
[37]
K. Kruthika, B. M. Kiran Kumar, and Sanjay Lakshminarayanan. 2016. Design and development of a robotic arm. In Proceedings of the International Conference on Circuits, Controls, Communications and Computing (I4C). IEEE, 1–4.
[38]
Kurt Leimer, Andreas Winkler, Stefan Ohrhallinger, and Przemyslaw Musialski. 2020. Pose to Seat: Automated design of body-supporting surfaces. Comput.-aid. Geom. Des. 79 (2020), 101855.
[39]
James R. Lewis. 2018. The system usability scale: Past, present, and future. Int. J. Hum.-comput. Interact. 34, 7 (2018), 577–590.
[40]
M.-H. Liao and C. G. Drury. 2000. Posture, discomfort and performance in a VDT task. Ergonomics 43, 3 (2000), 345–359.
[41]
Pedro Martins and Jorge Batista. 2008. Accurate single view model-based head pose estimation. In Proceedings of the 8th IEEE International Conference on Automatic Face & Gesture Recognition. IEEE, 1–6.
[42]
Lizette Mowatt, Carron Gordon, Arvind Babu Rajendra Santosh, and Thaon Jones. 2018. Computer vision syndrome and ergonomic practices among undergraduate university students. Int. J. Clin. Pract. 72, 1 (2018), e13035.
[43]
Stěpán Obdržálek, Gregorij Kurillo, Jay Han, Ted Abresch, Ruzena Bajcsy, et al. 2012. Real-time human pose detection and tracking for tele-rehabilitation in virtual reality. Stud. Health Technol. Inform. 173 (2012), 320–324.
[44]
Yingjie Pan, Hong Zhu, and Ruirui Ji. 2005. 3-D head pose estimation for monocular image. In Proceedings of the International Conference on Fuzzy Systems and Knowledge Discovery. Springer, 293–301.
[45]
Michelle Robertson, Benjamin C. Amick III, Kelly DeRango, Ted Rooney, Lianna Bazzani, Ron Harrist, and Anne Moore. 2009. The effects of an office ergonomics training and chair intervention on worker knowledge, behavior and musculoskeletal risk. Appl. Ergon. 40, 1 (2009), 124–135.
[46]
Nataniel Ruiz, Eunji Chong, and James M. Rehg. 2018. Fine-grained head pose estimation without keypoints. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops. 2074–2083.
[47]
Eduardo Costa Sa, Mario Ferreira Junior, and Lys Esther Rocha. 2012. Risk factors for computer visual syndrome (CVS) among operators of two call centers in São Paulo, Brazil. Work 41, Supplement 1 (2012), 3568–3574.
[48]
Annina B. Schmid, Paul A. Kubler, Venerina Johnston, and Michel W. Coppieters. 2015. A vertical mouse and ergonomic mouse pads alter wrist position but do not reduce carpal tunnel pressure in patients with carpal tunnel syndrome. Appl. Ergon. 47 (2015), 151–156.
[49]
James E. Sheedy, John Hayes, Jon Engle, et al. 2003. Is all asthenopia the same?Optom. Vis. Sci. 80, 11 (2003), 732–739.
[50]
Joon-Gi Shin, Eiji Onchi, Maria Jose Reyes, Junbong Song, Uichin Lee, Seung-Hee Lee, and Daniel Saakes. 2019. Slow robots for unobtrusive posture correction. In Proceedings of the CHI Conference on Human Factors in Computing Systems. 1–10.
[51]
Luke Shires, Steven Battersby, James Lewis, David Brown, Nasser Sherkat, and Penny Standen. 2013. Enhancing the tracking capabilities of the Microsoft Kinect for stroke rehabilitation. In Proceedings of the IEEE 2nd International Conference on Serious Games and Applications for Health (SeGAH). IEEE, 1–8.
[52]
Chuan-Jun Su. 2013. Personal rehabilitation exercise assistant with kinect and dynamic time warping. Int. J. Inf. Educ. Technol. 3, 4 (2013), 448–454.
[53]
Grace P. Szeto and Raymond Lee. 2002. An ergonomic evaluation comparing desktop, notebook, and subnotebook computers. Arch. Phys. Med. Rehab. 83, 4 (2002), 527–532.
[54]
Akira Takahashi, Masahiro Inazawa, Yuki Ban, and Shin’ichi Warisawa. 2020. Indirect posture correction system without additional equipment using display content rotation. In Proceedings of the 13th International Conference on Bio-inspired Systems and Signal Processing. 266–273.
[55]
Jonathan J. Tompson, Arjun Jain, Yann LeCun, and Christoph Bregler. 2014. Joint training of a convolutional network and a graphical model for human pose estimation. Adv. Neural Inf. Process. Syst. 27 (2014), 1799–1807.
[56]
Alexander Toshev and Christian Szegedy. 2014. DeepPose: Human pose estimation via deep neural networks. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 1653–1660.
[57]
Patricia Hyland Travers and Babette-Ann Stanton. 1984. Office workers and video display terminals: Physical, psychological and ergonomic factors. Occupat. Health Nurs. 32, 11 (1984), 586–591.
[58]
D. Treaster, W. S. Marras, D. Burr, J. E. Sheedy, and D. Hart. 2006. Myofascial trigger point development from visual and postural stressors during computer work. J. Electromyog. Kinesiol. 16, 2 (2006), 115–124.
[59]
Jau-Yih Tsauo, Yuh Jang, Chung-Li Du, and Huey-Wen Liang. 2007. Incidence and risk factors of neck discomfort: A 6-month sedentary-worker cohort study. J. Occup. Rehab. 17, 2 (2007), 171–179.
[60]
Raquel Urtasun, David J. Fleet, and Pascal Fua. 2005. Monocular 3D tracking of the golf swing. In Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR’05). IEEE, 932–938.
[61]
Teodora Vatahska, Maren Bennewitz, and Sven Behnke. 2007. Feature-based head pose estimation from images. In Proceedings of the 7th IEEE-RAS International Conference on Humanoid Robots. IEEE, 330–335.
[62]
Gerlienke E. Voerman, Leif Sandsjö, Miriam M. R. Vollenbroek-Hutten, Pernilla Larsman, Roland Kadefors, and Hermie J. Hermens. 2007. Effects of ambulant myofeedback training and ergonomic counselling in female computer workers with work-related neck-shoulder complaints: A randomized controlled trial. J. Occup. Rehab. 17, 1 (2007), 137–152.
[63]
Jens Wahlström. 2005. Ergonomics, musculoskeletal disorders and computer work. Occup. Med. 55, 3 (2005), 168–176.
[64]
Haofan Wang, Zhenghua Chen, and Yi Zhou. 2019. Hybrid coarse-fine classification for head pose estimation. arXiv:1901.06778
[65]
Clarice N. Waters, Er Pei Ling, Anne H. Y. Chu, Sheryl H. X. Ng, Audrey Chia, Yee Wei Lim, and Falk Müller-Riemenschneider. 2016. Assessing and understanding sedentary behaviour in office-based working adults: A mixed-method approach. BMC Pub. Health 16, 1 (2016), 1–11.
[66]
Shih-En Wei, Jason Saragih, Tomas Simon, Adam W. Harley, Stephen Lombardi, Michal Perdoch, Alexander Hypes, Dawei Wang, Hernan Badino, and Yaser Sheikh. 2019. VR facial animation via multiview image translation. ACM Trans. Graph. 38, 4 (2019), 1–16.
[67]
Mark Weiser. 1991. The computer for the 21st century. Scient. Amer. 265, 3 (1991), 94–105.
[68]
Yu-Chian Wu, Te-Yen Wu, Paul Taele, Bryan Wang, Jun-You Liu, Pin-Sung Ku, Po-En Lai, and Mike Y. Chen. 2018. ActiveErgo: Automatic and personalized ergonomics using self-actuating furniture. In Proceedings of the CHI Conference on Human Factors in Computing Systems. 1–8.
[69]
Zheng Yan, Liang Hu, Hao Chen, and Fan Lu. 2008. Computer vision syndrome: A widely spreading but largely unknown epidemic among computer users. Comput. Hum. Behav. 24, 5 (2008), 2026–2042.
[70]
Tsun-Yi Yang, Yi-Ting Chen, Yen-Yu Lin, and Yung-Yu Chuang. 2019. FSA-Net: Learning fine-grained structure aggregation for head pose estimation from a single image. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 1087–1096.
[71]
Wei Yang, Wanli Ouyang, Hongsheng Li, and Xiaogang Wang. 2016. End-to-end learning of deformable mixture of parts and deep convolutional neural networks for human pose estimation. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 3073–3082.
[72]
Xiaowei Zhou, Menglong Zhu, Spyridon Leonardos, Konstantinos G. Derpanis, and Kostas Daniilidis. 2016. Sparseness meets deepness: 3D human pose estimation from monocular video. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 4966–4975.
[73]
Xiangyu Zhu, Zhen Lei, Xiaoming Liu, Hailin Shi, and Stan Z. Li. 2016. Face alignment across large poses: A 3D solution. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 146–155.

Cited By

View all
  • (2024)Toward the design of persuasive systems for a healthy workplace: a real-time posture detectionFrontiers in Big Data10.3389/fdata.2024.13599067Online publication date: 17-Jun-2024
  • (2024)Enhancing Home Exercise Experiences with Video Motion-Tracking for Automatic Display Height AdjustmentProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642936(1-13)Online publication date: 11-May-2024
  • (2024)Human body features recognition based adaptive user interface for extra-large touch screensDisplays10.1016/j.displa.2024.10283885(102838)Online publication date: Dec-2024

Index Terms

  1. Improving Office Workers’ Workspace Using a Self-adjusting Computer Screen

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Transactions on Interactive Intelligent Systems
    ACM Transactions on Interactive Intelligent Systems  Volume 12, Issue 3
    September 2022
    257 pages
    ISSN:2160-6455
    EISSN:2160-6463
    DOI:10.1145/3543991
    Issue’s Table of Contents

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 16 August 2022
    Online AM: 28 June 2022
    Accepted: 01 May 2022
    Revised: 01 May 2022
    Received: 01 September 2021
    Published in TIIS Volume 12, Issue 3

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. Automatic screen position adjustment
    2. user’s pose identification
    3. dynamic workspace adjustment

    Qualifiers

    • Research-article
    • Refereed

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)132
    • Downloads (Last 6 weeks)8
    Reflects downloads up to 28 Feb 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)Toward the design of persuasive systems for a healthy workplace: a real-time posture detectionFrontiers in Big Data10.3389/fdata.2024.13599067Online publication date: 17-Jun-2024
    • (2024)Enhancing Home Exercise Experiences with Video Motion-Tracking for Automatic Display Height AdjustmentProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642936(1-13)Online publication date: 11-May-2024
    • (2024)Human body features recognition based adaptive user interface for extra-large touch screensDisplays10.1016/j.displa.2024.10283885(102838)Online publication date: Dec-2024

    View Options

    Login options

    Full Access

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Full Text

    View this article in Full Text.

    Full Text

    HTML Format

    View this article in HTML Format.

    HTML Format

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media