skip to main content
10.1145/3313831.3376703acmconferencesArticle/Chapter ViewAbstractPublication PageschiConference Proceedingsconference-collections
research-article

INWARD: A Computer-Supported Tool for Video-Reflection Improves Efficiency and Effectiveness in Executive Coaching

Published: 23 April 2020 Publication History

Abstract

Video-Reflection is a common approach to realize reflection in the field of executive coaching for professional development, which presents a video recording of the coaching session to a coachee in order to make the coachee reflectively think about oneself. However, it requires a great deal of time to watch the full length of the video and is highly dependent on the skills of the coach. We expect that the quality and efficiency of video-reflection can be improved with the support of computers. In this paper, we introduce INWARD, a computational tool that leverages human behavior analysis and video-based interaction techniques. The results of a user study involving 20 coaching sessions with five coaches indicate that INWARD enables efficient video-reflection and, by leveraging meta-reflection, realizes the ameliorated outcome of executive coaching. Moreover, discussions based on comments from the participants support the effectiveness of INWARD and suggest further possibilities of computer-supported approaches.

Supplemental Material

MP4 File

References

[1]
Jagdishkumar Aggarwal and Michael S. Ryoo. 2011. Human activity analysis: A review. Comput. Surveys 43, 3 (2011), 16:1--16:43.
[2]
Riku Arakawa and Hiromu Yakura. 2019. REsCUE: A framework for REal-time feedback on behavioral CUEs using multimodal anomaly detection. In Proceedings of the 2019 ACM CHI Conference on Human Factors in Computing Systems. ACM, NY, NY, Article 572, 13 pages.
[3]
Godfrey T Barrett-Lennard. 1999. Carl Rogers' Helping System: Journey and Substance. SAGE Publications, London UK.
[4]
Eric P. S. Baumer. 2015. Reflective Informatics: Conceptual Dimensions for Designing Technologies of Reflection. In Proceedings of the 2015 ACM CHI Conference on Human Factors in Computing Systems. ACM, NY, NY, 585--594.
[5]
Eric P. S. Baumer, Vera D. Khovanskaya, Mark Matthews, Lindsay Reynolds, Victoria Schwanda Sosik, and Geri Gay. 2014. Reviewing reflection: on the use of reflection in interactive system design. In Proceedings of the 2014 ACM Conference on Designing Interactive Systems. ACM, NY, NY, 93--102.
[6]
Ian Brooks and Sarah Wright. 2007. A survey of executive coaching practices in New Zealand. International Journal of Evidence Based Coaching and Mentoring 5, 1 (2007), 30--41.
[7]
Lynn A Bryan and Art Recesso. 2006. Promoting reflection among science student teachers using a web-based video analysis tool. Journal of Computing in Teacher Education 23, 1 (2006), 31--39.
[8]
Fraser Carson. 2008. Utilizing video to facilitate reflective practice: Developing sports coaches. International Journal of Sports Science & Coaching 3, 3 (2008), 381--390.
[9]
Charles Horton Cooley. 1902. Human nature and the social order. Charles Scribner's Sons, New York, NY.
[10]
Erik De Haan. 2012. Supervision in Action: A relational approach to coaching and consulting supervision. Open University Press, New York, NY.
[11]
John Dewey. 1933. How we think: a restatement of the relation of reflective thinking to the educative process. Houghton Mifflin, Boston, MA.
[12]
Shelley Duval and Robert A Wicklund. 1972. A theory of objective self awareness. Academic Press, Oxford, UK.
[13]
Daniel C. Feldman and Melenie J. Lankau. 2005. Executive Coaching: A Review and Agenda for Future Research. Journal of Management 31, 6 (2005), 829--848.
[14]
Allan Fenigstein, Michael F Scheier, and Arnold H Buss. 1975. Public and private self-consciousness: Assessment and theory. Journal of Consulting and Clinical Psychology 43, 4 (1975), 522--527.
[15]
Angela Fessl, Gudrun Wesiak, Verónica Rivera-Pelayo, Sandra Feyertag, and Viktoria Pammer. 2017. In-app reflection guidance: lessons learned across four field trials at the workplace. IEEE Transactions on Learning Technologies 10, 4 (2017), 488--501.
[16]
Rowanne Fleck and Geraldine Fitzpatrick. 2010. Reflecting on reflection: framing a design landscape. In Proceedings of the 22nd Australasian Computer-Human Interaction Conference. ACM, NY, NY, 216--223.
[17]
Margaret A. Fletcher, Ortrun Zuber-Skerritt, Brendan Bartlett, Ruth Albertyn, and Judith Kearney. 2010. Meta-Action Research on a Leadership Development Program: A Process Model for Life-long Learning. Systemic Practice and Action Research 23, 6 (2010), 487--507.
[18]
Ricki Goldman, Roy Pea, Brigid Barron, and Sharon J Derry. 2014. Video research in the learning sciences. Routledge, London, UK.
[19]
Daniel Goleman. 1995. Emotional intelligence. Bantam, New York, NY.
[20]
John M Govern and Lisa A Marsch. 2001. Development and validation of the situational self-awareness scale. Consciousness and cognition 10, 3 (2001), 366--378.
[21]
Stella Granville and Laura Dison. 2005. Thinking about thinking: Integrating self-reflection into an academic literacy course. Journal of English for Academic Purposes 4, 2 (2005), 99--118.
[22]
David E Gray. 2006. Executive coaching: Towards a dynamic alliance of psychotherapy and transformative learning processes. Management learning 37, 4 (2006), 475--497.
[23]
Ryan Groom and Chris Cushion. 2005. Using of video based coaching with players: A case study. International Journal of Performance Analysis in Sport 5, 3 (2005), 40--46.
[24]
Thomas R Guskey. 2000. Evaluating professional development. Corwin Press, Thousand Oaks, CA.
[25]
Neville Hatton and David Smith. 1995. Reflection in teacher education: Towards definition and implementation. Teaching and Teacher Education 11, 1 (1995), 33--49.
[26]
Peter Hawkins. 2014. Coaching supervision. In The Complete Handbook of Coaching (2 ed.), Elaine Cox, Tatiana Bachkirova, and David Clutterbuck (Eds.). SAGE Publications, London, UK, 381--393.
[27]
Keita Higuchi, Ryo Yonetani, and Yoichi Sato. 2017. EgoScanning: Quickly Scanning First-Person Videos with Egocentric Elastic Timelines. In Proceedings of the 2017 ACM CHI Conference on Human Factors in Computing Systems. ACM, NY, NY, 6536--6546.
[28]
Mohammed (Ehsan) Hoque, Matthieu Courgeon, Jean-Claude Martin, Bilge Mutlu, and Rosalind W. Picard. 2013. MACH: my automated conversation coach. In Proceedings of the 2013 ACM International Joint Conference on Pervasive and Ubiquitous Computing. ACM, NY, NY, 697--706.
[29]
Kiyoko Ishikawa, Tsugukazu Sugahara, Chihiro Kabe, and Ryota Negishi. 2014. The Development of a Japanese Authenticity Scale: Research on the Authentic Personality Development (in Japanese). In Proceedings of the 78th Annual Convention of the Japanese Psychological Association. Japanese Psychological Association, Tokyo, Japan, 1EV--2--024.
[30]
Evan Kalkus. 2018. The reality-machine: development of a thought experiment measure for potential use with psychotherapy clients. Ph.D. Dissertation. Graduate School of Applied and Professional Psychology, Rutgers University.
[31]
Michael H Kernis. 2003. Toward a conceptualization of optimal self-esteem. Psychological Inquiry 14, 1 (2003), 1--26.
[32]
Richard R Kilburg. 1997. Coaching and executive character: Core problems and basic approaches. Consulting Psychology Journal: Practice and Research 49, 4 (1997), 281--299.
[33]
Francis A Kombarakaran, Julia A Yang, Mila N Baker, and Pauline B Fernandes. 2008. Executive coaching: it works! Consulting Psychology Journal: Practice and Research 60, 1 (2008), 78--90.
[34]
Richard Koonce. 1994. One on One. Training & Development 48, 2 (1994), 34--40.
[35]
Louise Kovacs and Sarah Corrie. 2017. Building reflective capability to enhance coaching practice. Coaching Psychologist 13, 1 (2017), 4--12.
[36]
Karren Kowalski and Colleen Casper. 2007. The Coaching Process: An Effective Tool for Professional Development. Nursing Administration Quarterly 31, 2 (2007), 171--179.
[37]
-li Leijen, Ineke Lam, Liesbeth Wildschut, P Robert-Jan Simons, and Wilfried Admiraal. 2009. Streaming video to enhance students' reflection in dance education. Computers & Education 52, 1 (2009), 169--176.
[38]
Anastassia McNulty and Bojan Lazarevic. 2012. Best Practices in Using Video Technology to Promote Second Language Acquisition. Teaching English with Technology 12, 3 (2012), 49--61.
[39]
Jennifer A Moon. 2013. Reflection in learning and professional development: Theory and practice. Routledge, London, UK.
[40]
Hugh Munby. 1989. Reflection-in-Action and Reflection-on-Action. Education and Culture 9, 1 (1989), 31--41.
[41]
David Murphy, Petr Slovak, Anja Thieme, Dan Jackson, Patrick Olivier, and Geraldine Fitzpatrick. 2017. Developing technology to enhance learning interpersonal skills in counsellor education. British Journal of Guidance & Counselling 47, 3 (2017), 328--341.
[42]
Michael Newman. 1994. Defining the Enemy: Adult Education in Social Action. Stewart Victor Publishing, Sydney, Australia.
[43]
Thomas Olsson, Kaisa Väänänen-Vainio-Mattila, Timo Saari, Andrés Lucero, and Juha Arrasvuori. 2013. Reflections on experience-driven design: a case study on designing for playful experiences. In Proceedings of the 6th International Conference on Designing Pleasurable Products and Interfaces. ACM, NY, NY, 165--174.
[44]
Ruth L. Orenstein. 2002. Executive Coaching: It's Not Just about the Executive. The Journal of Applied Behavioral Science 38, 3 (2002), 355--374.
[45]
Sebastian Otte, Adrian Bangerter, Mirjam Britsch, and Urs Wüthrich. 2014. Attitudes of coaches towards the use of computer-based technology in coaching. Consulting Psychology Journal: Practice and Research 66, 1 (2014), 38--52.
[46]
Helen Paige. 2002. Examining the effectiveness of executive coaching on executives. International Education Journal 3, 2 (2002), 61--70.
[47]
Ann Watts Pailliotet. 1995. I never saw that before: A deeper view of video analysis in teacher education. The Teacher Educator 31, 2 (1995), 138--156.
[48]
Alex Pascal, Maggie Sass, and Jane Brodie Gregory. 2015. I'm only human: The role of technology in coaching. Consulting Psychology Journal: Practice and Research 67, 2 (2015), 100--109.
[49]
Deborah Peel and Sue Shortland. 2004. Student teacher collaborative reflection: perspectives on learning together. Innovations in Education and Teaching International 41, 1 (2004), 49--58.
[50]
Michael Prilla, Martin Degeling, and Thomas Herrmann. 2012. Collaborative reflection at work: supporting informal learning at a healthcare workplace. In Proceedings of the 17th ACM International Conference on Supporting Group Work. ACM, NY, NY, 55--64.
[51]
Michael Prilla and Bettina Renner. 2014. Supporting collaborative reflection at work: A comparative case analysis. In Proceedings of the 18th International Conference on Supporting Group Work. ACM, NY, NY, 182--193.
[52]
Javier Ramirez, Juan Manuel Górriz, and José Carlos Segura. 2007. Voice activity detection. fundamentals and speech recognition system robustness. In Robust speech recognition and understanding, Michael Grimm and Kristian Kroschel (Eds.). InTech, London, UK.
[53]
Bettina Renner, Gudrun Wesiak, Viktoria Pammer-Schindler, Michael Prilla, Lars Müller, Dalia Morosini, Simone Mora, Nils Faltin, and Ulrike Cress. 2019. Computer-supported reflective learning: how apps can foster reflection at work. Behaviour & Information Technology 0, 0 (2019), 1--21.
[54]
Peter J Rich and Michael Hannafin. 2009. Video annotation tools: Technologies to scaffold, structure, and transform teacher reflection. Journal of Teacher Education 60, 1 (2009), 52--67.
[55]
Donald A. Schön. 1983. The Reflective Practitioner: How Professionals Think in Action. Basic Books, New York, NY.
[56]
Stratford Sherman and Alyssa Freas. 2004. The Wild West of Executive Coaching. Harvard Business Review 82, 11 (2004), 82--90.
[57]
Petr Slovák, Christopher Frauenberger, and Geraldine Fitzpatrick. 2017. Reflective Practicum: A Framework of Sensitising Concepts to Design for Transformative Reflection. In Proceedings of the 2017 ACM CHI Conference on Human Factors in Computing Systems. ACM, NY, NY, 2696--2707.
[58]
Lewis R Stern. 2004. Executive coaching: A working definition. Consulting Psychology Journal: Practice and Research 56, 3 (2004), 154--162.
[59]
Ingo Susing. 2011. The potential use of the Authenticity Scale as an outcome measure in executive coaching. The Coaching Psychologist 7 (2011), 16--25.
[60]
Anthony Thorpe and Diane Garside. 2017. (Co) meta-reflection as a method for the professional development of academic middle leaders in higher education. Management in Education 31, 3 (2017), 111--117.
[61]
Alessandro Vinciarelli, Maja Pantic, Dirk Heylen, Catherine Pelachaud, Isabella Poggi, Francesca D'Errico, and Marc Schröder. 2012. Bridging the Gap between Social Animal and Unsocial Machine: A Survey of Social Signal Processing. IEEE Transaction on Affective Computing 3, 1 (2012), 69--87.
[62]
William M Webb, Kerry L Marsh, William Schneiderman, and Bob Davis. 1989. Interaction between self-monitoring and manipulated states of self-awareness. Journal of Personality and Social Psychology 56, 1 (1989), 70--80.
[63]
Shih-En Wei, Varun Ramakrishna, Takeo Kanade, and Yaser Sheikh. 2016. Convolutional Pose Machines. In Proceedings of the 29th IEEE Conference on Computer Vision and Pattern Recognition. IEEE Computer Society, Washington, DC, 4724--4732.
[64]
Robert A Wicklund. 1975. Objective self-awareness. Advances in experimental social psychology 8 (1975), 233--275.
[65]
Robert Witherspoon and Randall P White. 1996. Executive coaching: A continuum of roles. Consulting Psychology Journal: Practice and Research 48, 2 (1996), 124--133.
[66]
Alex M Wood, P Alex Linley, John Maltby, Michael Baliousis, and Stephen Joseph. 2008. The authentic personality: A theoretical and empirical conceptualization and the development of the Authenticity Scale. Journal of Counseling Psychology 55, 3 (2008), 385--399.
[67]
Kenji Yamanishi, Jun'ichi Takeuchi, Graham J. Williams, and Peter Milne. 2004. On-Line Unsupervised Outlier Detection Using Finite Mixtures with Discounting Learning Algorithms. Data Mining and Knowledge Discovery 8, 3 (2004), 275--300.
[68]
Hye-Gyoung Yoon and Mijung Kim. 2010. Collaborative Reflection through Dilemma Cases of Science Practical Work during Practicum. International Journal of Science Education 32, 3 (2010), 283--301.
[69]
Barry J Zimmerman. 2002. Becoming a self-regulated learner: An overview. Theory Into Practice 41, 2 (2002), 64--70.
[70]
Barry J Zimmerman. 2013. Theories of self-regulated learning and academic achievement: An overview and analysis. In Self-regulated learning and academic achievement, Dale H. Schunk Barry J. Zimmerman (Ed.). Routledge, London, UK, 10--45.

Cited By

View all
  • (2025)Conversate: Supporting Reflective Learning in Interview Practice Through Interactive Simulation and Dialogic FeedbackProceedings of the ACM on Human-Computer Interaction10.1145/37011889:1(1-32)Online publication date: 10-Jan-2025
  • (2024)ConverSearch: Supporting Experts in Human Behavior Analysis of Conversational Videos with a Multimodal Scene Search ToolACM Transactions on Interactive Intelligent Systems10.1145/370901215:1(1-31)Online publication date: 23-Dec-2024
  • (2024)Technology which Makes You ThinkProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36596158:2(1-24)Online publication date: 15-May-2024
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
CHI '20: Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems
April 2020
10688 pages
ISBN:9781450367080
DOI:10.1145/3313831
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 23 April 2020

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. executive coaching
  2. meta-reflection
  3. video-reflection

Qualifiers

  • Research-article

Conference

CHI '20
Sponsor:

Acceptance Rates

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Upcoming Conference

CHI 2025
ACM CHI Conference on Human Factors in Computing Systems
April 26 - May 1, 2025
Yokohama , Japan

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)99
  • Downloads (Last 6 weeks)9
Reflects downloads up to 13 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2025)Conversate: Supporting Reflective Learning in Interview Practice Through Interactive Simulation and Dialogic FeedbackProceedings of the ACM on Human-Computer Interaction10.1145/37011889:1(1-32)Online publication date: 10-Jan-2025
  • (2024)ConverSearch: Supporting Experts in Human Behavior Analysis of Conversational Videos with a Multimodal Scene Search ToolACM Transactions on Interactive Intelligent Systems10.1145/370901215:1(1-31)Online publication date: 23-Dec-2024
  • (2024)Technology which Makes You ThinkProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36596158:2(1-24)Online publication date: 15-May-2024
  • (2024)Coaching Copilot: Blended Form of an LLM-Powered Chatbot and a Human Coach to Effectively Support Self-Reflection for Leadership GrowthProceedings of the 6th ACM Conference on Conversational User Interfaces10.1145/3640794.3665549(1-14)Online publication date: 8-Jul-2024
  • (2024)ConverSense: An Automated Approach to Assess Patient-Provider Interactions using Social SignalsProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3641998(1-22)Online publication date: 11-May-2024
  • (2024)Unearthing AI coaching chatbots capabilities for professional coaching: a systematic literature reviewJournal of Management Development10.1108/JMD-06-2024-018243:6(833-848)Online publication date: 26-Sep-2024
  • (2024)FT Xtraction: Feature extraction and visualization of conversational video data for social and emotional analysisSoftwareX10.1016/j.softx.2024.10182727(101827)Online publication date: Sep-2024
  • (2024)Determinants and trends of executive coaching effectiveness in post-pandemic era: A critical systematic literature review analysisManagement Review Quarterly10.1007/s11301-024-00428-xOnline publication date: 19-Apr-2024
  • (2023)A Generative Framework for Designing Interactions to Overcome the Gaps between Humans and Imperfect AIs Instead of Improving the Accuracy of the AIsExtended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544549.3577036(1-5)Online publication date: 19-Apr-2023
  • (2023)AI for human assessment: What do professional assessors need?Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544549.3573849(1-7)Online publication date: 19-Apr-2023
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media