skip to main content
10.1145/3490632.3490668acmotherconferencesArticle/Chapter ViewAbstractPublication PagesmumConference Proceedingsconference-collections
research-article
Open access

AR in TV: Design and Evaluation of Mid-Air Gestures for Moderators to Control Augmented Reality Applications in TV

Published: 25 February 2022 Publication History

Abstract

Recent developments in augmented reality for TV productions encouraged broadcasters to enhance interaction with virtual content for moderators. However, traditional interaction methods are considered distracting and not intuitive. To overcome these issues, we performed a gesture elicitation study with a follow-up evaluation. For this, we considered TV moderators as primary users of the gestures as well as viewers as recipients. The elicited gesture set consists of five gestures for two types of camera shots (long shot and close shot). Findings of the evaluation study indicate that the derived set of gestures requires low physical and concentration effort from moderators. Also, both moderators and viewers found them appropriate to be used in TV with respect to understandability, distraction, likeability, and appropriateness. Using these gestures would allow moderators to control AR content in TV and tell stories in a modern and more expressive way.

Supplementary Material

MP4 File (mum_final.mp4)
Supplemental video

References

[1]
John Aliprantis, Markos Konstantakis, Rozalia Nikopoulou, Phivos Mylonas, and George Caridakis. 2019. Natural Interaction in Augmented Reality context. In Proceedings of 1st International Workshop on Visual Pattern Extraction and Recognition for Cultural Heritage Understanding co-located with 15th Italian Research Conference on Digital Libraries (IRCDL 2019). CEUR-WS.org, Italy,Piza. http://ceur-ws.org/Vol-2320/paper11.pdf
[2]
Oliver Amft, Roman Amstutz, Asim Smailagic, Dan Siewiorek, and Gerhard Tröster. 2009. Gesture-controlled user input to complete questionnaires on wrist-worn watches. In International Conference on Human-Computer Interaction. Springer, Berlin, Heidelberg, Germany, 131–140. https://doi.org/10.1007/978-3-642-02577-8_15
[3]
Ronald T. Azuma. 1997. A Survey of Augmented Reality. Presence: Teleoper. Virtual Environ. 6, 4 (Aug. 1997), 355–385. https://doi.org/10.1162/pres.1997.6.4.355
[4]
Moniruzzaman Bhuiyan, Rich Picking, 2011. A gesture controlled user interface for inclusive design and evaluative study of its usability. Journal of software engineering and applications 4, 09(2011), 513. https://doi.org/10.4236/jsea.2011.49059
[5]
Mark Billinghurst, Adrian Clark, Gun Lee, 2015. A survey of augmented reality. Foundations and Trends® in Human–Computer Interaction 8, 2-3(2015), 73–272. https://doi.org/10.1145/2468356.2468527
[6]
Jan Bobeth, Susanne Schmehl, Ernst Kruijff, Stephanie Deutsch, and Manfred Tscheligi. 2012. Evaluating Performance and Acceptance of Older Adults Using Freehand Gestures for TV Menu Control. In Proceedings of the 10th European Conference on Interactive TV and Video (Berlin, Germany) (EuroITV ’12). Association for Computing Machinery, New York, USA, 35–44. https://doi.org/10.1145/2325616.2325625
[7]
Jeremy Bradley. 2008. The inventor behind CNN’s election ’Magic Wall’ - CNN.com. https://edition.cnn.com/2008/TECH/11/04/magic.wall/
[8]
J. Clement. 2019. Second screen usage - Statistics & Facts | Statista. https://www.statista.com/topics/2531/second-screen-usage/
[9]
Simon Von der au. 2019. AR in the TV production. https://lab.irt.de/ios-spectator-view-ar-in-the-tv-production/
[10]
Dak Dillon. 2017. Industry Insights: Augmented reality in broadcast television - NewscastStudio. https://www.newscaststudio.com/2017/07/31/broadcast-augmented-reality-solutions-roundtable/
[11]
Galileo. 2017. Vom 6. bis 10. November zeigt ”Galileo” das Fernsehen der Zukunft. https://www.prosieben.de/tv/galileo/news/galileo-ar-woche
[12]
Lisa Graichen, Matthias Graichen, and Josef F. Krems. 2019. Evaluation of Gesture-Based In-Vehicle Interaction: User Experience and the Potential to Reduce Driver Distraction. Human Factors 61, 5 (2019), 774–792. https://doi.org/10.1177/0018720818824253 arXiv:https://doi.org/10.1177/0018720818824253PMID: 30694705.
[13]
Sukeshini A Grandhi, Gina Joue, and Irene Mittelberg. 2011. Understanding naturalness and intuitiveness in gesture production: insights for touchless gestural interfaces. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. Proceedings of the ACM Conference on Human Factors in Computing Systems (CHI ’11), Vancouver, British Columbia, 821–824. https://doi.org/10.1145/1978942.1979061
[14]
Anne Köpsel and Nikola Bubalo. 2015. Benefiting from legacy bias. Interactions 22, 5 (2015), 44–47. https://doi.org/10.1145/2803169
[15]
Joseph J. LaViola Jr., Ernst Kruijff, Doug Bowman, Ivan P. Poupyrev, and Ryan P. McMahan. 2017. 3D User Interfaces: Theory and Practice (second edition). Addison-Wesley, Boston, USA.
[16]
Andrés Lucero and Akos Vetek. 2014. NotifEye: Using Interactive Glasses to Deal with Notifications While Walking in Public(ACE ’14). Association for Computing Machinery, New York, USA, Article 17, 10 pages. https://doi.org/10.1145/2663806.2663824
[17]
Javier Montesa. 2016. D4.3. Prototype scene augmentation and interaction handling module. http://www.visualmediaproject.com/outcomes/
[18]
Javier Montesa. 2016. Visual Media Project — Immersive and Interactive Real Time 3D Social Media Graphics Environments for the Broadcast Industry. http://www.visualmediaproject.com
[19]
Meredith Ringel Morris, Andreea Danielescu, Steven Drucker, Danyel Fisher, Bongshin Lee, MC Schraefel, and Jacob O Wobbrock. 2014. Reducing legacy bias in gesture elicitation studies. interactions 21, 3 (2014), 40–45. https://doi.org/10.1145/2591689
[20]
Sebastian Nicu. 2018. So arbeiten ARD & ZDF im Fußball-WM-Studio - CHIP. https://www.chip.de/news/10-GBit-Leitung-7-Meter-Kran-So-arbeiten-ARD-ZDF-im-WM-Studio_141645482.html
[21]
Sara Nielsen, Lucca Julie Nellemann, Lars Bo Larsen, and Kashmiri Stec. 2020. The Social Acceptability of Peripheral Interaction with 3D Gestures in a Simulated Setting. In International Conference on Human-Computer Interaction. Springer, Copenhagen, Denmark, 77–95. https://doi.org/10.1007/978-3-030-49062-1_5
[22]
John V Pavlik and Frank Bridges. 2013. The emergence of augmented reality (AR) as a storytelling medium in journalism. Journalism & Communication Monographs 15, 1 (2013), 4–59. https://doi.org/10.1177/1522637912470819
[23]
Tran Pham, Jo Vermeulen, Anthony Tang, and Lindsay MacDonald Vermeulen. 2018. Scale Impacts Elicited Gestures for Manipulating Holograms: Implications for AR Gesture Design. In Proceedings of the 2018 Designing Interactive Systems Conference (Hong Kong, China) (DIS ’18). Association for Computing Machinery, New York, USA, 227–240. https://doi.org/10.1145/3196709.3196719
[24]
Thammathip Piumsomboon, Adrian Clark, Mark Billinghurst, and Andy Cockburn. 2013. User-Defined Gestures for Augmented Reality. In CHI ’13 Extended Abstracts on Human Factors in Computing Systems (Paris, France) (CHI EA ’13). Association for Computing Machinery, New York, USA, 955–960. https://doi.org/10.1145/2468356.2468527
[25]
Irina Popovici and Radu-Daniel Vatavu. 2019. Understanding Users’ Preferences for Augmented Reality Television. International journal of human-computer studies (2019), 269–278. https://doi.org/10.1109/ISMAR.2019.00024
[26]
Halley Profita, Reem Albaghli, Leah Findlater, Paul Jaeger, and Shaun K. Kane. 2016. The AT Effect: How Disability Affects the Perceived Social Acceptability of Head-Mounted Display Use. Association for Computing Machinery, New York, USA, 4884–4895. https://doi.org/10.1145/2858036.2858130
[27]
Siddharth S Rautaray and Anupam Agrawal. 2015. Vision based hand gesture recognition for human computer interaction: a survey. Artificial intelligence review 43, 1 (2015), 1–54. https://doi.org/10.1007/s10462-012-9356-9
[28]
Eric S. Raymond and Guy L. Steele. 1993. The New Hacker’s Dictionary, 2nd Ed.MIT Press, Cambridge, USA. https://dl.acm.org/doi/book/10.5555/562355
[29]
Julie Rico and Stephen Brewster. 2010. Usable Gestures for Mobile Interfaces: Evaluating Social Acceptability. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, USA, 887–896. https://doi.org/10.1145/1753326.1753458
[30]
Pejman Saeghe, Gavin Abercrombie, Bruce Weir, Sarah Clinch, Stephen Pettifer, and Robert Stevens. 2020. Augmented Reality and Television: Dimensions and Themes. In ACM International Conference on Interactive Media Experiences (Cornella, Barcelona, Spain) (IMX ’20). Association for Computing Machinery, New York, USA, 13–23. https://doi.org/10.1145/3391614.3393649
[31]
Chaklam Silpasuwanchai and Xiangshi Ren. 2015. Designing concurrent full-body gestures for intense gameplay. International Journal of Human Computer Studies 80 (2015), 1–13. https://doi.org/10.1016/j.ijhcs.2015.02.010
[32]
Graham Thomas. 2011. Chapter 5 - Virtual Graphics for Broadcast Production. In Advances in Computers. Vol. 82. Elsevier, 165–216. https://doi.org/10.1016/B978-0-12-385512-1.00005-0
[33]
Theophanis Tsandilas. 2018. Fallacies of agreement: A critical review of consensus assessment methods for gesture elicitation. ACM Transactions on Computer-Human Interaction (TOCHI) 25, 3(2018), 1–49. https://doi.org/10.1145/3182168
[34]
Pranav Vadehra. 11 September 2018. Augmented Reality - the hottest trend in broadcast graphics. https://www.digitalstudiome.com/broadcast/broadcast-business/30504-augmented-reality-in-broadcast-graphics
[35]
Radu-Daniel Vatavu, Pejman Saeghe, Teresa Chambel, Vinoba Vinayagamoorthy, and Marian F Ursu. 2020. Conceptualizing Augmented Reality Television for the Living Room. In ACM International Conference on Interactive Media Experiences (Cornella, Barcelona, Spain) (IMX ’20). Association for Computing Machinery, New York, USA, 1–12. https://doi.org/10.1145/3391614.3393660
[36]
Radu-Daniel Vatavu and Jacob O. Wobbrock. 2015. Formalizing Agreement Analysis for Elicitation Studies: New Measures, Significance Test, and Toolkit. Association for Computing Machinery, New York,USA, 1325–1334. https://doi.org/10.1145/2702123.2702223
[37]
S. Vollmann. April, 2019. The Dusseldorf University of Applied Sciences, the Media Facility ”Mixed Reality and Visualization” and LAVAlab. https://www1.wdr.de/fernsehen/unterwegs-im-westen/ar-app/ar-app-info-100.html
[38]
Volucap. 2019. Tagesschau 2025 – Volucap. https://volucap.de/portfolio-items/tagesschau-2025/
[39]
Mark Wilson. 2019. Behind the Weather Channel’s virtual reality forecasts. https://www.fastcompany.com/90399799/inside-the-weather-channels-bonkers-plan-to-reinvent-storm-chasing
[40]
Jacob O. Wobbrock, Htet Htet Aung, Brandon Rothrock, and Brad A. Myers. 2005. Maximizing the Guessability of Symbolic Input. In CHI ’05 Extended Abstracts on Human Factors in Computing Systems (Portland, OR, USA) (CHI EA ’05). Association for Computing Machinery, New York, USA, 1869–1872. https://doi.org/10.1145/1056808.1057043
[41]
Jacob O. Wobbrock, Meredith Ringel Morris, and Andrew D. Wilson. 2009. User-Defined Gestures for Surface Computing. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Boston, MA, USA) (CHI ’09). Association for Computing Machinery, New York, USA, 1083–1092. https://doi.org/10.1145/1518701.1518866
[42]
Huiyue Wu, Jianmin Wang, and Xiaolong Luke Zhang. 2016. User-centered gesture development in TV viewing environment. Multimedia Tools and Applications 75, 2 (2016), 733–760. https://doi.org/10.1007/s11042-014-2323-5
[43]
Huiyue Wu, Yu Wang, Jiali Qiu, Jiayi Liu, and Xiaolong Zhang. 2019. User-defined gesture interaction for immersive VR shopping applications. Behaviour & Information Technology 38, 7 (2019), 726–741. https://doi.org/10.1080/0144929X.2018.1552313
[44]
Li Xuan, Guan Daisong, Zhou Moli, Zhang Jingya, Liu Xingtong, and Li Siqi. 2019. Comparison on User Experience of Mid-Air Gesture Interaction and Traditional Remotes Control. In Proceedings of the Seventh International Symposium of Chinese CHI (Xiamen, China) (Chinese CHI ’19). Association for Computing Machinery, New York, NY, USA, 16–22. https://doi.org/10.1145/3332169.3333570
[45]
Ionuţ-Alexandru Zaiţi, Ştefan-Gheorghe Pentiuc, and Radu-Daniel Vatavu. 2015. On free-hand TV control: experimental results on user-elicited gestures with Leap Motion. Personal and Ubiquitous Computing 19, 5-6 (2015), 821–838. https://doi.org/10.1007/s00779-015-0863-y

Cited By

View all
  • (2024)Exploring Methods to Optimize Gesture Elicitation Studies: A Systematic Literature ReviewIEEE Access10.1109/ACCESS.2024.338726912(64958-64979)Online publication date: 2024
  • (2023)Factors Affecting the Results of Gesture Elicitation: A Review2023 11th International Conference in Software Engineering Research and Innovation (CONISOFT)10.1109/CONISOFT58849.2023.00030(169-176)Online publication date: 6-Nov-2023
  • (2023)Using Mid-Air Haptics to Guide Mid-Air InteractionsHuman-Computer Interaction – INTERACT 202310.1007/978-3-031-42280-5_3(43-64)Online publication date: 28-Aug-2023
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences
MUM '21: Proceedings of the 20th International Conference on Mobile and Ubiquitous Multimedia
December 2021
263 pages
ISBN:9781450386432
DOI:10.1145/3490632
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 25 February 2022

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. Augmented Reality
  2. Elicitation Study
  3. Gesture
  4. TV

Qualifiers

  • Research-article
  • Research
  • Refereed limited

Conference

MUM 2021

Acceptance Rates

Overall Acceptance Rate 190 of 465 submissions, 41%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)149
  • Downloads (Last 6 weeks)33
Reflects downloads up to 24 Jan 2025

Other Metrics

Citations

Cited By

View all
  • (2024)Exploring Methods to Optimize Gesture Elicitation Studies: A Systematic Literature ReviewIEEE Access10.1109/ACCESS.2024.338726912(64958-64979)Online publication date: 2024
  • (2023)Factors Affecting the Results of Gesture Elicitation: A Review2023 11th International Conference in Software Engineering Research and Innovation (CONISOFT)10.1109/CONISOFT58849.2023.00030(169-176)Online publication date: 6-Nov-2023
  • (2023)Using Mid-Air Haptics to Guide Mid-Air InteractionsHuman-Computer Interaction – INTERACT 202310.1007/978-3-031-42280-5_3(43-64)Online publication date: 28-Aug-2023
  • (2022)Scenario-based Exploration of Integrating Radar Sensing into Everyday Objects for Free-Hand Television ControlProceedings of the 2022 ACM International Conference on Interactive Media Experiences10.1145/3505284.3532982(357-362)Online publication date: 21-Jun-2022

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Login options

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media