skip to main content
10.1145/3580585.3606282acmconferencesArticle/Chapter ViewAbstractPublication PagesautomotiveuiConference Proceedingsconference-collections
research-article

Investigating Hazard Notifications for Cyclists in Mixed Reality: A Comparative Analysis with a Test Track Study

Published: 18 September 2023 Publication History

Abstract

One way to improve road safety for cyclists is the development of hazard notification systems. Instead of in field experiments, such systems could be tested in safe and more controlled simulated environments; however, their validity needs verification. We evaluated the validity of mixed reality (MR) simulation for bicycle support systems notifying of dooring hazards. In a mixed-design study (N=43) with environment type(MR/test track) as within and hazard notifications (with/without) as between factor, comparing subjective and objective measures across environments.
In conclusion, MR simulation is absolutely valid for user experience and perceived safety and relatively valid for workload, standard deviation of lateral position, and speed. However, MR simulation was not valid for lateral distance, as participants cycled more in the center of the street than on the test track, perhaps to avoid simulator sickness. Thus, we conclude that MR simulation is valuable for studying bicycle safety.

Supplementary Material

Supplementary Materials (SupMaterial.zip)

References

[1]
Peter Apasnore, Karim Ismail, and Ali Kassim. 2017. Bicycle-vehicle interactions at mid-sections of mixed traffic streets: Examining passing distance and bicycle comfort perception. Accident Analysis and Prevention 106 (2017), 141–148. https://doi.org/10.1016/j.aap.2017.05.003
[2]
Ronald T. Azuma. 1997. A Survey of Augmented Reality. Presence: Teleoperators and Virtual Environments 6, 4 (1997), 355–385. https://doi.org/10.1162/pres.1997.6.4.355
[3]
Gerard J Blaauw. 1982. Driving experience and task demands in simulator and instrumented car: a validation study. Human Factors 24, 4 (1982), 473–486.
[4]
Tom Brijs, Filomena Mauriello, Alfonso Montella, Francesco Galante, Kris Brijs, and Veerle Ross. 2022. Studying the effects of an advanced driver-assistance system to improve safety of cyclists overtaking. Accident; analysis and prevention 174 (2022), 106763. https://doi.org/10.1016/j.aap.2022.106763
[5]
Gerd Bruder, Ferran Argelaguet, Anne-Héléne Olivier, and Anatole Lécuyer. 2016. CAVE Size Matters: Effects of Screen Distance and Parallax on Distance Estimation in Large Immersive Display Setups. Presence: Teleoperators and Virtual Environments 25, 1 (2016), 1–16. https://doi.org/10.1162/PRES_a_00241
[6]
Lauren E. Buck, Mary K. Young, and Bobby Bodenheimer. 2018. A Comparison of Distance Estimation in HMD-Based Virtual Environments with Different HMD-Based Conditions. ACM Transactions on Applied Perception 15, 3 (2018), 1–15. https://doi.org/10.1145/3196885
[7]
Alessandro Calvi, Fabrizio D’Amico, Chiara Ferrante, and Luca Bianchini Ciampoli. 2021. Driving Simulator Study for Evaluating the Effectiveness of Virtual Warnings to Improve the Safety of Interaction Between Cyclists and Vehicles. Transportation Research Record: Journal of the Transportation Research Board 2676, 4 (2021), 036119812110613. https://doi.org/10.1177/03611981211061351
[8]
James Carifio and Rocco Perla. 2009. Resolving the 50-year Debate Around using and Misusing Likert Scales. Medical education 42 (2009), 1150–1152. https://doi.org/10.1111/j.1365-2923.2008.03172.x
[9]
Joost De Winter, Peter M van Leeuwen, and Riender Happee. 2012. Advantages and disadvantages of driving simulators: A discussion. In Proceedings of Measuring Behavior 2012, 8th International Conference on Methods and Techniques in Behavioral Research. Noldus Informatin Technology bv, Wageningen, The Netherlands, 47–50.
[10]
Christophe Deniaud, Vincent Honnet, Benoit Jeanne, and Daniel Mestre. 2015. The concept of “presence” as a measure of ecological validity in driving simulators. Journal of Interaction Science 3 (2015), 1–13.
[11]
Thomas Engen. 2008. Use and validation of driving simulators. Ph. D. Dissertation. Norwegian University of Science and Technology.
[12]
Elke-Henriette Erdei, Jochen Steinmann, and Carmen Hagemeister. 2021. Which signal modalities do cyclists prefer based on experiences in road traffic?Traffic injury prevention 22, 8 (2021), 640–645. https://doi.org/10.1080/15389588.2021.1985113
[13]
European Transport Safety Council. 2020. How Safe is Walking and Cycling in Europe? PIN Flash Report 38. https://etsc.eu/wp-content/uploads/PIN-Flash-38_FINAL.pdf
[14]
Christian Gold, Moritz Körber, Christoph Hohenberger, David Lechner, and Klaus Bengler. 2015. Trust in Automation – Before and After the Experience of Take-over Scenarios in a Highly Automated Vehicle. Procedia Manufacturing 3 (2015), 3025–3032. https://doi.org/10.1016/j.promfg.2015.07.847
[15]
C. J. Hamann, M. Pooley, D. McGehee, and C. Peek-Asa. 2014. A naturalistic study of child and adult bicycling behaviours and risk exposure. In 3rd International Cycling Safety Conference (ICSC2014), Anneli Hultén, Tony Grimaldi, and Peter Kronberg (Eds.). n.p., Gothenburg, Sweden, 1–15.
[16]
Sandra G. Hart and Lowell E. Staveland. 1988. Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research. In Human Mental Workload(Advances in Psychology, Vol. 52), Peter A. Hancock and Najmedin Meshkati (Eds.). North-Holland, Amsterdam, Netherlands, 139–183. https://doi.org/10.1016/S0166-4115(08)62386-9
[17]
Unai Hernandez-Jayo, Idoia De-la Iglesia, and Jagoba Perez. 2015. V-Alert: Description and Validation of a Vulnerable Road User Alert System in the Framework of a Smart City. Sensors (Basel, Switzerland) 15, 8 (2015), 18480–18505. https://doi.org/10.3390/s150818480
[18]
ISO 12204. 2012-11. Road vehicles - Ergonomic aspects of transport information and control systems - Introduction to integrating safety critical and time critical warning signals. https://www.iso.org/standard/51275.html
[19]
ISO 18682. 2016-10. Intelligent transport systems - External hazard detection and notification systems - Basic requirements. https://www.iso.org/standard/63250.html
[20]
Andrew F. Jarosz and Jennifer Wiley. 2014. What Are the Odds? A Practical Guide to Computing and Reporting Bayes Factors. The Journal of Problem Solving 7, 1 (2014), 9. https://doi.org/10.7771/1932-6246.1167
[21]
JASP Team. 2023. JASP (Version 0.17.1)[Computer software]. https://jasp-stats.org/
[22]
Wolf D Käppler. 1993. Views on the role of simulation in driver training. In Proceedings of the 12th European Annual conference on Human decision making and manual control, Vol. 5. n.p., Kassel, Germany, 12–17.
[23]
Christina Kaß, Stefanie Schoch, Frederik Naujoks, Sebastian Hergeth, Andreas Keinath, and Alexandra Neukum. 2020. A Methodological Approach to Determine the Benefits of External HMI During Interactions Between Cyclists and Automated Vehicles: A Bicycle Simulator Study. In HCI in Mobility, Transport, and Automotive Systems. Driving Behavior, Urban and Smart Mobility (MobiTAS), Vol. 12213. Springer International Publishing, Basel, Switzerland, 211–227. https://doi.org/10.1007/978-3-030-50537-0_16
[24]
Malte Klüver. 2016. Can We Trust Driving Simulator Studies: The Behavioral Validity of the Daimler AG Driving Simulators. Ph. D. Dissertation. Johannes-Gutenberg-Universität Mainz.
[25]
Gwendolin Knappe, Andreas Keinath, Klaus Bengler, and Cristina Meinecke. 2007. Driving Simulator as an Evaluation Tool – Assessment of the Influence of Field of View andSecondary Tasks on Lane Keeping and Steering Performance. In 20th International Technical Conference on the Enhanced Safety of Vehicles (ESV). National Highway Traffic Safety Administration (NHTSA), Washington, D.C., USA, 11. https://trid.trb.org/view/1366055
[26]
Isabel Kreißig, Sabine Springer, and Josef F. Krems. 2022. Cycling Safety at the Fore – Evaluation of a Cyclist Warning System from a User Perspective. In HCI International 2022 Posters, Constantine Stephanidis, Margherita Antona, and Stavroula Ntoa (Eds.). Vol. 1583. Springer International Publishing, Cham, 223–230. https://doi.org/10.1007/978-3-031-06394-7_29
[27]
Daniël Lakens. 2017. Equivalence Tests: A Practical Primer for t Tests, Correlations, and Meta-Analyses. Social psychological and personality science 8, 4 (2017), 355–362. https://doi.org/10.1177/1948550617697177
[28]
JJ-W Lin, Henry Been-Lirn Duh, Donald E Parker, Habib Abi-Rached, and Thomas A Furness. 2002. Effects of field of view on presence, enjoyment, memory, and simulator sickness in a virtual environment. In Proceedings IEEE Virtual Reality 2002. IEEE, New York, NY, USA, 164–171. https://doi.org/10.1109/VR.2002.996519
[29]
Sarah Malone and Roland Brünken. 2021. Hazard perception, presence, and simulation sickness—a comparison of desktop and head-mounted display for driving simulation. Frontiers in psychology 12 (2021), 647723.
[30]
William E. Marsh, Jean-Rémy Chardonnet, and Frédéric Merienne. 2014. Virtual Distance Estimation in a CAVE. In Spatial cognition IX, C. Freksa (Ed.). LNCS sublibrary. SL 7, Artificial intelligence, Vol. 8684. Springer, Cham, 354–369. https://doi.org/10.1007/978-3-319-11215-2_25
[31]
Andrii Matviienko, Florian Heller, and Bastian Pfleging. 2021. Quantified Cycling Safety: Towards a Mobile Sensing Platform to Understand Perceived Safety of Cyclists. In Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems, Yoshifumi Kitamura, Aaron Quigley, Katherine Isbister, and Takeo Igarashi (Eds.). ACM, New York, NY, USA, 1–6. https://doi.org/10.1145/3411763.3451678
[32]
Mohsen Nazemi, Michael A. B. van Eggermond, Alexander Erath, and Kay W. Axhausen. 2019. Studying Cyclists’ Behavior in a Non-Naturalistic Experiment Utilizing Cycling Simulator with Immersive Virtual Reality. Transportation Research Board 98th Annual MeetingTransportation Research Board 1383 (2019), 1–18. https://trid.trb.org/view/1573374
[33]
Geoffrey Norman. 2010. Likert scales, levels of measurement and the “laws” of statistics. Advances in health sciences education : theory and practice 15 (2010), 625–632. https://doi.org/10.1007/s10459-010-9222-y
[34]
Steve O’Hern, Jennie Oxley, and Mark Stevenson. 2017. Validation of a bicycle simulator for road safety research. Accident; analysis and prevention 100 (2017), 53–58. https://doi.org/10.1016/j.aap.2017.01.002
[35]
Rebekka S. Renner, Boris M. Velichkovsky, and Jens R. Helmert. 2013. The perception of egocentric distances in virtual environments - A review. ACM Computing Surveys 46, 2 (2013), 1–40. https://doi.org/10.1145/2543581.2543590
[36]
Jeffrey N Rouder, Richard D Morey, Paul L Speckman, and Jordan M Province. 2012. Default Bayes factors for ANOVA designs. Journal of mathematical psychology 56, 5 (2012), 356–374.
[37]
Antonella Scarano, Massimo Aria, Filomena Mauriello, Maria Rella Riccardi, and Alfonso Montella. 2023. Systematic literature review of 10 years of cyclist safety research. Accident Analysis & Prevention 184 (2023), 16.
[38]
Anne Silla, Lars Leden, Pirkko Rämä, Johan Scholliers, Martijn van Noort, and Daniel Bell. 2017. Can cyclist safety be improved with intelligent transport systems?Accident; analysis and prevention 105 (2017), 134–145. https://doi.org/10.1016/j.aap.2016.05.003
[39]
Elke Henriette Strohaeker, Alessandro Moia, Jochen Steinmann, and Carmen Hagemeister. 2022. How do warnings influence cyclists’ reaction to conflicts? Comparing acoustic and vibro-tactile warnings in different conflicts on a test track. Transportation Research Part F: Traffic Psychology and Behaviour 90 (2022), 151–166. https://doi.org/10.1016/j.trf.2022.08.006
[40]
The Linux Foundation. 2021. gRPC: A high performance, open source universal RPC framework. https://www.grpc.io
[41]
Jan Törnros. 1998. Driving behaviour in a real and a simulated road tunnel—a validation study. Accident Analysis & Prevention 30, 4 (1998), 497–503.
[42]
UEQ Team. 2018. User Experience Questionnaire. https://www.ueq-online.org/
[43]
Daniela Ullmann, Julian Kreimeier, and Harald Kipke. 2022. Pedaling through a virtually redesigned city: Evaluation of traffic planning and urban design factors influencing bicycle traffic. Journal of Urban Mobility 2 (2022), 100032. https://doi.org/10.1016/j.urbmob.2022.100032
[44]
Unity Technologies. 2022. Unity. https://unity.com/
[45]
Don van den Bergh, Johnny van Doorn, Maarten Marsman, Tim Draws, Erik-Jan van Kesteren, Koen Derks, Fabian Dablander, Quentin F. Gronau, Šimon Kucharský, Akash R. Komarlu Narendra Gupta, Alexandra Sarafoglou, Jan G. Voelkel, Angelika Stefan, Alexander Ly, Max Hinne, Dora Matzke, and Eric-Jan Wagenmakers. 2020. A Tutorial on Conducting and Interpreting a Bayesian ANOVA in JASP. L’Année psychologique Vol. 120, 1 (2020), 73–96. https://doi.org/10.3917/anpsy1.201.0073
[46]
Johnny van Doorn, Don van den Bergh, Udo Böhm, Fabian Dablander, Koen Derks, Tim Draws, Alexander Etz, Nathan J. Evans, Quentin F. Gronau, Julia M. Haaf, Max Hinne, Šimon Kucharský, Alexander Ly, Maarten Marsman, Dora Matzke, Akash R. Komarlu Narendra Gupta, Alexandra Sarafoglou, Angelika Stefan, Jan G. Voelkel, and Eric-Jan Wagenmakers. 2021. The JASP guidelines for conducting and reporting a Bayesian analysis. Psychonomic Bulletin & Review 28, 3 (2021), 813–826. https://doi.org/10.3758/s13423-020-01798-5
[47]
Tamara von Sawitzky, Thomas Grauschopf, and Andreas Riener. 2022. “Attention! A Door Could Open.”—Introducing Awareness Messages for Cyclists to Safely Evade Potential Hazards. Multimodal Technologies and Interaction 6, 1 (2022), 24. https://doi.org/10.3390/mti6010003
[48]
Tamara von Sawitzky, Thomas Grauschopf, and Andreas Riener. 2022. Hazard Notifications for Cyclists: Comparison of Awareness Message Modalities in a Mixed Reality Study. In 27th International Conference on Intelligent User Interfaces (IUI ’22). ACM, New York, NY, USA, 310–322. https://doi.org/10.1145/3490099.3511127
[49]
Eric-Jan Wagenmakers. 2007. A practical solution to the pervasive problems of p values. Psychonomic bulletin & review 14, 5 (2007), 779–804. https://doi.org/10.3758/BF03194105
[50]
Philipp Wintersberger, Andrii Matviienko, Andreas Schweidler, and Florian Michahelles. 2022. Development and Evaluation of a Motion-based VR Bicycle Simulator. Proceedings of the ACM on Human-Computer Interaction 6, MHCI (2022), 1–19.
[51]
World Health Organization. 2020. Cyclist safety: an information resource for decision-makers and practitioners. World Health Organization, Geneva, Switzerland. 34 pages.
[52]
World Medical Association. 2013. World Medical Association Declaration of Helsinki: ethical principles for medical research involving human subjects. JAMA 310, 20 (2013), 2191–2194. https://doi.org/10.1001/jama.2013.281053
[53]
Rachael A. Wynne, Vanessa Beanland, and Paul M. Salmon. 2019. Systematic review of driving simulator validation studies. Safety Science 117 (2019), 138–151. https://doi.org/10.1016/j.ssci.2019.04.004
[54]
Peter Zeile, Bernd Resch, Martin Loidl, Andreas Petutschnig, and Linda Dörrzapf. 2016. Urban Emotions and Cycling Experience – enriching traffic planning for cyclists with human sensor data. GI_Forum 4, 1 (2016), 204–216. https://doi.org/10.1553/giscience2016_01_s204

Cited By

View all
  • (2024)What does it Take to Test a Bicycle Simulator for Realism? A Discussion of the Challenges and Possible Evaluation MethodsProceedings of Mensch und Computer 202410.1145/3670653.3677491(461-465)Online publication date: 1-Sep-2024
  • (2024)Only Trust a Hidden Wizard: Investigating the Effects of Wizard Visibility in Automotive Wizard of Oz StudiesProceedings of the 16th International Conference on Automotive User Interfaces and Interactive Vehicular Applications10.1145/3640792.3675738(74-82)Online publication date: 22-Sep-2024
  • (2024)SafeARCross: Augmented Reality Collision Warnings and Virtual Traffic Lights for Pedestrian SafetyProceedings of the 16th International Conference on Automotive User Interfaces and Interactive Vehicular Applications10.1145/3640792.3675734(63-73)Online publication date: 22-Sep-2024
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
AutomotiveUI '23: Proceedings of the 15th International Conference on Automotive User Interfaces and Interactive Vehicular Applications
September 2023
352 pages
ISBN:9798400701054
DOI:10.1145/3580585
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 18 September 2023

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. Cyclist Safety
  2. Dooring
  3. Hazard Notifications
  4. Mixed Reality Study
  5. Test Track Study
  6. Validation

Qualifiers

  • Research-article
  • Research
  • Refereed limited

Funding Sources

  • Österreichische Forschungsförderungsgesellschaft (FFG)
  • Bundesministerium für Verkehr und Digitale Infrastruktur
  • Bundesministerium für Bildung und Forschung

Conference

AutomotiveUI '23
Sponsor:

Acceptance Rates

Overall Acceptance Rate 248 of 566 submissions, 44%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)109
  • Downloads (Last 6 weeks)6
Reflects downloads up to 10 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2024)What does it Take to Test a Bicycle Simulator for Realism? A Discussion of the Challenges and Possible Evaluation MethodsProceedings of Mensch und Computer 202410.1145/3670653.3677491(461-465)Online publication date: 1-Sep-2024
  • (2024)Only Trust a Hidden Wizard: Investigating the Effects of Wizard Visibility in Automotive Wizard of Oz StudiesProceedings of the 16th International Conference on Automotive User Interfaces and Interactive Vehicular Applications10.1145/3640792.3675738(74-82)Online publication date: 22-Sep-2024
  • (2024)SafeARCross: Augmented Reality Collision Warnings and Virtual Traffic Lights for Pedestrian SafetyProceedings of the 16th International Conference on Automotive User Interfaces and Interactive Vehicular Applications10.1145/3640792.3675734(63-73)Online publication date: 22-Sep-2024
  • (2024)Development and Evaluation of Advanced Cyclist Assistance Systems on a Bicycle SimulatorProceedings of the 16th International Conference on Automotive User Interfaces and Interactive Vehicular Applications10.1145/3640792.3675721(283-293)Online publication date: 22-Sep-2024
  • (2024)When the E-bike Takes Over: Speed Precision and Perception of Cruise Control for CyclistsProceedings of the 16th International Conference on Automotive User Interfaces and Interactive Vehicular Applications10.1145/3640792.3675714(272-282)Online publication date: 22-Sep-2024

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media