skip to main content
10.1145/3565287.3617987acmconferencesArticle/Chapter ViewAbstractPublication PagesmobihocConference Proceedingsconference-collections
poster
Public Access

Poster: Unraveling Reward Functions for Head-to-Head Autonomous Racing in AWS DeepRacer

Published: 16 October 2023 Publication History

Abstract

AWS DeepRacer is a fully autonomous 1/18th scale race car designed to help developers learn and practice reinforcement learning through cloud-based simulations and real-world racing. What drives the reinforcement learning model is the reward function, a way to provide positive or negative feedback to an agent, guiding its learning process in reinforcement learning by assigning numerical values. In the AWS training environment, there are multiple modes in which you can run training simulations and evaluations in. These modes include Time Trial, Object Avoidance, and a relatively new mode: Head to Bot. The research done in this project was primarily focused on testing reward functions in the Head to Bot mode as well as developing a research function that would be suited for training in this new Head to Bot mode. The developed algorithm outperformed the default Centerline reward function, as well as the Object Avoidance reward function.

References

[1]
Amazon Web Services, Inc. 2023. AWS DeepRacer reward function examples. Online at https://docs.aws.amazon.com/deepracer/latest/developerguide/deepracer-reward-function-examples.html.
[2]
Haikuo Du, Moyan Zhu, Wenjie Zhu, Yanbo Liu, Anbei Zhao, Wenchao Xu, Weiqi Sun, and Chunrun Du. 2022. A Dynamic Collaborative Planning Method for Multi-vehicles in the Autonomous Driving Platform of the DeepRacer. In 2022 41st Chinese Control Conference (CCC). 5524--5531.
[3]
Jacob McCalip, Mandil Pradhan, and Kecheng Yang. 2023. Reinforcement Learning Approaches for Racing and Object Avoidance on AWS DeepRacer. In 2023 IEEE 47th Annual Computers, Software, and Applications Conference (COMPSAC). IEEE, 958--961.

Index Terms

  1. Poster: Unraveling Reward Functions for Head-to-Head Autonomous Racing in AWS DeepRacer

      Recommendations

      Comments

      Information & Contributors

      Information

      Published In

      cover image ACM Conferences
      MobiHoc '23: Proceedings of the Twenty-fourth International Symposium on Theory, Algorithmic Foundations, and Protocol Design for Mobile Networks and Mobile Computing
      October 2023
      621 pages
      ISBN:9781450399265
      DOI:10.1145/3565287
      Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the owner/author(s).

      Sponsors

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 16 October 2023

      Check for updates

      Author Tags

      1. machine learning
      2. artificial intelligence
      3. reinforcement learning
      4. reward function
      5. autonomous racing

      Qualifiers

      • Poster

      Funding Sources

      Conference

      MobiHoc '23
      Sponsor:

      Acceptance Rates

      Overall Acceptance Rate 296 of 1,843 submissions, 16%

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • 0
        Total Citations
      • 101
        Total Downloads
      • Downloads (Last 12 months)78
      • Downloads (Last 6 weeks)15
      Reflects downloads up to 07 Mar 2025

      Other Metrics

      Citations

      View Options

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      Login options

      Figures

      Tables

      Media

      Share

      Share

      Share this Publication link

      Share on social media