skip to main content
10.1145/3626641.3627610acmotherconferencesArticle/Chapter ViewAbstractPublication PagessietConference Proceedingsconference-collections
research-article

DRIVEMATE: Empowering Safe Driving Through Real-Time Traffic Sign Detection and Speech Feedback on Mobile Devices Using YOLOv5 Algorithm and TensorFlow Lite

Published: 27 December 2023 Publication History

Abstract

The aim of this research was to develop an application called DRIVEMATE, which serves as an assistive tool for mobile device users while driving. By leveraging the capabilities of computer vision and machine learning, this research aims to enhance driver awareness and promote safer driving practices. The ability to accurately detect and recognize traffic signs in real-time scenarios, coupled with speech-based feedback, provides drivers with timely and informative alerts, improving their decision-making and reducing the risk of accidents. The research employed two key features: text-to-speech functionality for speech output and live traffic sign detection. Agile scrum development methodology was employed by the developers to ensure a well-structured and timely development process. TensorFlow Lite was utilized to export machine learning models suitable for Android devices, while Google Colab facilitated the training of the machine learning model. The Flutter framework, in combination with Android Studio Code, was employed to construct the application. To evaluate its performance, the application underwent testing and evaluation based on the International Organization for Standardization (ISO) 25010:2011, focusing on functionality, usability, efficiency, and reliability. A survey was conducted involving 100 respondents, indicating that the application provided accurate results, its functions operated correctly, and it proved to be a usable and reliable tool for drivers. The integration of YOLOv5, a real-time object detection method, enhanced the application's ability to detect traffic signs efficiently. Real-time images were collected for training the machine learning model, ensuring accurate traffic sign detection and recognition with speech output.

References

[1]
BURNS, E. 2023. What is artificial intelligence (AI)? - AI definition and how it works. Enterprise AI. https://www.techtarget.com/searchenterpri seai/definition/AI-Artificial-Intelligence.
[2]
GRANADOS, A. 2019. Driving better road safety with technology and artificial intelligence - Microsoft Stories Asia. Microsoft Stories Asia. https://news.microsoft.com/apac/2019/02/4/driving-better-road-safety-with technology-and-artificial-intelligence/
[3]
MELENDEZ, C. 2018. Data is the lifeblood of AI, but how do you collect it? InfoWorld. https://www.infoworld.com/article/32960 44/data- is-the-lifeblood-of-ai-but-how-do you-collect-it.html.
[4]
ROBIELOS, R.A.C. AND LIN, C.J. 2022. Traffic Sign Comprehension among Filipino Drivers and Nondrivers in Metro Manila. Applied Sciences 12, 16, 8337.
[5]
FERNANDEZ, J.J., PARINGIT, M.C., SALVADOR, J.R., LUCERO, P.I., AND GALUPINO, J.G. 2020. Understanding of traffic signs by drivers in the city of Manila, Philippines. Transportation Research Procedia 48, 3037–3048.
[6]
AYYADEVARA, V.K. 2020. Modern Computer Vision with PyTorch. Google Books. https://books.google.com/books/about/Mo dern_Computer_Vision_with_PyTorch.ht ml?id=GfILEAAAQBAJ.
[7]
ULTRALYTICS. PyTorch. YOLOv5 | PyTorch. https://www.pytorch.org.
[8]
PAGKATOTOHAN, J. 2022. Road traffic signs in the Philippines and their meanings. Road Traffic Signs in the Philippines and Their Meanings. https://www.moneymax.ph/lifestyle/articl es/road-signs-and-what-they-mean.
[9]
GUCIANO, A. 2019. Factors affecting traffic sign legibility and visibility: A review of literature. Transportation Research Procedia, 39, 148-156.https://doi.org/10.1016/j.trpro.2019.06.01 9
[10]
[33] PEREZ, J. 2020. Standard Speed for Vehicles in the Philippines. International Journal of Transportation Science and Technology, 9(1), 1-9
[11]
LABORATORY FOR INTELLIGENT AND SAFE AUTOMOBILES - CVRR - UCSD. 2023. CVRR. http://cvrr- nas.ucsd.edu/LISA/datasets.html.
[12]
PATEL, A. 2020. What is object detection? Medium. https://medium.com/ml-research-lab/what- is-object-detection-51f9d872ece7. [13] ROSEBROCK, A. 2021. What is pytorch?PyImageSearch. https://pyimagesearch.com/2021/07/05/wh at-is-pytorch/.
[13]
AGGAR, A. 2021. Traffic Sign detection Algorithm Based on Improved YOLOv5s. https://ieeexplore.ieee.org/document/9626 821/.
[14]
XING, J. 2021. Traffic sign recognition from digital images using Deep Learning aut.https://openrepository.aut.ac.nz/bitstream/handle/10292/ 15158/XingJ.pdf?sequence=3.
[15]
JIN, Y. 2022. Real-time parking sign detection for smart street parking. Scholarly Publishing Services-UWLibraries. https://digital.lib.washington.edu/research works/handle/1773/48418.
[16]
CHIANG, Y.-L. 2021. Real time license plate detection based on machine learning. UWM Digital Commons. https://dc.uwm.edu/etd/2654/. [18] PAPAGEORGIOU, T. 2021. DEPARTMENT OF DIGITAL SYSTEMS POSTGRADUATE PRORAMME“INFORMATION
[17]
SYSTEMS AND SERVICES” “Deep Learning and Object detection.” https://dione.lib.unipi.gr/xmlui/bitstream/handle/unipi/13915/Antoniadis_16004.pdf? sequence=1.

Cited By

View all
  • (2024)Paradapp: an Intelligent Car Parking Assistant Mobile Application Using Convolutional Neural Networks for Student and Novice Drivers2024 IEEE 22nd Student Conference on Research and Development (SCOReD)10.1109/SCOReD64708.2024.10872662(405-409)Online publication date: 19-Dec-2024

Index Terms

  1. DRIVEMATE: Empowering Safe Driving Through Real-Time Traffic Sign Detection and Speech Feedback on Mobile Devices Using YOLOv5 Algorithm and TensorFlow Lite

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Other conferences
    SIET '23: Proceedings of the 8th International Conference on Sustainable Information Engineering and Technology
    October 2023
    722 pages
    ISBN:9798400708503
    DOI:10.1145/3626641
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 27 December 2023

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. Artificial Neural Network (ANN)
    2. Darknet
    3. Image Processing
    4. Mobile Applications
    5. PyTorch
    6. Real- time object-detection
    7. feature extraction and classification

    Qualifiers

    • Research-article
    • Research
    • Refereed limited

    Conference

    SIET 2023

    Acceptance Rates

    Overall Acceptance Rate 45 of 57 submissions, 79%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)22
    • Downloads (Last 6 weeks)7
    Reflects downloads up to 05 Mar 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)Paradapp: an Intelligent Car Parking Assistant Mobile Application Using Convolutional Neural Networks for Student and Novice Drivers2024 IEEE 22nd Student Conference on Research and Development (SCOReD)10.1109/SCOReD64708.2024.10872662(405-409)Online publication date: 19-Dec-2024

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    HTML Format

    View this article in HTML Format.

    HTML Format

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media