Skip to main content

Advertisement

SpringerLink
Log in

SALA: A Self-Adaptive Learning Algorithm—Towards Efficient Dynamic Route Guidance in Urban Traffic Networks

  • Published:
Neural Processing Letters Aims and scope Submit manuscript

Abstract

In order to alleviate traffic congestion for vehicles in urban networks, most of current researches mainly focused on signal optimization models and traffic assignment models, or tried to recognize the interaction between signal control and traffic assignment. However, these methods may not be able to provide fast and accurate route guidance due to the lack of individual traffic demands, real-time traffic data and dynamic cooperation between vehicles. To solve these problems, this paper proposes a dynamic and real-time route selection model in urban traffic networks (DR2SM), which can supply a more accurate and personalized strategy for vehicles in urban traffic networks. Combining the preference for alternative routes with real-time traffic conditions, each vehicle in urban traffic networks updates its route selection before going through each intersection. Based on its historical experiences and estimation about route choices of the other vehicles, each vehicle uses a self-adaptive learning algorithm to play congestion game with each other to reach Nash equilibrium. In the route selection process, each vehicle selects the user-optimal route, which can maximize the utility of each driving vehicle. The results of the experiments on both synthetic and real-world road networks show that compared with non-cooperative route selection algorithms and three state-of-the-art equilibrium algorithms, DR2SM can effectively reduce the average traveling time in the dynamic and uncertain urban traffic networks.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6

Similar content being viewed by others

References

  1. Adacher L, Cipriani E, Gemma A (2015) The global optimization of signal settings and traffic assignment combined problem: a comparison between algorithms. Adv Transp Stud 36:35–48

    Google Scholar 

  2. Adacher L, Oliva G, Pascucci F (2014) Decentralized route guidance architectures with user preferences in urban transportation networks. Procedia Soc Behav Sci 111:1054–1062

    Article  Google Scholar 

  3. Benaïm M (2006) Dynamics of stochastic approximation algorithms. Séminaire De Probabilités XXXIII, vol 1709, pp 1–68

  4. Cantarella GE, Velonà P, Vitetta A (2012) Signal setting with demand assignment: global optimization with day-to-day dynamic stability constraints. J Adv Transp 46(3):254–268

    Article  Google Scholar 

  5. Chapman AC, Leslie DS, Rogers A et al (2013) Convergent learning algorithms for unknown reward games. SIAM J Control Optim 51(4):3154–3180

    Article  MathSciNet  MATH  Google Scholar 

  6. Chen LW, Hu TY (2012) Flow equilibrium under dynamic traffic assignment and signal control-an illustration of pretimed and actuated signal control policies. IEEE Trans Intell Transp Syst 13(3):1266–1276

    Article  Google Scholar 

  7. Chim TW, Yiu SM, Hui LCK et al (2014) VSPN: VANET-based secure and privacy-preserving navigation. IEEE Trans Comput 63(2):510–524

    Article  MathSciNet  Google Scholar 

  8. Chongwhite C, Millar G, Aydos JC (2014) Scenarios demonstrating congestion management policies using SCATS: Stage 2. In: ARRB Conference, 26th, 2014, Sydney, New South Wales, Australia

  9. Desai P, Loke SW, Desai A et al (2013) CARAVAN: congestion avoidance and route allocation using virtual agent negotiation. IEEE Trans Intell Transp Syst 14(3):1197–1207

    Article  Google Scholar 

  10. Dijkstra EW (1959) A note on two problems in connexion with graphs. Numer Math 1(1):269–271

    Article  MathSciNet  MATH  Google Scholar 

  11. Fernando O, Nicolas ES (2010) Wardrop equilibria with risk-averse users. Transp Sci 44(1):63–86

    Article  Google Scholar 

  12. Fudenberg BD, Levine DK (2015) The theory of learning in games, ser. http://ideas.repec.org/b/mtp/titles/0262061945.html

  13. Groot N, De Schutter B, Hellendoorn H (2015) Toward system-optimal routing in traffic networks: a reverse stackelberg game approach. IEEE Trans Intell Transp Syst 16(1):29–40

    Article  Google Scholar 

  14. Han K, Friesz TL, Yao T (2013) Existence of simultaneous route and departure choice dynamic user equilibrium. Transp Res Part B Methodol 53(3):17–30

    Article  Google Scholar 

  15. Hart PE, Nilsson NJ, Raphael B (1968) A formal basis for the heuristic determination of minimum cost paths. IEEE Trans Syst Sci Cybernet 4(2):100–107

    Article  Google Scholar 

  16. Hu W, Wang H, Yan L (2014) An actual urban traffic simulation model for predicting and avoiding traffic congestion. In: 2014 IEEE 17th international conference on intelligent transportation systems (ITSC). IEEE

  17. Hu W, Yan L, Liu K et al (2016) A short-term traffic flow forecasting method based on the hybrid PSO-SVR. Neural Process Lett 43(1):155–172

    Article  Google Scholar 

  18. Hu W, Yan L, Wang H et al (2015) On exploring a virtual agent negotiation inspired approach for route guidance in urban traffic networks. In: IEEE, international conference on algorithms and architectures for parallel processing. IEEE, pp 3–16

  19. Jimbo T, Fujinami K (2015) Detecting mischoice of public transportation route based on smartphone and GIS. In: 2015 ACM international joint conference on pervasive and ubiquitous computing (UbiComp 2015), pp 165–168

  20. Kaur T, Agrawal S (2014) Adaptive traffic lights based on hybrid of neural network and genetic algorithm for reduced traffic congestion. In: 2014 recent advances in engineering and computational sciences (RAECS), pp 1–5

  21. Lee WH, Tseng SS, Shieh WY (2010) Collaborative real-time traffic information generation and sharing framework for the intelligent transportation system. Inf Sci 180(1):62–70

    Article  Google Scholar 

  22. Li T, Zhang J, Wang S et al (2014) Research on route planning based on quantum-behaved particle swam optimization algorithm. In: Guidance, navigation and control conference (CGNCC), 2014 IEEE Chinese. IEEE, pp 335–339

  23. Lin J, Yu W, Yang X et al (2015) A novel dynamic en-route decision real-time route guidance scheme in intelligent transportation systems. In: IEEE, international conference on distributed computing systems. IEEE, pp 61–72

  24. Liu YW, Zhang HB (2012) Research and application of countdown traffic signal lamps based on SCOOT traffic control system. Transportation Standardization

  25. Lujak M, Giordani S, Ossowski S (2015) Route guidance: bridging system and user optimization in traffic assignment. Neurocomputing 151:449–460

    Article  Google Scholar 

  26. Mao Y, Zhang D, Chen N et al (2012) Dynamic route guidance system based on mixed genetic algorithm. Sci Mosaic 11:6–9

    Google Scholar 

  27. Miyagi T, Peque G, Fukumoto J (2013) Adaptive learning algorithms for traffic games with naive users. Procedia Soc Behav Sci 80:806–817

    Article  Google Scholar 

  28. Pan J, Popa IS, Borcea C (2017) DIVERT: a distributed vehicular traffic re-routing system for congestion avoidance. IEEE Trans Mob Comput 16(1):58–72

    Article  Google Scholar 

  29. Rodríguez M, Blesa F, Barrio R (2015) OpenCL parallel integration of ordinary differential equations: applications in computational dynamics. Comput Phys Commun 192(9):228–236

    Article  MATH  Google Scholar 

  30. Samadi P, Mohsenian-Rad H, Wong VWS et al (2014) Real-time pricing for demand response based on stochastic approximation. IEEE Trans Smart Grid 5(2):789–798

    Article  Google Scholar 

  31. Schrank D, Eisele B, Lomax T (2012) 2012 urban mobility report. Texas A & M University, College Station

    Google Scholar 

  32. Shamma JS (2015) Learning in Games. Encycl Syst Control 133(1):177–198

    Google Scholar 

  33. Taale H, Van ZHJ (2001) The combined traffic assignment and control problem—an overview of 25 years of research. In: Selected proceedings of the, world conference on transport research

  34. Wang L, Jiang P, Zhong J et al (2014) Intelligent traffic guidance system based on dynamic toll collection policy. In: 2014 fourth international conference on communication systems and network technologies (CSNT). IEEE, pp 1172–1176

  35. Yamada K, Ma J, Fukuda D (2013) Simulation analysis of the market diffusion effects of risk-averse route guidance on network traffic. Procedia Comput Sci 19:874–881

    Article  Google Scholar 

  36. Yu L, Li M, Yang Y et al (2015) An improved ant colony optimization for vehicle routing problem. In: Logistics@sThe emerging frontiers of transportation and development in China. ASCE, pp 3360–3366

  37. Yu S, Shingo M, Kanta MM et al (2013) An application of Q-value-based dynamic programming with Boltzmann distribution to real-world road networks. IEEE Trans Electr Electron Eng 8(2):139–145

    Article  Google Scholar 

  38. Zaidi AA, Kulcsár B, Wymeersch H (2016) Back-pressure traffic signal control with fixed and adaptive routing for urban vehicular networks. IEEE Trans Intell Transp Syst 17(8):2134–2143

    Article  Google Scholar 

Download references

Acknowledgements

This work is partially supported by National Natural Science Foundation of China (61572369, 61711530238); National Natural Science Foundation of Hubei Province (2015CFB423); Wuhan Major Science and Technology Program (2015010101010023); Science and Technology Project of Jiangxi Provincial Education Department (GJJ160494, GJJ160500) and Jiangxi Province Youth Science Foundation (20151BAB217017). The authors also gratefully acknowledge the helpful comments and suggestions of the reviewers, which have improved the presentation.

Author information

Authors and Affiliations

  1. School of Computer Science, Wuhan University, Wuhan, Hubei Province, China

    Liping Yan & Wenbin Hu

  2. School of Software, East China Jiaotong University, Nanchang, Jiangxi Province, China

    Liping Yan

  3. Civil and Environmental Engineering Department, Imperial College London, London, UK

    Simon Hu

Authors
  1. Liping Yan
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Wenbin Hu
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Simon Hu
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Wenbin Hu.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Yan, L., Hu, W. & Hu, S. SALA: A Self-Adaptive Learning Algorithm—Towards Efficient Dynamic Route Guidance in Urban Traffic Networks. Neural Process Lett 50, 77–101 (2019). https://doi.org/10.1007/s11063-018-9870-0

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11063-018-9870-0

Keywords

Search

Navigation