Skip to main content
SpringerLink
Log in
Book cover

International Symposium on Distributed Computing and Artificial Intelligence

DCAI 2019: Distributed Computing and Artificial Intelligence, 16th International Conference, Special Sessions pp 177–182Cite as

Future of Smart Parking: Automated Valet Parking Using Deep Q-Learning

  • Conference paper
  • First Online:

Part of the book series: Advances in Intelligent Systems and Computing ((AISC,volume 1004))

Abstract

Population growth and increasing the number of vehicles are causing many different economic and environmental problems. One of the crucial ones is finding a parking space. In order to deal with this issue, we can construct new parking lots or optimizing the old ones. In fact, building new parking costs a lot and will destroy nature. Most of the time there is not enough space to build a new one in cities. Thanks to the evolution of IoT, the implementation of smart parking based on IoT is possible. In this paper, We are focusing on an eco-friendly system called Automated Valet Parking which uses hybrid robotic valets in smart parking and helps optimizing parking space usage with Deep Q-Learning which is a reinforcement learning method, In order to achieve high performance. Because reinforcement learning is a goal absorbing algorithm and by well-defining the objective function (The goal), We can achieve optimum policy.

This is a preview of subscription content, log in via an institution.

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  1. Casado-Vara, R., Chamoso, P., De la Prieta, F., Prieto, J., Corchado, J.M.: Non-linear adaptive closed-loop control system for improved efficiency in IoT-blockchain management. Inf. Fusion 49, 227–239 (2019)

    Article  Google Scholar 

  2. Casado-Vara, R., Novais, P., Gil, A.B., Prieto, J., Corchado, J.M.: Distributed continuous-time fault estimation control for multiple devices in IoT networks. IEEE Access 7, 11972–11984 (2019)

    Article  Google Scholar 

  3. Casado-Vara, R., Prieto-Castrillo, F., Corchado, J.M.: A game theory approach for cooperative control to improve data quality and false data detection in WSN. Int. J. Robust Nonlinear Control 28(16), 5087–5102 (2018)

    Article  MathSciNet  Google Scholar 

  4. Baruque, B., Corchado, E., Mata, A., Corchado, J.M.: A forecasting solution to the oil spill problem based on a hybrid intelligent system. Inf. Sci. 180(10), 2029–2043 (2010). https://doi.org/10.1016/j.ins.2009.12.032

    Article  Google Scholar 

  5. Al-Fuqaha, A., et al.: Internet of Things: a survey on enabling technologies, protocols, and applications. IEEE Commun. Surv. Tutor. 17(4), 2347–2376 (2015)

    Article  Google Scholar 

  6. Chamoso, P., De La Prieta, F.: Swarm-based smart city platform: a traffic application. ADCAIJ Adv. Distrib. Comput. Artif. Intell. J. 4(2) (2015). ISSN: 2255-2863

    Article  Google Scholar 

  7. Mainetti, L., Palano, L., Patrono, L., Stefanizzi, M.L., Vergallo, R.: Integration of RFID and WSN technologies in a Smart Parking System. In: 2014 22nd International Conference on Software, Telecommunications and Computer Networks (SoftCOM) (2014)

    Google Scholar 

  8. Gazafroudi, A.S., Soares, J., Ghazvini, M.A.F., Pinto, T., Vale, Z., Corchado, J.M.: Stochastic interval-based optimal offering model for residential energy management systems by household owners. Int. J. Electr. Power Energy Syst. 105, 201–219 (2019)

    Article  Google Scholar 

  9. Prieto-Castrillo, F., Shokri Gazafroudi, A., Prieto, J., Corchado, J.M.: An ising spin-based model to explore efficient flexibility in distributed power systems. Complexity 2018, 16 (2018). https://doi.org/10.1155/2018/5905932. Article ID 5905932

    Article  MATH  Google Scholar 

  10. Gazafroudi, A.S., Prieto-Castrillo, F., Pinto, T., Prieto, J., Corchado, J.M., Bajo, J.: Energy flexibility management based on predictive dispatch model of domestic energy management system. Energies 10(9), 1397 (2017)

    Article  Google Scholar 

  11. Gazafroudi, A.S., Shafie-Khah, M., Abedi, M., Hosseinian, S.H., Dehkordi, G.H.R., Goel, L., Karimyan, P., Prieto-Castrillo, F., Corchado, J.M., Catalão, J.P.: A novel stochastic reserve cost allocation approach of electricity market agents in the restructured power systems. Electr. Power Syst. Res. 152, 223–236 (2017)

    Article  Google Scholar 

  12. Gazafroudi, A.S., Shafie-khah, M., Fitiwi, D.Z., Santos, S.F., Corchado, J.M., Catalão, J.P.: Impact of strategic behaviors of the electricity consumers on power system reliability. In: Sustainable Interdependent Networks II, pp. 193–215. Springer, Cham (2019)

    Google Scholar 

  13. Gazafroudi, A.S., Prieto-Castrillo, F., Pinto, T., Corchado, J.M.: Energy flexibility management in power distribution systems: decentralized approach. In: 2018 International Conference on Smart Energy Systems and Technologies (SEST), pp. 1–6. IEEE, September 2018

    Google Scholar 

  14. Ebrahimi, M., Gazafroudi, A.S., Corchado, J.M., Ebrahimi, M.: Energy management of smart home considering residences’ satisfaction and PHEV. In: 2018 International Conference on Smart Energy Systems and Technologies (SEST), pp. 1–6. IEEE, September 2018

    Google Scholar 

  15. Pinto, T., Gazafroudi, A.S., Prieto-Castrillo, F., Santos, G., Silva, F., Corchado, J.M., Vale, Z.: Reserve costs allocation model for energy and reserve market simulation. In: 2017 19th International Conference on Intelligent System Application to Power Systems (ISAP), pp. 1–6. IEEE, September 2017

    Google Scholar 

  16. Navarro-Cáceres, M., Gazafroudi, A.S., Prieto-Castillo, F., Venyagamoorthy, K.G., Corchado, J.M.: Application of artificial immune system to domestic energy management problem. In: 2017 IEEE 17th International Conference on Ubiquitous Wireless Broadband (ICUWB), pp. 1–7. IEEE, September 2017

    Google Scholar 

  17. Bajool, R., Shafie-khah, M., Gazafroudi, A.S., Catalão, J.P.: Mitigation of active and reactive demand response mismatches through reactive power control considering static load modeling in distribution grids. In: 2017 IEEE Conference on Control Technology and Applications (CCTA), pp. 1637–1642. IEEE, August 2017

    Google Scholar 

  18. Gazafroudi, A.S., Prieto-Castrillo, F., Corchado, J.M.: Residential energy management using a novel interval optimization method. In: 2017 4th International Conference on Control, Decision and Information Technologies (CoDIT), pp. 0196–0201. IEEE, April 2017

    Google Scholar 

  19. Banzhaf, H., Quedenfeld, F., Nienhüser, D., Knoop, S., Zöllner, J.M.: High density valet parking using k-deques in driveways. In: 2017 IEEE Intelligent Vehicles Symposium (IV) (2017)

    Google Scholar 

  20. Integration of an automated valet parking service into an internet of things platform. In: 2018 21st International Conference on Intelligent Transportation Systems (ITSC) (2018)

    Google Scholar 

  21. Robotics, S.: The first outdoor valet parking robot. https://stanley-robotics.com/

  22. Mnih, V., Kavukcuoglu, K., Silver, D., Rusu, A.A., Veness, J., Bellemare, M.G., Graves, A., Riedmiller, M., Fidjeland, A.K., Ostrovski, G., et al.: Human-level control through deep reinforcement learning. Nature 518, 529 (2015)

    Article  Google Scholar 

  23. van Otterlo, M., Wiering, M.: Reinforcement learning and markov decision processes. In: Reinforcement Learning, pp. 3–42. Springer (2012)

    Google Scholar 

  24. Gu, S., Lillicrap, T., Sutskever, I., Levine, S.: Continuous deep Q-learning with model-based acceleration. In: International Conference on Machine Learning (2016)

    Google Scholar 

  25. Gazafroudi, A.S., Corchado, J.M., Kean, A., Soroudi, A.: Decentralized flexibility management for electric vehicles. IET Renew. Power Gener. (2019). http://ietdl.org/t/IBgIPb

  26. Najafi, S., Talari, S., Gazafroudi, A.S., Shafie-khah, M., Corchado, J.M., Catalão, J.P.: Decentralized control of DR using a multi-agent method. In: Sustainable Interdependent Networks, pp. 233–249. Springer, Cham (2018)

    Google Scholar 

  27. Gazafroudi, A.S., Pinto, T., Prieto-Castrillo, F., Corchado, J.M., Abrishambaf, O., Jozi, A., Vale, Z.: Energy flexibility assessment of a multi agent-based smart home energy system. In: 2017 IEEE 17th International Conference on Ubiquitous Wireless Broadband (ICUWB), pp. 1–7. IEEE, September 2017

    Google Scholar 

  28. Gazafroudi, A.S., Prieto-Castrillo, F., Pinto, T., Jozi, A., Vale, Z.: Economic evaluation of predictive dispatch model in MAS-based smart home. In: International Conference on Practical Applications of Agents and Multi-Agent Systems, pp. 81–91. Springer, Cham, June 2017

    Google Scholar 

  29. Gazafroudi, A.S., De Paz, J.F., Prieto-Castrillo, F., Villarrubia, G., Talari, S., Shafie-khah, M., Catalão, J.P.: A review of multi-agent based energy management systems. In: International Symposium on Ambient Intelligence, pp. 203–209. Springer, Cham, June 2017

    Google Scholar 

  30. Gazafroudi, A.S., Pinto, T., Prieto-Castrillo, F., Prieto, J., Corchado, J.M., Jozi, A., Vale, Z., Venayagamoorthy, G.K.: Organization-based multi-agent structure of the smart home electricity system. In: 2017 IEEE Congress on Evolutionary Computation (CEC), pp. 1327–1334. IEEE, June 2017

    Google Scholar 

  31. González-Briones, A., Chamoso, P., Yoe, H., Corchado, J.M.: GreenVMAS: virtual organization based platform for heating greenhouses using waste energy from power plants. Sensors 18(3), 861 (2018)

    Article  Google Scholar 

  32. Chamoso, P., González-Briones, A., Rivas, A., De La Prieta, F., Corchado, J.M.: Social computing in currency exchange. Knowl. Inf. Syst., 1–21 (2019). https://doi.org/10.1007/s10115-018-1289-4

  33. Morente-Molinera, J.A., Kou, G., González-Crespo, R., Corchado, J.M., Herrera-Viedma, E.: Solving multi-criteria group decision making problems under environments with a high number of alternatives using fuzzy ontologies and multi-granular linguistic modelling methods. Knowl. Based Syst. 137, 54–64 (2017)

    Article  Google Scholar 

  34. Li, T., Sun, S., Bolić, M., Corchado, J.M.: Algorithm design for parallel implementation of the SMC-PHD filter. Signal Process. 119, 115–127 (2016). https://doi.org/10.1016/j.sigpro.2015.07.013

    Article  Google Scholar 

  35. Chamoso, P., Rodríguez, S., de la Prieta, F., Bajo, J.: Classification of retinal vessels using a collaborative agent-based architecture. AI Commun. 1–18 (2018). (Preprint)

    Google Scholar 

  36. Chamoso, P., González-Briones, A., Rodríguez, S., Corchado, J.M.: Tendencies of technologies and platforms in smart cities: A state-of-the-art review. Wirel. Commun. Mob. Comput. 2018, 17 (2018). https://doi.org/10.1155/2018/3086854. Article ID 3086854

    Article  Google Scholar 

  37. Gonzalez-Briones, A., Prieto, J., De La Prieta, F., Herrera-Viedma, E., Corchado, J.M.: Energy optimization using a case-based reasoning strategy. Sensors (Basel) 18(3), 865 (2018). https://doi.org/10.3390/s18030865

    Article  Google Scholar 

  38. Gonzalez-Briones, A., Chamoso, P., De La Prieta, F., Demazeau, Y., Corchado, J.M.: Agreement technologies for energy optimization at home. Sensors (Basel) 18(5), 1633 (2018). https://doi.org/10.3390/s18051633

    Article  Google Scholar 

  39. Rodríguez, S., De La Prieta, F., Tapia, D.I., Corchado, J.M.: Agents and computer vision for processing stereoscopic images. In: Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). LNAI, vol. 6077 (2010). https://doi.org/10.1007/978-3-642-13803-4_12

    Google Scholar 

  40. Rodríguez, S., Gil, O., De La Prieta, F., Zato, C., Corchado, J.M., Vega, P., Francisco, M.: People detection and stereoscopic analysis using MAS. In: INES 2010 - 14th International Conference on Intelligent Engineering Systems, Proceedings (2010). https://doi.org/10.1109/INES.2010.5483855

  41. Rodríguez, S., Tapia, D.I., Sanz, E., Zato, C., De La Prieta, F., Gil, O.: Cloud computing integrated into service-oriented multi-agent architecture. In: IFIP Advances in Information and Communication Technology. AICT, vol. 322 (2010). https://doi.org/10.1007/978-3-642-14341-0_29

    Chapter  Google Scholar 

  42. Tapia, D.I., Corchado, J.M.: An ambient intelligence based multi-agent system for alzheimer health care. Int. J. Ambient. Comput. Intell. 1(1), 15–26 (2009)

    Article  Google Scholar 

  43. Corchado, J.M., Pavón, J., Corchado, E.S., Castillo, L.F.: Development of CBR-BDI agents: a tourist guide application. In: Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 3155, pp. 547–559 (2004). https://doi.org/10.1007/978-3-540-28631-8

  44. Laza, R., Pavn, R., Corchado, J.M.: A reasoning model for CBR_BDI agents using an adaptable fuzzy inference system. In: Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 3040, pp. 96–106. Springer, Heidelberg (2004)

    Chapter  Google Scholar 

  45. Fyfe, C., Corchado Rodríguez, E., González Bedia, M., Corchado Rodríguez, J.M.: Analytical Model for Constructing Deliberative Agents (2002)

    Google Scholar 

  46. Rodriguez-Fernandez J., Pinto T., Silva F., Praça I., Vale Z., Corchado J.M.: Reputation computational model to support electricity market players energy contracts negotiation. In: Bajo J., et al. (eds.) Highlights of Practical Applications of Agents, Multi-Agent Systems, and Complexity: The PAAMS Collection. PAAMS 2018. Communications in Computer and Information Science, vol. 887. Springer, Cham (2018)

    Chapter  Google Scholar 

  47. Guimaraes, M., Adamatti, D., Emmendorfer, L.: An agent-based environment for dynamic positioning of the Fogg behavior model threshold line. ADCAIJ Adv. Distrib. Comput. Artif. Intell. J. 7(1), 67–76 (2018)

    Google Scholar 

  48. Omatu, S., Wada, T., Rodríguez, S., Chamoso, P., Corchado, J.M.: Multi-agent technology to perform odor classification. In: ISAmI 2014, pp. 241–252 (2014)

    Google Scholar 

  49. Tapia, D.I., Alonso, R.S., García, Ó., Corchado, J.M.: HERA: hardware-embedded reactive agents platform. In: PAAMS (Special Sessions), pp. 249–256 (2011)

    Google Scholar 

  50. Souza de Castro, L.F., Vaz Alves, G., Pinz Borges, A.: Using trust degree for agents in order to assign spots in a Smart Parking (2017)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Babol Noshirvani University of Technology, Babol, Mazandaran, Iran

    Nastaran Shoeibi

  2. BISITE Research Group, University of Salamanca, Salamanca, Spain

    Niloufar Shoeibi

Authors
  1. Nastaran Shoeibi
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Niloufar Shoeibi
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding authors

Correspondence to Nastaran Shoeibi or Niloufar Shoeibi .

Editor information

Editors and Affiliations

  1. University of Granada, Granada, Spain

    Enrique Herrera-Viedma

  2. Engineering Institute, Polytechnic of Porto, Porto, Portugal

    Zita Vale

  3. Department of Materials and Production, The Faculty of Engineering and Science, Aalborg University, Aalborg, Denmark

    Peter Nielsen

  4. Department of Applied Mathematics, Faculty of Science, University of Salamanca, Salamanca, Salamanca, Spain

    Angel Martin Del Rey

  5. BISITE Digital Innovation Hub, University of Salamanca, Salamanca, Spain

    Roberto Casado Vara

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Shoeibi, N., Shoeibi, N. (2020). Future of Smart Parking: Automated Valet Parking Using Deep Q-Learning. In: Herrera-Viedma, E., Vale, Z., Nielsen, P., Martin Del Rey, A., Casado Vara , R. (eds) Distributed Computing and Artificial Intelligence, 16th International Conference, Special Sessions. DCAI 2019. Advances in Intelligent Systems and Computing, vol 1004. Springer, Cham. https://doi.org/10.1007/978-3-030-23946-6_20

Download citation

Publish with us

Policies and ethics

Search

Navigation