Skip to main content

Metacognitive Control of Linear Dynamic Systems with Self-confidence Adaptation

  • Conference paper
  • First Online:
European Robotics Forum 2024 (ERF 2024)

Part of the book series: Springer Proceedings in Advanced Robotics ((SPAR,volume 32))

Included in the following conference series:

  • 64 Accesses

Abstract

Metacognitive control is a salient capability of the human cognitive processes that allows them to regulate their executive functions and improve their performance and learning. Here, we contribute towards a mathematical model of metacognitive control for linear dynamic systems with three key features i) control the system, ii) evaluate a second order judgement about the decisions made (confidence in control) and, iii) self-monitor the control confidence and adapt it to improve the controller. We show that adapting the control confidence can improve the controller performance, particularly when the agent is biased with over confidence on its prior beliefs, i.e., it is too confident about its control.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Anderson, M.L., Oates, T., Chong, W., Perlis, D.: The metacognitive loop I: enhancing reinforcement learning with metacognitive monitoring and control for improved perturbation tolerance. J. Exp. Theor. Artif. Intell. 18(3), 387–411 (2006)

    Article  MATH  Google Scholar 

  2. Anil Meera, A., Lanillos, P.: Towards metacognitive robot decision making for tool selection. In: International Workshop on Active Inference, pp. 31–42. Springer (2023)

    Google Scholar 

  3. Blei, D.M., Kucukelbir, A., McAuliffe, J.D.: Variational inference: a review for statisticians. J. Am. Stat. Assoc. 112(518), 859–877 (2017)

    Article  MathSciNet  MATH  Google Scholar 

  4. Daglarli, E.: Computational modeling of prefrontal cortex for meta-cognition of a humanoid robot. IEEE Access 8, 98491–98507 (2020)

    Article  Google Scholar 

  5. Friston, K.: The free-energy principle: a unified brain theory? Nat. Rev. Neurosci. 11(2), 127–138 (2010)

    Article  MATH  Google Scholar 

  6. Hesp, C., Smith, R., Parr, T., Allen, M., Friston, K.J., Ramstead, M.J.: Deeply felt affect: the emergence of valence in deep active inference. Neural Comput. 33(2), 398–446 (2021)

    Article  MathSciNet  MATH  Google Scholar 

  7. Kawato, M., Cortese, A.: From internal models toward metacognitive AI. Biol. Cybern. 115, 415–430 (2021)

    Article  MATH  Google Scholar 

  8. Lanillos, P., et al.: Active inference in robotics and artificial agents: survey and challenges. arXiv preprint arXiv:2112.01871 (2021)

  9. Lyons, K.E., Zelazo, P.D.: Monitoring, metacognition, and executive function: elucidating the role of self-reflection in the development of self-regulation. Adv. Child Dev. Behav. 40, 379–412 (2011)

    Article  MATH  Google Scholar 

  10. Ogata, K.: Modern control engineering fifth edition (2010)

    Google Scholar 

  11. Parr, T., Pezzulo, G., Friston, K.J.: Active Inference: The Free Energy Principle in Mind, Brain, and Behavior. MIT Press, Cambridge (2022)

    Book  MATH  Google Scholar 

  12. Taniguchi, T., et al.: World models and predictive coding for cognitive and developmental robotics: frontiers and challenges. Adv. Robot. 1–27 (2023)

    Google Scholar 

Download references

Acknowledgments

This work has been funded by the EU METATOOL project funded by the EIC Pathfinder challenge Awareness Inside.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Ajith Anil Meera .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2024 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Anil Meera, A., Lanillos, P. (2024). Metacognitive Control of Linear Dynamic Systems with Self-confidence Adaptation. In: Secchi, C., Marconi, L. (eds) European Robotics Forum 2024. ERF 2024. Springer Proceedings in Advanced Robotics, vol 32. Springer, Cham. https://doi.org/10.1007/978-3-031-76424-0_19

Download citation

Publish with us

Policies and ethics