skip to main content
research-article

Automata-Based Quantitative Reasoning

Published:24 August 2023Publication History
Skip Abstract Section

Abstract

Existing solution approaches for problems in formal quantitative analysis suffer from two challenges that adversely impact their theoretical understanding and large-scale applicability. These are the lack of generalizability, and separation-of-techniques. Lack of generalizability refers to the issue that solution approaches are often specialized to the underlying cost model that evaluates the quantitative property. Different cost models deploy such disparate algorithms that there is no transfer of knowledge from one cost model to another. Separation-of-techniques refers to the inherent dichotomy in solving problems in quantitative analysis. Most algorithms comprise of two phases: A structural phase, which reasons about the structure of the quantitative system(s) using techniques from automata or graphs; and a numerical phase, which reasons about the quantitative dimension/cost model using numerical methods. These techniques are incompatible with one another, forcing the phases to be performed sequentially, thereby impacting scalability.

The article presents a novel framework that addresses the aforementioned challenges. The introduced framework, called comparator automata or comparators in short, builds on automata-theoretic foundations to generalize across a variety of cost models. The crux of comparators is that they enable automata-based methods in the numerical phase, hence eradicating the dependence on numerical methods. In doing so, comparators are able to integrate the structural and numerical phases. On the theoretical front, we demonstrate that comparator-based solutions have the advantage of generalizable results, and yield complexity-theoretic improvements over a range of problems in quantitative analysis. On the practical front, we demonstrate through empirical analysis that comparator-based solutions render more efficient, scalable, and robust performance, and demonstrate broader applicability than traditional methods for quantitative reasoning.

References

  1. Rabit-Reduce. http://www.languageinclusion.org/. (????).Google ScholarGoogle Scholar
  2. Dilip Abreu. 1988. On the theory of infinitely repeated games with discounting. Econometrica (1988), 383--396.Google ScholarGoogle Scholar
  3. S. Almagor, U. Boker, and O. Kupferman. 2011. Whatś decidable about weighted automata? In Proc. of ATVA. Springer, 482--491.Google ScholarGoogle Scholar
  4. B. Alpern and F. B. Schneider. 1987. Recognizing safety and liveness. Distributed computing 2, 3 (1987), 117--126.Google ScholarGoogle Scholar
  5. Rajeev Alur, Suguman Bansal, Osbert Bastani, and Kishor Jothimurugan. 2022. A framework for transforming specifications in reinforcement learning. In Principles of Systems Design: Essays Dedicated to Thomas A. Henzinger on the Occasion of His 60th Birthday. Springer, 604--624.Google ScholarGoogle Scholar
  6. Garrett Andersen and Vincent Conitzer. 2013. Fast Equilibrium Computation for Infinitely Repeated Games. In Proc. of AAAI. 53--59.Google ScholarGoogle ScholarCross RefCross Ref
  7. Christel Baier, Joost-Pieter Katoen, and others. 2008. Principles of model checking. MIT press Cambridge.Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Suguman Bansal. Doctoral Dissertation, Rice University, June 2020. Automata-based Quantitative Analysis.Google ScholarGoogle Scholar
  9. S. Bansal. Master's thesis, Rice University, 2016. Algorithmic analysis of Regular Repeated Games.Google ScholarGoogle Scholar
  10. Suguman Bansal, Krishnendu Chatterjee, and Moshe Y. Vardi. 2021. On satisficing in quantitative games. In Proc. of TACAS.Google ScholarGoogle Scholar
  11. Suguman Bansal, Swarat Chaudhuri, and Moshe Y. Vardi. 2018a. Automata vs Linear-Programming Discounted-Sum Inclusion. In Proc. of CAV.Google ScholarGoogle Scholar
  12. Suguman Bansal, Swarat Chaudhuri, and Moshe Y. Vardi. 2018b. Comparator automata in quantitative verification. In Proc. of FOSSACS.Google ScholarGoogle Scholar
  13. Suguman Bansal, Swarat Chaudhuri, and Moshe Y Vardi. 2022a. Comparator automata in quantitative verification. Logical Methods in Computer Science 18 (2022).Google ScholarGoogle Scholar
  14. Suguman Bansal, Lydia Kavraki, Moshe Y Vardi, and Andrew Wells. 2022b. Synthesis from Satisficing and Temporal Goals. In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 36. 9679--9686.Google ScholarGoogle ScholarCross RefCross Ref
  15. Suguman Bansal, Yong Li, Lucas Tabajara, and Moshe Vardi. 2020. Hybrid compositional reasoning for reactive synthesis from finite-horizon specifications. In Proc. of AAAI.Google ScholarGoogle ScholarCross RefCross Ref
  16. Suguman Bansal and Moshe Y. Vardi. 2019. Safety and Co-safety Comparator Automata for Discounted-Sum Inclusion. In Proc. of CAV.Google ScholarGoogle Scholar
  17. Udi Boker and Guy Hefetz. 2021. Discounted-sum automata with multiple discount factors. In 29th EACSL Annual Conference on Computer Science Logic (CSL 2021). Schloss Dagstuhl-Leibniz-Zentrum für Informatik.Google ScholarGoogle Scholar
  18. U. Boker and T. A. Henzinger. 2014. Exact and Approximate Determinization of Discounted-Sum Automata. LMCS 10, 1 (2014).Google ScholarGoogle Scholar
  19. U. Boker, T. A. Henzinger, and J. Otop. 2015. The Target Discounted-Sum Problem. In Proc. of LICS. 750--761.Google ScholarGoogle Scholar
  20. Patricia Bouyer, Romain Brenguier, and Nicolas Markey. 2010. Nash equilibria for reachability objectives in multi-player timed games. In International Conference on Concurrency Theory. Springer, 192--206.Google ScholarGoogle ScholarCross RefCross Ref
  21. Patricia Bouyer, Romain Brenguier, Nicolas Markey, and Michael Ummels. 2011. Nash Equilibria in Concurrent Games with Büchi Objectives.. In Proc. of FSTTCS. 375--386.Google ScholarGoogle Scholar
  22. R. E. Bryant. 1986. Graph-based algorithms for boolean function manipulation. Computers, IEEE Transactions on 100, 8 (1986), 677--691.Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. Jerry R Burch, Edmund M Clarke, Kenneth L McMillan, David L Dill, and Lain-Jinn Hwang. 1992. Symbolic model checking: 1020 states and beyond. Information and computation 98, 2 (1992), 142--170.Google ScholarGoogle Scholar
  24. Krishnendu Chatterjee. 2008. Linear time algorithm for weak parity games. arXiv preprint arXiv:0805.1391 (2008).Google ScholarGoogle Scholar
  25. K. Chatterjee, L. Doyen, and T. A. Henzinger. 2009. Expressiveness and closure properties for quantitative languages. In Proc. of LICS. IEEE, 199--208.Google ScholarGoogle Scholar
  26. K. Chatterjee, L. Doyen, and T. A. Henzinger. 2010. Quantitative languages. Transactions on Computational Logic 11, 4 (2010), 23.Google ScholarGoogle ScholarDigital LibraryDigital Library
  27. Krishnendu Chatterjee, Thomas A Henzinger, Jan Otop, and Yaron Velner. 2017. Quantitative fair simulation games. Information and Computation 254 (2017), 143--166.Google ScholarGoogle ScholarCross RefCross Ref
  28. Alonzo Church. 1963. Application of recursive arithmetic to the problem of circuit synthesis. Journal of Symbolic Logic 28, 4 (1963).Google ScholarGoogle Scholar
  29. Edmund M. Clarke, E Allen Emerson, and A Prasad Sistla. 1986. Automatic verification of finite-state concurrent systems using temporal logic specifications. ACM Transactions on Programming Languages and Systems (TOPLAS) 8, 2 (1986), 244--263.Google ScholarGoogle ScholarDigital LibraryDigital Library
  30. Rina S Cohen and Arie Y Gold. 1977. Theory of ω-languagesI: Characterizations of ω-context-free languages. JCSS 15, 2 (1977).Google ScholarGoogle Scholar
  31. K. He, M. Lahijanian, L.E. Kavraki, and M.Y. Vardi. 2017. Reactive synthesis for finite tasks under resource constraints. In Intelligent Robots and Systems (IROS), 2017 IEEE/RSJ International Conference on. IEEE, 5326--5332.Google ScholarGoogle Scholar
  32. O. Kupferman and M. Y. Vardi. 1999. Model checking of safety properties. In Proc. of CAV. Springer, 172--183.Google ScholarGoogle Scholar
  33. M. Lahijanian, S. Almagor, D. Fried, L.E. Kavraki, and M.Y. Vardi. 2015. This Time the Robot Settles for a Cost: A Quantitative Approach to Temporal Logic Planning with Partial Satisfaction.. In AAAI. 3664--3671.Google ScholarGoogle Scholar
  34. Philipp J Meyer, Salomon Sickert, and Michael Luttenberger. 2018. Strix: Explicit reactive synthesis strikes back!. In International Conference on Computer Aided Verification. Springer, 578--586.Google ScholarGoogle ScholarCross RefCross Ref
  35. Koko Muroya, Takahiro Sanada, and Natsuki Urabe. 2021. Preorder-Constrained Simulation for Nondeterministic Automata (Early Ideas). In 9th Conference on Algebra and Coalgebra in Computer Science (CALCO 2021). Schloss Dagstuhl-Leibniz-Zentrum für Informatik.Google ScholarGoogle Scholar
  36. Kedar S Namjoshi and Nisarg Patel. 2022. Synthesis of Compact Strategies for Coordination Programs. In International Conference on Tools and Algorithms for the Construction and Analysis of Systems. Springer, 46--63.Google ScholarGoogle Scholar
  37. John F. Nash. 1950. Equilibrium points in n-person games. Proceedings of the National Academy of Sciences 36, 1 (1950), 48--49. Google ScholarGoogle ScholarCross RefCross Ref
  38. M.J. Osborne and A. Rubinstein. 1994. A course in game theory. MIT press.Google ScholarGoogle Scholar
  39. Amir Pnueli. 1977. The temporal logic of programs. In Proc. of FOCS. IEEE, 46--57.Google ScholarGoogle ScholarDigital LibraryDigital Library
  40. Amir Pnueli and Roni Rosner. 1989. On the synthesis of a reactive module. In POPL. 179--190.Google ScholarGoogle Scholar
  41. M.L. Puterman. 1990. Markov decision processes. Handbooks in operations research and management science 2 (1990), 331--434.Google ScholarGoogle Scholar
  42. Senthil Rajasekaran, Suguman Bansal, and Moshe Y Vardi. 2023. Multi-Agent Systems with Quantitative Satisficing Goals. arXiv preprint arXiv:2305.00953 (2023).Google ScholarGoogle Scholar
  43. S. Safra. 1988. On the complexity of ω-automata. In Proc. of FOCS. IEEE, 319--327.Google ScholarGoogle ScholarDigital LibraryDigital Library
  44. S. Schewe and B. Finkbeiner. 2007. Bounded synthesis. Proc. of ATVA (2007), 474--488.Google ScholarGoogle Scholar
  45. Yoav Shoham and Kevin Leyton-Brown. 2009. Multiagent Systems - Algorithmic, Game-Theoretic, and Logical Foundations. Cambridge University Press.Google ScholarGoogle Scholar
  46. Herbert A Simon. 1956. Rational choice and the structure of the environment. Psychological review 63, 2 (1956), 129.Google ScholarGoogle Scholar
  47. R.S. Sutton and A.G. Barto. 1998. Introduction to reinforcement learning. Vol. 135. MIT press Cambridge.Google ScholarGoogle Scholar
  48. W. Thomas, T. Wilke, and others. 2002. Automata, logics, and infinite games: A guide to current research. Vol. 2500. Springer Science & Business Media.Google ScholarGoogle Scholar
  49. Michael Ummels, Nicolas Markey, Romain Brenguier, and Patricia Bouyer. 2015. Pure Nash Equilibria in Concurrent Deterministic Games. Logical Methods in Computer Science 11 (2015).Google ScholarGoogle Scholar
  50. M. Y Vardi. 2007. The Büchi complementation saga. In Annual Symposium on Theoretical Aspects of Computer Science. Springer, 12--22.Google ScholarGoogle ScholarCross RefCross Ref
  51. Michael Wooldridge. 2009. An introduction to multiagent systems. John wiley & sons.Google ScholarGoogle Scholar
  52. S. Zhu, L. M. Tabajara, J. Li, G. Pu, and M. Y Vardi. 2017. A Symbolic Approach to Safety LTL Synthesis. In Haifa Verification Conference. Springer, 147--162.Google ScholarGoogle ScholarCross RefCross Ref

Recommendations

Comments

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Sign in

Full Access

  • Published in

    cover image ACM SIGLOG News
    ACM SIGLOG News  Volume 10, Issue 3
    July 2023
    23 pages
    EISSN:2372-3491
    DOI:10.1145/3617576
    Issue’s Table of Contents

    Copyright © 2023 Copyright is held by the owner/author(s)

    Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    • Published: 24 August 2023

    Check for updates

    Qualifiers

    • research-article
  • Article Metrics

    • Downloads (Last 12 months)34
    • Downloads (Last 6 weeks)2

    Other Metrics

PDF Format

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader