Skip to main content

An Investigation of Problem Instance Difficulty for Case-Based Reasoning and Heuristic Search

  • Conference paper
  • First Online:
Enterprise Information Systems (ICEIS 2020)

Part of the book series: Lecture Notes in Business Information Processing ((LNBIP,volume 417))

Included in the following conference series:

  • 1495 Accesses

Abstract

For managing the ever increasing variability of hardware/software interfaces (HSIs), e.g., in automotive systems, there is a need for the reuse of already existing HSIs. This reuse should be automated, and we (meta-)modeled the HSI domain for design space exploration. These models together with additionally defined transformation rules that lead from a model of one specific HSI to another one facilitate automatic adaptations of HSI instances in these models and, hence, both case-based reasoning (CBR) and (heuristic) search. Using these approaches for solving concrete problem instances, estimating their difficulty really matters, but there is not much theory available.

This work compares different approaches to estimating problem instance difficulty (similarity metrics, heuristic functions). It also shows that even measuring problem instance difficulty depends on the ground truth available and used. In order to avoid finding only domain-specific insights, we also employed sliding-tile puzzles for our experiments. The experimental results in both domains show how different approaches statistically correlate. Overall, this paper investigates problem instance difficulty for CBR and heuristic search. This investigation led to the insight that admissible functions guiding heuristic search may also be used for retrieving cases for CBR.

Roman Popp did this work when he was with the Institute of Computer Technology at TU Wien.

Thomas Rathfux did this work when he was with the Institute of Computer Technology at TU Wien.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

Abbreviations

st:

Start node and goal node, respectively

\(g^*(n)\) :

Cost of an optimal path from s to n

\(h^*(n)\) :

Cost of an optimal path from n to t

g(n), h(n):

Estimates of \(g^*(n)\) and \(h^*(n)\) , respectively

f(n):

Static evaluation function: \(g(n) + h(n)\)

\(C^*\) :

Cost of an optimal path from s to t

\(N\#\) :

Number of nodes generated

References

  1. Aamodt, A., Plaza, E.: Case-based reasoning: foundational issues, methodological variations, and system approaches. AI Commun. 7(1), 39–59 (1994). http://dl.acm.org/citation.cfm?id=196108.196115

  2. Bandyopadhyay, S., Saha, S.: Unsupervised Classification: Similarity Measures, Classical and Metaheuristic Approaches, and Applications. Springer, Heidelberg (2012). https://doi.org/10.1007/978-3-642-32451-2

    Book  MATH  Google Scholar 

  3. Bergmann, G., et al.: Viatra 3: a reactive model transformation platform. In: Kolovos, D., Wimmer, M. (eds.) ICMT 2015. LNCS, vol. 9152, pp. 101–110. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-21155-8_8

    Chapter  Google Scholar 

  4. Bu, Z., Korf, R.E.: A*+IDA*: A simple hybrid search algorithm. In: Proceedings of the Twenty-Eighth International Joint Conference on Artificial Intelligence, IJCAI-2019, pp. 1206–1212. International Joint Conferences on Artificial Intelligence Organization, July 2019. https://doi.org/10.24963/ijcai.2019/168

  5. Bulitko, V., Björnsson, Y., Lawrence, R.: Case-based subgoaling in real-time heuristic search for video game pathfinding. J. Artif. Int. Res. 39(1), 269–300 (2010). http://dl.acm.org/citation.cfm?id=1946417.1946423

  6. Burke, E.K., Petrovic, S., Qu, R.: Case-based heuristic selection for timetabling problems. J. Sched. 9(2), 115–132 (2006). https://doi.org/10.1007/s10951-006-6775-y

    Article  MATH  Google Scholar 

  7. Cha, S.H.: Comprehensive survey on distance/similarity measures between probability density functions. Int. J. Math. Models Methods Appl. Sci. 1(4), 300–307 (2007). http://www.gly.fsu.edu/~parker/geostats/Cha.pdf

  8. Dechter, R., Pearl, J.: Generalized best-first strategies and the optimality of a*. J. ACM 32(3), 505–536 (1985)

    Article  MathSciNet  Google Scholar 

  9. Eclipse: Package org.eclipse.emf.ecore (EMF JavaDoc) (2017). http://download.eclipse.org/modeling/emf/emf/javadoc/2.9.0/

  10. Edelkamp, S., Schroedl, S.: Heuristic Search: Theory and Applications. Morgan Kaufmann, Waltham (2012)

    Google Scholar 

  11. Felner, A., Korf, R.E., Hanan, S.: Additive pattern database heuristics. J. Artif. Int. Res. 22(1), 279–318 (2004). http://dl.acm.org/citation.cfm?id=1622487.1622496

  12. Goel, A.K., Diaz-Agudo, B.: What’s hot in case-based reasoning. In: Proceedings of Thirty-First AAAI Conference on Artificial Intelligence (AAAI-2017), pp. 5067–5069. AAAI Press/The MIT Press, Menlo Park (2017)

    Google Scholar 

  13. Hart, P., Nilsson, N., Raphael, B.: A formal basis for the heuristic determination of minimum cost paths. IEEE Trans. Syst. Sci. Cybern. (SSC) SSC-4(2), 100–107 (1968)

    Google Scholar 

  14. Kaindl, H., Kainz, G.: Bidirectional heuristic search reconsidered. J. Artif. Intell. Res. (JAIR) 7, 283–317 (1997)

    Article  MathSciNet  Google Scholar 

  15. Kaindl, H., Kainz, G., Leeb, A., Smetana, H.: How to use limited memory in heuristic search. In: Proceedings of Fourteenth International Joint Conference on Artificial Intelligence (IJCAI-1995), pp. 236–242. Morgan Kaufmann Publishers, San Francisco (1995)

    Google Scholar 

  16. Kaindl, H., Smialek, M., Nowakowski, W.: Case-based reuse with partial requirements specifications. In: Proceedings of the 18th IEEE International Requirements Engineering Conference (RE 2010), pp. 399–400, September 2010. https://doi.org/10.1109/RE.2010.57

  17. Kaindl, H., Hoch, R., Popp, R.: Estimating problem instance difficulty. In: Filipe, J., Smialek, M., Brodsky, A., Hammoudi, S. (eds.) Proceedings of the 22nd International Conference on Enterprise Information Systems, ICEIS 2020, Prague, Czech Republic, 5–7 May 2020, vol. 1, pp. 359–369. SCITEPRESS (2020). https://doi.org/10.5220/0009390003590369

  18. Kirsopp, C., Shepperd, M., Hart, J.: Search heuristics, case-based reasoning and software project effort prediction. In: Proceedings of the 4th Annual Conference on Genetic and Evolutionary Computation, GECCO 2002, pp. 1367–1374. Morgan Kaufmann Publishers Inc., San Francisco (2002). http://dl.acm.org/citation.cfm?id=2955491.2955741

  19. Köll, A., Kaindl, H.: Bidirectional best-first search with bounded error: summary of results. In: Proceedings of Thirteenth International Joint Conference on Artificial Intelligence (IJCAI-1993), pp. 217–223. Morgan Kaufmann Publishers, San Francisco (1993)

    Google Scholar 

  20. Kolodner, J.: Case-Based Reasoning. Morgan Kaufmann Publishers Inc., San Francisco (1993)

    Book  Google Scholar 

  21. Korf, R.: Depth-first iterative deepening: an optimal admissible tree search. Artif. Intell. 27(1), 97–109 (1985)

    Article  MathSciNet  Google Scholar 

  22. Korf, R.E., Reid, M., Edelkamp, S.: Time complexity of iterative-deepening-A*. Artif. Intell. 129(1), 199–218 (2001). https://doi.org/10.1016/S0004-3702(01)00094-7

    Article  MathSciNet  MATH  Google Scholar 

  23. Lopez de Mantaras, R., et al.: Retrieval, reuse, revision and retention in case-based reasoning. Knowl. Eng. Rev. 20(3), 215–240 (2005). https://doi.org/10.1017/S0269888906000646

  24. Pearl, J.: Heuristics: Intelligent Search Strategies for Computer Problem Solving. Addison-Wesley, Reading (1984)

    Google Scholar 

  25. Rathfux, T., Kaindl, H., Hoch, R., Lukasch, F.: An experimental evaluation of design space exploration of hardware/software interfaces. In: Proceedings of the 14th International Conference on Evaluation of Novel Approaches to Software Engineering, ENASE 2019, pp. 289–296. INSTICC, SciTePress (2019). https://doi.org/10.5220/0007689002890296

  26. Rathfux, T., Kaindl, H., Hoch, R., Lukasch, F.: Efficiently finding optimal solutions to easy problems in design space exploration: A* tie-breaking. In: van Sinderen, M., Maciaszek, L.A. (eds.) Proceedings of the 14th International Conference on Software Technologies, ICSOFT 2019, Prague, Czech Republic, 26–28 July 2019, pp. 595–604. SciTePress (2019). https://doi.org/10.5220/0008119405950604

  27. Reiser, C., Kaindl, H.: Case-based reasoning for multi-step problems and its integration with heuristic search. In: Haton, J.-P., Keane, M., Manago, M. (eds.) EWCBR 1994. LNCS, vol. 984, pp. 113–125. Springer, Heidelberg (1995). https://doi.org/10.1007/3-540-60364-6_31

    Chapter  Google Scholar 

  28. Schank, R.C.: Dynamic Memory: A Theory of Reminding and Learning in Computers and People. Cambridge University Press, New York (1983)

    Google Scholar 

  29. Sohangir, S., Wang, D.: Improved sqrt-cosine similarity measurement. J. Big Data 4(1), 25 (2017). https://doi.org/10.1186/s40537-017-0083-6

    Article  Google Scholar 

  30. Steinberg, D., Budinsky, F., Paternostro, M., Merks, E.: EMF: Eclipse Modeling Framework 2.0, 2nd edn. Addison-Wesley Professional, Boston (2009)

    Google Scholar 

Download references

Acknowledgments

The InteReUse project (No. 855399) has been funded by the Austrian Federal Ministry of Transport, Innovation and Technology (BMVIT) under the program “ICT of the Future” between September 2016 and August 2019. More information can be found at https://iktderzukunft.at/en/.

The VIATRA team provided us with their VIATRA2 tool. Our implementations of the Fifteen Puzzle are based on the very efficient C code of IDA* and A* made available by Richard Korf and an efficient hashing schema by Jonathan Shaeffer. Ariel Felner and Shahaf Shperberg provided us with hints about the availability of code for the Fifteen Puzzle pattern databases.

Last but not least, Alexander Seiler and Lukas Schröer helped us with getting all the C code running under Windows for our Fifteen Puzzle experiment.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Hermann Kaindl .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2021 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Kaindl, H., Hoch, R., Popp, R., Rathfux, T., Lukasch, F. (2021). An Investigation of Problem Instance Difficulty for Case-Based Reasoning and Heuristic Search. In: Filipe, J., Śmiałek, M., Brodsky, A., Hammoudi, S. (eds) Enterprise Information Systems. ICEIS 2020. Lecture Notes in Business Information Processing, vol 417. Springer, Cham. https://doi.org/10.1007/978-3-030-75418-1_9

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-75418-1_9

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-75417-4

  • Online ISBN: 978-3-030-75418-1

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics