Skip to main content
SpringerLink
Log in

Comparison and evaluation of goal-oriented satisfaction analysis techniques

  • Original Article
  • Published:
Requirements Engineering Aims and scope Submit manuscript

Abstract

Goal-oriented requirements engineering (GORE) has been introduced as a means of modeling and understanding the motivations for system requirements. Using models to make goals explicit helps to avoid system failures due to implementing the wrong requirements or ignoring certain stakeholder needs. These models are unique when compared to other models used in system analysis in that their structure naturally lends itself to an analysis of goal satisfaction. Existing work claims that analysis using goal models can facilitate decision making over functional or design alternatives, using criteria in the model. Many different approaches to the analysis of goal-oriented requirements models have been proposed, including several procedures that analyze the satisfaction or denial of goals. These procedures make different choices in their interpretation of the goal model syntax, the methods to resolve conflicting or partial evidence, and in the way they represent satisfaction. This work uses three available tools implementing seven similar goal satisfaction analysis procedures to analyze three sample goal models. Results are reported and compared. The purpose of this comparison is to understand the ways in which procedural design choices affect analysis results, and how differences in analysis results could lead to different recommendations over alternatives in the model. Our comparison shows that different satisfaction analysis techniques for goal models can produce variable results, depending on the structure of the model. Comparison findings lead us to recommend the use of satisfaction analysis techniques for goal models as only heuristics for decision making. Our results emphasize investigation into the benefits of satisfaction analysis beyond decision making, namely improving model quality, increasing domain knowledge, and facilitating communication.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5

Similar content being viewed by others

References

  1. Chung L, Nixon BA, Yu E, Mylopoulos J (2000) Non-functional requirements in software engineering. Kluwer, Norwell

    Book  MATH  Google Scholar 

  2. Yu E Towards modelling and reasoning support for early-phase requirements engineering. In: Proceedings of 3rd IEEE international symposium on requirements engineering (RE’97), IEEE Press, pp 226–235

  3. Dardenne A, van Lamsweerde A, Fickas S (1993) Goal-directed requirements acquisition. Sci Comput Program 20:3–50

    Article  MATH  Google Scholar 

  4. Bresciani P, Perini A, Giorgini P, Giunchiglia F, Mylopoulos J (2004) Tropos: an agent-oriented software development methodology. Aut Agents MAS 8(3):203–236

    Article  Google Scholar 

  5. Antón AI, Potts C (1998) The use of goals to surface requirements for evolving systems. In: Proceedings of the 20th international conference on software engineering (ICSE’98). IEEE Computer Society, Washington, DC, pp 157–166

  6. Maiden NAM, Jones SV, Manning S, Greenwood J, Renou L (2004) Model-driven requirements engineering: synchronising models in an air traffic management case study. In: Proceedings of CAiSE’04, Springer, LNCS, vol 3084, pp 367–383

  7. Horkoff J, Yu E (2009) Evaluating goal achievement in enterprise modeling—an interactive procedure and experiences. In: Proceedings of 2nd IFIP WG 8.1 working conference on the practice of enterprise modeling (PoEM’09), Springer, LNBIP, vol 39, pp 145–160

  8. An Y, Gerrity P, Dalrymple PW, Horkoff J, Rogers M, Yu E Collaborative social modeling for designing a patient wellness tracking system in a nurse-managed health care center. In: Proceedings of the 4th international conference on design science research in information systems and technology (DESRIST ‘09), ACM Press, Article 2, 14 pages

  9. Giorgini P, Mylopoulous J, Sebastiani R (2005) Goal-oriented requirements analysis and reasoning in the tropos methodology. Eng Appl AI 18(2):159–171

    Google Scholar 

  10. Amyot D, Ghanavati S, Horkoff J, Mussbacher G, Peyton L, Yu E (2010) Evaluating goal models within the goal-oriented requirement language. International Journal Intelligent Systems 25(8):841–877

    Article  Google Scholar 

  11. Franch X (2006) On the quantitative analysis of agent-oriented models. In: Proceedings of CAiSE’06, Springer, LNCS, vol 4001, pp 495–509

  12. Kaiya H, Horai H, Saeki M (2002) AGORA: attributed goal-oriented requirements analysis method. In: Proceedings of international requirements engineering conference (RE’02), IEEE Press, p 13

  13. Bryl V, Giorgini P, Mylopoulos J (2007) Supporting requirements analysis in tropos: a planning-based approach. In: Proceedings of Pacific Rim international workshop on multi-agents (PRIMA’07), Springer, vol 5044, pp 243–254

  14. Asnar Y, Bryl V, Giorgini P (2007) Using risk to evaluate design alternatives. Proc AOSE VII, Springer, LNCS 44405:140–155

    Google Scholar 

  15. Gans D, Schmitz D, Arzdorf T, Jarke M, Lakemeyer G (2004) SNet reloaded: roles, monitoring and agent evolution. In: Proceedings of international bi-conference workshop on agent-oriented information systems (II) (AOIS’04), Springer, LNCS, vol 3508, pp 68–84

  16. Wang X, Lesperance Y (2001) Agent-oriented requirements engineering using ConGolog and i*. In: Proceedings of workshop on agent-oriented information systems (AOIS’01), pp 59—78. http://www.aois.org/

  17. Fuxman A, Liu L, Pistore M, Roveri M, Mylopoulos J (2001) Specifying and analyzing early requirements: some experimental results. In: Proceedings of IEEE international requirements engineering conference (RE’03), IEEE Press, pp 105–114

  18. Giorgini P, Massaci F, Mylopoulos J, Zannone N (2004) Requirements engineering meets trust management: model, methodology, and reasoning. In: Proceedings of international Itrust conference, Springer, LNCS, vol 2995, pp 176–190

  19. Horkoff J, Yu E, Ghose A (2010) Interactive goal model analysis applied—systematic procedures versus Ad hoc analysis. In: Proceedings of 3rd IFIP working conference on the practice of enterprise modeling (PoEM’10), pp 130–144

  20. Horkoff J, Yu E (2011) Analyzing goal models—different approaches and how to choose among them. Requirement engineering track—fourth edition, part of the 16th ACM symposium on applied computing, SAC’11

  21. van Lamsweerde A (2004) Goal-oriented requirements engineering: a roundtrip from research to practice. In: Proceedings of IEEE international requirements engineering conference (RE’04), IEEE Press, pp 4–8

  22. Proceedings of the i* Industrial Showcase (2011) JUCMNav (2011) http://jucmnav.softwareengineering.ca/. Accessed July 2011

  23. Liu L, Yu E Designing information systems in social context: a goal and scenario modelling approach. In: Information systems, vol 29, number 2, April 2004, 2003, pp 187–203 (17)

  24. Kaiya H, Horai H, Saeki M (2002) AGORA: attributed goal-oriented requirements analysis method. In: Proceedings international requirements engineering conference (RE’02), IEEE Press, p 13

  25. van Lamsweerde A (2005) Requirements engineering in the year 00: a research perspective. In: Proceedings of the 22nd international conference on software engineering (ICSE ‘00), ACM, New York, pp 5–19

  26. Mylopoulos J, Chung L, Yu E (1999) From object-oriented to goal-oriented requirements analysis. Commun ACM 42(1):31–37

    Article  Google Scholar 

  27. Letier E, van Lamsweerde A (2004) Reasoning about partial goal satisfaction for requirements and design engineering. In: Proceedings of international symposium on the foundation of SE (FSE’04), ACM Press, pp 53–62

  28. Tanabe D, Uno K, Akemine K, Yoshikawa T, Kaiya H, Saeki M (2008) Supporting requirements change management in goal oriented analysis. IEEE international conference on requirements engineering, pp 3–12

  29. Maiden NAM, Lockerbie J, Randall D, Jones S, Bush D (2007) Using satisfaction arguments to enhance i* modelling of an air traffic management system. In: Proceedings of IEEE international conference on requirements engineering (RE’07), IEEE Press, pp 49–52

  30. Giorgini P, Mylopoulos J, Sebastiani R (2004) Simple and minimum-cost satisfiability for goal models. In: Proceedings of CAiSE 2004, Springer, LNCS, vol 3084, pp 20–3–5

  31. Horkoff J, Yu E (2010) Finding solutions in goal models: an interactive backward reasoning approach. In: Proceedings 29th international conference on conceptual modeling (ER’10), pp 59–75

  32. Asnar Y, Giorgini P (2006) Modeling risk and identifying countermeasure in organizations. In: Proceedings of international workshop on critical information infrastructures security (CRITIS’06), Springer, LNCS, vol 4347, pp 55–56

  33. Wang Y, McIlraith S, Yu Y, Mylopoulos J (2007) An automated approach to monitoring and diagnosing requirements. In: Proceedings of international conference on automated SE (ASE’07), ACM Press, pp 293–302

  34. Horkoff J, Yu E (2009) A qualitative, interactive evaluation procedure for goal—and agent-oriented models. In: CAiSE forum, CEUR workshop proceedings

  35. Giorgini P, Mylopoulos J, Nicchiarelli E, Sebastiani R (2002) Reasoning with goal models. In: 21st international conference on conceptual modeling (ER2002). Springer, Tampere

    Google Scholar 

  36. Bradel B (2009) Extending goal models with a probability model and using Bayesian networks. In: Proceedings of the international conference on software engineering research and practice, pp 543–549

  37. JUCMNav (2011) http://jucmnav.softwareengineering.ca/. Accessed Mar 2011

  38. OpenOME (2011) http://www.cs.toronto.edu/km/openome/. Accessed Mar 2011

  39. G-R Tool (2011) http://www.troposproject.org/tools/grtool/. Accessed Mar 2011

  40. Franch X, Maiden NAM (2003) Modelling component dependencies to inform their selection. In: Proceedings of COTS-based software systems, Springer, LNCS, vol 2580, pp 81–91

  41. Franch X, Grau G, Quer C (2004) A framework for the definition of metrics for actor-dependency models. In: Proceedings of IEEE joint international conference on requirements engineering (RE’04), IEEE Press, pp 327–328

  42. Bryl V, Giorgini P, Mylopoulos J (2006) Designing cooperative IS: exploring and evaluating alternatives. In: Proceedings of CoopIS 2006, Springer, LNCS, vol 4275, pp 533–550

  43. Asnar Y, Bryl V, Giorgini P (2007) Using risk to evaluate design alternatives. In: Proceedings of agent-oriented software engineering (AOSE VII), Springer, LNCS, vol 44405, pp 140–155

  44. Bryl V, Giorgini P, Mylopoulos J (2007) Supporting requirements analysis in tropos: a planning-based approach. In: Proceeding of the Pacific Rim international workshop on multi-agents (PRIMA’07), Springer, vol 5044, pp 243–254

  45. Bryl V, Massacci F, Mylopoulos J, Zannone N (2006) Designing security requirements models through planning. In: Proceedings of CAiSE’06, Springer, LNCS, vol 4001, pp 33–47

  46. Gans G, Jarke M, Lakemeyer G, Schmitz D (2003) Deliberation in a modeling and simulation environment for inter-organizational Networks. In: Proceedings of CAiSE’03 (LNCS), vol 2681. Springer, pp 242–257

  47. Gans G, Jarke M, Lakemeyer G, Vits T (2002) SNet: a modeling and simulation environment for agent networks based on i* and ConGolog. In: Proceedings of CAiSE’02 (LNCS), vol 2348. Springer, pp 328–343

  48. Wang X, Lesperance Y (2001) Agent-oriented requirements engineering using ConGolog and i*. In: Proceedings of the workshop on agent-oriented information systems, pp 59–78

  49. Gans G, Jarke M, Kethers S, Lakemeyer G (2003) Continuous requirements management for organization networks: a (dis)trust-based approach. RE J 8:4–22

    Google Scholar 

  50. Gans D, Schmitz D, Arzdorf T, Jarke M, Lakemeyer G (2004) SNet reloaded: roles, monitoring and agent evolution. In: Proceedings international workshop on agent-oriented information systems (AOIS’04) (LNCS), vol 3508. Springer, pp 68–84

  51. Fuxman A, Liu L, Pistore M, Roveri M, Mylopoulos J (2003) Specifying and analyzing early requirements: some experimental results. In: Proceedings international requirements engineering conference (RE’03), IEEE Press, pp 105–114

  52. Fuxman A, Pistore A, Mylopoulos J, Traverso P (2001) Model checking early requirements specifications in tropos. In: Proceedings of IEEE international symposium on requirements engineering (RE’01), IEEE Press, pp 174–181

Download references

Acknowledgments

Financial support has been provided by the Natural Sciences and Engineering Research Council of Canada and the Ontario Graduate Scholarship Program.

Author information

Authors and Affiliations

  1. Department of Computer Science, University of Toronto, Toronto, Canada

    Jennifer Horkoff

  2. Faculty of Information, University of Toronto, Toronto, Canada

    Eric Yu

Authors
  1. Jennifer Horkoff
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Eric Yu
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Jennifer Horkoff.

Appendices

Appendix 1

See Table 11.

Table 11 Results of the evaluation techniques applied for three alternatives over the Media Shop model in Fig. 1
Full size table

Appendix 2

See Table 12.

Table 12 Results of the evaluation techniques applied for three alternatives over the Wireless Services Model in Fig. 2
Full size table

Appendix 3

See Table 13.

Table 13 Results of the evaluation techniques applied for three alternatives over the Counseling Services model in Fig. 3
Full size table

Rights and permissions

Reprints and permissions

About this article

Cite this article

Horkoff, J., Yu, E. Comparison and evaluation of goal-oriented satisfaction analysis techniques. Requirements Eng 18, 199–222 (2013). https://doi.org/10.1007/s00766-011-0143-y

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00766-011-0143-y

Keywords

Search

Navigation