Skip to main content

Evaluating the Effort of Composing Design Models: A Controlled Experiment

  • Conference paper
Model Driven Engineering Languages and Systems (MODELS 2012)

Part of the book series: Lecture Notes in Computer Science ((LNPSE,volume 7590))

Abstract

The lack of empirical knowledge about the effects of model composition techniques on developers’ effort is the key impairment for their widespread adoption in practice. This problem applies to both existing categories of model composition techniques, i.e. specification-based (e.g. Epsilon) and heuristic-based (e.g. IBM RSA) techniques. This paper reports on a controlled experiment that investigates the effort to: (1) apply both categories of model composition techniques, and (2) detect and resolve inconsistencies in the output composed models. The techniques are investigated in 144 evolution scenarios, where 2304 compositions of elements of class diagrams were produced. The results suggest that: (1) the employed heuristic-based techniques require less effort to produce the intended model than the chosen specification-based technique, (2) the correctness of the output composed models generated by the techniques is not significantly different, and (3) the use of manual heuristics for model composition outperforms their automated counterparts.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Wohlin, et al.: Experimentation in Software Engineering: an Introduction. Kluwer Academic Publishers, Norwell (2000)

    Book  MATH  Google Scholar 

  2. Devore, J., et al.: Applied Statistics for Engineers and Scientists. Duxbury (1999)

    Google Scholar 

  3. Basili, V., Caldiera, G., Rombach, H.: The Goal Question Metric Paradigm. In: Encyclopedia of Software Engineering, vol. 2, pp. 528–532. John Wiley and Sons (1994)

    Google Scholar 

  4. Farias, K., Garcia, A., Whittle, J.: Assessing the Impact of Aspects on Model Composition Effort. In: AOSD 2012, Saint Malo, France, pp. 73–84 (2010)

    Google Scholar 

  5. France, R., Rumpe, B.: Model-Driven Development of Complex Software: A Research Roadmap. In: Future of Software Engineering at ICSE 2007, pp. 37–54 (2007)

    Google Scholar 

  6. Unified Modeling Language: Infrastructure, Object Management Group (February 2010)

    Google Scholar 

  7. Whittle, J., Jayaraman, P.: Synthesizing Hierarchical State Machines from Expressive Scenario Descriptions. ACM TOSEM 19(3) (January 2010)

    Google Scholar 

  8. Mens, T.: A State-of-the-Art Survey on Software Merging. IEEE Trans. on Soft. Engineering 28(5), 449–462 (2002)

    Article  Google Scholar 

  9. Clarke, S.: Composition of Object-Oriented Software Design Models, PhD thesis, Dublin City University (2001)

    Google Scholar 

  10. Jørgensen, M.: Practical Guidelines for Expert-Judgment-Based Software Effort Estimation. IEEE Software, 57–63 (May 2005)

    Google Scholar 

  11. Thaker, S., Batory, D., Kitchin, D., Cook, W.: Safe Composition of Product Lines. In: 6th GPCE, Salzburg, Austria, pp. 95–104 (2007)

    Google Scholar 

  12. Klein, J., Hélouët, L., Jézéquel, J.: Semantic-based Weaving of Scenarios. In: 5th AOSD 2006, Bonn, Germany, pp. 27–38 (March 2006)

    Google Scholar 

  13. Dingel, J., Diskin, Z., Zito, A.: Understanding and Improving UML Package Merge. Journal of Soft. and Syst. Modeling 7(4), 443–467 (2008)

    Article  Google Scholar 

  14. Lange, C., Chaudron, M.: Effects of Defects in UML Models – An Experimental Investigation. In: ICSE 2006, China, pp. 401–410 (2006)

    Google Scholar 

  15. Epsilon (2011), http://www.eclipse.org/gmt/epsilon/

  16. IBM RSA (2011), http://www.ibm.com/developerworks/rational/products/rsa/

  17. Clarke, S., Baniassad, E.: Aspect-Oriented Analysis and Design: The Theme Approach. Addison-Wesley, Upper Saddle River (2005)

    Google Scholar 

  18. Asklund, U.: Identifying Conflicts during Structural Merge. In: Proc. Nordic Workshop Programming Environment Research, pp. 231–242 (1994)

    Google Scholar 

  19. Evaluating the Effort of Composing Design Models: A Controlled Experiment (2012), http://www.les.inf.puc-rio.br/opus/models12-app

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2012 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Farias, K., Garcia, A., Whittle, J., Chavez, C., Lucena, C. (2012). Evaluating the Effort of Composing Design Models: A Controlled Experiment. In: France, R.B., Kazmeier, J., Breu, R., Atkinson, C. (eds) Model Driven Engineering Languages and Systems. MODELS 2012. Lecture Notes in Computer Science, vol 7590. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-33666-9_43

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-33666-9_43

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-33665-2

  • Online ISBN: 978-3-642-33666-9

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics