research-article

Comprehensively evaluating conformance error rates of applying aspect state machines

Authors:

Zafar Iqbal MalikAuthors Info & Claims

AOSD '12: Proceedings of the 11th annual international conference on Aspect-oriented Software Development

Pages 155 - 166

https://doi.org/10.1145/2162049.2162068

Published: 25 March 2012 Publication History

Abstract

Aspect Oriented Modeling (AOM) aims to provide enhanced separation of concerns during the design phase and proclaims many benefits (e.g., easier model evolution, reduced modeling effort, and reduced modeling errors) over traditional modeling paradigms such as object-oriented modeling. However, empirical evaluations of these benefits is severely lacking in the AOM community. In this paper, we empirically evaluate one of the AOM profiles: AspectSM, via a controlled experiment to assess if it can help in reducing modeling errors (referred as conformance errors in this paper), which is one of the benefits offered by AOM. AspectSM is a UML profile, which is developed to support automated state-based robustness testing. With AspectSM, crosscutting behaviors are modeled as aspect state machines using the stereotypes defined in AspectSM. We evaluate the conformance error rates of applying AspectSM from various perspectives by conducting four activities: 1) identifying modeling defects, 2) comprehending state machines, 3) modeling state machines, and 4) weaving aspect state machines into base state machines. For most of these activities, experimental results show that the error rates while performing these four activities using AspectSM are significantly lower than standard UML state machine modeling approaches.

References

[1]

Ali, S., Briand, L. C. and Hemmati, H. Modeling Robustness Behavior Using Aspect-Oriented Modeling to Support Robustness Testing of Industrial Systems. Systems and Software Modeling (SOSYM)(2011).

Digital Library

[2]

Weigert, T. and Reed, R. Specifying Telecommunications Systems with UML. Kluwer Academic Publishers, 2003.

[3]

Drusinsky, D. Modeling and Verification using UML Statecharts: A Working Guide to Reactive System Design, Runtime Monitoring and Execution-based Model Checking. Newnes, 2006.

Digital Library

[4]

SmartState, http://www.smartstatestudio.com/, 2010

[5]

Utting, M. and Legeard, B. Practical Model-Based Testing: A Tools Approach. Morgan-Kaufmann, 2007.

Digital Library

[6]

Binder, R. V. Testing object-oriented systems: models, patterns, and tools. Addison-Wesley Longman Publishing Co., Inc., 1999.

Digital Library

[7]

Cavarra, R., Crichton, C., Davies, J., Hartman, A. and Mounier, L. Using UML for automatic test generation In Proceedings of the International Symposium on Software Testing and Analysis (ISSTA '02) (2002).

[8]

Pender, T. UML Bible. Wiley, 2003.

Digital Library

[9]

Yedduladoddi, R. Aspect Oriented Software Development: An Approach to Composing UML Design Models. VDM Verlag Dr. Müller, 2009.

[10]

IBM OCL Parser, IBM, http://www-01.ibm.com/software/awdtools/library/standards/ocl-download.html, 2010

[11]

OCLE, http://lci.cs.ubbcluj.ro/ocle/, 2010

[12]

EyeOCL Software, http://maude.sip.ucm.es/eos/, 2010

[13]

Zhang, G. Towards Aspect-Oriented State Machines. In Proceedings of the 2nd Asian Workshop on Aspect-Oriented Software Development (AOASIA'06) (Tokyo, 2006).

[14]

Zhang, G. and Hölzl, M. HiLA: High-Level Aspects for UML-State Machines. In Proceedings of the In Proceedings of the 14th Workshop on Aspect-Oriented Modeling (AOM@MoDELS'09) (2009).

Digital Library

[15]

Zhang, G., Hölzl, M. M. and Knapp, A. Enhancing UML State Machines with Aspects. 2007.

[16]

Xu, D., Xu, W. and Nygard, K. A State-Based Approach to Testing Aspect-Oriented Programs. In Proceedings of the 17th International Conference on Software Engineering and Knowledge Engineering (Taiwan, 2005).

[17]

Whittle, J., Moreira, A., Araújo, J., Jayaraman, P., Elkhodary, A. and Rabbi, R. An Expressive Aspect Composition Language for UML State Diagrams. 2007.

[18]

Laddad, R. AspectJ in Action: Practical Aspect-Oriented Programming. Manning Publications, 2003.

Digital Library

[19]

Gomaa, H. Designing Concurrent, Distributed, and Real-Time Applications with UML. Addison-Wesley Professional, 2000.

Digital Library

[20]

Wohlin, C., Runeson, P. and Höst, M. Experimentation in Software Engineering: An Introduction. Springer, 1999.

Digital Library

[21]

Ali, S., Yue, T., Briand, L. C. and Malik, Z. I. Does Aspect-Oriented Modeling Help Improve the Readability of UML State Machines? Simula Reserach Laboratory, Technical Report(2010--11), 2010.

[22]

Sheskin, D. J. Handbook of Parametric and Nonparametric Statistical Procedures. Chapman and Hall/CRC, 2007.

Digital Library

[23]

Höst, M., Regnell, B. and Wohlin, C. Using Students as Subjects-A Comparative Study of Students and Professionals in Lead-Time Impact Assessment. Empirical Software Engineering, 5, 3I (2000), pp. 201--214.

Digital Library

[24]

Arisholm, E. and Sjoberg, D. I. K. Evaluating the Effect of a Delegated versus Centralized Control Style on the Maintainability of Object-Oriented Software. IEEE Transactions on Software Engineering, 30, 8I (2004), pp. 521--534.

Digital Library

[25]

Holt, R. W., Boehm-Davis, D. A. and Shultz, A. C. Mental Representations of Programs for Student and Professional Programmers. Ablex Publishing Corp., 1987.

[26]

Durr, P., Bergmans, L. and Aksit, M. A Controlled Experiment for the Assessment of Aspects - Tracing in an Industrial Context. University of Twente, CTIT, 2008.

[27]

Hanenberg, S., Kleinschmager, S. and Josupeit-Walter, M. Does aspect-oriented programming increase the development speed for crosscutting code? An empirical study. In Proceedings of the 2009 3rd International Symposium on Empirical Software Engineering and Measurement (2009). IEEE Computer Society.

Digital Library

[28]

Walker, R. J., Baniassad, E. L. A. and Murphy, G. C. An initial assessment of aspect-oriented programming. In Proceedings of the 21st international conference on Software engineering (Los Angeles, California, United States, 1999). ACM.

Digital Library

[29]

Bartsch, M. and Harrison, R. An exploratory study of the effect of aspect-oriented programming on maintainability. Software Quality Control, 16, 1I (2008), pp. 23--44.

Digital Library

[30]

Ferrari, F., Burrows, R., Lemos, v., Garcia, A., Figueiredo, E., Cacho, N., Lopes, F., Temudo, N., Silva, L., Soares, S., Rashid, A., Masiero, P., Batista, T. and Maldonado, J. An exploratory study of fault-proneness in evolving aspect-oriented programs. In Proceedings of the Proceedings of the 32nd ACM/IEEE International Conference on Software Engineering - Volume 1 (Cape Town, South Africa, 2010). ACM.

Digital Library

[31]

Farias, K., Garcia, A. and Whittle, J. Assessing the impact of aspects on model composition effort. In Proceedings of the Proceedings of the 9th International Conference on Aspect-Oriented Software Development (Rennes and Saint-Malo, France). ACM.

Digital Library

[32]

Carton, A., Driver, C., Jackson, A. and Clarke, S. Model-Driven Theme/UML. Springer-Verlag, 2009.

Digital Library

[33]

Hovsepyan, A., Scandariato, R., Baelen, S. V., Berbers, Y. and Joosen, W. From aspect-oriented models to aspect-oriented code?: the maintenance perspective. In Proceedings of the Proceedings of the 9th International Conference on Aspect-Oriented Software Development (Rennes and Saint-Malo, France). ACM.

Digital Library

Cited By

Yue TAli S(2014)A MOF-Based Framework for Defining Metrics to Measure the Quality of ModelsProceedings of the 10th European Conference on Modelling Foundations and Applications - Volume 856910.1007/978-3-319-09195-2_14(213-229)Online publication date: 21-Jul-2014
https://dl.acm.org/doi/10.1007/978-3-319-09195-2_14
Ali SYue TBriand L(2013)Assessing Quality and Effort of Applying Aspect State Machines for Robustness Testing: A Controlled Experiment2013 IEEE Sixth International Conference on Software Testing, Verification and Validation10.1109/ICST.2013.15(212-221)Online publication date: Mar-2013
https://doi.org/10.1109/ICST.2013.15
Mussbacher GAlam OAlhaj MAli SAmálio NBarn BBræk RClark TCombemale BCysneiros LFatima UFrance RGeorg GHorkoff JKienzle JLeite JLethbridge TLuckey MMoreira AMutz FOliveira APetriu DSchöttle MTroup LWerneck V(2012)Assessing composition in modeling approachesProceedings of the CMA 2012 Workshop10.1145/2459031.2459032(1-26)Online publication date: 30-Sep-2012
https://dl.acm.org/doi/10.1145/2459031.2459032
Show More Cited By

Index Terms

Comprehensively evaluating conformance error rates of applying aspect state machines
1. Software and its engineering

Recommendations

Studying the Understandability of Aspect State Machines through the Weaving Activity
APSEC '12: Proceedings of the 2012 19th Asia-Pacific Software Engineering Conference - Volume 01

Aspect-oriented Modeling (AOM) is a relatively recent, very active field of research and is assumed to yield several potential benefits such as enhanced modularization, easier evolution, increased reusability, and improved readability and ...
Does aspect-oriented modeling help improve the readability of UML state machines?

Aspect-oriented modeling (AOM) is a relatively recent and very active field of research, whose application has, however, been limited in practice. AOM is assumed to yield several potential benefits such as enhanced modularization, easier evolution, ...
Assessing Quality and Effort of Applying Aspect State Machines for Robustness Testing: A Controlled Experiment
ICST '13: Proceedings of the 2013 IEEE Sixth International Conference on Software Testing, Verification and Validation

Aspect-Oriented Modeling (AOM) has been the subject of intense research over the last decade and aims to provide numerous benefits to modeling, such as enhanced modularization, easier evolution, higher quality as well as reduced modeling effort. However,...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

AOSD '12: Proceedings of the 11th annual international conference on Aspect-oriented Software Development

March 2012

286 pages

ISBN:9781450310925

DOI:10.1145/2162049

Conference Chair:
Michael Haupt
Oracle Labs, Potsdam, Germany
,
General Chair:
Robert Hirschfeld
Hasso-Plattner-Institut, University of Potsdam, Germany
,
Program Chairs:
Éric Tanter
Universidad de Chile, Chile
,
Kevin J. Sullivan
University of Virginia, USA
,
Richard P. Gabriel
IBM Research, USA

Copyright © 2012 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

In-Cooperation

AOSA: Aspect-Oriented Software Association

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 25 March 2012

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

AOSD '12

Sponsor:

AOSD '12: Aspect-oriented Software Development

March 25 - 30, 2012

Potsdam, Germany

Acceptance Rates

AOSD '12 Paper Acceptance Rate 20 of 79 submissions, 25%;

Overall Acceptance Rate 41 of 139 submissions, 29%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

5
Total Citations
View Citations
155
Total Downloads

Downloads (Last 12 months)1
Downloads (Last 6 weeks)0

Reflects downloads up to 25 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Yue TAli S(2014)A MOF-Based Framework for Defining Metrics to Measure the Quality of ModelsProceedings of the 10th European Conference on Modelling Foundations and Applications - Volume 856910.1007/978-3-319-09195-2_14(213-229)Online publication date: 21-Jul-2014
https://dl.acm.org/doi/10.1007/978-3-319-09195-2_14
Ali SYue TBriand L(2013)Assessing Quality and Effort of Applying Aspect State Machines for Robustness Testing: A Controlled Experiment2013 IEEE Sixth International Conference on Software Testing, Verification and Validation10.1109/ICST.2013.15(212-221)Online publication date: Mar-2013
https://doi.org/10.1109/ICST.2013.15
Mussbacher GAlam OAlhaj MAli SAmálio NBarn BBræk RClark TCombemale BCysneiros LFatima UFrance RGeorg GHorkoff JKienzle JLeite JLethbridge TLuckey MMoreira AMutz FOliveira APetriu DSchöttle MTroup LWerneck V(2012)Assessing composition in modeling approachesProceedings of the CMA 2012 Workshop10.1145/2459031.2459032(1-26)Online publication date: 30-Sep-2012
https://dl.acm.org/doi/10.1145/2459031.2459032
Ali SYue TBriand LWalawege S(2012)A product line modeling and configuration methodology to support model-based testingProceedings of the 15th international conference on Model Driven Engineering Languages and Systems10.1007/978-3-642-33666-9_46(726-742)Online publication date: 30-Sep-2012
https://dl.acm.org/doi/10.1007/978-3-642-33666-9_46
Yue TAli S(2012)Bridging the gap between requirements and aspect state machines to support non-functional testingProceedings of the 8th European conference on Modelling Foundations and Applications10.1007/978-3-642-31491-9_12(133-145)Online publication date: 2-Jul-2012
https://dl.acm.org/doi/10.1007/978-3-642-31491-9_12

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten