Skip to main content

Matching Context Aware Software Testing Design Techniques to ISO/IEC/IEEE 29119

  • Conference paper
  • First Online:
Software Process Improvement and Capability Determination (SPICE 2015)

Abstract

A software system is context aware when it uses contextual information to help actors (users or other systems) to achieve their tasks. Testing this type of software can be a challenge since context and its variabilities cannot be controlled by the software tester. The ISO/IEC/IEEE 29119 intended to cover testing of any software system. It provides a common language and process for testing software systems, including a categorization of conventional testing techniques. This paper contains the initial results of our ongoing efforts to understand the testing of context aware software, Specifically, we evaluate whether the observed techniques for testing context aware software can be matched against the ISO/IEC/IEEE 29119 categories or if they represent a new breed of testing techniques. The results indicate that using conventional techniques variations to test context aware software systems does not produce evidence on their feasibility to test the context awareness features in such systems.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Software and systems engineering Software testing Part 1:Concepts and definitions. ISO/IEC/IEEE 29119-1:2013. 1–64 (2013)

    Google Scholar 

  2. Malik, N., Mahmud, U., Javed, Y.: Future challenges in context-aware computing. In: Proc. IADIS Int. Conf. 306–310 (2007)

    Google Scholar 

  3. Rodrigues, F., Matalonga, S., Travassos, G.H.: Systematic literature review protocol: Investigating context aware software testing strategies.Rio de Janeiro (2014) www.cos.ufrj.br/~ght/cactus_pr012014.pdf

  4. Travassos, G.H., Santos, P.S.M. dos, Mian, P.G., Neto, A.C.D., Biolchini, J.: An Environment to Support Large Scale Experimentation in Software Engineering. In: 13th IEEE International Conference on Engineering of Complex Computer Systems (ICECCS 2008), pp. 193–202. IEEE (2008)

    Google Scholar 

  5. Pai, M., Mcculloch, M., Gorman, J.D., Pai, N., Enanoria, W., Kennedy, G., Tharyan, P., Colford Jr, J.M., Colford, J.M.: Systematic reviews and meta-analyses: an illustrated, step-by-step guide. Natl. Med. J. India 17, 86–95 (2004)

    Google Scholar 

  6. Alsos, O.A., Dahl, Y.: Toward a best practice for laboratory-based usability evaluations of mobile ICT for hospitals. In: Proc. 5th Nord. Conf. Human-computer Interact. Build. Bridg. – Nord, 3 (2008)

    Google Scholar 

  7. Amalfitano, D., Fasolino, A.R., Tramontana, P., Amatucci, N.: Considering Context Events in Event-Based Testing of Mobile Applications. In: 2013 IEEE Sixth International Conference on Software Testing, Verification and Validation Workshops, pp. 126–133 (2013)

    Google Scholar 

  8. Jiang, B., Long, X., Gao, X.: MobileTest: A tool supporting automatic black box test for software on smart mobile devices. In: Proceedings of the International Conference on Software Engineering (2007)

    Google Scholar 

  9. Canfora, G., Mercaldo, F., Visaggio, C.A., D’Angelo, M., Furno, A., Manganelli, C.: A case study of automating user experience-oriented performance testing on smartphones. In: Proceedings of the IEEE 6th International Conference on Software Testing, Verification and Validation, ICST 2013. pp. 66–69 (2013)

    Google Scholar 

  10. Lu, H., Chan, W.K., Tse, T.H.: Testing context-aware middleware-centric programs. In: Proceedings of the 14th ACM SIGSOFT International Symposium on Foundations of Software Engineering, SIGSOFT 2006/FSE-14. p. 242. ACM Press, New York (2006)

    Google Scholar 

  11. Merdes, M., Malaka, R., Suliman, D., Paech, B., Brenner, D., Atkinson, C.: Ubiquitous RATs: How Resource-Aware Run-Time Tests Can Improve Ubiquitous Software System. In: 6th International Workshop on Software Engineering and Middleware, SEM 2006, pp. 55–62 (2006)

    Google Scholar 

  12. Ryan, C., Gonsalves, A.: The effect of context and application type on mobile usability: An empirical study. In: Conferences in Research and Practice in Information Technology Series, pp. 115–124 (2005)

    Google Scholar 

  13. Satoh, I.: Software testing for mobile and ubiquitous computing. In: The Sixth International Symposium on Autonomous Decentralized Systems, ISADS 2003 (2003)

    Google Scholar 

  14. She, S., Sivapalan, S., Warren, I.: Hermes: A tool for testing mobile device applications. In: Proceedings of the Australian Software Engineering Conference, ASWEC, pp. 121–130 (2009)

    Google Scholar 

  15. Tse, T.H., Yau, S.S.: Testing context-sensitive middleware-based software applications. In: Proceedings of the 28th Annual International Computer Software and Applications Conference, COMPSAC 2004, pp. 458–466. IEEE (2004)

    Google Scholar 

  16. Wang, H., Chan, W.K.: Weaving Context Sensitivity into Test Suite Construction. In: 2009 IEEE/ACM International Conference on Automated Software Engineering, pp. 610–614. IEEE, Auckland (2009)

    Google Scholar 

  17. Software and systems engineering Software testing Part 2:Test processes. ISO/IEC/IEEE 29119-3:2013(E). 1–138 (2013)

    Google Scholar 

  18. IEEE Draft International Standard for Software and Systems Engineering–Software Testing–Part 4: Test Techniques. ISO/IEC/IEEE P29119-4-DISMay2013. 1–132 (2014)

    Google Scholar 

  19. Systems and software engineering – Systems and software Quality Requirements and Evaluation (SQuaRE) – System and software quality models. ISO/IEC 25010:2011. 1–34 (2011)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Santiago Matalonga .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2015 Springer International Publishing Switzerland

About this paper

Cite this paper

Matalonga, S., Rodrigues, F., Travassos, G.H. (2015). Matching Context Aware Software Testing Design Techniques to ISO/IEC/IEEE 29119. In: Rout, T., O’Connor, R., Dorling, A. (eds) Software Process Improvement and Capability Determination. SPICE 2015. Communications in Computer and Information Science, vol 526. Springer, Cham. https://doi.org/10.1007/978-3-319-19860-6_4

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-19860-6_4

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-19859-0

  • Online ISBN: 978-3-319-19860-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics