research-article

Re-architecture of Contiki and Cooja Regression Test Suites using Combinatorial Testing Approach

Authors:

Abhinandan H. Patil,

Krishnan RangarajanAuthors Info & Claims

ACM SIGSOFT Software Engineering Notes, Volume 40, Issue 2

Pages 1 - 3

https://doi.org/10.1145/2735399.2735413

Published: 03 April 2015 Publication History

Abstract

In this paper, we describe how combinatorial testing can be applied to re-architecture Contiki and Cooja regression test suites. Contiki is the popular and widely accepted internet of things operating system. Combinatorial testing was pioneered by National Institute of Standards and Technology. National Institute of Standards and Technology offers a set of tools to public. One such tool is Automated Combinatorial Testing for Software. We describe how Automated Combinatorial Testing for Software can be used to generate a complete test suite for Contiki and Cooja. Coverage of base test suite is gathered using CodeCover, a code coverage tool for Java. The low percentage of coverage in Cooja indicated the need for a redesign of test suite. Once the base regression test suite is modified using Combinatorial Testing approach, it can be the new base regression test suite.

References

[1]

D. Richard Kuhn, Raghu N. Kacker and Yu Lei 2013. Introduction to combinatorial testing, Text book.

Digital Library

[2]

D. Richard Kuhn, Raghu N. Kacker and Yu Lei 2013. Practical combinatorial testing manual, NIST special publications 800-142.

[3]

NIST, http://csrc.nist.gov/groups/SNS/acts/index.html

[4]

Contiki Operating System, http://www.contiki-os.org/

[5]

Contiki supported hardware platforms, http://www.contikios.org/hardware.html

[6]

CodeCover, http://codecover.org/

[7]

C Nie et al, A survey of combinatorial testing, ACM Computing Surveys, Vol. 43, No. 2, Article 11, Publication date: January 2011.

Digital Library

[8]

Abhinandan H. Patil, Nandini S. Sidnal. CodeCover: A CodeCoverage tool for JAVA Projects in ERCICA, Elsevier publications-2013.

[9]

P. Ammann, P.E. Black, Abstracting Formal Specifications to Generate Software Tests via Model Checking, Proc. 18th Digital Avionics Systems Conference, Oct.1999, IEEE, vol. 2. pp. 10.A.6.1-10

[10]

P. Ammann, J. Offutt, Introduction to Software Testing, Cambridge University Press, New York, 2008.

Digital Library

[11]

J. Bach, P. Shroeder, Pairwise Testing - A Best Practice That Isn't. Proceedings of 22nd Pacific Northwest Software Quality Conference, 2004, pp. 180--196

[12]

L. Baresi, M. Young, Test Oracles, Dept. of Computer and Information Science,Univ. of Oregon, 2001. http://www.cs.uoregon.edu/michal/pubs/oracles.html

[13]

B. Beizer, Software Testing Techniques, Van Nostrand Reinhold, New York, 2nd edition, 1990.

Digital Library

[14]

Introducing Combinatorial Testing in Large Organizations, ASTQB, Mar 2014

[15]

Evaluating the t-way Technique for Determining the Thoroughness of a Test Suite, NASA IV&V Workshop, Sept. 2013.

[16]

Combinatorial coverage measurement NASA IV&V Workshop Sept 11-13, 2012.

[17]

Combinatorial Methods for Event Sequence Testing, D.R. Kuhn, J. Higdon, J. Lawrence, R.N. Kacker and Y. Lei, FIrst Intl Workshop on combinatorial Testing, April, 2012.

Digital Library

[18]

Combinatorial Testing of ACTS: A Case Study, M. Nouroz Borazjany, L. Yu, Y. Lei, R.N. Kacker and D.R. Kuhn

[19]

Y. Lei, "IPOG -- A General Strategy for t-Way Software Testing", IEEE Engineering of Computer Based Systems conference, 2007.- describes generalized IPO algorithm for constructing t-way covering arrays.

Digital Library

Cited By

Bakar MJamal A(2021)Determination of Suitable Resource Discovery Tool and Methodology for High-Volume Internet of Things (IoT)Journal of Physics: Conference Series10.1088/1742-6596/1874/1/0120461874:1(012046)Online publication date: 1-May-2021
https://doi.org/10.1088/1742-6596/1874/1/012046
H. Patil AGoveas NRangarajan K(2015)Test Suite Design Methodology Using Combinatorial Approach for Internet of Things Operating SystemsJournal of Software Engineering and Applications10.4236/jsea.2015.8703108:07(303-312)Online publication date: 2015
https://doi.org/10.4236/jsea.2015.87031

Index Terms

Re-architecture of Contiki and Cooja Regression Test Suites using Combinatorial Testing Approach
1. Software and its engineering
  1. Software creation and management
    1. Software verification and validation
      1. Software defect analysis
        Software testing and debugging
  2. Software organization and properties
    1. Software system structures
      1. Software architectures

Recommendations

Prioritizing random combinatorial test suites
SAC '17: Proceedings of the Symposium on Applied Computing

The behaviour of a system under test can be influenced by several factors, such as system configurations, user inputs, and so on. It has also been observed that many failures are caused by only a small number of factors. Combinatorial testing aims at ...
Comparing non-adequate test suites using coverage criteria
ISSTA 2013: Proceedings of the 2013 International Symposium on Software Testing and Analysis

A fundamental question in software testing research is how to compare test suites, often as a means for comparing test-generation techniques. Researchers frequently compare test suites by measuring their coverage. A coverage criterion C provides a set ...
Using coverage criteria on RepOK to reduce bounded-exhaustive test suites
TAP'12: Proceedings of the 6th international conference on Tests and Proofs

Bounded-exhaustive exploration of test case candidates is a commonly employed approach for test generation in some contexts. Even when small bounds are used for test generation, executing the obtained tests may become prohibitive, despite the time for ...

Comments

Information & Contributors

Information

Published In

cover image ACM SIGSOFT Software Engineering Notes

ACM SIGSOFT Software Engineering Notes Volume 40, Issue 2

March 2015

125 pages

ISSN:0163-5948

DOI:10.1145/2735399

Editor:
Michael Wing

Issue’s Table of Contents

Copyright © 2015 Authors.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 03 April 2015

Published in SIGSOFT Volume 40, Issue 2

Check for updates

Author Tags

Qualifiers

Research-article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
185
Total Downloads

Downloads (Last 12 months)2
Downloads (Last 6 weeks)0

Reflects downloads up to 08 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Bakar MJamal A(2021)Determination of Suitable Resource Discovery Tool and Methodology for High-Volume Internet of Things (IoT)Journal of Physics: Conference Series10.1088/1742-6596/1874/1/0120461874:1(012046)Online publication date: 1-May-2021
https://doi.org/10.1088/1742-6596/1874/1/012046
H. Patil AGoveas NRangarajan K(2015)Test Suite Design Methodology Using Combinatorial Approach for Internet of Things Operating SystemsJournal of Software Engineering and Applications10.4236/jsea.2015.8703108:07(303-312)Online publication date: 2015
https://doi.org/10.4236/jsea.2015.87031

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Issue’s Table of Contents