Abstract
The implementation of the INSPIRE directive requires to check the conformity of a large number of network services with the implementing rules of INSPIRE. The evaluation whether a service is fully conformant with INSPIRE is complex and requires the use of specialized testing tools that should report how verification has been made and should identify non-conformances. The use of these tools requires a high degree of technical knowledge. This fact makes very difficult for non-technical stakeholders (end users, managers, domain experts, etc.) to participate effectively in conformance testing, hinders stakeholders understanding of the causes and consequences of non-conformant results and may cause in some stakeholders disinterest in conformance testing. This work explores the suitability of a behaviour-driven development (BDD) approach to the conformance testing of OGC Web services in the context of the INSPIRE directive. BDD emphasizes the participation of non-technical parties in the design of acceptance tests by means of automatable abstract tests expressed in a human readable format. Using this idea as base, this work describes a BDD based workflow to derive abstract test suites and executable test suites from INSPIRE implementation requirements that can be written in the language used by non-technical stakeholders. This work also analyses if BDD and popular BDD tools, such as Gherkin and Cucumber, are compatible with ISO 19105:2000 testing methodology. As demonstration, we present an online conformance tool for INSPIRE View and Discovery services that executes BDD test suites.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
Properly speaking, the Gherkin language is the ubiquitous language understood by the Cucumber and Behat test execution tools.
- 2.
We assume in this section that the behavior model will be written in plain English although the Gherkin language supported by Cucumber and Behat provides keywords for more than 40 languages.
- 3.
Popular BDD tools, such as Cucumber, do not distinguish semantically among these steps. This behavior has practical, strong implications discussed in next sections.
- 4.
This system is planned to be publicly available at IDEE, the SDI of Spain. At the moment of the writing, the access to the development version is restricted. Readers can request the corresponding author access to the service.
References
Bermudez L, Bacharach S (2013) Compliance testing program policies and procedures. Open Geospatial Consortium, Wayland
Bernard L, Kanellopoulos I, Annoni A, Smits P (2005) The European geoportal–one step towards the establishment of a European Spatial Data Infrastructure. Comput Environ Urban 29:15–31. doi:10.1016/j.compenvurbsys.2004.05.009
Bertolino A (2007) Software testing research: achievements, challenges, dreams. Future of software enginnering (FOSE’07), Minneapolis, 23–25 May 2007. doi:10.1109/FOSE.2007.25
Bozkurt M, Harman M, Hassoun Y (2013) Testing and verification in service-oriented architecture: a survey. Softw Test Verif Reliab 23:261–313. doi:10.1002/stvr.1470
Canfora G, Di Penta M (2009) Service-oriented architectures testing: a survey. In: De Lucia A, Ferrucci F (eds) Software engineering. Springer, Berlin, pp 78–105
Chartier B (2011) Vos services WMS sont-ils INSPIREd? In: Neogeo technologies. http://www.neogeo-online.net/blog/archives/1331/. Accessed 3 Dec 2013
Chelimsky D, Astels D, Dennis Z, Helmkamp B, Hellesøy A, North D (2010) The RSpec book. The Pragmatic Bookshelf, Dallas
Corriveau J-P, Shi W (2013) On acceptance testing. International conference on software engineering research and practice (SERP 2013), Las Vegas, 22–25 July 2013
Esbrí MÁ, Gould M, López ML (2004) Conformance Test Engines for quality assurance of INSPIRE Services. 10th EC-GI&GIS Workshop, Warsaw, 23–25 June 2004
European Commission (2013) Guidance documents. In: Network services: legislation. http://inspire.jrc.ec.europa.eu/index.cfm/pageid/5. Accessed 4 Dec 2013
Evans E (2003) Domain-driven design. Addison-Wesley Professional, Boston
Giuliani G, Dubois A, Lacroix P (2013) Testing OGC web feature and coverage service performance: towards an efficient access to geospatial data. J Spat Inf Sci (In press). doi:10.5311/JOSIS.2013.7.112
Gray M, Goldfine A, Rosenthal L, Carnahan L (2010) Conformance testing. In: Information technology laboratory, NIST. http://www.nist.gov/itl/ssd/is/conformancetesting.cfm. Accessed 4 Dec 2013
Hogrebe D (2012) GDI-DE Testsuite. Improving interoperability. INSPIRE Conference, Istanbul, 23–27 June 2012
Horák J, Ardielli J, R\(\mathop {\rm {u}}\limits ^{\circ }\)žička J, (2011) Performance testing of web map services. In: Nguyen N, Trawiński B, Jung J (eds) New challenges for intelligent information and database systems. Springer, Berlin, pp 257–266
ISO, TC 211, (2000) ISO 19105:2000—Geographic information—conformance and testing. Switzerland, Geneva
JRC IES/SDI Unit (2011) INSPIRE geoportal metadata validator. In: INSPIRE geoportal. http://inspire-geoportal.ec.europa.eu/validator2/. Accessed 4 Apr 2013
Kliment T, Tuchyňa M, Kliment M (2012) Methodology for conformance testing of spatial data infrastructure components including an example of its implementation in Slovakia. Slovak J Civil Eng XX:10–20, doi:10.2478/v10189-012-0002-y
Kresse W, Fadaie K (2004) ISO standards for geographic information. Springer, Berlin
Lerner RM (2010) At the forge: cucumber. Linux J 2010:7
Martirano G (2013) The eENVplus approach for data harmonization and validation. eENVplus workshop, INSPIRE conference, Florence, 24 Jun 2013
Nebert D, Reed C, Wagner RM (2007) Proposal for a spatial data infrastructure standards suite: SDI 1.0. In: Onsrud H (ed) Research and theory in advancing spatial data infrastructure concepts. ESRI Press, Redlands, pp 147–159
Nogueras-Iso J, Latre MA, Béjar R, Muro-Medrano PR, Zarazaga-Soria FJ (2012) A model driven approach for the development of metadata editors, applicability to the annotation of geographic information resources. Data Knowl Eng 81–82:118–139. doi:10.1016/j.datak.2012.09.001
North D (2007) Introducing behaviour driven development. In: Dan North & Associates. http://dannorth.net/introducing-bdd/. Accessed 25 Nov 2013
Östman A (2010) Network for testing GI services. GIS Ostrava, Ostrava
Solis C, Wang X (2011) A study of the characteristics of behaviour driven development. 37th EUROMICRO conference on software engineering and advanced applications (SEAA), Oulu, 20 Aug–2 Sept 2011. doi:10.1109/SEAA.2011.76
Utting M, Legeard B (2010) Practical model-based testing. Morgan Kaufmann, San Francisco
Veanes M, Campbell C, Grieskamp W, Schulte W, Tillmann N, Nachmanson L (2008) Model-based testing of object-oriented reactive systems with spec explorer. In: Hierons RM, Bowen JP, Harman M (eds) Formal methods and testing. Springer, Berlin, pp 39–76
Wynne M, Hellesøy A (2012) The cucumber book: behaviour-driven development for testers and developers. The Pragmatic Bookshelf, Dallas
Acknowledgments
This work has been partially supported by the Spanish Government (project TIN2012-37826-C02-01), the National Geographic Institute (IGN) of Spain and GeoSLab, S.L.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer International Publishing Switzerland
About this chapter
Cite this chapter
Lopez-Pellicer, F.J., Latre, M.Á., Nogueras-Iso, J., Zarazaga-Soria, F.J., Barrera, J. (2014). Behaviour-Driven Development Applied to the Conformance Testing of INSPIRE Web Services. In: Huerta, J., Schade, S., Granell, C. (eds) Connecting a Digital Europe Through Location and Place. Lecture Notes in Geoinformation and Cartography. Springer, Cham. https://doi.org/10.1007/978-3-319-03611-3_19
Download citation
DOI: https://doi.org/10.1007/978-3-319-03611-3_19
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-03610-6
Online ISBN: 978-3-319-03611-3
eBook Packages: Earth and Environmental ScienceEarth and Environmental Science (R0)