Elsevier

Environmental Modelling & Software

Volume 84, October 2016, Pages 193-209
Environmental Modelling & Software

A decision support system for updating and incorporating climate change impacts into rainfall intensity-duration-frequency curves: Review of the stakeholder involvement process

https://doi.org/10.1016/j.envsoft.2016.06.012Get rights and content

Highlights

  • This paper reviews stakeholder involvement in the development of a DSS concerning climate change impacts on IDF curves.

  • The DSS project reflected the nature of a “knowledge mobilization” funding mechanism, emphasising practical tool development.

  • The stakeholder involvement process incorporated recommended practices and principles identified in the DSS literature.

  • While generally successful, limited funding constrained stakeholder representativeness and long-term involvement.

Abstract

Stakeholder involvement can serve to increase the quality of decision support systems (DSSs) and increase the perceived legitimacy of DSS outputs. Involving those who are ultimately affected by the outputs of DSSs in system design and development also reflects democratic principles. Importantly, stakeholder involvement can help ensure that the outputs of DSSs are used in decision-making processes. However, DSSs often fail due to poor engagement of stakeholder and end-user communities in the development and design of systems. The stakeholder engagement process applied in the development of the Computerized Tool for the Development of Intensity Duration Frequency Curves under Climate Change described here followed many of the tenants of best practices identified in the literature. While the engagement strategy was generally considered successful, over- and under-representation of some stakeholder groups and long term funding issues were weaknesses in the engagement process.

Introduction

Environment and water management-related Decision Support Systems (DSSs) and related computer-based information systems frequently experience low uptake (Diez and McIntosh, 2009, Dragan et al., 2003, Giupponi et al., 2007, McCown, 2002, McIntosh et al., 2005, Ochola and Kerkides, 2004, Oliver et al., 2012, Van Delden et al., 2011). McIntosh et al. (2011: 1394) argued the main challenge associated with uptake of DSSs by end-users includes the “… quantity, quality and appropriateness” of the involvement of end-users in the DSS development process. Conversely, many authors have identified improved stakeholder engagement as a means of increasing the uptake and application of computer-based systems, including environmental models, computer-based information systems and decision support systems (DSSs) (Baroudi et al., 1986, Diez and McIntosh, 2009, Oxley et al., 2004).

There are numerous reported benefits of the involvement of a variety of stakeholders in the development of DSSs (Diez and McIntosh, 2009, Fiorino, 1990, McIntosh et al., 2011, Oliver et al., 2012). Through participation in the development processes, users are able to affect design of systems to satisfy their needs, develop a sense of ownership, and develop an understanding of how systems can assist them in their work (Barki and Hartwick, 1994). Local stakeholders are likely to have a better understanding of the implications of certain DSS outputs at the local scale (Voinov and Bousquet, 2010). Further, stakeholders are often “… more likely to be listened to than the scientists who may be perceived as foreign to the problem or the locality” (Voinov and Bousquet, 2010: 1277), increasing the likelihood that DSSs will be used in local decision-making. Involving individuals in the design of systems and decisions that affect them is also viewed as reflecting democratic values (Korfmacher, 2001, Pretty, 1995), as individuals have a right to be involved in the design of systems and decisions that will ultimately have a direct impact on them (Oliver et al., 2012).

Despite the value and importance of stakeholder participation in DSS development, stakeholders are often not effectively involved in development processes. Reasons for limited involvement include lack of stakeholder engagement strategies, lack of funding for stakeholder involvement, improperly defining the scope of stakeholder involvement at the beginning of a project, improperly defining relevant stakeholder groups, mismatches in scale with respect to funding organizations (which may be national) and implementation (typically local scale), defining and involving stakeholders late in the development process, among other barriers (McIntosh et al., 2011, Quinn, 2010).

This paper reviews and critiques the stakeholder engagement process used to support the development of the Computerized Tool for the Development of Intensity Duration Frequency Curves under Climate Change (hereafter referred to as the IDFCC tool). The IDFCC tool is a DSS designed to assist local water management professionals in the updating and adjustment of rainfall intensity-duration-frequency (IDF) curves to account for the potential impacts of climate change on extreme rainfall regimes in Canada. The IDFCC tool was developed to increase the capacity of local water managers to integrate climate change impacts into infrastructure planning, design, operations and maintenance decisions through increasing the availability and applicability of Global Climate Model (GCM) outputs. The tool was designed to be user-friendly, was published on the Internet and is freely accessible to any member of the public. Stakeholder involvement was a key component of the design of the tool.

Part 2 describes the purpose and background of the IDFCC tool, including a description of rainfall IDF curves, their use, and the need for climate change affected IDF curve information in Canada. Part 2 also provides an overview of the IDFCC tool and its user interface. In Part 3, a review of the context and practice of stakeholder involvement in DSS development is provided. Part 4 provides methods for inclusion of stakeholders in the development of the IDFCC tool, and Part 5 provides a discussion of results of the involvement process.

Section snippets

IDFCC tool: purpose and background

Rainfall IDF curve information describes the frequency of extreme rainfall events for a variety of durations and intensities (see Fig. 1). Rainfall IDF curves are used for a number of water management applications in Canada, including the design of major and minor stormwater management systems, sewers, detention ponds, culverts, bridges, dams, pumping stations, roads, and master drainage planning, among other applications (CSA (Canadian Standards Association), 2012, Watt and Marsalek, 2013).

A

Context

Involvement of a variety of stakeholders in the development of complicated environmental modelling and decision support systems, including the public and experts as well as executives and managers that may use these tools in the formulation of management decisions, has been of growing interest to the modelling community, starting as early as the 1960s (Sprague, 1980, Voinov and Bousquet, 2010). It has been established that user involvement can improve system quality, usage, user attitudes and

IDFCC tool stakeholder engagement process: methods

Two factors affected the stakeholder engagement process for the IDFCC tool. These included the tool's emphasis on the intelligence phase of decision-making, and the characteristics of the “knowledge mobilization” orientation of the funding mechanism.

Simon (1960, cited in McIntosh et al., 2011) differentiated between three phases of organizational decision-making. These included intelligence (identifying a need for change), design (development of alternative strategies) and a process of

Early, in-depth collaboration

Major themes identified in early, in-depth collaboration are provided in Table 8. A focus of concern of early collaborations was the potential sensitivities of increasing public access to locally relevant climate change impacts information. Specifically, collaborators expressed concern that external groups may use the tool to challenge climate change adaptation and risk management decisions made by municipalities. Collaborators were concerned that non-technical individuals might attempt to

Conclusion

This paper reviewed the successes and weaknesses of the stakeholder engagement process for the development of the IDFCC tool. The IDFCC tool development team considered engagement process successful. The end result was a highly accessible, useable and useful DSS for municipal water management professionals that served an identified need. Indeed, at the time of writing, there were 373 registered IDFCC tool users from across Canada and representing multiple sectors.

As discussed by Voinov and

Acknowledgements

Funding provided by the Canadian Water Network and the Institute for Catastrophic Loss Reduction for the development of this project was greatly appreciated. Early input provided by several municipal water management professionals from the cities of Toronto and Hamilton, notably David Kellershohn and Nahed Ghbn, was invaluable. Assistance provided by the Insurance Bureau of Canada was also appreciated. Finally, the authors would like to thank the professionals who attended the workshops and

References (80)

  • B.S. Mcintosh et al.

    Bridging the gaps between design and use: developing tools to support environmental management and policy

  • W.O. Ochola et al.

    An integrated indicator-based spatial decision support system for land quality assessment in Kenya

    Comput. Electron. Agric.

    (2004)
  • D. Oliver et al.

    Valuing local knowledge as a source of expert data: farmer engagement and the design of decision support systems

    Environ. Model. Softw.

    (2012)
  • J.N. Pretty

    Participatory learning for sustainable agriculture

    World Dev.

    (1995)
  • S. Sieber et al.

    Evaluating the characteristics of a non-standardised model requirements analysis (MRA) for the development of policy impact assessment tools

    Environ. Model. Softw.

    (2013)
  • M. Srite et al.

    Effects of individuals' psychological states on their satisfaction with the GSS process

    Inf. Manag.

    (2007)
  • H. Van Delden et al.

    A methodology for the design and development of integrated models for policy support

    Environ. Model. Softw.

    (2011)
  • A. Voinov et al.

    Modelling with stakeholders—next generation

    Environ. Model. Softw.

    (2016)
  • A. Voinov et al.

    Modelling with stakeholders

    Environ. Model. Softw.

    (2010)
  • A. Voinov et al.

    Lessons for successful participatory watershed modelling: a perspective from modelling practitioners

    Ecol. Model.

    (2008)
  • B.J. Adams et al.

    Design storm pathology

    Can. Water Resour. J.

    (1986)
  • O. Barreteau et al.

    A framework for clarifying participation in participatory research to prevent its rejection for the wrong reasons

    Ecol. Soc.

    (2010)
  • H. Barki et al.

    Measuring user participation, user involvement and user attitude

    MIS Q. March

    (1994)
  • J. Baroudi et al.

    An empirical study of the impact of user involvement on system usage and information satisfaction

    Commun. ACM

    (1986)
  • T.C. Beirele et al.

    Democracy in Practice: Public Participation in Environmental Decisions

    (2002)
  • British Columbia Ministry of Environment

    Preparing for Climate Change: British Columbia's Adaptation Strategy

    (2010)
  • E.J. Bush et al.
  • J. Carmin et al.

    Progress and Challenges in Urban Climate Adaptation Planning: Results of a Global Survey

    (2012)
  • L. Cheng et al.

    Nonstationary precipitation intensity-Duration-Frequency curves for infrastructure design in a changing climate

    Sci. Rep.

    (2014)
  • City of Vancouver

    Climate Change Adaptation Strategy

    (2012)
  • City of Windsor

    Climate Change Adaptation Plan

    (2012)
  • P. Crabbe et al.

    Institutional adaptation of water resource infrastructures to climate change in eastern Ontario

    Clim. Change

    (2006)
  • CSA (Canadian Standards Association)

    Development, Interpretation and Use of Rainfall Intensity-duration-frequency (IDF) Information: Guideline for Canadian Water Resources Practitioners. Technical Guide

    (2012)
  • U. Cubasch et al.

    Introduction

  • J.L. de Kok et al.

    From design to application of a decision-support system for integrated river-basin management

    Water Resour. Manag.

    (2009)
  • D. Engi et al.

    The Vital Issues Process: Strategic Planning for a Changing World

    (May 1995)
  • Environmental Commissioner of Ontario

    Connecting the Dots on Climate Data in Ontario

    (2015)
  • Environmental Commissioner of Ontario

    Sink, Swim or Tread Water: Adapting Infrastructure to Extreme Weather Events

    (2014)
  • Environment Canada

    Short Duration Rainfall Intensity-duration-frequency Data

    (2015)
  • Environment Canada

    Climate Trends and Variations Bulletin

    (2013)
  • Cited by (38)

    • Human-centered flood mapping and intelligent routing through augmenting flood gauge data with crowdsourced street photos

      2022, Advanced Engineering Informatics
      Citation Excerpt :

      The system uses paired pre- and post-flood stop sign photos to estimate the depth of floodwater, and consequently uses this information to carry out risk-informed route optimization. To effectively incorporate user input into technology design and validation, we first conducted a needs assessment survey in local communities in Houston and Galveston, Texas, that are among the most vulnerable to flood risk in the U.S. Stakeholder involvement ensures that the designed technology and tools have a high degree of practicality among intended users [88], while also helping improve the quality, functionality, and ease of use of the developed tools, resulting in increased user satisfaction of the research outcomes [89]. Survey respondents were recruited using snowball sampling by sharing the survey link with several community partners and distributing the survey on social media, university email lists, and local outlets.

    • Regional-scale modeling of rainfall-induced landslides under random rainfall patterns

      2022, Environmental Modelling and Software
      Citation Excerpt :

      Rainfall-induced landslides are a common geological hazard worldwide (An et al., 2016; Wang et al., 2020; Guo et al., 2022). With global climate change in recent years, rainfall events have increased in intensity (Dehn et al., 2000; Dore, 2005; Sandink et al., 2016; Kristo et al., 2017). Consequently, this may affect the stability of natural and artificial slopes (Dixon and Brook, 2007), and cause landslides in the future (Crozier, 2010; Dijkstra and Dixon, 2010; Damiano and Mercogliano, 2013; Chaithong et al., 2017; Komori et al., 2018).

    View all citing articles on Scopus
    View full text