Modelling the reliability of search and rescue operations with Bayesian Belief Networks

https://doi.org/10.1016/j.ress.2007.03.006Get rights and content

Abstract

This paper uses a Bayesian Belief Networks (BBN) methodology to model the reliability of Search And Rescue (SAR) operations within UK Coastguard (Maritime Rescue) coordination centres. This is an extension of earlier work, which investigated the rationale of the government's decision to close a number of coordination centres. The previous study made use of secondary data sources and employed a binary logistic regression methodology to support the analysis. This study focused on the collection of primary data through a structured elicitation process, which resulted in the construction of a BBN. The main findings of the study are that statistical analysis of secondary data can be used to complement BBNs. The former provided a more objective assessment of associations between variables, but was restricted in the level of detail that could be explicitly expressed within the model due to a lack of available data. The latter method provided a much more detailed model, but the validity of the numeric assessments was more questionable. Each method can be used to inform and defend the development of the other. The paper describes in detail the elicitation process employed to construct the BBN and reflects on the potential for bias.

Introduction

The UK government is concerned with improving the operational performance of the Maritime and Coastguard Agency (MCA). Since 1994, there have been a number of reviews of the effectiveness of Search And Rescue (SAR) operations coordinated by the MCA, culminating in the decision in 1999 to close a number of the Maritime Rescue coordination centres. However, there appears to have been a distinct lack of formal analysis to justify this decision.

The aim of this research is to conduct a formal analysis of the Coastguard SAR service in order to identify the key factors that influence its effectiveness and to provide a way of measuring this influence. An earlier study had been conducted with this aim, which made use of publicly available secondary data (in the form of annual Incident Statistics) and developed a binary logistic regression model to support the assessment [1]. The findings of this previous study highlighted the importance of explanatory variables such as the size or scale of incidents, staff workload and the length of coastline monitored by each coordination centre. Such variables may be interpreted as providing rather crude composite indicators for the multitude of factors that determine the effectiveness of this kind of complex operational system. The contribution of the present study is to support a more detailed explanation of the relationship between the reliability of SAR operations and identifiable causal factors.

In Section 2, we present a summary of background research. First, we present a summary of recent events relating to the UK Maritime and Coastguard Agency that provided the motivation for this research; and second, we present a summary of relevant research literature on maritime risk. In Section 3, we present a summary of our analysis of the available secondary data. This analysis is conducted at a crude aggregate level, but highlights some significant characteristics associated with better-performing centres. In Section 4, we describe the Bayesian Belief Network (BBN) that we obtained and reflect on the process of eliciting subjective probabilities. In Section 5, we conclude by reflecting on the synergies between statistical modelling and BBNs, whereby the former supports the validation of the latter and the latter provides a causal description of the associations identified in the former.

Section snippets

Background

Within this section, we provide a brief overview of the UK Maritime and Coastguard Agency as related to this research project; and in Section 2.2 we provide a brief summary of research conducted on maritime risk issues.

Secondary data analysis

This section will present a summary of the analysis conducted on the available secondary data. The original study by Van der Meer et al. [1] was based on data for the period 1995–1999; the present study uses data for the period 1995–2004. We explore the data through contingency tables, which can then form the basis for an empirical BBN. In Section 3.2, we shall provide a discussion of the shortcomings of the data and the implications for inference.

Elicitation of BBN

Within this section BBNs are briefly described, followed by the description of the elicitation process undertaken to develop the BBN for this situation. The final model is shown along with a reflection on the process of elicitation.

Summary and future work

The BBN analysis concerning environmental factors identified several other factors that the UK Coastguard do not officially measure. However, captured within the BBN are variables related to staff workload, local knowledge and size and severity of incidents that are consistent with the statistical analysis described in Section 3.

The process of constructing the BBN resulted in a deeper understanding of validity (and lack thereof) of the surrogate measures used with the secondary data analysis.

Cited by (82)

  • Emergency response in cascading scenarios triggered by natural events

    2024, Reliability Engineering and System Safety
View all citing articles on Scopus
View full text