Partitioning total variance in risk assessment: Application to a municipal solid waste incinerator

https://doi.org/10.1016/j.envsoft.2008.06.012Get rights and content

Abstract

Comprehensive health risk assessment based on aggregate exposure and cumulative risk calculations requires a better understanding of exposure variables and uncertainty associated with them. Although there are many sources of uncertainty in system models, two basic kinds of parametric uncertainty are fundamentally different from each other: natural/stochastic and epistemic uncertainties. However, conventional methods such as standard Monte Carlo Sampling (MCS), which assumes vagueness as random property, may not be suitable for this type of uncertainty analysis. An improved systematic uncertainty and variability analysis can provide insight into the level of confidence in model estimates, and it can aid in assessing how various possible model estimates should be weighed. The main goal of the present study was to introduce Fuzzy Latin Hypercube Sampling (FLHS), a hybrid approach for incorporating epistemic and stochastic uncertainties separately. An important property of this technique is its ability to merge inexact generated data of the LHS approach to increase the quality of information. The FLHS technique ensures that the entire range of each variable is sampled with proper incorporation of uncertainty and variability. A fuzzified statistical summary of the model results produces a detailed sensitivity analysis, which relates the effects of variability and uncertainty of input variables to model predictions. The feasibility of the method has been tested with a case study, analyzing total variance in the calculation of incremental lifetime risks due to polychlorinated dibenzo-p-dioxins and dibenzofurans (PCDD/Fs) for the residents living in the surroundings of a municipal solid waste incinerator (MSWI) in the Basque Country, Spain.

Introduction

Recent health risk assessment studies often consider aggregate exposure and cumulative risk calculation. Accumulated uncertainty in the final result can produce a misleading assessment if it is not incorporated adequately. Studies in risk analysis have shown that consideration of different sources of uncertainty may be crucial for reliable results. Uncertainty and ignorance associated with assessments and predictions on which to base policies make the communication even more difficult (van der Sluijs, 2007). The characterization and quantification of uncertainty and variability in health risk assessment are important to prevent erroneous inferences in multimedia modeling and exposure assessment, which may lead to major environmental policy implications (Frey and Zhao, 2004).

Several different classifications of uncertainty have been suggested (Alefeld and Herzberger, 1983, Haimes, 1998, van Asselt and Rotmans, 2002, Walker et al., 2003). However, for the objectives of the current study, only parametric uncertainty has been considered. The parametric uncertainty has been classified on the basis of its source and nature. Sources of parameter uncertainty are measurement errors, sampling errors, variability, and the use of surrogate data (Moschandreas and Karuchit, 2005). Measurement errors refer to random (imprecision) or systematic errors (bias), while sampling errors are errors from small sample size and/or misrepresentative samples. Heterogeneity in environmental and exposure-related data includes seasonal variation, spatial variation, and variation of human activity patterns by age, gender, and geographic location, leading to variability errors. Surrogate data refer to errors from the use of substitute data. van Asselt and Rotmans (2002) and Walker et al. (2003) classified uncertainty based on its nature. They called it epistemic uncertainty/imprecision, and stochastic uncertainty/natural variability. Epistemic uncertainty which results from incomplete knowledge about the system under study is reducible by additional studies (e.g. further research and data collection). Stochastic uncertainty which stems from variability of the underlying stochastic process is non-reducible for a given system and under specific management scenario. Natural variability has also been termed (basic) variability, randomly uncertainty, objective uncertainty, inherent variability, (basic) randomness, and type-I uncertainty. Terms for epistemic uncertainty are systematic uncertainty, subjective uncertainty, lack of knowledge or limited-knowledge uncertainty, ignorance, specification error, prediction error, and type-II uncertainty (Haimes, 1998, Rotmans and van Asselt, 2001, van Asselt and Rotmans, 2002, Merz and Thieken, 2005, Moschandreas and Karuchit, 2005, Refsgaard et al., 2007). In this paper, the term uncertainty is used to denote epistemic, variability to denote stochastic uncertainty, and total variance or simply variance to denote total uncertainty and variability in the outcome.

In spite of this obvious distinction, uncertainty and variability have been used as synonym. Some of the reasons are the blurred knowledge about uncertainty and variability and the lack of commonly agreed guidelines on uncertainty characterization and appropriate methodology. Consequently, in uncertainty estimation both types of uncertainty are clubbed together and treated as random variables, though epistemic uncertainty is not random in nature. The purpose of uncertainty analysis is to provide decision makers with a complete spectrum of information concerning the assessment and its quality. It also gives some scope to improve predictive results (Rotmans and van Asselt, 2001). When the uncertainty in the risk estimate is unacceptable for decision-making, additional data are acquired for the major uncertainty contributing model components. This process is repeated until the level of residual uncertainty is acceptable. For this we need to identify uncertainty components which are reducible. Further, separate measurements can provide us relevant information to the risk management decision (Spencer et al., 2001).

From a practical viewpoint, it is rare to encounter only one type of uncertainty. Pure variability would mean that all relations and their parameters which describe the random process are exactly known. Pure epistemic uncertainty would mean that a deterministic process is considered, but the relevant information cannot be obtained (e.g. due to the inability to measure the relevant parameters) (Merz and Thieken, 2005). For example, given a parameter X with total variance Vx, it can sometimes be straightforward to partition the variance into uncertainty and variability components, where α is the uncertainty component and (1  α) attributable to variability (Fig. 1). Notwithstanding, there also can be an intermediate vague region in which uncertainty and variability commingle. So sometimes it is difficult to separate them and in that case it needs special handling to measure both uncertainty and variability together.

Several approaches to uncertainty analysis in environmental risk analysis have been developed (Isukapalli, 1999, Schulz and Huwe, 1999). Among them, probabilistic approaches (e.g. Monte Carlo Simulation) are quite common and have been commonly used in the treatment and processing of uncertainty for solution of system modeling (Schuhmacher et al., 2001). Another prominent approach based on fuzzy set theory (e.g. fuzzy α-cut analysis) has been recently applied in various fields including environmental modeling for uncertainty quantification (Isukapalli, 1999, Mauris et al., 2001, Cho et al., 2002, Hanss, 2002, Kentel and Aral, 2004, Kumar and Schuhmacher, 2005). However, this model has been branded as too conservative and basically applied in pure epistemic condition (Mauris et al., 2001). All these methods have been developed to handle either variability or uncertainty of the process parameters or they club them together without valid distinction in analysis. Few recent efforts have been made to treat them separately. One common approach used in this field is 2D Monte Carlo Analysis, which classifies epistemic uncertainty as second order uncertainty (Simon, 1999). This technique requires knowledge of parameter values and their statistical distribution from which a formal mathematical description of uncertainty must be developed. However, site investigation is generally not detailed enough to determine values for some of the parameters and their distribution pattern, and sufficient data may not be collected for calibrating a model (Kentel and Aral, 2005). These approaches suffer from an obvious lack of precision and specific site-characterization, making difficult to determine how much error is introduced into the result due to assumptions and prediction. Recently, a number of authors have suggested adopting other approaches in the data limited situation. Refsgaard et al. (2007) reported: ‘The test theory of classical statistics permits the testing of a sample for randomness. If the sample does not exhibit the property of randomness, other uncertainty models such as, e.g. fuzzy randomness must be adopted’. Previously, Möller et al. (2002) presented the idea of fuzzy randomness and formalized the concept of random variable and uncertain variable. Kentel and Aral (2005) introduced 2D Fuzzy Monte Carlo and applied it in the area of health risk assessment. 2D Fuzzy Monte Carlo and fuzzy randomness have been classified as hybrid approach mixing the concept of probability and fuzzy set theory. The present study aims to continue this area of research and introduces a new hybrid approach, Fuzzy Latin Hypercube Sampling (FLHS), for uncertainty and variability analysis. It needs lesser computational effort and allows incorporating parameters correlation. Further we present a way to apply sensitivity analysis in fuzzy–stochastic modeling paradigm. The feasibility of the method has been validated analyzing total variance in the calculation of incremental lifetime risks due to polychlorinated dibenzo-p-dioxins and dibenzofurans (PCDD/Fs) for the residents living in the surroundings of a municipal solid waste incinerator (MSWI) in the Basque Country, Spain.

Section snippets

Fuzzy sets and numbers

Fuzzy set theory replaces the two-valued set-membership function with a real-valued function; that is to say, membership is treated as a possibility or as a degree of truthfulness. Likewise, one assigns a real value to assertions as an indication of their degree of truthfulness. Membership functions define the degree of participation of an observable element in the set. Fuzzy numbers are the fuzzy set defined on the set of real numbers and have special significance. They represent the intuitive

Concept: Fuzzy Latin Hypercube Sampling technique

In this study, the Fuzzy Latin Hypercube Sampling (FLHS) technique is proposed. This technique uses a combination of probability and possibility theory to include imprecise probabilistic information in risk analysis model. It allows the characterization of both uncertainty and variability in one or more input variables. Parameters can be uncertain, variable, or uncertain–variable. The variability in the random variables of the model is treated using probability density functions (PDFs), while

Case study

Recently, a new MSWI which treats around 250,000 tones/yr of domestic wastes started its regular operations in the Basque Country (North of Spain). The facility is placed at 3 km from a metropolitan area with population around a million of inhabitants. In order to estimate the impact of the new MSWI on the environment and the population living in the neighborhood, fate and transport models were applied to estimate PCDD/F concentrations in different compartments. In turn, these concentrations were

Results and discussion

The output of FLHS simulation is fuzzy probabilistic distributions, which can be represented in various forms (multi-plot of PDF/CDFs over different α-cuts). Several forms of information can be extracted from the results. In the present case study, results have been shown according to the conventional way used by risk modeler community. The frequency distribution has been plotted at three levels of uncertainty, lower α-0, α-1 and upper α-0, which basically represent min–mode–max pattern in

Conclusions

In the current case study, only parametric uncertainty consisting of natural variability and epistemic uncertainty has been analyzed. However, the proposed methodology (FLHS) can be used to evaluate other uncertainty components (e.g. model uncertainty and scenario uncertainty). FLHS technique can encompass uncertainty in the inventory, in fate and transport processes, and in exposure pathways to potential receptors. The outputs of these models are also fuzzy probability distributions that, if

Acknowledgements

Vikas Kumar was supported by URV scholarship grant and later Marie Curie early stage training grant at Catchment Science Centre, University of Sheffield. Authors are grateful for the comments of two anonymous reviewers.

References (58)

  • Abebe, A.J., Guinot, V., Solomatine, D.P., 2000. Fuzzy alpha-cut vs. Monte Carlo techniques in assessing uncertainty in...
  • G. Alefeld et al.

    Introduction to Interval Computations

    (1983)
  • V. Arija et al.

    Consumo, hábitos alimentarios y estado nutricional de la población de Reus (IX). Evolución del consumo de alimentos, de su participación en la ingestión de energía y nutrientes en relación con el nivel socioeconómico y cultural entre 1983 y 1993

    Medicina Clinica

    (1996)
  • M.B.A. van Asselt et al.

    Uncertainty in integrated assessment modelling. From positivism to pluralism

    Climatic Change

    (2002)
  • G.D. Belcher et al.

    Modeling support for the RURA and municipal waste combustion projects: final report on sensitivity and uncertainty analysis for the terrestrial food chain model

    (1989)
  • G.R. Blake et al.

    Particle density

  • B. Crowe

    Probabilistic Modeling: Applications to Performance Assessment Maintenance Plan Studies for Low-Level Waste Disposal Facilities

    (2002)
  • B. Finley et al.

    The benefits of probabilistic exposure assessment: three case studies involving contaminated air, water, and soil

    Risk Analysis

    (1994)
  • B. Finley et al.

    Development of a standard soil-to-skin adherence probability density function for use in the Monte Carlo analysis of dermal exposure

    Risk Analysis

    (1994)
  • Frey, H.C., 1993. Separating variability and uncertainty in exposure assessment: motivation and method. In: Proceedings...
  • H.C. Frey et al.

    Quantification of variability and uncertainty for air toxic emission inventories with censored emission factor data

    Environmental Science & Technology

    (2004)
  • D. Guyonnet et al.

    Hybrid method for addressing uncertainty in risk assessments

    Journal of Environmental Engineering

    (2003)
  • Y.Y. Haimes

    Risk Modeling, Assessment, and Management

    (1998)
  • A.M. Hanss

    The transformation method for the simulation and analysis of systems with uncertain parameters

    Fuzzy Sets and Systems

    (2002)
  • D. Hillel

    Fundamentals of Soil Physics

    (1980)
  • F.O. Hoffman et al.

    A Statistical Analysis of Selected Parameters for Predicting Food Chain Transport and Internal Dose of Radionuclides

    (1979)
  • R.L. Iman et al.

    A Comparison of Uncertainty and Sensitivity Analysis Techniques for Computer Models

    (1985)
  • M. Israeli et al.

    Distribution and expected time of residence for U.S. households

    Risk Analysis

    (1992)
  • S.S. Isukapalli

    Uncertainty Analysis of Transport–Transformation Models

    (1999)
  • Cited by (28)

    • Sustainability risk management in the supply chain of telecommunication companies: A case study

      2018, Journal of Cleaner Production
      Citation Excerpt :

      Hence, the statistical methods were used in this research to determine the risk level and analyze the data. Therefore, first a risk criterion or a risk confidence interval was obtained and then the risk levels were determined accordingly (Kumar et al., 2009). Therefore, first the average RPN and then the standard deviation were calculated by using the following relations.

    • PBPK modeling for PFOS and PFOA: Validation with human experimental data

      2014, Toxicology Letters
      Citation Excerpt :

      The reduction of uncertainty can be done by using more precise measurements of the parameterization data (Huizer et al., 2012), while the variability cannot be reduced, but only described. Therefore, the separate characterization of variability and uncertainty should be considered to address more appropriately this issue (Kumar et al., 2009). Finally, further research must be carried out to improve the performance of the PBPK model by introducing temporal dynamics of exposure concentration and physiological parameters for the long-term exposure to PFASs.

    • A comparison of models for assessing human risks of petroleum hydrocarbons in polluted soils

      2014, Environmental Modelling and Software
      Citation Excerpt :

      Some harmonization to improve the consistency of risk assessment tools in the European Union Member States must occur (Swartjes et al., 2009). Moreover, model uncertainties and sensitivities should be clearly known to understand the derived risks for any proposed scenario (Kumar et al., 2009; McKnight and Finkel, 2013). Therefore, a model comparison should be performed to determine model strengths and weakness.

    View all citing articles on Scopus
    View full text