Partitioning total variance in risk assessment: Application to a municipal solid waste incinerator
Introduction
Recent health risk assessment studies often consider aggregate exposure and cumulative risk calculation. Accumulated uncertainty in the final result can produce a misleading assessment if it is not incorporated adequately. Studies in risk analysis have shown that consideration of different sources of uncertainty may be crucial for reliable results. Uncertainty and ignorance associated with assessments and predictions on which to base policies make the communication even more difficult (van der Sluijs, 2007). The characterization and quantification of uncertainty and variability in health risk assessment are important to prevent erroneous inferences in multimedia modeling and exposure assessment, which may lead to major environmental policy implications (Frey and Zhao, 2004).
Several different classifications of uncertainty have been suggested (Alefeld and Herzberger, 1983, Haimes, 1998, van Asselt and Rotmans, 2002, Walker et al., 2003). However, for the objectives of the current study, only parametric uncertainty has been considered. The parametric uncertainty has been classified on the basis of its source and nature. Sources of parameter uncertainty are measurement errors, sampling errors, variability, and the use of surrogate data (Moschandreas and Karuchit, 2005). Measurement errors refer to random (imprecision) or systematic errors (bias), while sampling errors are errors from small sample size and/or misrepresentative samples. Heterogeneity in environmental and exposure-related data includes seasonal variation, spatial variation, and variation of human activity patterns by age, gender, and geographic location, leading to variability errors. Surrogate data refer to errors from the use of substitute data. van Asselt and Rotmans (2002) and Walker et al. (2003) classified uncertainty based on its nature. They called it epistemic uncertainty/imprecision, and stochastic uncertainty/natural variability. Epistemic uncertainty which results from incomplete knowledge about the system under study is reducible by additional studies (e.g. further research and data collection). Stochastic uncertainty which stems from variability of the underlying stochastic process is non-reducible for a given system and under specific management scenario. Natural variability has also been termed (basic) variability, randomly uncertainty, objective uncertainty, inherent variability, (basic) randomness, and type-I uncertainty. Terms for epistemic uncertainty are systematic uncertainty, subjective uncertainty, lack of knowledge or limited-knowledge uncertainty, ignorance, specification error, prediction error, and type-II uncertainty (Haimes, 1998, Rotmans and van Asselt, 2001, van Asselt and Rotmans, 2002, Merz and Thieken, 2005, Moschandreas and Karuchit, 2005, Refsgaard et al., 2007). In this paper, the term uncertainty is used to denote epistemic, variability to denote stochastic uncertainty, and total variance or simply variance to denote total uncertainty and variability in the outcome.
In spite of this obvious distinction, uncertainty and variability have been used as synonym. Some of the reasons are the blurred knowledge about uncertainty and variability and the lack of commonly agreed guidelines on uncertainty characterization and appropriate methodology. Consequently, in uncertainty estimation both types of uncertainty are clubbed together and treated as random variables, though epistemic uncertainty is not random in nature. The purpose of uncertainty analysis is to provide decision makers with a complete spectrum of information concerning the assessment and its quality. It also gives some scope to improve predictive results (Rotmans and van Asselt, 2001). When the uncertainty in the risk estimate is unacceptable for decision-making, additional data are acquired for the major uncertainty contributing model components. This process is repeated until the level of residual uncertainty is acceptable. For this we need to identify uncertainty components which are reducible. Further, separate measurements can provide us relevant information to the risk management decision (Spencer et al., 2001).
From a practical viewpoint, it is rare to encounter only one type of uncertainty. Pure variability would mean that all relations and their parameters which describe the random process are exactly known. Pure epistemic uncertainty would mean that a deterministic process is considered, but the relevant information cannot be obtained (e.g. due to the inability to measure the relevant parameters) (Merz and Thieken, 2005). For example, given a parameter X with total variance Vx, it can sometimes be straightforward to partition the variance into uncertainty and variability components, where α is the uncertainty component and (1 − α) attributable to variability (Fig. 1). Notwithstanding, there also can be an intermediate vague region in which uncertainty and variability commingle. So sometimes it is difficult to separate them and in that case it needs special handling to measure both uncertainty and variability together.
Several approaches to uncertainty analysis in environmental risk analysis have been developed (Isukapalli, 1999, Schulz and Huwe, 1999). Among them, probabilistic approaches (e.g. Monte Carlo Simulation) are quite common and have been commonly used in the treatment and processing of uncertainty for solution of system modeling (Schuhmacher et al., 2001). Another prominent approach based on fuzzy set theory (e.g. fuzzy α-cut analysis) has been recently applied in various fields including environmental modeling for uncertainty quantification (Isukapalli, 1999, Mauris et al., 2001, Cho et al., 2002, Hanss, 2002, Kentel and Aral, 2004, Kumar and Schuhmacher, 2005). However, this model has been branded as too conservative and basically applied in pure epistemic condition (Mauris et al., 2001). All these methods have been developed to handle either variability or uncertainty of the process parameters or they club them together without valid distinction in analysis. Few recent efforts have been made to treat them separately. One common approach used in this field is 2D Monte Carlo Analysis, which classifies epistemic uncertainty as second order uncertainty (Simon, 1999). This technique requires knowledge of parameter values and their statistical distribution from which a formal mathematical description of uncertainty must be developed. However, site investigation is generally not detailed enough to determine values for some of the parameters and their distribution pattern, and sufficient data may not be collected for calibrating a model (Kentel and Aral, 2005). These approaches suffer from an obvious lack of precision and specific site-characterization, making difficult to determine how much error is introduced into the result due to assumptions and prediction. Recently, a number of authors have suggested adopting other approaches in the data limited situation. Refsgaard et al. (2007) reported: ‘The test theory of classical statistics permits the testing of a sample for randomness. If the sample does not exhibit the property of randomness, other uncertainty models such as, e.g. fuzzy randomness must be adopted’. Previously, Möller et al. (2002) presented the idea of fuzzy randomness and formalized the concept of random variable and uncertain variable. Kentel and Aral (2005) introduced 2D Fuzzy Monte Carlo and applied it in the area of health risk assessment. 2D Fuzzy Monte Carlo and fuzzy randomness have been classified as hybrid approach mixing the concept of probability and fuzzy set theory. The present study aims to continue this area of research and introduces a new hybrid approach, Fuzzy Latin Hypercube Sampling (FLHS), for uncertainty and variability analysis. It needs lesser computational effort and allows incorporating parameters correlation. Further we present a way to apply sensitivity analysis in fuzzy–stochastic modeling paradigm. The feasibility of the method has been validated analyzing total variance in the calculation of incremental lifetime risks due to polychlorinated dibenzo-p-dioxins and dibenzofurans (PCDD/Fs) for the residents living in the surroundings of a municipal solid waste incinerator (MSWI) in the Basque Country, Spain.
Section snippets
Fuzzy sets and numbers
Fuzzy set theory replaces the two-valued set-membership function with a real-valued function; that is to say, membership is treated as a possibility or as a degree of truthfulness. Likewise, one assigns a real value to assertions as an indication of their degree of truthfulness. Membership functions define the degree of participation of an observable element in the set. Fuzzy numbers are the fuzzy set defined on the set of real numbers and have special significance. They represent the intuitive
Concept: Fuzzy Latin Hypercube Sampling technique
In this study, the Fuzzy Latin Hypercube Sampling (FLHS) technique is proposed. This technique uses a combination of probability and possibility theory to include imprecise probabilistic information in risk analysis model. It allows the characterization of both uncertainty and variability in one or more input variables. Parameters can be uncertain, variable, or uncertain–variable. The variability in the random variables of the model is treated using probability density functions (PDFs), while
Case study
Recently, a new MSWI which treats around 250,000 tones/yr of domestic wastes started its regular operations in the Basque Country (North of Spain). The facility is placed at 3 km from a metropolitan area with population around a million of inhabitants. In order to estimate the impact of the new MSWI on the environment and the population living in the neighborhood, fate and transport models were applied to estimate PCDD/F concentrations in different compartments. In turn, these concentrations were
Results and discussion
The output of FLHS simulation is fuzzy probabilistic distributions, which can be represented in various forms (multi-plot of PDF/CDFs over different α-cuts). Several forms of information can be extracted from the results. In the present case study, results have been shown according to the conventional way used by risk modeler community. The frequency distribution has been plotted at three levels of uncertainty, lower α-0, α-1 and upper α-0, which basically represent min–mode–max pattern in
Conclusions
In the current case study, only parametric uncertainty consisting of natural variability and epistemic uncertainty has been analyzed. However, the proposed methodology (FLHS) can be used to evaluate other uncertainty components (e.g. model uncertainty and scenario uncertainty). FLHS technique can encompass uncertainty in the inventory, in fate and transport processes, and in exposure pathways to potential receptors. The outputs of these models are also fuzzy probability distributions that, if
Acknowledgements
Vikas Kumar was supported by URV scholarship grant and later Marie Curie early stage training grant at Catchment Science Centre, University of Sheffield. Authors are grateful for the comments of two anonymous reviewers.
References (58)
- et al.
A risk assessment methodology for incorporating uncertainties using fuzzy concepts
Reliability Engineering and System Safety
(2002) - et al.
Unsupervised parallel image classification using Markovian models
Pattern Recignition
(1999) - et al.
Dioxins: WHO's tolerable daily intake revisited
Chemosphere
(2000) - et al.
A fuzzy approach for the expression of uncertainty in measurement
Measurement
(2001) - et al.
Separating natural and epistemic uncertainty in flood frequency analysis
Journal of Hydrology
(2005) - et al.
Uncertainty in the environmental modelling process – a framework and guidance
Environmental Modelling & Software
(2007) - et al.
The use of Monte-Carlo simulation techniques for risk assessment: study of a municipal waste incinerator
Chemosphere
(2001) Uncertainty and precaution in environmental management: insights from the UPEM conference
Environmental Modelling & Software
(2007)Fuzzy sets
Information and Control
(1965)Fuzzy probabilities
Information Processing and Management
(1984)
Introduction to Interval Computations
Consumo, hábitos alimentarios y estado nutricional de la población de Reus (IX). Evolución del consumo de alimentos, de su participación en la ingestión de energía y nutrientes en relación con el nivel socioeconómico y cultural entre 1983 y 1993
Medicina Clinica
Uncertainty in integrated assessment modelling. From positivism to pluralism
Climatic Change
Modeling support for the RURA and municipal waste combustion projects: final report on sensitivity and uncertainty analysis for the terrestrial food chain model
Particle density
Probabilistic Modeling: Applications to Performance Assessment Maintenance Plan Studies for Low-Level Waste Disposal Facilities
The benefits of probabilistic exposure assessment: three case studies involving contaminated air, water, and soil
Risk Analysis
Development of a standard soil-to-skin adherence probability density function for use in the Monte Carlo analysis of dermal exposure
Risk Analysis
Quantification of variability and uncertainty for air toxic emission inventories with censored emission factor data
Environmental Science & Technology
Hybrid method for addressing uncertainty in risk assessments
Journal of Environmental Engineering
Risk Modeling, Assessment, and Management
The transformation method for the simulation and analysis of systems with uncertain parameters
Fuzzy Sets and Systems
Fundamentals of Soil Physics
A Statistical Analysis of Selected Parameters for Predicting Food Chain Transport and Internal Dose of Radionuclides
A Comparison of Uncertainty and Sensitivity Analysis Techniques for Computer Models
Distribution and expected time of residence for U.S. households
Risk Analysis
Uncertainty Analysis of Transport–Transformation Models
Cited by (28)
Sustainability risk management in the supply chain of telecommunication companies: A case study
2018, Journal of Cleaner ProductionCitation Excerpt :Hence, the statistical methods were used in this research to determine the risk level and analyze the data. Therefore, first a risk criterion or a risk confidence interval was obtained and then the risk levels were determined accordingly (Kumar et al., 2009). Therefore, first the average RPN and then the standard deviation were calculated by using the following relations.
Influence of the uncertainty in the validation of PBPK models: A case-study for PFOS and PFOA
2016, Regulatory Toxicology and PharmacologyPBPK modeling for PFOS and PFOA: Validation with human experimental data
2014, Toxicology LettersCitation Excerpt :The reduction of uncertainty can be done by using more precise measurements of the parameterization data (Huizer et al., 2012), while the variability cannot be reduced, but only described. Therefore, the separate characterization of variability and uncertainty should be considered to address more appropriately this issue (Kumar et al., 2009). Finally, further research must be carried out to improve the performance of the PBPK model by introducing temporal dynamics of exposure concentration and physiological parameters for the long-term exposure to PFASs.
A comparison of models for assessing human risks of petroleum hydrocarbons in polluted soils
2014, Environmental Modelling and SoftwareCitation Excerpt :Some harmonization to improve the consistency of risk assessment tools in the European Union Member States must occur (Swartjes et al., 2009). Moreover, model uncertainties and sensitivities should be clearly known to understand the derived risks for any proposed scenario (Kumar et al., 2009; McKnight and Finkel, 2013). Therefore, a model comparison should be performed to determine model strengths and weakness.