Skip to main content

Advertisement

Log in

Performance assessment of energy companies employing Hierarchy Stochastic Multi-Attribute Acceptability Analysis

  • Original paper
  • Published:
Operational Research Aims and scope Submit manuscript

Abstract

This paper analyses the development of a performance assessment model for the most important listed companies operating in the energy sector, using a dataset obtained merging different sources. The construction of the model is based on a multiple criteria decision aid approach considering various indicators. The multidimensional nature of the topic in this paper requires the definition of a hierarchical structure of criteria, which has been aggregated into a composite index to obtain a final ranking for the energy companies under investigation. To handle with a hierarchical criteria structure and to take into account the space of fluctuations related to the imprecision on criteria weights, we employ the Hierarchy Stochastic Multi-Attribute Analysis. Thus, the proposed model is able to evaluate the performances of energy companies under different uncertainty scenarios. The results indicate that the first and last positions are quite robust in all considered scenarios, while the rankings relative to the intermediate positions vary widely by the chosen set of weights, exemplifying the need to rank companies based on multiple sets of criteria weights.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4

Similar content being viewed by others

References

  • Afgan NH, Carvalho MG (2008) Sustainability assessment of a hybrid energy system. Energy Policy 36(8):2903–2910

    Google Scholar 

  • Alam IMS, Sickles RC (1998) The relationship between stock market returns and technical efficiency innovations: evidence from the US airline industry. J Prod Anal 9:35–51

    Google Scholar 

  • Altman EI (1968) Financial ratios, discriminant analysis and the prediction of corporate bankruptcy. J Finance 23(4):589–609

    Google Scholar 

  • Angilella S, Bottero M, Corrente S, Ferretti V, Greco S, Lami IM (2016a) Non Additive Robust Ordinal Regression for urban and territorial planning: an application for siting an urban waste landfill. Ann Oper Res 245(1–2):427–456

    Google Scholar 

  • Angilella S, Corrente S, Greco S (2015) Stochastic multiobjective acceptability analysis for the Choquet integral preference model and the scale construction problem. Eur J Oper Res 240(1):172–182

    Google Scholar 

  • Angilella S, Corrente S, Greco S, Słowiński R (2016b) Robust ordinal regression and stochastic multiobjective acceptability analysis in multiple criteria hierarchy process for the Choquet integral preference model. Omega 63:154–169

    Google Scholar 

  • Arera. Relazione annuale (2018). Indagine annuale sui settori regolati 2017, vol 2, 101. https://www.arera.it/it/relaz_ann/18/18.htm

  • Babic Z, Plazibat N (1998) Ranking of enterprises based on multicriterial analysis. Int J Prod Econ 56:29–35

    Google Scholar 

  • Banker RD, Potter G, Srinivasan D (2000) An empirical investigation of an incentive plan that includes nonfinancial performance measures. Account Rev 75(1):65–92

    Google Scholar 

  • Barros JJC, Coira ML, De la Cruz López MP, del Caño Gochi A (2015) Assessing the global sustainability of different electricity generation systems. Energy 89:473–489

    Google Scholar 

  • Beaver WH (1966) Financial ratios as predictors of failure. J Account Res 4:71–111

    Google Scholar 

  • Capece G, Di Pillo F, Levialdi N (2013) The performance assessment of energy companies. APCBEE Procedia 5:265–270

    Google Scholar 

  • Cinelli M (2017) The art of supporting decision-making. Exchanges Interdiscip Res J 4(2):298–308

    Google Scholar 

  • Ciomek K, Kadziński M, Tervonen T (2017) Heuristics for selecting pair-wise elicitation questions in multiple criteria choice problems. Eur J Oper Res 262(2):693–707

    Google Scholar 

  • Compustat Database from S&P Global Market Intelligence, S&P Capital IQ. https://www.capitaliq.com. Accessed 13 June 2019

  • Corrente S, Figueira JR, Greco S (2014) The Smaa-Promethee method. Eur J Oper Res 239(2):514–522

    Google Scholar 

  • Corrente S, Greco S, SłOwińSki R (2012) Multiple criteria hierarchy process in robust ordinal regression. Decis Support Syst 53(3):660–674

    Google Scholar 

  • De Matteis D, Ishizaka A, Resce G (2019) The ‘postcode lottery’ of the Italian public health bill analysed with the hierarchy Stochastic multiobjective acceptability analysis. Socio-Econ Plan Sci 68:100603

    Google Scholar 

  • Dias LC, Antunes CH, Dantas G, de Castro N, Zamboni L (2018) A multi-criteria approach to sort and rank policies based on Delphi qualitative assessments and ELECTRE TRI: the case of smart grids in Brazil. Omega 76:100–111

    Google Scholar 

  • Doumpos M (2012) Learning non-monotonic additive value functions for multicriteria decision making. OR Spectrum 34(1):89–106

    Google Scholar 

  • Doumpos M, Andriosopoulos K, Galariotis E, Makridou G, Zopounidis C (2017) Corporate failure prediction in the European energy sector: a multicriteria approach and the effect of country characteristics. Eur J Oper Res 262(1):347–360

    Google Scholar 

  • Edwards D (2014) The link between company environmental and financial performance (Routledge Revivals). Routledge, Abingdon

    Google Scholar 

  • EU Commission (2011) Energy roadmap 2050. Brussels, XXX COM 885(2)

  • Eyüboglu K, Çelik P (2016) Financial performance evaluation of Turkish energy companies with fuzzy AHP and fuzzy TOPSIS methods. Bus Econ Res J 7(3):21

    Google Scholar 

  • Farsi M, Filippini M, Kuenzle M (2007) Cost efficiency in the Swiss gas distribution sector. Energy Econ 29(1):64–78

    Google Scholar 

  • Figueira J, Greco S, Ehrgott M (eds) (2005) Multiple criteria decision analysis: state of the art surveys, 78. Springer, Berlin

    Google Scholar 

  • Gasser P, Suter J, Cinelli M, Spada M, Burgherr P, Hirschberg S, Kadziński M, Stojadinović B (2020) Comprehensive resilience assessment of electricity supply security for 140 countries. Ecol Ind 110:105731

    Google Scholar 

  • Greco S, Matarazzo B, Slowinski R (2001) Rough sets theory for multicriteria decision analysis. Eur J Oper Res 129(1):1–47

    Google Scholar 

  • GRI- Global Reporting Initiative (2002) The global reporting initiative—an overview. Global Reporting Initiative

  • Guo D, Chen H, Long R (2016) Who reports high company performance? A quantitative study of Chinese listed companies in the energy industry. SpringerPlus 5(1):20–41

    Google Scholar 

  • Hera Group. Consolidated non-financial report (2017) p 220. https://www.gruppohera.it/binary/hr_gruppo/download_center/GruppoHera_Bilancio_di_Sostenibilita2017.1522856170.pdf

  • Iberian Data Flyer 2017-EDP Espana (2019) The living energy book. Market shares in the Iberian Peninsula p 4. https://espana.edp.com/sites/default/files/portal.es/documents/iberian_data_flyer_2017.pdf. Accessed 17 June 2019

  • Jamasb T, Pollitt M (2005) Electricity market reform in the European Union: review of progress toward liberalization & integration. The Energy Journal 26 (Special Issue)

  • Jamasb T, Orea L, Pollitt M (2012) Estimating the marginal cost of quality improvements: the case of the UK electricity distribution companies. Energy Econ 34(5):1498–1506

    Google Scholar 

  • Joint Research Centre-European Commission (2008) Handbook on constructing composite indicators: methodology and user guide. OECD Publishing, Paris

    Google Scholar 

  • Jovanović M, Afgan N, Radovanović P, Stevanović V (2009) Sustainable development of the Belgrade energy system. Energy 34(5):532–539

    Google Scholar 

  • Jung N, Moula ME, Fang T, Hamdy M, Lahdelma R (2016) Social acceptance of renewable energy technologies for buildings in the Helsinki Metropolitan Area of Finland. Renew Energy 99:813–824

    Google Scholar 

  • Kahraman C, Kaya İ, Cebi S (2009) A comparative analysis for multi-attribute selection among renewable energy alternatives using fuzzy axiomatic design and fuzzy analytic hierarchy process. Energy 34(10):1603–1616

    Google Scholar 

  • Kirppu H, Lahdelma R, Salminen P (2018) Multicriteria evaluation of carbon-neutral heat-only production technologies for district heating. Appl Therm Eng 130:466–476

    Google Scholar 

  • Klassen RD, McLaughlin CP (1996) The impact of environmental management on firm performance. Manag Sci 42(8):1199–1214

    Google Scholar 

  • Keeney RL, Raiffa H (1993) Decisions with multiple objectives: preferences and value trade-offs. Cambridge University Press, Cambridge

    Google Scholar 

  • Kontu K, Rinne S, Olkkonen V, Lahdelma R, Salminen P (2015) Multicriteria evaluation of heating choices for a new sustainable residential area. Energy Build 93:169–179

    Google Scholar 

  • La Rovere EL, Soares JB, Oliveira LB, Lauria T (2010) Sustainable expansion of electricity sector: sustainability indicators as an instrument to support decision-making. Renew Sustain Energy Rev 14(1):422–429

    Google Scholar 

  • Lahdelma R, Salminen P (2001) SMAA-2: Stochastic multicriteria acceptability analysis for group decision making. Oper Res 49(3):444–454

    Google Scholar 

  • Lahdelma R, Salminen P (2006) Stochastic multicriteria acceptability analysis using the data envelopment model. Eur J Oper Res 170(1):241–252

    Google Scholar 

  • Lahdelma R, Hokkanen J, Salminen P (1998) SMAA-stochastic multiobjective acceptability analysis. Eur J Oper Res 106(1):137–143

    Google Scholar 

  • Lahdelma R, Makkonen S, Salminen P (2006) Multivariate Gaussian criteria in SMAA. Eur J Oper Res 170(3):957–970

    Google Scholar 

  • Lahdelma R, Makkonen S, Salminen P (2009) Two ways to handle dependent uncertainties in multi-criteria decision problems. Omega 37(1):79–92

    Google Scholar 

  • Lahdelma R, Miettinen K, Salminen P (2003) Ordinal criteria in stochastic multicriteria acceptability analysis (SMAA). Eur J Oper Res 147(1):117–127

    Google Scholar 

  • Loikkanen O, Lahdelma R, Salminen P (2017) Multicriteria evaluation of sustainable energy solutions for Colosseum. Sustain Cities Soc 35:289–297

    Google Scholar 

  • Mardani A, Jusoh A, Zavadskas E, Cavallaro F, Khalifah Z (2015) Sustainable and renewable energy: an overview of the application of multiple criteria decision making techniques and approaches. Sustainability 7(10):13947–13984

    Google Scholar 

  • Mateo JRSC (2012) Multi-criteria analysis. In: Multi criteria analysis in the renewable energy industry. Green energy and technology. Springer Science and Business Media, London

  • Maxim A (2014) Sustainability assessment of electricity generation technologies using weighted multi-criteria decision analysis. Energy Policy 65:284–297

    Google Scholar 

  • Mendecka B, Lombardi L, Kozioł J (2020) Probabilistic multi-criteria analysis for evaluation of biodiesel production technologies from used cooking oil. Renew Energy 147:2542–2553

    Google Scholar 

  • OFGEM Data Portal (2017) Retail energy market and indicators. State of the energy market 2017. https://www.ofgem.gov.uk/data-portal/retail-market-indicators. Accessed 17 June 2019

  • Pelissari R, Oliveira MC, Amor SB, Kandakoglu A, Helleno AL (2019) SMAA methods and their applications: a literature review and future research directions. Ann Oper Res. https://doi.org/10.1007/s10479-019-03151-z

    Article  Google Scholar 

  • Pohekar SD, Ramachandran M (2004) Application of multi-criteria decision making to sustainable energy planning—a review. Renew Sustain Energy Rev 8(4):365–381

    Google Scholar 

  • Prescott JE, Kohli AK, Venkatraman N (1986) The market share-profitability relationship: An empirical assessment of major assertions and contradictions. Strateg Manag J 7(4):377–394

    Google Scholar 

  • Rahman MM, Paatero JV, Lahdelma R (2013) Evaluation of choices for sustainable rural electrification in developing countries: a multicriteria approach. Energy Policy 59:589–599

    Google Scholar 

  • Rahman MM, Paatero JV, Lahdelma R, Wahid MA (2016) Multicriteria-based decision aiding technique for assessing energy policy elements-demonstration to a case in Bangladesh. Appl Energy 164:237–244

    Google Scholar 

  • Ramaswami SN, Srivastava RK, Bhargava M (2009) Market-based capabilities and financial performance of firms: insights into marketing’s contribution to firm value. J Acad Mark Sci 37(2):97

    Google Scholar 

  • Roy B (2013) Multicriteria methodology for decision aiding, 12. Springer, Berlin

    Google Scholar 

  • Rusinko C (2007) Green manufacturing: an evaluation of environmentally sustainable manufacturing practices and their impact on competitive outcomes. IEEE Trans Eng Manag 54(3):445–454

    Google Scholar 

  • Saaty TL (2016) The analytic hierarchy and analytic network processes for the measurement of intangible criteria and for decision-making. In: Multiple criteria decision analysis. Springer, New York, pp 363–419.

  • Sarkar MB, Echambadi RAJ, Harrison JS (2001) Alliance entrepreneurship and firm market performance. Strateg Manag J 22(6–7):701–711

    Google Scholar 

  • Shrivastava P (1995) Environmental technologies and competitive advantage. Strateg Manag J 16(S1):183–200

    Google Scholar 

  • Smith RL (1984) Efficient Monte Carlo procedures for generating points uniformly distributed over bounded regions. Oper Res 32(6):1296–1308

    Google Scholar 

  • Song L, Fu Y, Zhou P, Lai KK (2017) Measuring national energy performance via energy trilemma index: a stochastic multicriteria acceptability analysis. Energy Economics 66:313–319

    Google Scholar 

  • Strantzali E, Aravossis K (2016) Decision making in renewable energy investments: a review. Renew Sustain Energy Rev 55:885–898

    Google Scholar 

  • Štreimikienė D, Šliogerienė J, Turskis Z (2016) Multi-criteria analysis of electricity generation technologies in Lithuania. Renew Energy 85:148–156

    Google Scholar 

  • Sustainability Report Hera Group (2017) La metodologia dell’indagine della soddisfazione dei clienti

  • Szymanski DM, Bharadwaj SG, Varadarajan PR (1993) An analysis of the market share-profitability relationship. J Mark 57(3):1–18

    Google Scholar 

  • Tervonen T, Lahdelma R (2007) Implementing stochastic multicriteria acceptability analysis. Eur J Oper Res 178(2):500–513

    Google Scholar 

  • Tervonen T, van Valkenhoef G, Baştürk N, Postmus D (2013) Hit-and-run enables efficient weight generation for simulation-based multiple criteria decision analysis. Eur J Oper Res 224(3):552–559

    Google Scholar 

  • Tylock SM, Seager TP, Snell J, Bennett ER, Sweet D (2012) Energy management under policy and technology uncertainty. Energy Policy 47:156–163

    Google Scholar 

  • U.S. Energy Information Administration (EIA). Glossary of U.S. Energy Information Administration (2012). https://www.eia.gov/tools/glossary/index.php?id=C

  • U.S. Energy Information Administration (EIA). State Electricity Profiles, Total retail sales (2017). https://www.eia.gov/electricity/state/. Accessed 17 June 2019

  • Van Dijk BM (2010) AMADEUS: a database of comparable financial information for public and private companies across Europe. Bureau Van Dijk. https://amadeus.bvdinfo.com/home.serv?product=amadeusneo&loginfromcontext=ipaddress

  • Vishnupriyan J, Manoharan PS (2018) Multi-criteria decision analysis for renewable energy integration: a southern India focus. Renew Energy 121:474–488

    Google Scholar 

  • Wang H, Duanmu L, Lahdelma R, Li X (2017) Developing a multicriteria decision support framework for CHP based combined district heating systems. Appl Energy 205:345–368

    Google Scholar 

  • Wang H, Jiao W, Lahdelma R, Zhu C, Zou P (2015) Stochastic multicriteria acceptability analysis for evaluation of combined heat and power units. Energies 8(1):59–78

    Google Scholar 

  • Wang H, Lahdelma R, Salminen P (2018) Stochastic multicriteria evaluation of district heating systems considering the uncertainties. Sci Technol Built Environ 24(8):830–838

    Google Scholar 

  • Wang JJ, Jing YY, Zhang CF, Zhao JH (2009) Review on multi-criteria decision analysis aid in sustainable energy decision-making. Renew Sustain Energy Rev 13(9):2263–2278

    Google Scholar 

  • Weber O, Koellner T, Habegger D, Steffensen H, Ohnemus P (2008) The relation between the GRI indicators and the financial performance of firms. Prog Ind Ecol Int J 5(3):236–254

    Google Scholar 

  • World Energy Council (2017) World Energy Trilemma Index 2017. https://trilemma.worldenergy.org/

Download references

Acknowledgements

The authors would like to thank the two anonymous Reviewers, whose comments have helped to improve this paper.

For the entire research process of this study, the authors have benefited the PRD fund of the University of Catania “Indebtedness, bank credit and economic activities”. The first author has also benefited the “FFABR” fund of the Ministry of Education, University and Research of the Italian government.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Maria Rosaria Pappalardo.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Appendix

Appendix

See Tables 11,12, 13, 14, 15 and 16.

Table 11 Cases (1) and (2) “From first to Seventh Scenario”: rank acceptability indices (all the data are expressed in percent.)
Table 12 Cases (1) and (2) “From first to Seventh Scenario”: downward cumulative rank acceptability indices (all the data are expressed in percent)
Table 13 Rank acceptability indices on financial macro-criterion
Table 14 Rank acceptability indices on sustainability macro-criterion
Table 15 Rank acceptability indices on technical macro-criterion
Table 16 Rank acceptability indices on market macro-criterion

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Angilella, S., Pappalardo, M.R. Performance assessment of energy companies employing Hierarchy Stochastic Multi-Attribute Acceptability Analysis. Oper Res Int J 22, 299–370 (2022). https://doi.org/10.1007/s12351-020-00567-5

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s12351-020-00567-5

Keywords

Navigation