Skip to main content

Advertisement

Log in

Labor inspectorates’ efficiency and effectiveness assessment as a learning path to improve work-related accident prevention

  • S.I.: Data Envelopment Analysis: Four Decades On
  • Published:
Annals of Operations Research Aims and scope Submit manuscript

Abstract

Labor inspectorates, by monitoring and enforcing labor legislation, giving information and technical advice to employers and employees, promoting awareness-raising campaigns and implementing occupational risk prevention policies, play a fundamental role in promoting safer and healthier working conditions and, ultimately, in reducing the number of work-related accidents. Even so, every year, hundreds of thousands of people die from accidents at work and around 2 million die from occupational diseases, highlighting that considerable room for improvement remains. The identification and sharing of best practices in labor inspection can be a useful first step in this direction. The main purpose of this research is to propose Data Envelopment Analysis as a suitable technique for assessing the performance of labor inspectorates and identifying best practices. The potential of the proposed methodology is tested by using it to assess the efficiency and the effectiveness of the 32 local branches of the Portuguese Authority for Working Conditions, a key player of the Portuguese system of occupational risk prevention, and by exploring its value in identifying best practices and possible paths for performance improvement.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1

Source: Adapted from Tõsine and Wedege (2013:25)

Fig. 2

Source: Own elaboration, adapted from Tõsine and Wedege (2013:25)

Fig. 3

Source: Own elaboration, based on EMS outputs

Fig. 4

Source: Own elaboration, based on the ACT data, as well as on GEP (2015), INE (2013) and Eurostat (2016)

Fig. 5

Source: Own elaboration. The names of the cities highlighted in red and yellow indicate the geographic location of the delegations operating under sub-optimal scale sizes as reflected by the results in Table 5. Highlighted in red are the branches that are scale resource inefficient and in yellow those that are also scale cost inefficient

Similar content being viewed by others

References

  • ACT (2015a). Inspection activity guidelines of the ACT [WWW Document]. http://www.act.gov.pt/(pt-PT)/crc/PublicacoesElectronicas/Documents/Referencial da atividade inspetiva.pdf. Accessed 26 Nov 2016.

  • ACT (2015b). The authority for working conditions and the investigation of accidents at work and occupational diseases—practical guidance [WWW Document]. http://www.act.gov.pt/(pt-PT)/crc/PublicacoesElectronicas/Documents/A, Autoridade para as Condições do Trabalho e os Inquéritos de Acidente de Trabalho e Doença Profissional.pdf. Accessed 1 Jan 2016.

  • ACT (2016). Labour administrative infringement proceedings—practical guide. Lisbon, Portugal.

  • Adalberto, C., & Telma, L. (2005). A inspeção do trabalho no Brasil/L’inspection du travail au Brésil/Labor inspection in Brazil. Dados Revista Ciências Sociais,48, 451–490. https://doi.org/10.1590/S0011-52582005000300001.

    Article  Google Scholar 

  • Ali, A. I., & Seiford, L. M. (1990). Translation invariance in data envelopment analysis. Operations Research Letters,9, 403–405. https://doi.org/10.1007/978-1-4899-7553-9_8.

    Article  Google Scholar 

  • Ali, A. I., & Seiford, L. M. (1993). The mathematical programming approach to efficiency analysis. In H. O. Fried, C. A. K. Lovell, & S. S. Schmidt (Eds.), The measurement of productive efficiency: Techniques and applications (pp. 120–159). Oxford: Oxford University Press.

    Google Scholar 

  • Allahyar, M., & Rostamy-Malkhalifeh, M. (2015). Negative data in data envelopment analysis: Efficiency analysis and estimating returns to scale. Computers and Industrial Engineering,82, 78–81. https://doi.org/10.1016/j.cie.2015.01.022.

    Article  Google Scholar 

  • Allen, R., Athanassoupoulos, A., Dyson, R. G., & Thanassoulis, E. (1997). Weights restrictions and value judgements in data envelopment analysis: Evolution, development and future directions. Annals of Operations Research,73, 13–34.

    Article  Google Scholar 

  • Alli, B. O. (2008). Fundamental principles of occupational health and safety (2nd ed.). Geneva: International Labour Office.

    Google Scholar 

  • Angulo-Meza, L., & Lins, M. P. (2002). Review of methods for increasing discrimination in data envelopment analysis. Annals of Operations Research,116, 225–242.

    Article  Google Scholar 

  • Anton, J. J. (1992). Seniority and efficiency. Scandinavian Journal of Economics,94, 425–442.

    Article  Google Scholar 

  • Banker, R. D., Charnes, A., & Cooper, W. W. (1984). Some models for estimating technical and scale inefficiencies in data envelopment analysis. Management Science,30, 1078–1092.

    Article  Google Scholar 

  • Banker, R. D., & Morey, R. C. (1986). Efficiency analysis for exogenously fixed inputs and outputs. Operations Research,34, 513–521. https://doi.org/10.1287/opre.34.4.513.

    Article  Google Scholar 

  • Banker, R. D., & Natarajan, R. (2008). Evaluating contextual variables affecting productivity using data envelopment analysis. Operations Research,56, 48–58. https://doi.org/10.1287/opre.1070.0460.

    Article  Google Scholar 

  • Banker, R. D., & Podinovski, V. V. (2017). Novel theory and methodology developments in data envelopment analysis. Annals of Operations Research,250(1), 1–3. https://doi.org/10.1007/s10479-017-2413-7.

    Article  Google Scholar 

  • Becker, G. S. (1975). Human Capital. New York: Columbia University Press.

    Google Scholar 

  • Cagno, E., Micheli, G. J. L., Masi, D., & Jacinto, C. (2013). Review: Economic evaluation of OSH and its way to SMEs: A constructive review. Safety Science,53, 134–152. https://doi.org/10.1016/j.ssci.2012.08.016.

    Article  Google Scholar 

  • Camanho, A. S., & Dyson, R. G. (1999). Efficiency, size, benchmarks and targets for bank branches: an application of data envelopment analysis. Journal of the Operational Research Society,50, 903–915. https://doi.org/10.1057/palgrave.jors.2600792.

    Article  Google Scholar 

  • Charnes, A., Cooper, W. W., & Rhodes, E. (1978). Measuring the efficiency of decision making units. European Journal of Operational Research,2, 429–444. https://doi.org/10.1016/0377-2217(78)90138-8.

    Article  Google Scholar 

  • Charnes, A., Cooper, W. W., Seiford, L., & Stutz, J. (1983). Invariant multiplicative efficiency and piecewise cobb-douglas envelopments. Operations Research Letters.,2, 101–103. https://doi.org/10.1016/0167-6377(83)90014-7.

    Article  Google Scholar 

  • Cherchye, L., Moesen, W., Rogge, N., & Van Puyenbroeck, T. (2007). An introduction to “benefit of the doubt” composite indicators. Social Indicators Research,82, 111–145. https://doi.org/10.1007/s11205-006-9029-7.

    Article  Google Scholar 

  • Contreras, C. A. R., Almaguer, K. P. J., & Tovar, Y. S. (2015). Percepciones del impacto de la capacitación, compensación y selección del personal en la eficiencia de los proyectos/Perceptions of the impact of training, compensation and recruitment on project effectiveness 0, 5. https://doi.org/10.17230/ad-minister.27.1.

  • Dyson, R. G., Allen, R., Camanho, A. S., Podinovski, V. V., Sarrico, C. S., & Shale, E. A. (2001). Pitfalls and protocols in DEA. European Journal of Operational Research,132, 245–259. https://doi.org/10.1016/S0377-2217(00)00149-1.

    Article  Google Scholar 

  • Emrouznejad, A. (2014). Advances in data envelopment analysis. Annals of Operations Research,214(1), 1–4. https://doi.org/10.1007/s10479-014-1535-4.

    Article  Google Scholar 

  • European Council (1989). Directive No. 89/391/EEC, of 12 June 1989, concerning the introduction of measures to encourage improvements in the safety and health of workers at work. Official Journal of the European Union, 183, 1–8.

    Google Scholar 

  • European Parliament (2014). Resolution No. 2013/2112(INI), of 14 January 2014, on effective labour inspections as a strategy to improve working conditions in Europe.

  • Eurostat (2016). European Statistics on Accidents at Work (ESAW) [WWW Document]. http://ec.europa.eu/eurostat/data/database. Accessed 7 Jan 2016.

  • Frick, K. (2011). Worker influence on voluntary OHS management systems—A review of its ends and means. Safety Science,49, 974–987. https://doi.org/10.1016/j.ssci.2011.04.007.

    Article  Google Scholar 

  • Fusco, E. (2015). Enhancing non-compensatory composite indicators: a directional proposal. European Journal of Operational Research,242(2), 620–630.

    Article  Google Scholar 

  • Geminiani, F. L., & Smallwood, J. J. F. (2013). A comparative analysis between contractors’ and inspectors’ perceptions of the department of labour occupational health and safety inspectorate relative to South African construction. Safety Science,53, 186–192.

    Article  Google Scholar 

  • GEP (2015). Work-related Accidents in Portugal 2013 [WWW Document]. https://doi.org/10.1590/s0102-311x2003000200015.

  • Göbel, C., Zwick, T. (2009). Age and productivity—evidence from linked employer employee data, ZEW Discussion Paper No. 09–020. ZEW, Mannheim.

  • Göbel, C., & Zwick, T. (2013). Are personnel measures effective in increasing productivity of old workers? Labour Economics,22, 80–93. https://doi.org/10.1016/j.labeco.2012.11.005.

    Article  Google Scholar 

  • Hämäläinen, P., Leena Saarela, K., & Takala, J. (2009). Global trend according to estimated number of occupational accidents and fatal work-related diseases at region and country level. Journal of Safety Research,40, 125–139. https://doi.org/10.1016/j.jsr.2008.12.010.

    Article  Google Scholar 

  • Hasle, P., Kvorning, L. V., Rasmussen, C. D., Smith, L. H., & Flyvholm, M.-A. (2012). A model for design of tailored working environment intervention programmes for small enterprises. Safety Health Work,3, 181–191. https://doi.org/10.5491/SHAW.2012.3.3.181.

    Article  Google Scholar 

  • Hoff, A. (2007). Second stage DEA: Comparison of approaches for modelling the DEA score. European Journal of Operational Research,181, 425–435. https://doi.org/10.1016/j.ejor.2006.05.019.

    Article  Google Scholar 

  • HSE. (2015). Costs to Britain of workplace fatalities and self-reported injuries and ill health, 2013/2014. London: Health and Safety Executive.

    Google Scholar 

  • Ilmarinen, J. (2006). The ageing workforce—Challenges for occupational health. Occupational Medicine (Chic. Ill). 56, 362–364. https://doi.org/10.1093/occmed/kql046.

  • ILO. (1947). Convention No. 81, concerning labour inspection in industry and commerce—Labour inspection convention. Adopted in the 30th ILC session, 11 July 1947, Geneva: Switzerland.

  • ILO. (1969). Convention No. 129, concerning labour inspection in agriculture—Labour inspection (Agriculture) convention. Adopted in the 53rd ILC session, 25 June 1969, Geneva: Switzerland.

  • ILO. (1981). Convention No. 155, concerning occupational safety and health and the working environment—Occupational safety and health convention. Adopted in the 67th ILC session, 22 June 1981, Geneva: Switzerland.

  • ILO. (2003). Fundamental rights at work and international labour standards. Geneva: International Labour Office.

    Google Scholar 

  • ILO. (2006a). Convention No. 187, concerning the promotional framework for occupational safety and health—Promotional Framework for Occupational Safety and Health Convention. Adopted in the 95th ILC session, 15 June 2006, Geneva: Switzerland.

  • ILO. (2006b). Strategies and practice for labour inspection. Geneva: International Labour Office.

    Google Scholar 

  • ILO. (2007). Safe and healthy workplaces—Making decent work a reality. Geneva: International Labour Office.

    Google Scholar 

  • ILO. (2009). Albania labour inspection audit—Joint outcome on labour inspection. Interna: Labour Administration and Inspection Programme, (LAB/ADMIN).

    Google Scholar 

  • ILO. (2011). Labour administration and labour inspection, Report V to the 100th session of the international labour conference. Geneva: International Labour Office.

    Google Scholar 

  • INE. (2013). Census 2011—Employed population by municipality and economic activity sector [WWW Document]. Stat. Port. Portal. https://www.ine.pt/xportal/xmain?xpid=INE&xpgid=ine_indicadores&indOcorrCod=0007001&contexto=bd&selTab=tab2. Accessed 9 April 16.

  • Lin, S., & Hsu, C.-C. (2017). A study of impact on-job training on job performance of employees in catering industry. International Journal Organizational Innovation,9, 125–137.

    Google Scholar 

  • Liu, J. S., Lu, L. Y. Y., & Lu, W.-M. (2016). Research fronts in data envelopment analysis. Omega,58, 33–45. https://doi.org/10.1016/j.omega.2015.04.004.

    Article  Google Scholar 

  • MacKelprang, A. W., Jayaram, J., & Xu, K. (2012). The influence of types of training on service system performance in mass service and service shop operations. International Journal Production Economics,138, 183–194. https://doi.org/10.1016/j.ijpe.2012.03.022.

    Article  Google Scholar 

  • McDonald, J. (2009). Using least squares and tobit in second stage DEA efficiency analyses. European Journal of Operational Research,197, 792–798. https://doi.org/10.1016/j.ejor.2008.07.039.

    Article  Google Scholar 

  • Niskanen, T., Louhelainen, K., & Hirvonen, M. L. (2014). An evaluation of the effects of the occupational safety and health inspectors’ supervision in workplaces. Accident Analysis and Prevention,68, 139–155. https://doi.org/10.1016/j.aap.2013.11.013.

    Article  Google Scholar 

  • Podgórski, D. (2015). Measuring operational performance of OSH management system—A demonstration of AHP-based selection of leading key performance indicators. Safety Science,73, 146–166. https://doi.org/10.1016/j.ssci.2014.11.018.

    Article  Google Scholar 

  • Podinovski, V. V. (2004). Production trade-offs and weight restrictions in data envelopment analysis. Journal Opererational Research Society,55, 1311–1322. https://doi.org/10.1057/palgrave.jors.2601794.

    Article  Google Scholar 

  • Podinovski, V. V. (2007). Computation of efficient targets in DEA models with production trade-offs and weight restrictions. European Journal of Operational Research,181(2), 586–591.

    Article  Google Scholar 

  • Portuguese Government (1998). Decree-Law No. 106/98, of 24 April, which lays down rules concerning the payment of daily allowances and transport allowances to public officials in case of service travels. Diário da República/Off. J. Port. Repub. I-A, 1832–1837.

  • Portuguese Government (2000). Decree-Law No. 102/2000, of 2 June, which approves the Statute of the Portuguese General Labour Inspectorate. Diário da República/Off. J. Port. Repub., I-A I-A, 2554–2561.

  • Portuguese Government (2001). Regulatory Decree No. 20/2001, of 22 December, which defines and regulates the labour inspector career. Diário da República/Off. J. Port. Repub. I-B, 8404–8406.

  • Portuguese Government (2007). Decree-Law No. 276/2007, of 31 July, laying down the legal regime of inspection activity. Diário da República/Off. J. Port. Repub. I, 4889–4893.

  • Portuguese Government (2012). Regulatory Decree No. 47/2012, of 31 July, which approves the organic of the Portuguese Authority for Working Conditions (ACT). Diário da República/Off. J. Port. Repub., I I, 3959–3962.

  • Portuguese Parliament (2009). Law No. 107/2009, of 14 September, approving the procedural regime applicable to the infringement proceedings concerning the administrative offences to labour and social security regulations. Diário da República/Off. J. Port. Repub. I, 5097–5098.

  • Portuguese Parliament (2014). Law No. 35/2014, of 20 June, approving the general employment law in public functions. Diário da República/Off. J. Port. Repub., I 1, 3220–3304.

  • Quiñones, M. A., Ford, J. K., & Teachout, M. S. (1995). The Relationship Between Work Experience and Job Performance: A conceptual and meta-analytic review. Personnel Psychology,48, 887–910. https://doi.org/10.1111/j.1744-6570.1995.tb01785.x.

    Article  Google Scholar 

  • Ramalho, E. A., Ramalho, J. J. S., & Henriques, P. D. (2010). Fractional regression models for second stage DEA efficiency analyses. Journal Productivity Analysis,34, 239–255. https://doi.org/10.1007/s11123-010-0184-0.

    Article  Google Scholar 

  • Richthofen, W. Von. (2002). Labour inspection: a guide to the profession. Geneva: International Labour Office.

    Google Scholar 

  • Robson, L. S., Clarke, J. A., Cullen, K., Bielecky, A., Severin, C., Bigelow, P. L., et al. (2007). The effectiveness of occupational health and safety management system interventions: A systematic review. Safety Science,45, 329–353. https://doi.org/10.1016/j.ssci.2006.07.003.

    Article  Google Scholar 

  • Rogge, N., De Jaeger, S., & Lavigne, C. (2017). Waste performance of NUTS 2—regions in the EU: A conditional directional distance benefit-of-the-doubt model. Ecological Economics,139, 19–32.

    Article  Google Scholar 

  • Scheel, H. (2000). EMS: Efficiency Measurement System Users Manual, Version 1.3. University of Dortmund, Dortmund.

  • Scheel, H. (2001). Undesirable outputs in efficiency valuations. European Journal of Operational Research,132, 400–410. https://doi.org/10.1016/S0377-2217(00)00160-0.

    Article  Google Scholar 

  • Schinnar, A. P., Kamis-Gould, E., Delucia, N., & Rothbard, A. B. (1990). Organizational determinants of efficiency and effectiveness in mental health partial care programs. Health Services Research,25, 387–420.

    Google Scholar 

  • Seiford, M. L., & Zhu, J. (2002). Modeling undesirable factors in efficiency evaluation. European Journal of Operational Research,142, 16–20.

    Article  Google Scholar 

  • Shaffer, K. J., & Dalton, P. M. (2014). The connection between training, electronic ordering, strategic alliances and supply chain procurement efficiency: An empirical study. International Journal of Business, Marketing, & Decision Science,7, 59–80.

    Google Scholar 

  • Shea, T., De Cieri, H., Donohue, R., Cooper, B., & Sheehan, C. (2016). Leading indicators of occupational health and safety: An employee and workplace level validation study. Safety Science,85, 293–304. https://doi.org/10.1016/j.ssci.2016.01.015.

    Article  Google Scholar 

  • Sheehan, C., Donohue, R., Shea, T., Cooper, B., & Cieri, H. De. (2016). Leading and lagging indicators of occupational health and safety: The moderating role of safety leadership. Accident Analysis and Prevention,92, 130–138. https://doi.org/10.1016/j.aap.2016.03.018.

    Article  Google Scholar 

  • Sherman, H.D., Zhu, J. (2006). Service productivity management—Improving service performance using data envelopment analysis (DEA). Springer.

  • Simar, L., & Wilson, P. W. (2007). Estimation and inference in two-stage, semi-parametric models of production processes. Journal of Econometrics,136, 31–64. https://doi.org/10.1016/j.jeconom.2005.07.009.

    Article  Google Scholar 

  • Simar, L., & Wilson, P. W. (2011). Two-stage DEA: caveat emptor. Journal Productivity Analysis,36, 205–218. https://doi.org/10.1007/s11123-011-0230-6.

    Article  Google Scholar 

  • Sinelnikov, S., Inouye, J., & Kerper, S. (2015). Using leading indicators to measure occupational health and safety performance. Safety Science,72, 240–248. https://doi.org/10.1016/j.ssci.2014.09.010.

    Article  Google Scholar 

  • Skirbekk, V. (2004). Age and individual productivity: A literature survey. In G. Feichtinger (Ed.), Vienna yearbook of population research. Vienna: Verlag der Österreichischen Akademie der Wissenschaften.

    Google Scholar 

  • SLIC (2015a). Evaluation reference manual—Carrying out a SLIC evaluation. Senior Labour Inspectors Committee (SLIC), European Commission, Luxembourg.

  • SLIC (2015b). Common principles for labour inspection in relation to health and safety in the workplace. Senior Labour Inspectors Committee (SLIC), European Commission, Luxembourg.

  • Szczepura, A., Davies, C., Fletcher, J., & Boussofiane, A. (1993). Efficiency and effectiveness in general practice. Journal of Management in Medicine,7, 36–47.

    Article  Google Scholar 

  • Tabassi, A. A., Ramli, M., & Bakar, A. H. A. (2012). Effects of training and motivation practices on teamwork improvement and task efficiency: The case of construction firms. International Journal of Project Management,30, 213–224. https://doi.org/10.1016/j.ijproman.2011.05.009.

    Article  Google Scholar 

  • Thompson, R. G., Langemeier, C. L., Lee, E., & Thrall, R. (1990). The role of multiplier bounds in efficiency analysis with application to Kansas farming. Journal of Econometrics,46, 93–108.

    Article  Google Scholar 

  • Thompson, R. G., Singleton, F. D., Jr., Thrall, R. M., & Smith, B. A. (1986). Comparative site evaluations for locating a high-energy physics lab in Texas. Interfaces,16, 35–49.

    Article  Google Scholar 

  • Tõsine, H., Wedege, N.-P. (2013). Measuring performance of the occupational safety and health function—A handbook for labour inspectorates. international association of labour inspection (IALI).

  • Zanella, A., Camanho, A. S., & Dias, T. G. (2013). Benchmarking countries’ environmental performance. Journal of the Operational Research Society,64, 426–438.

    Article  Google Scholar 

  • Zanella, A., Camanho, A. S., & Dias, T. G. (2015). Undesirable outputs and weighting schemes in composite indicators based on data envelopment analysis. European Journal of Operational Research,245(2), 517–530.

    Article  Google Scholar 

Download references

Acknowledgements

The authors wish to thank to the ACT, in the person of its previous Inspector General, Pedro Braz, for the provision of the data used in this research. They also acknowledge the important support of Maria José Tiago, Carlos Pereira, Helena Martins, Rui Santos, Sandra Santos, Alexandre Marques and Paulo Simões of the ACT. A word of gratitude is also due to Inês Gonçalves, from GEP/MTSSS, for the provision of data on work-related accidents and days of absence from work in Portugal, by municipality and economic activity sector. The second and third authors are pleased to acknowledge financial support from Fundação para a Ciência e a Tecnologia (Grant UID/ECO/04007/2019).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Sérgio P. Santos.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Santos, A.J.R., Santos, S.P., Amado, C.A.F. et al. Labor inspectorates’ efficiency and effectiveness assessment as a learning path to improve work-related accident prevention. Ann Oper Res 288, 609–651 (2020). https://doi.org/10.1007/s10479-019-03287-y

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10479-019-03287-y

Keywords

Navigation