Skip to main content

Lessons Learned from Applying Requirements and Design Techniques in the Development of a Machine Learning System for Predicting Lawsuits Against Power Companies

  • Conference paper
  • First Online:
Human Interface and the Management of Information. Information Presentation and Visualization (HCII 2021)

Abstract

Machine Learning (ML) has shown great potential for automating several aspects of everyday life and business. Experiences reports on developing ML systems, however, focus mainly on how to install, configure and maintain an ML system, but do not focus on the requirements engineering process and the design of the user interface that will present the data to the user. In this paper, we report the lessons learned from applying different requirements and design methods in one of the stages of a large development project (18 months). Its goal was to develop and evaluate a Web based application embedding an ML model that would produce data on the probability of lawsuits based on features such as: number of complaints, electrical damage to appliances and power shutdowns. At all, the design team applied the following techniques: (a) Interviews and document analysis, to identify the major reasons for filling a lawsuit; (b) Personas, to define which type of clients could file a lawsuit; (c) Scenarios, to define which interaction (conversations) would be automatically triggered by a chatbot to try to solve client problems, avoiding a lawsuit; and (d) Prototype evaluation, to define the interaction and type of data that would be available to the lawyers through a Web application. Through the lessons learned within this paper and by providing details for its replication, we intend to encourage software companies to combine requirements and design approaches for cost-effective user centered design, especially in decision support intelligent systems.

Supported by Equatorial Energia.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    Brazilian Website “Complain Here” (“Reclame Aqui” in Portuguese) - https://www.reclameaqui.com.br/.

  2. 2.

    Equatorial Power Company Brazilian Website - https://ma.equatorialenergia.com.br/.

References

  1. de Almeida, G.R., Cirqueira, D.R., Lobato, F.M.: Improving social CRM through electronic word-of-mouth: a case study of ReclameAqui. In: Anais Estendidos do XXIII Simpósio Brasileiro de Sistemas Multimídia e Web, pp. 107–110. SBC (2017)

    Google Scholar 

  2. Amin, A., et al.: Customer churn prediction in the telecommunication sector using a rough set approach. Neurocomputing 237, 242–254 (2017)

    Article  Google Scholar 

  3. Arora, M., Verma, S., Kavita, Chopra S: A systematic literature review of machine learning estimation approaches in scrum projects. In: Mallick, P., Balas, V., Bhoi, A., Chae, G.S. (eds.) Cognitive Informatics and Soft Computing. Advances in Intelligent Systems and Computing, vol. 1040, pp. 573–586. Springer, Singapore (2020). https://doi.org/10.1007/978-981-15-1451-7_59

    Chapter  Google Scholar 

  4. Camburn, B., et al.: Design prototyping methods: state of the art in strategies, techniques, and guidelines. Des. Sci. 3, e13 (2017)

    Article  Google Scholar 

  5. Davis, A., Dieste, O., Hickey, A., Juristo, N., Moreno, A.M.: Effectiveness of requirements elicitation techniques: empirical results derived from a systematic review. In: 14th IEEE International Requirements Engineering Conference (RE 2006), pp. 179–188. IEEE (2006)

    Google Scholar 

  6. Dove, G., Halskov, K., Forlizzi, J., Zimmerman, J.: UX design innovation: challenges for working with machine learning as a design material. In: Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems, pp. 278–288 (2017)

    Google Scholar 

  7. França, J.V., et al.: Legal judgment prediction in the context of energy market using gradient boosting. In: 2020 IEEE International Conference on Systems, Man, and Cybernetics (SMC), pp. 875–880. IEEE (2020)

    Google Scholar 

  8. Gruginskie, L., Vaccaro, G.L.R.: Lawsuit lead time prediction: Comparison of data mining techniques based on categorical response variable. PLoS One 13(6), e0198122–e0198122 (2018)

    Article  Google Scholar 

  9. Hill, C., Bellamy, R., Erickson, T., Burnett, M.: Trials and tribulations of developers of intelligent systems: a field study. In: 2016 IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC), pp. 162–170. IEEE (2016)

    Google Scholar 

  10. Hirsch, T., Merced, K., Narayanan, S., Imel, Z.E., Atkins, D.C.: Designing contestability: interaction design, machine learning, and mental health. In: Proceedings of the 2017 Conference on Designing Interactive Systems, pp. 95–99 (2017)

    Google Scholar 

  11. Hohman, F., Wongsuphasawat, K., Kery, M.B., Patel, K.: Understanding and visualizing data iteration in machine learning. In: Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems, pp. 1–13 (2020)

    Google Scholar 

  12. Holbrook III, H.: A scenario-based methodology for conducting requirements elicitation. ACM SIGSOFT Softw. Eng. Notes 15(1), 95–104 (1990)

    Article  Google Scholar 

  13. Ibáñez, V.A., Hartmann, P., Calvo, P.Z.: Antecedents of customer loyalty in residential energy markets: Service quality, satisfaction, trust and switching costs. Serv. Ind. J. 26(6), 633–650 (2006)

    Article  Google Scholar 

  14. Jain, P., Djamasbi, S., Wyatt, J.: Creating value with proto-research persona development. In: Nah, F.F.-H., Siau, K. (eds.) HCII 2019. LNCS, vol. 11589, pp. 72–82. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-22338-0_6

    Chapter  Google Scholar 

  15. Keramati, A., Ghaneei, H., Mirmohammadi, S.M.: Developing a prediction model for customer churn from electronic banking services using data mining. Financ. Innov. 2(1), 1–13 (2016). https://doi.org/10.1186/s40854-016-0029-6

    Article  Google Scholar 

  16. Kumeno, F.: Software engineering challenges for machine learning applications: a literature review. Intell. Decis. Technol. 13(4), 463–476 (2019)

    Article  Google Scholar 

  17. Lei, H., Ganjeizadeh, F., Jayachandran, P.K., Ozcan, P.: A statistical analysis of the effects of Scrum and Kanban on software development projects. Robot. Comput.-Integr. Manuf. 43, 59–67 (2017)

    Article  Google Scholar 

  18. Lytvyn, V., et al.: Design of a recommendation system based on collaborative filtering and machine learning considering personal needs of the user, vol. 4, no. 2, pp. 6–28 (2019)

    Google Scholar 

  19. Marchetti, R., Prado, P.H.: Avaliação da satisfação do consumidor utilizando o método de equações estruturais: um modelo aplicado ao setor elétrico brasileiro. Revista de Administração Contemporânea 8(4), 9–32 (2004)

    Article  Google Scholar 

  20. Masuda, S., Matsuodani, T., Tsuda, K.: Automatic generation of test cases using document analysis techniques. Int. J. New Technol. Res. 2(7), 59–64 (2016)

    Google Scholar 

  21. de O. Melo, C., et al.: The evolution of agile software development in Brazil. J. Braz. Comput. Soc. 19(4), 523–552 (2013). https://doi.org/10.1007/s13173-013-0114-x

    Article  Google Scholar 

  22. Menzies, T.: The five laws of se for AI. IEEE Softw. 37(1), 81–85 (2019)

    Article  Google Scholar 

  23. Poth, A., Riel, A.: Quality requirements elicitation by ideation of product quality risks with design thinking. In: 2020 IEEE 28th International Requirements Engineering Conference (RE), pp. 238–249. IEEE (2020)

    Google Scholar 

  24. Rafiq, U., Bajwa, S.S., Wang, X., Lunesu, I.: Requirements elicitation techniques applied in software startups. In: 2017 43rd Euromicro Conference on Software Engineering and Advanced Applications (SEAA), pp. 141–144. IEEE (2017)

    Google Scholar 

  25. Rivero, L., et al.: Deployment of a machine learning system for predicting lawsuits against power companies: lessons learned from an agile testing experience for improving software quality. In: Brazilian Symposium on Software Quality. ACM (2020)

    Google Scholar 

  26. Yang, Q.: The role of design in creating machine-learning-enhanced user experience. In: 2017 AAAI Spring Symposium Series (2017)

    Google Scholar 

Download references

Acknowledgments

This work was supported by SijurI project funded by Equatorial Energy under the Brazilian Electricity Regulatory Agency (ANEEL) P&D Program Grant number APLPED00044_PROJETOPED_0036_S01. Additionally, this work was supported by the Foundation for the Support of Research and Scientific Development of Maranh(FAPEMA), the Coordination for the Improvement of Higher Education Personnel (CAPES) and the National Council for Scientific and Technological Development (CNPq).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Luis Rivero .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2021 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Rivero, L. et al. (2021). Lessons Learned from Applying Requirements and Design Techniques in the Development of a Machine Learning System for Predicting Lawsuits Against Power Companies. In: Yamamoto, S., Mori, H. (eds) Human Interface and the Management of Information. Information Presentation and Visualization. HCII 2021. Lecture Notes in Computer Science(), vol 12765. Springer, Cham. https://doi.org/10.1007/978-3-030-78321-1_18

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-78321-1_18

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-78320-4

  • Online ISBN: 978-3-030-78321-1

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics