Skip to main content

Experiences from Developing a Web Crawler Using a Model-Driven Development Tool: Emerging Opportunities

  • Conference paper
  • First Online:
Enterprise, Business-Process and Information Systems Modeling (BPMDS 2022, EMMSAD 2022)

Abstract

Model-driven development (MDD) tools aim to increase software development speed and decrease software time-to-market. Available MDD tools in the market state that software development teams can fast and easily develop “any” software by using them. So, the following research question arises: what is the perception of a software developer in using an MDD tool to create software he/she is used to develop without models? We selected Mendix, a user-friendly and easy configurable MDD tool, to address such a question and develop a domain-specific software artifact. We propose a use case collaborating with a Swiss company that allows users to compare insurances based on web crawling. Therefore, we ask a software developer at the Swiss company to develop a simplified version of a web crawler using the selected MDD tool. The software developer has extensive experience with developing web crawlers. However, for the software developer using MDD tools was a new paradigm of software development. We observe that the software developer successfully developed the web crawler using the MDD tool. However, he/she perceived some difficulties during the development, arising opportunities such as decreasing modeling complexity, increasing the MDD tool integrability, and improving modeling assistance. Finally, we conclude the experience report by drawing next research endeavors to generalize the results and discover new opportunities for improving MDD tools.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Sendall, S., Kozaczynski, W.: Model transformation: the heart and soul of model-driven software development. IEEE Softw. 20, 42–45 (2003)

    Article  Google Scholar 

  2. OutSystems Home Page. https://www.outsystems.com. Accessed 04 Mar 2022

  3. PowerApps Home Page. https://powerapps.microsoft.com/en-us/. Accessed 04 Mar 2022

  4. Appian Home Page. https://appian.com. Accessed 04 Mar 2022

  5. WebRato Home Page. https://www.webratio.com/site/content/es/home. Accessed 04 Mar 2022

  6. Mendix Home Page. https://www.mendix.com. Accessed 04 Mar 2022

  7. Jia, X., Jones, C.: AXIOM: a model-driven approach to cross-platform application development. In: ICSOFT 2012 - Proceedings of the 7th International Conference on Software Paradigm Trends, pp. 24–33 (2012)

    Google Scholar 

  8. Acerbis, R., Bongio, A., Brambilla, M., Butti, S.: Model-driven development of cross-platform mobile applications with web ratio and IFML. In: Proceedings - 2nd ACM International Conference on Mobile Software Engineering and Systems, MOBILESoft 2015, pp. 170–171 (2015)

    Google Scholar 

  9. Rieger, C.: Business apps with MAML. In: Proceedings of the Symposium on Applied Computing, pp. 1599–1606. ACM, New York, NY, USA (2017)

    Google Scholar 

  10. Rosales-Morales, V.Y., Sánchez-Morales, L.N., AlorHernández, G., Garcia-Alcaraz, J.L., Sánchez-Cervantes, J.L., Rodriguez-Mazahua, L.: ImagIngDev: a new approach for developing automatic cross-platform mobile applications using image processing techniques. Comput. J. 63, 732–757 (2020)

    Article  Google Scholar 

  11. Khder, M.: Web scraping or web crawling: state of art, techniques, approaches and application. Int. J. Adv. Soft Comput. App. 13, 145–168 (2021)

    Google Scholar 

  12. Liddle, S.W.: Model-driven software development. In: Embley, D., Thalheim, B. (eds) Handbook of Conceptual Modeling, pp. 17–54. Springer, Heidelberg (2011). https://doi.org/10.1007/978-3-642-158650-0_2

  13. Sahay, A., Indamutsa, A., di Ruscio, D., Pierantonio, A.: Supporting the understanding and comparison of low-code development platforms. In: 46th Euromicro Conference on Software Engineering and Advanced Applications (SEAA), pp. 171–178. IEEE (2020)

    Google Scholar 

  14. Brambilla, M., Butti, S., Fraternali, P.: WebRatio BPM: a tool for designing and deploying business processes on the web. In: Benatallah, B., Casati, F., Kappel, G., Rossi, G. (eds.) Web Engineering. LNCS, vol. 6189, pp. 415–429. Springer, Heidelberg (2010). https://doi.org/10.1007/978-3-642-13911-6_28

    Chapter  Google Scholar 

  15. Geer, D.: Eclipse becomes the dominant Java IDE. Computer (Long Beach Calif). 38, 16–18 (2005)

    Google Scholar 

  16. Gartner, I.: Gartner Magic Quadrant for Enterprise Low-Code Application Platforms (2021)

    Google Scholar 

  17. Puppeteer GitHub Repository. https://github.com/puppeteer/puppeteer. Accessed 06 Mar 2022

Download references

Acknowledgments

Our research is supported by the Zürich University of Applied Sciences (ZHAW) – School of Engineering: Institute for Applied Information Technology (InIT); and the Innosuisse Flagship Initiative - Project SHIFT.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to David Mosquera .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2022 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Mosquera, D., Martakos, A., Ruiz, M. (2022). Experiences from Developing a Web Crawler Using a Model-Driven Development Tool: Emerging Opportunities. In: Augusto, A., Gill, A., Bork, D., Nurcan, S., Reinhartz-Berger, I., Schmidt, R. (eds) Enterprise, Business-Process and Information Systems Modeling. BPMDS EMMSAD 2022 2022. Lecture Notes in Business Information Processing, vol 450. Springer, Cham. https://doi.org/10.1007/978-3-031-07475-2_23

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-07475-2_23

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-07474-5

  • Online ISBN: 978-3-031-07475-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics