Skip to main content
SpringerLink
Log in

An Edge Computing Architecture for Internet Measurement Network to Measure and Analyze Protocol Data

  • Original Research
  • Published:
SN Computer Science Aims and scope Submit manuscript

Abstract

This paper presents the high-level architecture, task execution methods, and scheduling algorithms behind community internet measurement network (IMN), named AIORI-IMN (Raje A, et al. The Internet Measurement Network (AIORI-IMN). In: 2023 4th International Conference on Computing and Communication Systems (I3CS) 1–8, 2023). AIORI-IMN is researched and developed as part of the project “Advanced Internet Operations Research in India” (AIORI) funded by MeitY, Govt. of India (Internet Governance | Ministry of Electronics and Information Technology, Government of India. URL https://www.meity.gov.in/content/internet-proliferation-governance). AIORI-IMN is designed to collect, analyze, collaborate and share protocol measurement metrics using distributed Remote Endpoints (RE). The underlying architecture supports the measurement platform to be plug-and-play, secured, scalable, interoperable and resilient. The core architecture is based on distributed edge computing paradigm. It has been designed to be layered with defined interfaces, helping each layer to be interoperable and flexible to adopt new changes with minimal or no impact on other layers. The distributed communication is handled using the Publish-Subscribe messaging pattern. The architecture, design and algorithms have been tested with a reference implementation. The implementation is live now having 100+ Remote Endpoints (RE). The portal https://aiori.in facilitates stakeholders to execute, analyze and visualize measurement tasks in REs. The underlying distributed edge architecture is having three layers (Worker, Controller, UI Management & Analytics). All the layers are interoperable and communicate through APIs and messages. The task execution and scheduling algorithms keep track of optimal resource utilization. A novel approach to Internet Measurement has been researched. It needs continuous evolution so that it remains relevant for future Internet architecture.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8

Similar content being viewed by others

References

  1. Raje A, et al. The internet measurement network (AIORI-IMN). In: 2023 4th International Conference on Computing and Communication Systems (I3CS), pp. 1–8. 2023. https://doi.org/10.1109/I3CS58314.2023.10127255.

  2. Internet Governance|Ministry of Electronics and Information Technology, Government of India. https://www.meity.gov.in/content/internet-proliferation-governance. Accessed 9 May 2023.

  3. Claffy K. Measuring the Internet. IEEE Internet Comput. 2000;4:73–5 (Conference Name: IEEE Internet Computing).

    Article  Google Scholar 

  4. The Internet. https://www.livinginternet.com/i/i.htm. Accessed 22 Apr 2023.

  5. The Fundamentals of Networking|IBM. https://www.ibm.com/topics/networking. Accessed 9 May 2023.

  6. Peterson LL, Davie BS. Computer networks: a systems approach (Morgan Kaufmann, 2012). https://cseweb.ucsd.edu/classes/wi19/cse124-a/courseoverview/compnetworks.pdf.

  7. Lottor M. Domain Administrators Operations Guide. RFC RFC1033, RFC Editor. 1987. https://www.rfc-editor.org/info/rfc1033. Accessed 12 Jan 2022.

  8. Mockapetris P. Domain names—concepts and facilities. Tech. Rep. RFC1034, RFC Editor. 1987. https://www.rfc-editor.org/info/rfc1034. Accessed 12 Jan 2022.

  9. Bajpai V, Schönwälder J. A survey on internet performance measurement platforms and related standardization efforts. IEEE Commun Surv Tutor. 2015;17:1313–41 (Conference Name: IEEE Communications Surveys & Tutorials).

    Article  Google Scholar 

  10. Clark DD, et al. Measurement and analysis of internet interconnection and congestion. Soc Sci Res Netw. 2014. https://papers.ssrn.com/abstract=2417573. Accessed 26 June 2023.

  11. Knight S, Nguyen HX, Falkner N, Bowden R, Roughan M. The Internet topology zoo. IEEE J Select Areas Commun. 2011;29:1765–75 (Conference Name: IEEE Journal on Selected Areas in Communications.Conference Name: IEEE Journal on Selected Areas in Communications).

    Article  Google Scholar 

  12. Dart E, Rotman L, Tierney B, Hester M, Zurawski J. The Science DMZ: a network design pattern for data-intensive science. 2013. https://doi.org/10.1145/2503210.2503245.

  13. Yan H, et al. BGPmon: a real-time. In: Extensible monitoring system: scalable. In: 2009 Cybersecurity Applications and Technology Conference for Homeland Security, pp. 212–223. 2009. https://doi.org/10.1109/CATCH.2009.28

  14. Claffy K, Hyun Y, Keys K, Fomenkov M, Krioukov, D. Internet Mapping: from art to science. In: 2009 Cybersecurity Applications and Technology Conference for Homeland Security, pp. 205–211. 2009. https://doi.org/10.1109/CATCH.2009.38.

  15. Madhyastha HV, et al. iPlane: an information plane for distributed services. In: Proceedings of the 7th symposium on Operating systems design and implementation. USENIX Association, pp. 367–380. 2006 (ISBN 978-1-931971-47-8).

  16. Lodhi A, Larson N, Dhamdhere A, Dovrolis C, Claffy K. Using peeringDB to understand the peering ecosystem. ACM SIGCOMM Comput Commun Rev. 2014;44:20–7. https://doi.org/10.1145/2602204.2602208.

    Article  Google Scholar 

  17. Shavitt Y, Shir E. DIMES: let the internet measure itself. ACM SIGCOMM Comput Commun Rev. 2005;35:71–4. https://doi.org/10.1145/1096536.1096546.

    Article  Google Scholar 

  18. Borgnat P, Dewaele G, Fukuda K, Abry P, Cho K. Seven years and one day: sketching the evolution of internet traffic 2009. In: IEEE INFOCOM 2009, pp. 711–719. 2009. https://doi.org/10.1109/INFCOM.2009.5061979. (ISSN: 0743-166X).

  19. RFCs. https://www.ietf.org/standards/rfcs/. Accessed 24 May 2023.

  20. Lindqvist KE, Abley J. Operation of anycast services. In: Request for Comments RFC 4786, Internet Engineering Task Force. 2006;24. https://datatracker.ietf.org/doc/rfc4786. Accessed 15 June 2023.

  21. Arachchi S, Perera I. Continuous integration and continuous delivery pipeline automation for agile software project management. In: 2018 Moratuwa Engineering Research Conference (MERCon), pp. 156–161. 2018. https://doi.org/10.1109/MERCon.2018.8421965.

  22. Quevedo W. In The NATS protocol (ed.Quevedo, W.) Practical NATS: from beginner to Pro 19–41. 2018. https://doi.org/10.1007/978-1-4842-3570-6_2.

  23. Liu G, et al. Microservices: architecture, container, and challenges. In: 2020 IEEE 20th International Conference on Software Quality, Reliability and Security Companion (QRS-C), pp. 629–635. 2020. https://doi.org/10.1109/QRS-C51114.2020.00107.

  24. NATS: Channels. https://docs.nats.io/legacy/stan/intro/channels. Accessed 9 May 2023.

  25. Quevedo W. In High availability with NATS clustering (ed.Quevedo, W.) Practical NATS: from beginner to Pro 111–130. 2018. https://doi.org/10.1007/978-1-4842-3570-6_5.

  26. Leaf nodes. https://docs.nats.io/running-a-nats-service/configuration/leafnodes. Accessed 9 May 2023.

Download references

Acknowledgements

We acknowledge the entire AIORI Research team and the community stakeholders who have shown interest in hosting REs. AIORI is a grant-in-aid program of the Ministry of Electronics & Information Technology (MeitY) with Software Technology Parks of India (STPI) as the executing agency and India Internet Foundation (IIFON) and Internet Society Kolkata Chapter as the implementing agency

Funding

This study is funded by the Ministry of Electronics and Information Technology (MeitY), Internet Governance Division (IGD), Govt. of India (Grant Number: L-13014/38/2018-IGD-MeitY)

Author information

Author notes

  1. Anupam Agrawal, T. Santhosh, Indrajit De, Sushanta Sinha, Joherul Haq, Subodh Sachan and Manjit Nayak have contributed equally to this work.

Authors and Affiliations

  1. AIORI, India Internet Foundation (IIFON), 7/83, Shahid nagar, Kolkata, 700078, West Bengal, India

    Anand Raje, Anupam Agrawal, Indrajit De, Sushanta Sinha & Joherul Haq

  2. MeitY, Government of India, New Delhi, India

    T. Santhosh

  3. STPI, Government of India, New Delhi, India

    Subodh Sachan

  4. STPI, Government of India, Kolkata, West Bengal, India

    Manjit Nayak

  5. Professor, IEM and UEM, Kolkata, West Bengal, India

    Indrajit De

Authors
  1. Anand Raje
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Anupam Agrawal
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. T. Santhosh
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Indrajit De
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Sushanta Sinha
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Joherul Haq
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Subodh Sachan
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Manjit Nayak
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Anand Raje.

Ethics declarations

Conflict of interest

The authors declare that they have no conflict of interest.

Ethics Approval

This article does not contain any studies with human participants or animals performed by any of the authors.

Research Involving Human Participants and/or Animals

Not applicable.

Informed Consent

Not Applicable.

Consent to Participate

Not applicable.

Consent for Publication

Not applicable.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

This article is part of the topical collection “Advances in Internet Research and Engineering 2023” guest edited by Sudarsan S D, Mohit Sethi and Balaji Rajendran.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Raje, A., Agrawal, A., Santhosh, T. et al. An Edge Computing Architecture for Internet Measurement Network to Measure and Analyze Protocol Data. SN COMPUT. SCI. 4, 822 (2023). https://doi.org/10.1007/s42979-023-02267-1

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s42979-023-02267-1

Keywords

Search

Navigation