Skip to main content
SpringerLink
Log in

Environment for Data Transfer Measurement

  • Conference paper
  • First Online:
Data Mining and Big Data (DMBD 2016)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 9714))

Included in the following conference series:

  • 2870 Accesses

Abstract

Measurement of the data transfer considered as often task when regular transfer over long distant network of large volume data is required. The data transfer over network depends on many conditions and parameters. Quite often measurements have to be repeated several times. The paper describes procedure how to implement appropriate measurements to store automatically all the parameters and messages during the data transfer. The saved history tracking permits to do detailed comparison of measurement results.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. ISO/IEC JTC 1 - Big Data. Preliminary report (2014). http://www.iso.org/iso/home/store/publication_item.htm?pid=PUB100361

  2. Khoruzhnikov, S.E., Grudinin, V.A., Sadov, O.L., Shevel, A.Y., Kairkanov, A.B.: Transfer of large volume data over internet with parallel data links and SDN. In: Tan, Y., Shi, Y., Buarque, F., Gelbukh, A., Das, S., Engelbrecht, A. (eds.) ICSI-CCI 2015. LNCS, vol. 9142, pp. 463–471. Springer, Heidelberg (2015)

    Chapter  Google Scholar 

  3. Data Transfer Tools. http://fasterdata.es.net/data-transfer-tools

  4. NIST Big Data public working group. http://bigdatawg.nist.gov

  5. Johnston, W.E., Dart, E., Ernst, M., Tierney, B.: Enabling high throughput in widely distributed data management and analysis systems: lessons from the LHC (2013). https://tnc2013.terena.org/getfile/402

  6. OpenSSH. http://openssh.org

  7. Ah Nam, H. et al: The practical obstacles of data transfer: why researchers still love scp. In: NDM 2013 Proceedings of the Third International Workshop on Network-Aware Data Management, Article No. 7 (2013). doi:10.1145/2534695.2534703

  8. Patched OpenSSH. http://sourceforge.net/projects/hpnssh

  9. BBCP – utility to transfer the data over network. http://www.slac.stanford.edu/~abh/bbcp

  10. BBFTP – utility for bulk data transfer. http://doc.in2p3.fr/bbftp

  11. Fast Data Transfer. http://monalisa.cern.ch/FDT

  12. Grid/Globus data transfer tool. Client part is known as globus-url-copy. http://toolkit.globus.org/toolkit/data/gridftp

  13. File Transfer Service. http://www.eu-emi.eu/products/-/asset_publisher/1gkD/content/fts3

  14. Generate debug information for the system. http://linux.die.net/man/1/sosreport

  15. Perfsonar. http://www.perfsonar.net

  16. Laboratory of the Network Technology. http://sdn.ifmo.ru

Download references

Acknowledgements

The research has been carried out with the financial support of the Ministry of Education and Science of the Russian Federation under grant agreement #14.575.21.0058.

Author information

Authors and Affiliations

  1. ITMO University, St. Petersburg, Russian Federation

    Sergey Khoruzhnikov, Vladimir Grudinin, Oleg Sadov, Andrey Shevel, Stefanos Georgiou & Arsen Kairkanov

  2. National Research Centre “Kurchatov Institute”, B.P. Konstantinov, Petersburg Nuclear Physics Institute, Gatchina, Russian Federation

    Andrey Shevel

  3. Athens University of Economics and Business, Athens, Greece

    Stefanos Georgiou

Authors
  1. Sergey Khoruzhnikov
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Vladimir Grudinin
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Oleg Sadov
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Andrey Shevel
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Stefanos Georgiou
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Arsen Kairkanov
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Arsen Kairkanov .

Editor information

Editors and Affiliations

  1. Peking University, Beijing, China

    Ying Tan

  2. Xi'an Jiaotong-Liverpool University, Suzhou, China

    Yuhui Shi

Rights and permissions

Reprints and permissions

Copyright information

© 2016 Springer International Publishing Switzerland

About this paper

Cite this paper

Khoruzhnikov, S., Grudinin, V., Sadov, O., Shevel, A., Georgiou, S., Kairkanov, A. (2016). Environment for Data Transfer Measurement. In: Tan, Y., Shi, Y. (eds) Data Mining and Big Data. DMBD 2016. Lecture Notes in Computer Science(), vol 9714. Springer, Cham. https://doi.org/10.1007/978-3-319-40973-3_42

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-40973-3_42

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-40972-6

  • Online ISBN: 978-3-319-40973-3

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation