skip to main content
10.1145/2608029.2608030acmconferencesArticle/Chapter ViewAbstractPublication PageshpdcConference Proceedingsconference-collections
research-article

Science in the cloud: lessons from three years of research projects on microsoft azure

Published:23 June 2014Publication History

ABSTRACT

Microsoft Research is now in its fourth year of awarding Windows Azure cloud resources to the academic community. As of April 2014, over 200 research projects have started. In this paper we review the results of this effort to date. We also characterize the computational paradigms that work well in public cloud environments and those that are usually disappointing. We also discuss many of the barriers to successfully using commercial cloud platforms in research and ways these problems can be overcome.

References

  1. http://www.reasearch.microsoft.com/azureGoogle ScholarGoogle Scholar
  2. Keith R. Jackson, Lavanya Ramakrishnan, Krishna Muriki, Shane Canon, Shreyas Cholia, John Shalf, Harvey J. Wasserman, and Nicholas J. Wright. 2010. Performance Analysis of High Performance Computing Applications on the Amazon Web Services Cloud. In Proceedings of the 2010 IEEE Second International Conference on Cloud Computing Technology and Science (CLOUDCOM '10). IEEE Computer Society, Washington, DC, USA, 159--168. DOI=10.1109/CloudCom.2010.69. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Lavanya Ramakrishnan, Piotr T. Zbiegel, Scott Campbell, Rick Bradshaw, Richard Shane Canon, Susan Coghlan, Iwona Sakrejda, Narayan Desai, Tina Declerck, and Anping Liu. 2011. Magellan: experiences from a science cloud. In Proceedings of the 2nd international workshop on Scientific cloud computing (ScienceCloud '11). ACM, New York, NY, USA, 49--58. DOI=10.1145/1996109.1996119. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. M. Humphrey, N. Beekwilder, J. Goodall, and M. Ercan. Calibration of Watershed Models using Cloud Computing. Proceedings of the 8th IEEE International Conference on eScience (eScience 2012). Oct 8--12 2012. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. AzureBlast: a case study of developing science applications on the cloud., Wei Lu, Jared Jackson, Roger S. Barga. 01/2010; DOI:10.1145/1851476.1851537 In proceeding of: Proceedings of the 19th ACM International Symposium on High Performance Distributed Computing, HPDC 2010, Chicago, Illinois, USA, June 21--25, 2010. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Radu Tudoran, Alexandru Costan, Gabriel Antoniu, Hakan Soncu. "TomusBlobs: Towards Communication-Efficient Storage for MapReduce Applications in Azure." In Proc. 12th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (CCGrid'2012), May 2012, Ottawa, Canada. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Puri, S., Agarwal D., He, X., and Prasad, S.K. MapReduce algorithms for GIS Polygonal Overlay Processing, in: IEEE International Parallel and Distributed Processing Symposium workshops, to appear, Boston, USA, May 2013 Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Thompson, J.M., N.G. Sgourakis, G. Liu, P. Rossi, Y. Tang, J.L. Mills, T. Szyperski, G.T. Montelione, and D. Baker, Accurate protein structure modeling using sparse NMR data and homologous structure information. Proceedings of the National Academy of Sciences, 2012. 109(25): p. 9875--9880.Google ScholarGoogle Scholar
  9. Nabeel M. Mohamed, Heshan Lin, Wuchun Feng. Accelerating Data-Intensive Genome Analysis in the Cloud. In Proceedings of the 5th International Conference on Bioinformatics and Computational Biology (BICoB), Honolulu, Hawaii, USA, March 2013.Google ScholarGoogle Scholar
  10. Thilina Gunarathne, Judy Qiu, and Geoffrey Fox, Iterative MapReduce for Azure Cloud in CCA11 Cloud Computing and Its Applications. April 12--13, 2011. Chicago, ILL.Google ScholarGoogle Scholar
  11. Wilkins-Diehr, N.; Gannon, D.; Klimeck, G.; Oster, S.; Pamidighantam, S., "TeraGrid Science Gateways and Their Impact on Science," Computer, vol.41, no.11, pp.32--41, Nov. 2008 doi: 10.1109/MC.2008.470 Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Ignacio Blanquer, Goetz Brasche, Jacek Cala, Fabrizio Gagliardi, Dennis Gannon, Hugo Hiden, Hakan Soncu, Kenji Takeda, Andrés Tomás, Simon Woodman, Supporting NGS pipelines in the cloud, 2013 - journal.embnet.orgGoogle ScholarGoogle Scholar
  13. J Cała, H Hiden, S Woodman, P Watson, Fast Exploration of the QSAR Model Space with e-Science Central and Windows Azure. 2012 - esciencecentral.co.ukGoogle ScholarGoogle Scholar
  14. Neo D. Martinez, Perrine Tonin, Barbara Bauer, Rosalyn C. Rael, Rahul Singh, Sangyuk Yoon, Ilmi Yoon , and Jennifer A. Dunne, Sustaining Economic Exploitation of Complex Ecosystems in Computational Models of Coupled Human-Natural Networks, Proceedings of the Twenty-Sixth AAAI Conference on Artificial Intelligence, 2013.Google ScholarGoogle Scholar
  15. http://fetchclimate.cloudapp.net/Google ScholarGoogle Scholar
  16. Matthew J. Smith, Paul I. Palmer, Drew W. Purves, Mark C. Vanderwel, Vassily Lyutsarev, Ben Calderhead, Lucas N. Joppa, Christopher M. Bishop, and Stephen Emmott, Changing how Earth System Modelling is done to provide more useful information for decision making, science and society., in Bulletin of the American Meteorological Society, American Meteorological Society, February 2014Google ScholarGoogle Scholar
  17. DataUp: Describe, Manage and Share Your Data, http://dataup.cdlib.org and http://research.microsoft.com/en-us/projects/dataup/Google ScholarGoogle Scholar
  18. Dazhi Chong, Kurt Maly, Elizabeth Rasnick, Harris Wu and Mohammad Zubair, "Social Curation of large multimedia collections on the cloud", Digital Humanities 2012, Hamburg, Germany, July 16--22, 2012Google ScholarGoogle Scholar
  19. B Howe, F Ribalet, S Chitnis, G Armbrust, D Halperin, SQLShare: Scientific Workflow Management via Relational View Sharing - 2013 Computing in Science and Engineering 15:22--31. Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. http://www.flickr.com/photos/britishlibrary/Google ScholarGoogle Scholar
  21. http://mechanicalcurator.tumblr.com/Google ScholarGoogle Scholar
  22. http://vmdepot.msopentech.com/List/IndexGoogle ScholarGoogle Scholar
  23. http://thedata.org/Google ScholarGoogle Scholar
  24. http://research.microsoft.com/apps/video/default.aspx?id=175587Google ScholarGoogle Scholar
  25. Clouds in Space: Scientific Computing using Windows Azure, Steven J Johnston*, Neil S O'Brien, Hugh G Lewis, Elizabeth E Hart, Adam White and Simon J Cox, Journal of Cloud Computing: Advances, Systems and Applications 2013, 2:2Google ScholarGoogle Scholar

Index Terms

  1. Science in the cloud: lessons from three years of research projects on microsoft azure

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in
    • Published in

      cover image ACM Conferences
      ScienceCloud '14: Proceedings of the 5th ACM workshop on Scientific cloud computing
      June 2014
      70 pages
      ISBN:9781450329118
      DOI:10.1145/2608029
      • General Chairs:
      • Ioan Raicu,
      • Kate Keahey,
      • Program Chairs:
      • Kyle Chard,
      • Bogdan Nicolae

      Copyright © 2014 ACM

      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 23 June 2014

      Permissions

      Request permissions about this article.

      Request Permissions

      Check for updates

      Qualifiers

      • research-article

      Acceptance Rates

      ScienceCloud '14 Paper Acceptance Rate8of17submissions,47%Overall Acceptance Rate44of151submissions,29%

      Upcoming Conference

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader