A. Tosson
ABSTRACT
The X-ray crystallography community has recently been affected by a significant increase in data volume caused by the use of advanced detector technologies and the new generation of high brilliance light sources. The fact that forced the decision makers to implement Big Data analytics, aiming to achieve a suitable environment for scientists at experimental and post-experimental phases. This paper demonstrates an extension of our approach towards a compact platform which provides the scientists with the digital ecosystem for the systematic harvest of data. It introduces an innovative solution to use warehousing and cloud computing to manage datasets collected by 2D energy-dispersive detectors, for an example. Moreover, it suggests that, deploying a Software as a Service (SaaS) cloud model, a public cloud data center, and cloud-based in-memory warehousing architecture, it is possible to dramatically reduce both hardware and processing costs.
- E. Martz, C.M. Logan, D.J. Schneberk and P.J. Shull, X-Ray Imaging: Fundamentals, Industrial Techniques and Applications, CRC Press (2016) [ISBN: 9780849397721].Google Scholar
- J. DePasquale, K. Arcand and P. Edmonds, High energy vision: Processing x-rays, Stud. Media Commun. 3 (2015) 62.Google Scholar
- C. Roobottom, G. Mitchell and G. Morgan-Hughes, Radiation reduction strategies in cardiac computed tomographic angiography, Clin. Radiol. 65 (2010) 859.Google ScholarCross Ref
- Z. Sayers, B. Avşar, E. Cholak and I. Karmous, Application of advanced x-ray methods in life sciences, Biochim. Biophys. Acta Gen. Subj. 1861 (2017) 3671.Google ScholarCross Ref
- W. Namkung, Review of third generation light sources, in proceedings of the 1st International Particle Accelerator Conference (IPAC 2010), Kyoto, Japan, 23-28 May 2010.Google Scholar
- Wilkinson, M. D. et al. The FAIR Guiding Principles for scientific data management and stewardship. Sci. Data 3:160018 doi: 10.1038/sdata.2016.18 (2016).Google Scholar
- W. Leitenberger, R. Hartmann, U. Pietsch, R. Andritschke, I. Starke and L. Strüder, Application of a pnCCD in x-ray diffraction: a three-dimensional x-ray detector, J. Synchrotron Radiat. 15 (2008) 449.Google ScholarCross Ref
- A. Tosson et al., "EDLD-tool: A real-time GPU-based tool to stream and analyze energy-dispersive Laue diffraction of big data sets collected by a pnCCD," Journal of Instrumentation 14(01), P01008(2019).Google ScholarCross Ref
- Bell, N. & Garland, M. Efficient sparse matrix-vector multiplication on CUDA tech. rep. (Nvidia Technical Report NVR-2008-004, Nvidia Corporation, 2008).Google Scholar
- ScieBo - Die Campuscloud < https://www.zimt.uni-siegen.de/dienste/campuscloud/>.Google Scholar
- Garofalo, R. Building enterprise applications with Windows Presentation Foundation and the model view ViewModel Pattern (Microsoft Press, 2011).Google Scholar
- SanthoshBaboo, S & Renjith Kumar, P. Next Generation Data Warehouse and In-Memory Analytics. International Journal of Computer Applications 69, 25--30 (2013).Google Scholar
Index Terms
- Application of Cloud Computing for Big Data in the X-Ray Crystallography Community
Recommendations
Big data analytics in Cloud computing: an overview
AbstractBig Data and Cloud Computing as two mainstream technologies, are at the center of concern in the IT field. Every day a huge amount of data is produced from different sources. This data is so big in size that traditional processing tools are unable ...
The rise of "big data" on cloud computing
Cloud computing is a powerful technology to perform massive-scale and complex computing. It eliminates the need to maintain expensive computing hardware, dedicated space, and software. Massive growth in the scale of data or big data generated through ...
Performance Analysis of Big Data and Cloud Computing Techniques: A Survey
AbstractA cloud framework refers to the aggregation of components like development tools, middleware and database services, needed for cloud computing, which aids in developing, deploying and managing cloud based applications strenuously, consequently ...
Comments