Abstract
Spatio-temporal data is a common data-type in astronomy, and layouts for this data are generally to improve the performance. However, restricted by Antarctic environmental conditions, the energy consumption of the storage system is the most pivotal problem. Traditional storage layout consumes a lot of energy for request execution. In this paper, a new storage layout for the astronomical observation data on Antarctic Dome A is designed, which divides the disk array by the observant sky coverage, stores data according to the space while the traditional storage method stores data chronologically. Then we use the tree-like structure to store the popular data and use the redundant mode to store the cold data. In simulated experiments, this storage layout is applied on the Antarctic storage system, and the average number of disks that needs to be opened at request can be reduced from 23.88 to 2.74, greatly reducing the energy consumption of the request.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Basak, J., Basak, J., Basak, J., Katz, R.: Data layout for power efficient archival storage systems. In: The Workshop on Power-Aware Computing and Systems, pp. 16–20 (2015)
Gong, Z., Lakshminarasimhan, S., Jenkins, J., Kolla, H., Ethier, S., Chen, J., Ross, R., Klasky, S., Samatova, N.F.: Multi-level layout optimization for efficient spatio-temporal queries on isabela-compressed data. In: Parallel & Distributed Processing Symposium, pp. 873–884 (2012)
Gurumurthi, S., Sivasubramaniam, A., Kandemir, M., Franke, H.: DRPM: dynamic speed control for power management in server class disks. ACM SIGARCH Comput. Archit. News 31(2), 169–181 (2003)
Huang, H., Hung, W., Kang, G.S.: Fs2: dynamic data replication in free disk space for improving disk performance and energy consumption. In: Twentieth ACM Symposium on Operating Systems Principles, pp. 263–276 (2005)
Liu, J., Zheng, J., Li, Y., Sun, Z., Wang, W., Yuan, T.: Hybrid s-raid: an energy-efficient data layout for sequential data storage. J. Comput. Res. Dev. 50(1), 37–48 (2013)
Lu, L., Varman, P., Wang, J.: Diskgroup: energy efficient disk layout for raid1 systems. In: International Conference on Networking, Architecture, and Storage, pp. 233–242 (2007)
Seagate: Desktop HDD product manual. http://www.seagate.com/wwwcontent/product-content/barracuda-fam/desktop-hdd/barracuda-7200-14/enus/docs/100686584p.pdf
Shang, Z., Hu, K., Hu, Y., Li, J., Li, J., Liu, Q., Ma, B., Quinn, J.L., Sun, J., Wang, L.: Operation, control, and data system for Antarctic survey telescope (ast3). In: Observatory Operations Strategies Processes & Systems IV. Proceedings of the SPIE, vol. 8448(8), p. 26 (2012)
Son, S.W., Chen, G., Kandemir, M.: Disk layout optimization for reducing energy consumption. In: International Conference on Supercomputing, pp. 274–283 (2005)
Son, S.W., Kandemir, M.: Energy-aware data prefetching for multi-speed disks. In: Conference on Computing Frontiers, Ischia, Italy, pp. 105–114, May 2006
K.D.U.S. Telescope: Kdust. http://en.wikipedia.org/wiki/Kunlun_Dark_Universe_Survey_Telescope
Yuan, Z., Yu, C., Sun, J., Xiao, J., Wang, J., Shang, Z., Hu, Y.: An energy efficient storage system for astronomical observation data on dome A. In: Wang, G., Zomaya, A., Perez, G.M., Li, K. (eds.) ICA3PP 2015. LNCS, vol. 9531, pp. 33–46. Springer, Cham (2015). doi:10.1007/978-3-319-27140-8_3
Zhu, Q., David, F.M., Devaraj, C.F., Li, Z., Zhou, Y., Cao, P.: Reducing energy consumption of disk storage using power-aware cache management. In: International Symposium on High PERFORMANCE Computer Architecture, p. 118 (2004)
Acknowledgments
This work is supported by the National Natural Science Foundation of China (11573019, 61602336), the Joint Research Fund in Astronomy (U1531111) under cooperative agreement between the National Natural Science Foundation of China (NSFC) and Chinese Academy of Sciences (CAS).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2017 Springer International Publishing AG
About this paper
Cite this paper
Yan, J. et al. (2017). Optimized Data Layout for Spatio-temporal Data in Time Domain Astronomy. In: Ibrahim, S., Choo, KK., Yan, Z., Pedrycz, W. (eds) Algorithms and Architectures for Parallel Processing. ICA3PP 2017. Lecture Notes in Computer Science(), vol 10393. Springer, Cham. https://doi.org/10.1007/978-3-319-65482-9_30
Download citation
DOI: https://doi.org/10.1007/978-3-319-65482-9_30
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-65481-2
Online ISBN: 978-3-319-65482-9
eBook Packages: Computer ScienceComputer Science (R0)