Storages Are Not Forever

Cambria, Erik; Chattopadhyay, Anupam; Linn, Eike; Mandal, Bappaditya; White, Bebo

doi:10.1007/s12559-017-9482-4

Title: Storages Are Not Forever

Journal Article · Sat May 27 00:00:00 EDT 2017 · Cognitive Computation

DOI:https://doi.org/10.1007/s12559-017-9482-4· OSTI ID:1420053

^[1]; Chattopadhyay, Anupam ^[1]; Linn, Eike ^[2]; Mandal, Bappaditya ^[3]; White, Bebo ^[4]

Nanyang Technological Univ. (Singapore)
RWTH Aachen Univ., Aachen (Germany)
A*STAR (Singapore)
SLAC National Accelerator Lab., Menlo Park, CA (United States)

Not unlike the concern over diminishing fossil fuel, information technology is bringing its own share of future worries. Here, we chose to look closely into one concern in this paper, namely the limited amount of data storage. By a simple extrapolatory analysis, it is shown that we are on the way to exhaust our storage capacity in less than two centuries with current technology and no recycling. This can be taken as a note of caution to expand research initiative in several directions: firstly, bringing forth innovative data analysis techniques to represent, learn, and aggregate useful knowledge while filtering out noise from data; secondly, tap onto the interplay between storage and computing to minimize storage allocation; thirdly, explore ingenious solutions to expand storage capacity. Throughout this paper, we delve deeper into the state-of-the-art research and also put forth novel propositions in all of the abovementioned directions, including space- and time-efficient data representation, intelligent data aggregation, in-memory computing, extra-terrestrial storage, and data curation. The main aim of this paper is to raise awareness on the storage limitation we are about to face if current technology is adopted and the storage utilization growth rate persists. In the manuscript, we propose some storage solutions and a better utilization of storage capacity through a global DIKW hierarchy.

View Accepted Manuscript (DOE)

Cite

Export

Save

Research Organization:: SLAC National Accelerator Laboratory (SLAC), Menlo Park, CA (United States)

Sponsoring Organization:: USDOE

Grant/Contract Number:: AC02-76SF00515

OSTI ID:: 1420053

Journal Information:: Cognitive Computation, Vol. 9, Issue 5; ISSN 1866-9956

Publisher:: SpringerCopyright Statement

Country of Publication:: United States

Language:: English

Citation Metrics:

Cited by: 5 works

Citation information provided by
Web of Science

References (59)

Accelerating the convergence of the back-propagation method Vogl, T. P.; Mangis, J. K.; Rigler, A. K. Biological Cybernetics, Vol. 59, Issue 4-5 https://doi.org/10.1007/BF00332914	journal	September 1988
Extreme Learning Machine for Regression and Multiclass Classification IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics), Vol. 42, Issue 2 https://doi.org/10.1109/TSMCB.2011.2168604	journal	April 2012
Database-friendly random projections: Johnson-Lindenstrauss with binary coins Achlioptas, Dimitris Journal of Computer and System Sciences, Vol. 66, Issue 4 https://doi.org/10.1016/S0022-0000(03)00025-4	journal	June 2003
Memristive devices and systems Chua, L. O. Proceedings of the IEEE, Vol. 64, Issue 2 https://doi.org/10.1109/PROC.1976.10092	journal	January 1976
Scaling limits of resistive memories Zhirnov, Victor V.; Meade, Roy; Cavin, Ralph K. Nanotechnology, Vol. 22, Issue 25 https://doi.org/10.1088/0957-4484/22/25/254027	journal	May 2011
A Complementary Resistive Switch-Based Crossbar Array Adder Siemon, Anne; Menzel, Stephan; Waser, Rainer IEEE Journal on Emerging and Selected Topics in Circuits and Systems, Vol. 5, Issue 1 https://doi.org/10.1109/JETCAS.2015.2398217	journal	March 2015
Ultimate physical limits to computation Lloyd, Seth Nature, Vol. 406, Issue 6799 https://doi.org/10.1038/35023282	journal	August 2000
Multistate Memristive Tantalum Oxide Devices for Ternary Arithmetic Kim, Wonjoo; Chattopadhyay, Anupam; Siemon, Anne Scientific Reports, Vol. 6, Issue 1 https://doi.org/10.1038/srep36652	journal	November 2016
Fisher discriminant analysis with kernels Mika, S.; Ratsch, G.; Weston, J. Neural Networks for Signal Processing IX: 1999 IEEE Signal Processing Society Workshop, Neural Networks for Signal Processing IX: Proceedings of the 1999 IEEE Signal Processing Society Workshop (Cat. No.98TH8468) https://doi.org/10.1109/NNSP.1999.788121	conference	January 1999
Beyond von Neumann—logic operations in passive crossbar arrays alongside memory operations Linn, E.; Rosezin, R.; Tappertzhofen, S. Nanotechnology, Vol. 23, Issue 30 https://doi.org/10.1088/0957-4484/23/30/305205	journal	July 2012
Input space versus feature space in kernel-based methods Scholkopf, B.; Mika, S.; Burges, C. J. C. IEEE Transactions on Neural Networks, Vol. 10, Issue 5 https://doi.org/10.1109/72.788641	journal	January 1999
‘Memristive’ switches enable ‘stateful’ logic operations via material implication Borghetti, Julien; Snider, Gregory S.; Kuekes, Philip J. Nature, Vol. 464, Issue 7290 https://doi.org/10.1038/nature08940	journal	April 2010
Image Processing Unit for General-Purpose Representation and Association System for Recognizing Low-Resolution Digits With Visual Information Variability Dai, Bowen; Li, Huihui; Wei, Lei IEEE Transactions on Systems, Man, and Cybernetics: Systems, Vol. 48, Issue 3 https://doi.org/10.1109/TSMC.2016.2601902	journal	March 2018
Learning word dependencies in text by means of a deep recurrent belief network Chaturvedi, Iti; Ong, Yew-Soon; Tsang, Ivor W. Knowledge-Based Systems, Vol. 108 https://doi.org/10.1016/j.knosys.2016.07.019	journal	September 2016
Face recognition in unconstrained videos with matched background similarity Wolf, Lior; Hassner, Tal; Maoz, Itay 2011 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), CVPR 2011 https://doi.org/10.1109/CVPR.2011.5995566	conference	June 2011
The DCC Curation Lifecycle Model Higgins, Sarah International Journal of Digital Curation, Vol. 3, Issue 1 https://doi.org/10.2218/ijdc.v3i1.48	journal	August 2008
The FERET evaluation methodology for face-recognition algorithms Phillips, P. J.; Rizvi, S. A. IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 22, Issue 10 https://doi.org/10.1109/34.879790	journal	January 2000
The Emerging "Big Dimensionality" Zhai, Yiteng; Ong, Yew-Soon; Tsang, Ivor W. IEEE Computational Intelligence Magazine, Vol. 9, Issue 3 https://doi.org/10.1109/MCI.2014.2326099	journal	August 2014
Using discriminant eigenfeatures for image retrieval Swets, D. L.; Weng, J. J. IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 18, Issue 8 https://doi.org/10.1109/34.531802	journal	January 1996
Whole space subclass discriminant analysis for face recognition Mandal, Bappaditya; Li, Liyuan; Chandrasekhar, Vijay 2015 IEEE International Conference on Image Processing (ICIP) https://doi.org/10.1109/ICIP.2015.7350814	conference	September 2015
In-memory adder functionality in 1S1R arrays Siemon, A.; Menzel, S.; Chattopadhyay, A. 2015 IEEE International Symposium on Circuits and Systems (ISCAS) https://doi.org/10.1109/ISCAS.2015.7168889	conference	May 2015
Extreme learning machines: a survey Huang, Guang-Bin; Wang, Dian Hui; Lan, Yuan International Journal of Machine Learning and Cybernetics, Vol. 2, Issue 2 https://doi.org/10.1007/s13042-011-0019-y	journal	May 2011
Critical decision method for eliciting knowledge Klein, G. A.; Calderwood, R.; MacGregor, D. IEEE Transactions on Systems, Man, and Cybernetics, Vol. 19, Issue 3 https://doi.org/10.1109/21.31053	journal	January 1989
Improved Analysis of the Subsampled Randomized Hadamard Transform Tropp, Joel A. Advances in Adaptive Data Analysis, Vol. 03, Issue 01n02 https://doi.org/10.1142/S1793536911000787	journal	April 2011
Realization of Boolean Logic Functionality Using Redox-Based Memristive Devices Siemon, Anne; Breuer, Thomas; Aslam, Nabeel Advanced Functional Materials, Vol. 25, Issue 40 https://doi.org/10.1002/adfm.201500865	journal	June 2015
Sentiment Data Flow Analysis by Means of Dynamic Linguistic Patterns Poria, Soujanya; Cambria, Erik; Gelbukh, Alexander IEEE Computational Intelligence Magazine, Vol. 10, Issue 4 https://doi.org/10.1109/MCI.2015.2471215	journal	November 2015
Complete discriminant evaluation and feature extraction in kernel space for face recognition Jiang, Xudong; Mandal, Bappaditya; Kot, Alex Machine Vision and Applications, Vol. 20, Issue 1 https://doi.org/10.1007/s00138-007-0103-1	journal	November 2007
The missing memristor found Strukov, Dmitri B.; Snider, Gregory S.; Stewart, Duncan R. Nature, Vol. 453, Issue 7191 https://doi.org/10.1038/nature06932	journal	May 2008
New Trends of Learning in Computational Intelligence [Guest Editorial] Huang, Guang-Bin; Cambria, Erik; Toh, Kar-Ann IEEE Computational Intelligence Magazine, Vol. 10, Issue 2 https://doi.org/10.1109/MCI.2015.2405277	journal	May 2015
In-Memory Data Compression Using ReRAMs Bhattacharjee, Debjyoti; Chattopadhyay, Anupam Emerging Technology and Architecture for Big-data Analytics https://doi.org/10.1007/978-3-319-54840-1_13	book	January 2017
Eigenfeature Regularization and Extraction in Face Recognition IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 30, Issue 3 https://doi.org/10.1109/TPAMI.2007.70708	journal	March 2008
Jumping NLP Curves: A Review of Natural Language Processing Research [Review Article] Cambria, Erik; White, Bebo IEEE Computational Intelligence Magazine, Vol. 9, Issue 2 https://doi.org/10.1109/MCI.2014.2307227	journal	May 2014
Extreme Learning Machines [Trends & Controversies] Cambria, Erik; Huang, Guang-Bin; Kasun, Liyanaarachchi Lekamalage Chamara IEEE Intelligent Systems, Vol. 28, Issue 6 https://doi.org/10.1109/MIS.2013.140	journal	November 2013
Statistical Learning Theory and ELM for Big Social Data Analysis Oneto, Luca; Bisio, Federica; Cambria, Erik IEEE Computational Intelligence Magazine, Vol. 11, Issue 3 https://doi.org/10.1109/MCI.2016.2572540	journal	August 2016
Bistability in Atomic-Scale Antiferromagnets Loth, S.; Baumann, S.; Lutz, C. P. Science, Vol. 335, Issue 6065 https://doi.org/10.1126/science.1214131	journal	January 2012
Efficient Binary Basic Linear Algebra Operations on ReRAM Crossbar Arrays Bhattacharjee, Debjyoti; Chattopadhyay, Anupam 2017 30th International Conference on VLSI Design and 2017 16th International Conference on Embedded Systems (VLSID) https://doi.org/10.1109/VLSID.2017.10	conference	January 2017
Universal upper bound on the entropy-to-energy ratio for bounded systems Bekenstein, Jacob D. Physical Review D, Vol. 23, Issue 2 https://doi.org/10.1103/PhysRevD.23.287	journal	January 1981
Universal Approximation Using Incremental Constructive Feedforward Networks With Random Hidden Nodes Huang, G. -B.; Chen, L.; Siew, C. -K. IEEE Transactions on Neural Networks, Vol. 17, Issue 4 https://doi.org/10.1109/TNN.2006.875977	journal	July 2006
The wisdom hierarchy: representations of the DIKW hierarchy Rowley, Jennifer Journal of Information Science, Vol. 33, Issue 2 https://doi.org/10.1177/0165551506070706	journal	February 2007
An Insight into Extreme Learning Machines: Random Neurons, Random Features and Kernels Huang, Guang-Bin Cognitive Computation, Vol. 6, Issue 3 https://doi.org/10.1007/s12559-014-9255-2	journal	April 2014
Circular backpropagation networks for classification Ridella, S.; Rovetta, S.; Zunino, R. IEEE Transactions on Neural Networks, Vol. 8, Issue 1 https://doi.org/10.1109/72.554194	journal	January 1997
Improved Approximation Algorithms for Large Matrices via Random Projections Sarlos, Tamas 2006 47th Annual IEEE Conference on Foundations of Computer Science, 2006 47th Annual IEEE Symposium on Foundations of Computer Science (FOCS'06) https://doi.org/10.1109/FOCS.2006.37	conference	October 2006
A Hybrid Belief Rule-Based Classification System Based on Uncertain Training Data and Expert Knowledge Jiao, Lianmeng; Denoeux, Thierry; Pan, Quan IEEE Transactions on Systems, Man, and Cybernetics: Systems, Vol. 46, Issue 12 https://doi.org/10.1109/TSMC.2015.2503381	journal	December 2016
(Keynote) Atomic Scale and Interface Interactions in Redox-Based Resistive Switching Memories Valov, I.; Tappertzhofen, S.; Linn, E. ECS Transactions, Vol. 64, Issue 14 https://doi.org/10.1149/06414.0003ecst	journal	August 2014
High density 3D memory architecture based on the resistive switching effect Kügeler, C.; Meier, M.; Rosezin, R. Solid-State Electronics, Vol. 53, Issue 12 https://doi.org/10.1016/j.sse.2009.09.034	journal	December 2009
DeepFace: Closing the Gap to Human-Level Performance in Face Verification Taigman, Yaniv; Yang, Ming; Ranzato, Marc'Aurelio 2014 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) https://doi.org/10.1109/CVPR.2014.220	conference	June 2014
Deep Learning-Based Model Reduction for Distributed Parameter Systems Wang, Mingliang; Li, Han-Xiong; Chen, Xin IEEE Transactions on Systems, Man, and Cybernetics: Systems, Vol. 46, Issue 12 https://doi.org/10.1109/TSMC.2016.2605159	journal	December 2016
Eigenfaces for Recognition Turk, Matthew; Pentland, Alex Journal of Cognitive Neuroscience, Vol. 3, Issue 1 https://doi.org/10.1162/jocn.1991.3.1.71	journal	January 1991
Sentic Computing: A Common-Sense-Based Framework for Concept-Level Sentiment Analysis Cambria, Erik; Hussain, Amir https://doi.org/10.1007/978-3-319-23654-4	book	January 2015
Incremental Linear Discriminant Analysis for Face Recognition Zhao, Haitao; Yuen, Pong Chi IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics), Vol. 38, Issue 1 https://doi.org/10.1109/TSMCB.2007.908870	journal	February 2008
Unsupervised learning of hierarchical representations with convolutional deep belief networks Lee, Honglak; Grosse, Roger; Ranganath, Rajesh Communications of the ACM, Vol. 54, Issue 10 https://doi.org/10.1145/2001269.2001295	journal	October 2011
Extreme learning machine: Theory and applications Huang, Guang-Bin; Zhu, Qin-Yu; Siew, Chee-Kheong Neurocomputing, Vol. 70, Issue 1-3 https://doi.org/10.1016/j.neucom.2005.12.126	journal	December 2006
Random projection in dimensionality reduction: applications to image and text data Bingham, Ella; Mannila, Heikki Proceedings of the seventh ACM SIGKDD international conference on Knowledge discovery and data mining - KDD '01 https://doi.org/10.1145/502512.502546	conference	January 2001
Guest Editorial: Big Social Data Analysis Cambria, Erik; Wang, Haixun; White, Bebo Knowledge-Based Systems, Vol. 69 https://doi.org/10.1016/j.knosys.2014.07.002	journal	October 2014
Next-Generation Digital Information Storage in DNA Church, G. M.; Gao, Y.; Kosuri, S. Science, Vol. 337, Issue 6102 https://doi.org/10.1126/science.1226355	journal	August 2012
Semi-supervised Learning for Affective Common-Sense Reasoning Oneto, Luca; Bisio, Federica; Cambria, Erik Cognitive Computation, Vol. 9, Issue 1 https://doi.org/10.1007/s12559-016-9433-5	journal	October 2016
Redox-based Resistive Memory Menzel, Stephan; Linn, Eike; Waser, Rainer Emerging Nanoelectronic Devices https://doi.org/10.1002/9781118958254.ch08	book	November 2014
Multi-level 40nm WOX resistive memory with excellent reliability Chien, Wei-Chih; Lee, Ming-Hsiu 2011 IEEE International Electron Devices Meeting (IEDM), 2011 International Electron Devices Meeting https://doi.org/10.1109/IEDM.2011.6131651	conference	December 2011
A HfO ₂ -Based Complementary Switching Crossbar Adder Breuer, Thomas; Siemon, Anne; Linn, Eike Advanced Electronic Materials, Vol. 1, Issue 10 https://doi.org/10.1002/aelm.201500138	journal	August 2015

Cited By (3)

Mining Big Data with Random Forests Lulli, Alessandro; Oneto, Luca; Anguita, Davide Cognitive Computation, Vol. 11, Issue 2 https://doi.org/10.1007/s12559-018-9615-4	journal	January 2019
A Grammar-Guided Genetic Programing Algorithm for Associative Classification in Big Data Padillo, F.; Luna, J. M.; Ventura, S. Cognitive Computation, Vol. 11, Issue 3 https://doi.org/10.1007/s12559-018-9617-2	journal	January 2019
PAS3-HSID: a Dynamic Bio-Inspired Approach for Real-Time Hot Spot Identification in Data Streams Tickle, Rebecca; Triguero, Isaac; Figueredo, Grazziela P. Cognitive Computation, Vol. 11, Issue 3 https://doi.org/10.1007/s12559-019-09638-y	journal	April 2019

Similar Records

Community participation in Health Impact Assessment. A scoping review of the literature

Journal Article · Fri Sep 15 00:00:00 EDT 2017 · Environmental Impact Assessment Review · OSTI ID:1420053

Uiters, Ellen; Wagemakers, Annemarie

Quantitative-qualitative assessments of environmental causal networks to support the DPSIR framework in the decision-making process

Journal Article · Thu Mar 15 00:00:00 EDT 2018 · Environmental Impact Assessment Review · OSTI ID:1420053

Ramos-Quintana, Fernando; Enrique, Sanchez-Salinas; Esmeralda, Ursula-Vazquez; +1 more

An investigation into the impact of electric vehicle load on the electric utility distribution system

Journal Article · Thu Apr 01 00:00:00 EST 1993 · IEEE Transactions on Power Delivery (Institute of Electrical and Electronics Engineers); (United States) · OSTI ID:1420053

Rahman, S; Shrestha, G B

Related Subjects

96 KNOWLEDGE MANAGEMENT AND PRESERVATION
information technology
big data analysis
data storage
data representation
data learning
data aggregation

Title: Storages Are Not Forever

Citation Formats

References (59)

Cited By (3)

Similar Records

Related Subjects