Is Entropy Suitable to Characterize Data and Signals for Cognitive Informatics?

doi:10.4018/jcini.2007040103

Reference Hub

This research has been cited in:

Conference
Complexity and its measures in cognitive and other complex systems2008 7th IEEE International Conference on Cognitive Informatics10.1109/COGINF.2008.4639147
Conference
Multiscale Analysis of False Neighbors for state space reconstruction of complicated systems2011 IEEE Workshop On Merging Fields Of Computational Intelligence And Sensor Technology10.1109/MFCIST.2011.5949517
Article
Decomposing the Twitter data stream in healthcare: An information theory perspectiveProceedings of the Association for Information Science and Technology10.1002/pra2.2017.14505401184
Chapter
System Complexity and Its Measures: How Complex Is ComplexAdvances in Cognitive Informatics and Cognitive Computing10.1007/978-3-642-16083-7_14
Conference
Zero-crossing analysis of Lévy walks for real-time feature extraction: Composite signal analysis for strengthening the IoT against DDoS attacks2016 IEEE 15th International Conference on Cognitive Informatics & Cognitive Computing (ICCI*CC)10.1109/ICCI-CC.2016.7862027
Article
Contemporary Cybernetics and Its Facets of Cognitive Informatics and Computational IntelligenceIEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics)10.1109/TSMCB.2009.2013721
Conference
Multiscaleanalysis of Skewness for Feature Extraction Inreal-Time2018 IEEE 17th International Conference on Cognitive Informatics & Cognitive Computing (ICCI*CC)10.1109/ICCI-CC.2018.8482100
Conference
Amplification of signal features using variance fractal dimension trajectory2009 8th IEEE International Conference on Cognitive Informatics10.1109/COGINF.2009.5250750
Conference
It's time for multiscale analysis and synthesis in cognitive systemsIEEE 10th International Conference on Cognitive Informatics and Cognitive Computing (ICCI-CC'11)10.1109/COGINF.2011.6016116
Article
The Interpretation of Graphical Information in Word ProcessingEntropy10.3390/e24101492
Conference
Zero-crossing analysis of Lévy walks for real-time feature extraction2016 IEEE International Conference on Electro Information Technology (EIT)10.1109/EIT.2016.7535276
Conference
Fractal modelling of residues in linear predictive coding of speech2009 8th IEEE International Conference on Cognitive Informatics10.1109/COGINF.2009.5250762
Article
Learning Entropy as a Learning-Based Information ConceptEntropy10.3390/e21020166
Article
Classification of audio events using permutation transformationApplied Acoustics10.1016/j.apacoust.2014.03.006
Conference
Determining ICT indicators using entropy theory2019 21st International Conference on Advanced Communication Technology (ICACT)10.23919/ICACT.2019.8702010
Conference
Speech segmentation using multifractal measures and amplification of signal features2008 7th IEEE International Conference on Cognitive Informatics10.1109/COGINF.2008.4639188
Article
Extracting Core ICT Indicators Using Entropy MethodThe Information Society10.1080/01972240903028490
Article
Learning Entropy: Multiscale Measure for Incremental LearningEntropy10.3390/e15104159
Article
Structural Analysis of Medical-Terminology Hashtag versus Lay-Language Hashtag Tweet Collections: An Information Theoretical Method with Entropy MatrixData and Information Management10.2478/dim-2018-0011
Chapter
Zero-Crossing Analysis of Lévy Walks and a DDoS Dataset for Real-Time Feature ExtractionResearch Anthology on Combating Denial-of-Service Attacks10.4018/978-1-7998-5348-0.ch021
Article
Amplification of Signal Features Using Variance Fractal Dimension TrajectoryInternational Journal of Cognitive Informatics and Natural Intelligence10.4018/jcini.2010100101
Chapter
Amplification of Signal Features Using Variance Fractal Dimension TrajectoryDevelopments in Natural Intelligence Research and Knowledge Engineering10.4018/978-1-4666-1743-8.ch019
Chapter
The Core Critical Success Factors in Implementation of Enterprise Resource Planning SystemsEnterprise Information Systems and Advancing Business Solutions10.4018/978-1-4666-1761-2.ch006
Article
Zero-Crossing Analysis and Information Divergence of Lévy Walks for Real-Time Feature ExtractionInternational Journal of Handheld Computing Research10.4018/IJHCR.2016100104
Chapter
Comparing Learning MethodsTransdisciplinary Advancements in Cognitive Mechanisms and Human Information Processing10.4018/978-1-60960-553-7.ch013
Article
The Core Critical Success Factors in Implementation of Enterprise Resource Planning SystemsInternational Journal of Enterprise Information Systems10.4018/jeis.2010040105

Is Entropy Suitable to Characterize Data and Signals for Cognitive Informatics?

Witold Kinsner

Source Title: International Journal of Cognitive Informatics and Natural Intelligence (IJCINI)1(2)

Cite Article Cite Article

MLA

Kinsner, Witold. "Is Entropy Suitable to Characterize Data and Signals for Cognitive Informatics?." IJCINI vol.1, no.2 2007: pp.34-57. http://doi.org/10.4018/jcini.2007040103

APA

Kinsner, W. (2007). Is Entropy Suitable to Characterize Data and Signals for Cognitive Informatics?. International Journal of Cognitive Informatics and Natural Intelligence (IJCINI), 1(2), 34-57. http://doi.org/10.4018/jcini.2007040103

Chicago

Kinsner, Witold. "Is Entropy Suitable to Characterize Data and Signals for Cognitive Informatics?," International Journal of Cognitive Informatics and Natural Intelligence (IJCINI) 1, no.2: 34-57. http://doi.org/10.4018/jcini.2007040103

Export Reference

Favorite Full-Issue Download

View Full Text PDF

Abstract

This article provides a review of Shannon and other entropy measures in evaluating the quality of materials used in perception, cognition, and learning processes. Energy-based metrics are not suitable for cognition, as energy itself does not carry information. Instead, morphological (structural and contextual) metrics as well as entropy-based multi-scale metrics should be considered in cognitive informatics. Appropriate data and signal transformation processes are defined and discussed in the perceptual framework followed by various classes of information and entropies suitable for characterization of data, signals, and distortion. Other entropies are also described including the Rényi generalized entropy spectrum, Kolmogorov complexity measure, Kolmogorov-Sinai entropy, and Prigogine entropy for evolutionary dynamical systems. Although such entropy-based measures are suitable for many signals, they are not sufficient for scale-invariant (fractal and multifractal) signals without corresponding complementary multi-scale measures.

You do not own this content. Please login to recommend this title to your institution's librarian or purchase it from the IGI Global bookstore.

Username or email: *

Password: *

Forgot individual login password?

Create individual account

Is Entropy Suitable to Characterize Data and Signals for Cognitive Informatics?

MLA

APA

Chicago

Export Reference

Abstract

Request Access