Abstract
We describe an information-theoretic approach to the analysis of sequential data, which emphasises the predictive aspects of perception, and the dynamic process of forming and modifying expectations about an unfolding stream of data, characterising these using a set of process information measures. After reviewing the theoretical foundations and the definition of the predictive information rate, we describe how this can be computed for Gaussian processes, including how the approach can be adpated to non-stationary processes, using an online Bayesian spectral estimation method to compute the Bayesian surprise. We finish with a sample analysis of a recording of Steve Reich’s Drumming.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Crutchfield, J., Packard, N.: Symbolic dynamics of noisy chaos. Physica D: Nonlinear Phenomena 7, 201–223 (1983)
Grassberger, P.: Toward a quantitative theory of self-generated complexity. International Journal of Theoretical Physics 25, 907–938 (1986)
Bialek, W., Nemenman, I., Tishby, N.: Predictability, complexity, and learning. Neural Computation 13, 2409–2463 (2001)
Abdallah, S.A., Plumbley, M.D.: Information dynamics: Patterns of expectation and surprise in the perception of music. Connection Science 21, 89–117 (2009)
Abdallah, S.A., Plumbley, M.D.: A measure of statistical complexity based on predictive information with application to finite spin systems. Physics Letters A 376, 275–281 (2012)
Dubnov, S.: Spectral anticipations. Computer Music Journal 30, 63–83 (2006)
Verdú, S., Weissman, T.: Erasure entropy. In: IEEE International Symposium on Information Theory (ISIT 2006), pp. 98–102 (2006)
Yeung, R.: A new outlook on Shannon’s information measures. IEEE Transactions on Information Theory 37, 466–474 (1991)
James, R.G., Ellison, C.J., Crutchfield, J.P.: Anatomy of a bit: Information in a time series observation. Chaos 21, 037109 (2011)
Itti, L., Baldi, P.: Bayesian surprise attracts human attention. In: Advances Neural in Information Processing Systems (NIPS 2005), vol. 19, pp. 547–554. MIT Press, Cambridge (2005)
Abdallah, S.A., Plumbley, M.D.: Instantaneous predictive information in Gaussian processes. Unpublished Technical Note (2012)
Kitagawa, G., Gersch, W.: A smoothness priors time-varying ar coefficient modeling of nonstationary covariance time series. IEEE Transactions on Automatic Control 30, 48–56 (1985)
Dubnov, S., McAdams, S., Reynolds, R.: Structural and affective aspects of music from statistical audio signal analysis. Journal of the American Society for Information Science and Technology 57, 1526–1536 (2006)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Abdallah, S., Plumbley, M. (2013). Predictive Information in Gaussian Processes with Application to Music Analysis. In: Nielsen, F., Barbaresco, F. (eds) Geometric Science of Information. GSI 2013. Lecture Notes in Computer Science, vol 8085. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-40020-9_72
Download citation
DOI: https://doi.org/10.1007/978-3-642-40020-9_72
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-40019-3
Online ISBN: 978-3-642-40020-9
eBook Packages: Computer ScienceComputer Science (R0)