Skip to main content

Point estimation using the Kullback-Leibler loss function and MML

  • Papers
  • Conference paper
  • First Online:

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 1394))

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. A.R. Barron and T.M. Cover. Minimum complexity density estimation. IEEE Transactions on Information Theory, 37:1034–1054, 1991.

    Article  MathSciNet  MATH  Google Scholar 

  2. T.M. Cover. IEEE Information Theory Newsletter, pages 1–6, 1992.

    Google Scholar 

  3. T.M. Cover and Joy A. Thomas. Elements of Information Theory. John Wiley and Sons,Inc., New York, 1991.

    Book  MATH  Google Scholar 

  4. D.L. Dowe, G.E. Farr, A.J. Hurst, and K.L. Lentin. Information-theoretic football tipping. In N. de Mestre, editor, Proc. 3rd Conference on Mathematics and Computers in Sport, pages 233–241, Bond University, Qld., Australia, 1996.

    Google Scholar 

  5. D.L. Dowe, J.J. Oliver, and C.S. Wallace. MML estimation of the parameters of the spherical Fisher distribution. In A. et al. Sharma, editor. Proc. 7th Conf. Algorithmic Learning Theory (ALT'96), LNAI 1160, pages 213–227. Sydney. Australia, October 1996.

    Google Scholar 

  6. D.L. Dowe and C.S. Wallace. Resolving the Neyman-Scott problem by Minimum Message Length. In Proc. Computing Science and Statistics — 28th Symposium on the interface, volume 28, pages 614–618. 1997.

    Google Scholar 

  7. R.A. Fisher. Dispersion on a sphere. Journal of the Royal Statistical Society (Series A), 217:295–305, 1953.

    MathSciNet  MATH  Google Scholar 

  8. I.J. Good. Explicativity, corroboration, and the relative odds of hypotheses. In Good thinking-The Foundations of Probability and its applications. University of Minnesota Press, Minneapolis,MN, 1983.

    Google Scholar 

  9. J. Neyman and E.L. Scott. Consistent estimates based on partially consistent observations. Econometrika, 16:1–32, 1948.

    Article  MathSciNet  MATH  Google Scholar 

  10. R.J. Solomonoff. A formal theory of inductive inference. Information and Control. 7:1–22,224–254, 1964.

    Article  MathSciNet  MATH  Google Scholar 

  11. C.S. Wallace. Multiple Factor Analysis by MML Estimation. Technical Report 95/218, Dept. of Computer Science, Monash University, Clayton, Victoria 3168. Australia, 1995. submitted to J. Multiv. Analysis.

    Google Scholar 

  12. C.S. Wallace. False Oracles and SMML Estimators. In D.L. Dowe, K.B. Korb, and J.J. Oliver, editors, Proceedings of the Information. Statistics and Induction in Science (ISIS) Conference, pages 304–316, Melbourne, Australia. August 1996. World Scientific. Was Tech Rept 89/128, Dept. Comp. Sci., Monash Univ., Australia, June 1989.

    Google Scholar 

  13. C.S. Wallace and D.M. Boulton. An information measure for classification. Computer Journal, 11:185–194, 1968.

    Article  MATH  Google Scholar 

  14. C.S. Wallace and D.M. Boulton. An invariant Bayes method for point estimation. Classification Society Bulletin, 3(3):11–34, 1975.

    Google Scholar 

  15. C.S. Wallace and D.L. Dowe. MML estimation of the von Mises concentration parameter. Tech Rept TR 93/193, Dept. of Comp. Sci.. Monash Univ., Clayton 3168, Australia, 1993. prov. accepted, Aust. J. Stat.

    Google Scholar 

  16. C.S. Wallace and D.L. Dowe. Intrinsic classification by MML — the Snob program. In C. Zhang and et al., editors, Proc. 7th Australian Joint Conf on Artif. Intelligence, pages 37–44. World Scientific, Singapore, 1994.

    Google Scholar 

  17. C.S. Wallace and P.R. Freeman. Estimation and inference by compact cooling. J. Royal Statistical Society (Series B), 49:240–252, 1987.

    MathSciNet  MATH  Google Scholar 

  18. C.S. Wallace and P.R. Freeman. Single factor analysis by MML estimation. Journal of the Royal Statistical Society (Series B). 54:195–209. 1992.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 1998 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Dowe, D.L., Baxter, R.A., Oliver, J.J., Wallace, C.S. (1998). Point estimation using the Kullback-Leibler loss function and MML. In: Wu, X., Kotagiri, R., Korb, K.B. (eds) Research and Development in Knowledge Discovery and Data Mining. PAKDD 1998. Lecture Notes in Computer Science, vol 1394. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-64383-4_8

Download citation

  • DOI: https://doi.org/10.1007/3-540-64383-4_8

  • Published:

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-64383-8

  • Online ISBN: 978-3-540-69768-8

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics