Abstract
We are asking to estimate a nonnegative density\(\bar x\) on ℝm, given some of its algebraic or trigonometric moments. The maximum entropy method is to introduce an entropy-like objective function and then solve a convex minimization programming with some linear constraints. In the existing literature, Newton's method or some other iteration methods are used to solve its dual problem. In this paper, special structures of the problem have been discovered when we use some particular entropies, which include Boltzmann-Shannon entropy and Burg's entropy. Useful linear relationships among the moments help us to set up very fast and effective algorithms. Numerical computations and comparison are also presented.
Similar content being viewed by others
References
J.M. Borwein and W. Huang, A fast heuristic algorithm for polynomial moment problems with Boltzmann-Shannon entropy, SIAM J. Optim. (1994).
J.M. Borwein and A.S. Lewis, Convergence of best entropy estimates, SIAM J. Optim. 1 (1991) 191–205.
J.M. Borwein and A.S. Lewis, Duality relationships for entropy-like minimization problems, SIAM Journal of Control Theory and Optimization 29 (1991) 325–338.
J.M. Borwein and A.S. Lewis, On the convergence of moment problems, Trans. Amer. Math. Soc. 325 (1991) 249–271.
J.M. Borwein and A.S. Lewis, A survey of convergence results for maximum entropy methods,Proceedings of MaxEnt 92, Kluwer, 1992.
J.P. Burg, Maximum entropy spectral analysis, Ph.D. Thesis, Stanford University, 1975.
A. Decarreau, D. Hilhorst, C. Lemaréchal and J. Navaza, Dual methods in entropy maximization application to some problems in crystallography, SIAM J. Optim. 2 (1992) 173–197.
J.E. Dennis and R.B. Schnabel,Numerical Methods for Unconstrained Optimization and Nonlinear Equations, Prentice-Hall, NJ, 1983.
W. Huang, Linearly constrained convex programming of entropy type: Convergence and algorithms, PhD thesis, Dalhousie University, Canada, 1993.
D.G. Luenberger,Optimization by Vector Space Methods, Wiley, 1969.
R.T. Rockafellar, Integrals which are convex functionals I, Pacific J. Math. 24 (1968) 525–539.
R.T. Rockafellar,Convex Analysis, Princeton University Press, 1970.
Author information
Authors and Affiliations
Additional information
Communicated by C. Brezinski
Rights and permissions
About this article
Cite this article
Huang, W. Heuristic solutions to polynomial moment problems with some convex entropic objectives. Numer Algor 12, 297–308 (1996). https://doi.org/10.1007/BF02142809
Received:
Revised:
Issue Date:
DOI: https://doi.org/10.1007/BF02142809