Skip to main content
Log in

The maximum entropy method on the mean: Applications to linear programming and superresolution

  • Published:
Mathematical Programming Submit manuscript

Abstract

In this paper, we give two different results. We propose new methods to solve classical optimization problems in linear programming. We also obtain precise quantitative results for the superresolution phenomenon, as observed earlier by practical searchers on specific algorithms. The common background of our work is the generalized moment problem, which is known to be connected with linear programming and superresolution. We describe the Maximum Entropy Method on the Mean that provides solution to the problem and leads to computational criteria to decide the existence of solutions or not.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. J.M. Borwein and A.S. Lewis, “Duality relationships for entropy-like minimization problems,”S.I.A.M. Journal on Control and Optimization 29 (1991) 325–338.

    Google Scholar 

  2. J.M. Borwein and A.S. Lewis, “Partially-finite programming inL 1 and the existence of maximum entropy estimates,”S.I.A.M. Journal on Optimization 3 (1993) 248–267.

    Google Scholar 

  3. D. Dacunha-Castelle and F. Gamboa, “Maximum d'entropie et problème des moments”,Annales de l'Institut Henri Poincaré 26 (1990) 567–596.

    Google Scholar 

  4. C. De Boor, “On ‘best’ interpolation”,Journal of Approximation Theory 16 (1976) 28–42.

    Google Scholar 

  5. D. Donoho, “Superresolution via sparsity constraints”,S.I.A.M. Journal on Mathematical Analysis 23 (1992) 1309–1331.

    Google Scholar 

  6. D. Donoho and E. Gassiat, “Superresolution via positivity constraints”, manuscript (1992).

  7. D. Donoho, I. Johnstone, J. Hoch and A. Stern, “Maximum entropy and the nearly black object”,Journal of the Royal Statistical Society B 54 (1992) 41–82.

    Google Scholar 

  8. G.J. Erickson and C.R. Smith (eds.),Maximum Entropy and Bayesian Methods in Science and Engineering (Kluwer, Dordrecht, The Netherlands, 1988).

    Google Scholar 

  9. J. Favard, “Sur l'interpolation”,Journal de Mathématiques Pures et Appliquées 19 (1940) 281–306.

    Google Scholar 

  10. A.V. Fiacco and K.O. Kortanek (eds.), Semi-infinite Programming and its Applications (Springer Verlag, Berlin, 1983).

    Google Scholar 

  11. F. Gamboa and E. Gassiat, “Maximum d'entropie et problème des moments cas multidimensionnel”,Probability and Mathematical Statistic (1991) 67–83.

  12. F. Gamboa and E. Gassiat, “Bayesian methods and maximum entropy for ill posed inverse problems”, submitted (1993).

  13. F. Gamboa and E. Gassiat, “Superresolution via M.E.M. technique”, submitted (1992).

  14. F. Gamboa, “Méthode du maximum d'entropie sur la moyenne et applications”, Thèse Orsay (1989).

  15. F. Gamboa and H. Gzyl, “Linear programming with maximum entropy”,Mathematical Computation and Modelling 13 (1990) 49–52.

    Google Scholar 

  16. P.A. Jansson (ed.),Deconvolution, with Applications in Spectroscopy (Academic Press, New York, 1984).

    Google Scholar 

  17. R. Hettich, “An implementation of a discretization method for semi-infinite programming”,Mathematical Programming 34 (1986) 354–361.

    Google Scholar 

  18. J. Kemperman, “Geometry of the moment problem”,Proceedings of Symposia in Applied Mathematics (American Mathematical Society, 1987, Providence) pp. 16–53.

    Google Scholar 

  19. M.G. Krein and A.A. Nudel'man,The Markov Moment Problem and Extremal Problems (American Mathematical Society, 50, 1977).

  20. A.S. Lewis, “Superresolution in the Markov moment problem”, preprint (1993).

  21. A.S. Lewis, “Consistency of moment systems”, preprint (1993).

  22. J. Navaza, “Use of non-local constraints in maximum entropy electron reconstruction”,Acta Crystallo graphica Section A 42 (1986) 212–222.

    Google Scholar 

  23. R.T. Rockafellar,Convex Analysis (Princeton University Press, Princeton, NJ, 1970).

    Google Scholar 

  24. J. Skilling (ed.),Maximum Entropy and Bayesian Methods (Kluwer, Dordrecht, The Netherlands, 1989).

    Google Scholar 

  25. S.R.S. Varadhan,Large Deviations and Applications (SIAM, Philadelphia, 1984).

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Additional information

Corresponding author.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Gamboa, F., Gassiat, E. The maximum entropy method on the mean: Applications to linear programming and superresolution. Mathematical Programming 66, 103–122 (1994). https://doi.org/10.1007/BF01581139

Download citation

  • Received:

  • Revised:

  • Issue Date:

  • DOI: https://doi.org/10.1007/BF01581139

A.M.S. Subject Classification

Keywords

Navigation