Abstract
As one simple type of statistical inference problems we consider Most Likely Solution problem, a task of finding a most likely solution (MLS in short) for a given problem instance under some given probability model. Although many MLS problems are NP-hard, we propose, for these problems, to study their average-case complexity under their assumed probabality models. We show three examples of MLS problems, and explain that “message passing algorithms” (e.g., belief propagation) work reasonably well for these problems. Some of the technical results of this paper are from the author’s recent joint work with his colleagues [WST, WY06, OW06] .
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Boppana, R.B.: Eigenvalues and graph bisection: an average-case analysis. In: Proc. Symposium on Foundations of Computer Science, pp. 280-285 (1987)
Bui, T., Chaudhuri, S., Leighton, F., Spiser, M.: Graph bisection algorithms with good average behavior. Combinatorica 7, 171–191 (1987)
Coja-Oghlan, A.: A spectral heuristic for bisecting random graphs. Random Struct. Algorithms 29(3), 351–398 (2006)
Dubhashi, D., Laura, L., Panconesi, A.: Analysis and experimental evaluation of a simple algorithm for collaborative filtering in planted partition models. In: Pandya, P.K., Radhakrishnan, J. (eds.) FST TCS 2003. LNCS, vol. 2914, pp. 168–182. Springer, Heidelberg (2003)
Gallager, R.G.: Low density parity check codes. IRE Trans. Inform. Theory IT-8(21), 21–28 (1962)
Garey, M.R., Johnson, D.S.: Computers and Intractability, Bell Telephone Laboratories, Incorporated (1979)
Jerrum, M., Sorkin, G.: The Metropolis algorithm for graph bisection. Discrete Appl. Math 82(1-3), 155–175 (1998)
Luby, M., Mitzenmacher, M., Shokrollahi, M., Spielman, D.: Improved low-density parity-check codes using irregular graphs. IEEE Trans. on Information Theory 47(2), 585–598 (2001)
MacKay, D.: Good error-correcting codes based on very sparse matrices. IEEE Trans. Inform. Theory IT-45(2), 399–431 (1999)
McEliece, R., MacKay, D., Cheng, J.: Turbo decoding as an instance of Pearl’s Belief Propagation algorithm. In: EEE J. on Selected Areas in Comm. 16(2) (1998)
McSherry, F.: Spectral partition of random graphs. In: FOCS’99. Proc. 40th IEEE Sympos. on Foundations of Computer Science, IEEE, NJ, New York (1999)
Onsjö, M.: Master Thesis (2005)
Onsjö, M., Watanabe, O.: Simple algorithms for graph partition problems, Research Report C-212, Dept. of Math. and Comput. Sci. Tokyo Inst. of Tech. (2005)
Onsjö, M., Watanabe, O.: A simple message passing algorithm for graph partition problem. In: Asano, T. (ed.) ISAAC 2006. LNCS, vol. 4288, pp. 507–516. Springer, Heidelberg (2006)
Pearl, J.: Probabilistic Reasoning in Intelligent Systems: Networks of Plausible Inference. Morgan Kaufmann Publishers, San Francisco (1988)
Watanabe, O., Sawai, T., Takahashi, H.: Analysis of a randomized local search algorithm for LDPCC decoding problem. In: Albrecht, A.A., Steinhöfel, K. (eds.) SAGA 2003. LNCS, vol. 2827, pp. 50–60. Springer, Heidelberg (2003)
Watanabe, O., Yamamoto, M.: Average-case analysis for the MAX-2SAT problem. In: Campilho, A., Kamel, M. (eds.) ICIAR 2006. LNCS, vol. 4142, pp. 277–282. Springer, Heidelberg (2006)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2007 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Watanabe, O., Onsjö, M. (2007). Finding Most Likely Solutions. In: Cooper, S.B., Löwe, B., Sorbi, A. (eds) Computation and Logic in the Real World. CiE 2007. Lecture Notes in Computer Science, vol 4497. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-73001-9_81
Download citation
DOI: https://doi.org/10.1007/978-3-540-73001-9_81
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-73000-2
Online ISBN: 978-3-540-73001-9
eBook Packages: Computer ScienceComputer Science (R0)