Skip to main content

Multiplicative Approximations of Random Walk Transition Probabilities

  • Conference paper
Approximation, Randomization, and Combinatorial Optimization. Algorithms and Techniques (APPROX 2011, RANDOM 2011)

Abstract

We study the space and time complexity of approximating distributions of l-step random walks in simple (possibly directed) graphs G. While very efficient algorithms for obtaining additive ε-approximations have been developed in the literature, no non-trivial results with multiplicative guarantees are known, and obtaining such approximations is the main focus of this paper. Specifically, we ask the following question: given a bound S on the space used, what is the minimum threshold t > 0 such that l-step transition probabilities for all pairs u, v ∈ V such that \(P_{uv}^l\geq t\) can be approximated within a 1±ε factor? How fast can an approximation be obtained?

We show that the following surprising behavior occurs. When the bound on the space is S = o(n 2/d), where d is the minimum out-degree of G, no approximation can be achieved for non-trivial values of the threshold t. However, if an extra factor of s space is allowed, i.e. \(S=\tilde \Omega(sn^2/d)\) space, then the threshold t is exponentially small in the length of the walk l and even very small transition probabilities can be approximated up to a 1±ε factor. One instantiation of these guarantees is as follows: any almost regular directed graph can be represented in \(\tilde O(l n^{3/2+{\epsilon}})\) space such that all probabilities larger than n − 10 can be approximated within a (1±ε) factor as long as l ≥ 40/ε 2. Moreover, we show how to estimate of such probabilities faster than matrix multiplication time.

For undirected graphs, we also give small space oracles for estimating \(P^l_{uv}\) using a notion of bicriteria approximation based on approximate distance oracles of Thorup and Zwick [STOC’01].

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Avrachenkov, K., Litvak, N., Nemirovsky, D., Osipova, N.: Monte carlo methods in pagerank computation: When one iteration is sufficient. SIAM J. Numer. Anal. 45 (2007)

    Google Scholar 

  2. Bahmani, B., Goel, A., Chowdhury, A.: Fast incremental and personalized pagerank. In: PVLDB (2010)

    Google Scholar 

  3. Baswana, S., Sen, S.: A simple linear time algorithm for computing (2k − 1)-spanner of o(n 1 + 1/k) size for weighted graphs. In: Baeten, J.C.M., Lenstra, J.K., Parrow, J., Woeginger, G.J. (eds.) ICALP 2003. LNCS, vol. 2719, Springer, Heidelberg (2003)

    Google Scholar 

  4. Berkhin, P.: A survey on pagerank computing. Internet Mathematics 2 (2005)

    Google Scholar 

  5. Clarkson, K., Woodruff, D.: Numerical linear algebra in the streaming model. In: STOC (2009)

    Google Scholar 

  6. Cohen, D.: Fast algorithms for constructing t-spanners and paths with stretch t. SIAM Journal on Computing 28, 210–236 (1999)

    Article  MathSciNet  MATH  Google Scholar 

  7. Dor, D., Halperin, U., Zwick, S.: All pairs almost shortest paths. SIAM Journal on Computing 29 (2000)

    Google Scholar 

  8. Drineas, P., Kannan, R.: Fast monte carlo algorithms for approximate matrix multiplication. In: FOCS (2001)

    Google Scholar 

  9. Drineas, P., Kannan, R., Mahoney, M.: Fast monte carlo algorithms for matrices i: Approximating matrix multiplication. SIAM J. Computing 36 (2006)

    Google Scholar 

  10. Elkin, M.L., Peleg, D.: (1 + ε, β)-spanner constructions for general graphs. In: STOC (2001)

    Google Scholar 

  11. Frieze, A., Kannan, R., Vempala, S.: Fast monte-carlo algorithms for finding low-rank approximations. JACM (2004)

    Google Scholar 

  12. Jeh, G., Widom, J.: Scaling personalized web search. In: WWW (2003)

    Google Scholar 

  13. Kamvar, S.D., Haveliwala, T.H., Manning, C.D., Golub, G.H.: Extrapolation methods for accelerating pagerank computations. In: WWW (2003)

    Google Scholar 

  14. Langville, A.N., Meyer, C.D.: Deeper inside pagerank. Internet Mathematics 1 (2004)

    Google Scholar 

  15. Magen, A., Zouzias, A.: Low rank matrix-valued chernoff bounds and approximate matrix multiplication. In: SODA (2011)

    Google Scholar 

  16. Nguyen, N.H., Do, T.T., Tran, T.D.: A fast and efficient algorithm for low-rank approximation of a matrix. In: STOC (2009)

    Google Scholar 

  17. Page, L., Brin, S., Motwani, R., Winograd, T.: The pagerank citation ranking: Bringing order to the web. Technical report, Stanford InfoLab (1999)

    Google Scholar 

  18. Patrascu, M., Roditty, L.: Distance oracles beyond the thorup-zwick bound. In: FOCS (2010)

    Google Scholar 

  19. Rutten, J., Kwiatkowska, M., Norman, G., Parker, D.: Mathematical Techniques for Analyzing Concurrent and Probabilistic Systems. In: Panangaden, P., van Breugel, F. (eds.) Mathematical Techniques for Analyzing Concurrent and Probabilistic Systems. CRM Monograph Series, vol. 23, American Mathematical Society, Providence (2004)

    Google Scholar 

  20. Sarlos, T.: Improved approximation algorithms for large matrices via random projections. In: FOCS (2006)

    Google Scholar 

  21. Sarlós, T., Benczúr, A.A., Csalogány, K., Fogaras, D., Rácz, B.: To randomize or not to randomize: space optimal summaries for hyperlink analysis. In: WWW (2006)

    Google Scholar 

  22. Sarma, A.D., Gollapudi, S., Panigrahy, R.: Estimating pagerank on graph streams. In: PODS (2008)

    Google Scholar 

  23. Thorup, M., Zwick, U.: Approximate distance oracles. In: STOC (2001)

    Google Scholar 

  24. Thorup, M., Zwick, U.: Spanners and emulators with sublinear distance errors. In: SODA (2006)

    Google Scholar 

  25. Woodruff, D.: Lower bounds for additive spanners, emulators and more. In: FOCS (2006)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2011 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Kapralov, M., Panigrahy, R. (2011). Multiplicative Approximations of Random Walk Transition Probabilities. In: Goldberg, L.A., Jansen, K., Ravi, R., Rolim, J.D.P. (eds) Approximation, Randomization, and Combinatorial Optimization. Algorithms and Techniques. APPROX RANDOM 2011 2011. Lecture Notes in Computer Science, vol 6845. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-22935-0_23

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-22935-0_23

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-22934-3

  • Online ISBN: 978-3-642-22935-0

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics