Abstract
A brief overview of some interesting dynamics commonly arising as scaling limits of stochastic approximation type algorithms is given, with sample applications to communications.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Bhorkar, A., Karandikar, A., Borkar, V.S.: Power Optimal Opportunistic Scheduling. In: IEEE GLOBECOM 2007, Washington DC (2007)
Borkar, V.S.: Convex Analytic Methods in Markov Decision Processes. In: Feinberg, E., Shwartz, A. (eds.) Markov Decision Processes: Models, Methods, Directions and Open Problems, pp. 347–375. Kluwer Academic, Norwell, Mass (2001)
Borkar, V.S.: Stochastic Approximation: A Dynamic Viewpoint (Book in preparation)
Borkar, V.S., Kumar, P.R.: Dynamic Cesaro-Wardrop Equilibration in Networks. IEEE Trans. Automatic Control 48(3), 382–396 (2003)
Borkar, V.S., Manjunath, D.: Charge-based Control of Diffserve-like Queues. Automatica 40, 2040–2057 (2004)
Cucker, F., Smale, S.: Emergent Behavior in Flocks (2005), Preprint available at http://www.tti-c.org/smale_papers/flock.pdf
Derevitskii, D.P., Fradkov, A.L.: Two Models for Analyzing the Dynamics of Adaptation Algorithms. Automation and Remote Control 35, 59–67 (1974)
Fudenberg, D., Levine, D.: Theory of Learning in Games. MIT Press, Cambridge, MA (1998)
Garg, D., Manjunath, D., Borkar, V.S.: Network Pricing for QoS: A ‘Regulation’ Approach. In: Abed, E.H. (ed.) Advances in Control, Communication Networks, and Transportation Systems, Birkhauser, Boston (2005)
Haykin, S.: Neural Networks: A Comprehensive Foundation, 2nd edn. McMillan Publ. Co., New York (1999)
Helmke, U., Moore, J.B.: Optimization and Dynamical Systems. Springer, London (1994)
Hirsch, M.W.: Systems of Differential Equations That Are Competitive or Cooperative II: Convergence Almost Everywhere. SIAM Journal on Mathematical Analysis 16, 423–439 (1985)
Hofbauer, C., Siegmund, K.: Evolutionary Games and Population Dynamics. Cambridge Uni. Press, Cambridge, UK (1999)
Kelly, F.P., Maulloo, A., Tan, D.: Rate Control in Communication Networks: Shadow Prices, Proportional Fairness and Stability. Journal of Operational Research Society 49, 237–252 (1998)
Ljung, L.: Analysis of Recursive Stochastic Algorithms. IEEE Trans. on Automatic Control 22, 551–575 (1977)
Robbins, H., Monro, S.: A Stochastic Approximation Method. Annals of Mathematical Statistics. 22, 400–407 (1951)
Salodkar, N., Bhorkar, A., Karandikar, A., Borkar, V.S.: A Power Optimal Scheduling Algorithm on a Point to Point Wireles Link (preprint)
Sandholm, W.: Evolutionary Implementation and Congestion Pricing. Review of Economic Studies. 69, 667–689 (2002)
Smith, H.L.: Monotone Dynamical Systems: An Introduction to the Theory of Competitive and Cooperative Systems. American Math. Society, Providence, RI (1995)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2007 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Borkar, V.S. (2007). Some Examples of Stochastic Approximation in Communications. In: Chahed, T., Tuffin, B. (eds) Network Control and Optimization. NET-COOP 2007. Lecture Notes in Computer Science, vol 4465. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-72709-5_16
Download citation
DOI: https://doi.org/10.1007/978-3-540-72709-5_16
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-72708-8
Online ISBN: 978-3-540-72709-5
eBook Packages: Computer ScienceComputer Science (R0)