Abstract
Sample average approximation (SAA) approach for two-stage stochastic variational inequalities (SVIs) with continuous probability distributions, where the second-stage problems have multiple solutions, may not promise convergence assertions as the sample size tends to infinity. In this paper, a regularized SAA approach is proposed to numerically solve a class of two-stage SVIs with continuous probability distributions, where the second-stage problems are monotone and allowed to have multiple solutions. We first give some structural properties. After that, the convergence analysis of the regularized SAA approach for two-stage SVIs is investigated as the regularization parameter tends to zero and the sample size tends to infinity. Finally, we employ the progressive hedging algorithm to report some numerical results.
Similar content being viewed by others
References
Aumann, R.J.: Integrals of set-valued functions. J. Math. Anal. Appl. 12(1), 1–12 (1965)
Chen, X., Fukushima, M.: Expected residual minimization method for stochastic linear complementarity problems. Math. Oper. Res. 30(4), 1022–1038 (2005)
Chen, X., Pong, T.K., Wets, R.J.B.: Two-stage stochastic variational inequalities: an ERM-solution procedure. Math. Program. 165(1), 71–111 (2017)
Chen, X., Shapiro, A., Sun, H.: Convergence analysis of sample average approximation of two-stage stochastic generalized equations. SIAM J. Optim. 29(1), 135–161 (2019)
Chen, X., Sun, H., Wets, R.J.B.: Regularized mathematical programs with stochastic equilibrium constraints: Estimating structural demand models. SIAM J. Optim. 25(1), 53–75 (2015)
Chen, X., Sun, H., Xu, H.: Discrete approximation of two-stage stochastic and distributionally robust linear complementarity problems. Math. Program. 177(1–2), 255–289 (2019)
Chen, X., Wets, R.J.B., Zhang, Y.: Stochastic variational inequalities: residual minimization smoothing sample average approximations. SIAM J. Optim. 22(2), 649–673 (2012)
Chen, X., Xiang, S.: Newton iterations in implicit time-stepping scheme for differential linear complementarity systems. Math. Program. 138(1–2), 579–606 (2013)
Chen, X., Zhang, C., Fukushima, M.: Robust solution of monotone stochastic linear complementarity problems. Math. Program. 117(1–2), 51–80 (2009)
Cottle, R.W., Pang, J.S., Stone, R.E.: The Linear Complementarity Problem. SIAM, Philadelphia (1992)
Facchinei, F., Pang, J.S.: Finite-Dimensional Variational Inequalities and Complementarity Problems. Springer, New York (2007)
Faraci, F., Jadamba, B., Raciti, F.: On stochastic variational inequalities with mean value constraints. J. Optim. Theory Appl. 171(2), 675–693 (2016)
Gwinner, J., Raciti, F.: On a class of random variational inequalities on random sets. Numer. Funct. Anal. Optim. 27(5–6), 619–636 (2006)
Gwinner, J., Raciti, F.: On monotone variational inequalities with random data. J. Math. Inequal. 3(3), 443–453 (2009)
Gwinner, J., Raciti, F.: Some equilibrium problems under uncertainty and random variational inequalities. Ann. Oper. Res. 200(1), 299–319 (2012)
Han, L., Tiwari, A., Camlibel, M.K., Pang, J.S.: Convergence of time-stepping schemes for passive and extended linear complementarity systems. SIAM J. Numer. Anal. 47(5), 3768–3796 (2009)
Jadamba, B., Khan, A.A., Raciti, F.: Regularization of stochastic variational inequalities and a comparison of an LP and a sample-path approach. Nonlinear Anal. 94, 65–83 (2014)
Jiang, J., Chen, X., Chen, Z.: Quantitative analysis for a class of two-stage stochastic linear variational inequality problems. Comput. Optim. Appl. 76(2), 431–460 (2020)
Jiang, J., Chen, Z., Yang, X.: Rates of convergence of sample average approximation under heavy tailed distributions. http://www.optimization-online.org/DB_HTML/2020/06/7849.html (2020)
Jiang, J., Shi, Y., Wang, X., Chen, X.: Regularized two-stage stochastic variational inequalities for Cournot–Nash equilibrium under uncertainty. J. Comput. Math. 37(6), 813–842 (2019)
Li, M., Zhang, C.: Two-stage stochastic variational inequality arising from stochastic programming. J. Optim. Theory Appl. 186(1), 324–343 (2020)
Rockafellar, R.T., Sun, J.: Solving monotone stochastic variational inequalities and complementarity problems by progressive hedging. Math. Program. 174(1–2), 453–471 (2019)
Rockafellar, R.T., Wets, R.J.B.: Scenarios and policy aggregation in optimization under uncertainty. Math. Oper. Res. 16(1), 119–147 (1991)
Rockafellar, R.T., Wets, R.J.B.: Variational Analysis. Springer, New York (2009)
Rockafellar, R.T., Wets, R.J.B.: Stochastic variational inequalities: single-stage to multistage. Math. Program. 165(1), 331–360 (2017)
Shapiro, A.: Monte Carlo sampling methods. Handb. Oper. Res. Manag. Sci. 10, 353–425 (2003)
Shapiro, A., Dentcheva, D., Ruszczyński, A.: Lectures on Stochastic Programming: Modeling and Theory. SIAM, Philadelphia (2014)
Sun, H., Chen, X.: Two-stage stochastic variational inequalities: theory, algorithms and applications. J. Oper. Res. Soc. China 9, 1–32 (2021)
Sun, H., Su, C.L., Chen, X.: SAA-regularized methods for multiproduct price optimization under the pure characteristics demand model. Math. Program. 165(1), 361–389 (2017)
Warga, J.: Fat homeomorphisms and unbounded derivate containers. J. Math. Anal. Appl. 81(2), 545–560 (1981)
Zhang, M., Sun, J., Xu, H.: Two-stage quadratic games under uncertainty and their solution by progressive hedging algorithms. SIAM J. Optim. 29(3), 1799–1818 (2019)
Acknowledgements
Jie Jiang was supported by China Postdoctoral Science Foundation (Grant No. 2020M673117) and CAS AMSS-PolyU Joint Laboratory of Applied Mathematics and Fundamental Research Funds for the Central Universities (Grant Nos. 2020CDJQY-A039 and 2021CDJQY-009). Shengjie Li was supported by the National Natural Science Foundation of China (Grant No. 11971078). The authors would like to thank editors for organizing such a professional and efficient reviewing process. They also appreciate two anonymous referees for their insightful and important comments, which improve the presentation and quality of the paper.
Author information
Authors and Affiliations
Corresponding author
Additional information
Communicated by Akhtar A. Khan.
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Jiang, J., Li, S. Regularized Sample Average Approximation Approach for Two-Stage Stochastic Variational Inequalities. J Optim Theory Appl 190, 650–671 (2021). https://doi.org/10.1007/s10957-021-01905-z
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10957-021-01905-z