Abstract
In this paper, we study an interpretation of the sample-based approach to chance-constrained programming problems grounded in statistical testing theory. On top of being simple and pragmatic, this approach is theoretically well founded, non parametric and leads to a general method for leveraging existing heuristic algorithms for the deterministic case to their chance-constrained counterparts. Throughout this paper, this algorithm design approach is illustrated on a real world graph partitioning problem which crops up in the field of compilation for parallel systems. Extensive computational results illustrate the practical relevance of the approach, as well as the robustness of the obtained solutions.
Similar content being viewed by others
Notes
An assumption that can be in practice checked, to some extent, using static program analysis techniques. An assumption which also relies reasonably on the expertise of test engineers in terms of designing validation cases representative of real-world system operation.
An one line OpenMP pragma will do the trick.
References
Aringhieri, R.: Solving chance-constrained programs combining tabu search and simulation. In: Proceedings of the 3rd International Workshop on Experimental and Efficient Algorithms (WEA04). Lecture Notes in Computer Science, vol. 3059, pp. 30–41. Springer, Berlin (2004)
Barbu, A., Zhu, S.-C.: Stochastic graph partition: generalizing the Swendsen–Wang method. Technical Report Paper 2003010120, UCLA Department of Statistics (2003)
Ben-Tal, A., Nemirovski, A.: Robust solutions of uncertain linear programs. Oper. Res. Lett. 25, 1–13 (1999)
Beraldi, P., Ruszczynski, A.: Beam search heuristic to solve stochastic integer problems under probabilistic constraints. Eur. J. Oper. Res. 167(1), 35–47 (2005)
Bertsimas, D., Sim, M.: The price of robustness. Oper. Res. 52(1), 35–53 (2004)
Bianchi, L., Dorigo, M., Gambardella, L., Gutjahr, W.: A survey on metaheuristics for stochastic combinatorial optimization. Nat Comput 8(2), 239–287 (2006)
Bichot, C.H.: A new method, the fusion fission, for the relaxed-way graph partitioning problem, and comparisons with some multilevel algorithms. J. Math. Model. Algorithms 6(3), 319–344 (2007)
Bichot, C., Durand, N.: Partitionnement de graphe. Lavoisier, Paris (2010)
Calafiore, G., Campi, M.: Uncertain convex programs: randomized solutions and confidence levels. Math. Program. 102, 25–46 (2005)
Calafiore, G., Campi, M.: The scenario approach to robust control design. IEEE Trans. Automat. Control 51(5), 742–753 (2006)
Charnes, A., Cooper, W.W., Symonds, G.H.: Cost horizons and certainty equivalents: an approach to stochastic programming of heating oil. Manag. Sci. 4(3), 235–263 (1958)
David, V., Fraboul, C., Rousselot, J.Y., Siron, P.: Etude et realisation d’une architecture modulaire et reconfigurable: Projet MODULOR. Technical Report, 1/3364/DERI.ONERA (1991)
de Farias, D., Van Roy, B.: On constraint sampling in the linear programming approach to approximate linear programming. In: Proceedings of the 42nd IEEE Conference on Decision and Control, vol. 3, pp. 2441–2446 (2003)
Demange, M., Paschos, V.: On an approximation measure founded on the links between optimization and polynomial approximation theory. Theor. Comput. Sci. 158, 117–141 (1996)
Dentcheva, D., Prékopa, A., Ruszczynski, A.: Concavity and efficient points of discrete distributions in probabilistic programming. Math. Program. 89, 55–77 (2000)
Efron, B., Tibshirani, R.: An Introduction to the Bootstrap. CRC Press, Boca Raton (1994)
Elsner, U.: Graph partitioning—a survey. Technical Report, TU Chemnitz SFB393/97-27 (1997)
Fan, N., Pardalos, P.: Robust optimization of graph partitioning and critical node detection in analyzing networks. In: Proceedings of the 4th Annual International Conference on Combinatorial Optimization and Applications (COCOA 2010), pp. 170–183 (2010)
Fan, N., Zheng, Q., Pardalos, P.: On the two-stage stochastic graph partitioning problem. In: Proceedings of the 5th Annual International Conference on Combinatorial Optimization and Applications (COCOA 2011), pp. 500–509 (2011)
Ferreira, C.E., Martin, A., de Souza, C., Weismantel, R., Wolsey, L.: The node capacitated graph partitioning problem: a computational study. Math. Program. 81, 229–256 (1998)
Fiduccia, C.M., Mattheyses, R.M.: A linear-time heuristic for improving network partitions. In: Proceedings of the 19th Design Automation Conference. DAC ’82, pp. 175–181. IEEE Press, Piscataway (1982)
Fjällström, P.O.: Algorithms for graph partitioning: a survey. Linköping Electron. Articles Comput. Inf. Sci. 3, 10 (1998)
Gaivoronski, A., Lisser, A., Lopez, R., Xu, H.: Knapsack problem with probability constraints. J. Glob. Optim. 49, 397–413 (2011)
Garey, M., Johnson, D., Stockmeyer, L.: Some simplified NP-complete graph problems. Theor. Comput. Sci. 1(3), 237–267 (1976)
Hendrickson, B., Leland, R.: A multilevel algorithm for partitioning graphs. In: Proceedings of the 1995 ACM/IEEE Conference on Supercomputing (CDROM). ACM, New York (1995)
Johnson, D., Aragon, C., McGeoch, L., Schevon, C.: Optimization by simulated annealing: an experimental evaluation; part i, graph partitioning. Oper. Res. 37(6), 865–892 (1989)
Johnson, E., Mehrotra, A., Nemhauser, G.L.: Min-cut clustering. Math. Program. 62, 133–151 (1993)
Karypis, G., Kumar, V.: A fast and high quality multilevel scheme for partitioning irregular graphs. SIAM J. Sci. Comput. 20, 359–392 (1998)
Kernighan, B., Lin, S.: An efficient heuristic procedure for partitioning graphs. Bell Syst. Tech. J. 49(1), 291–307 (1970)
Kirkpatrick, S.: Optimization by simulated annealing: quantitative studies. J. Stat. Phys. 34, 975–986 (1984)
Lisser, A., Rendl, F.: Graph partitioning using linear and semidefinite programming. Math. Program. 95, 91–101 (2003)
Loughlin, D.H., Ranjithan, S.: Chance-constrained genetic algorithms. In: GECCO-99: Proceedings of the Genetic and Evolutionary Computation Conference, pp. 369–376 (1999)
Mehrotra, A., Trick, M.: Cliques and clustering: a combinatorial approach. Oper. Res. Lett. 22, 1–12 (1997)
Pagnoncelli, B.K., Ahmed, S., Shapiro, A., Pardalos, P.M.: Sample average approximation method for chance constrained programming: theory and applications. J. Optim. Theory Appl. 142, 399–416 (2009)
Prekopa, A.: Stochastic Programming. Kluwer Academic Publishers, Dordrecht (1995)
Sensen, N.: Lower bounds and exact algorithms for the graph partitioning problem using multicommodity flows. In: Meyer auF der Heide, F. (ed.) Lecture Notes in Computer Science, vol. 2161, pp. 391–403. Springer, Berlin (2001)
Sirdey, R., David, V.: Approches heuristiques des problèmes de partitionnement, placement et routage de rèseaux de processus sur architectures parallèles clusterisées. Technical Report, CEA LIST DTSI/SARC/09-470/RS (2009)
Stan, O., Sirdey, R., Carlier, J., Nace, D.: A heuristic algorithm for stochastic partitioning of process networks. In: ICSTCC (2012)
Tanner, M.W., Beier, E.B.: A general heuristic method for joint chance-constrained stochastic programs with discretely distributed parameters (2007). http://www.optimization-online.org/DB_HTML/2007/08/1755.html
Taskin, Z.C., Smith, J.C., Ahmed, S., Schaefer, A.: Cutting plane algorithms for solving a stochastic edge-partition problem. Discret. Optim. 6(4), 420–435 (2009)
Vidyasagar, M.: Randomized algorithms for robust controller synthesis using statistical learning theory. In: Learning Control and Hybrid Systems. Lecture Notes in Control and Information Sciences, vol. 241, pp. 3–24. Springer, Berlin (1999)
Acknowledgments
The authors thank the anonymous referees for several suggestions that led to improvements in the paper.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Stan, O., Sirdey, R., Carlier, J. et al. The robust binomial approach to chance-constrained optimization problems with application to stochastic partitioning of large process networks. J Heuristics 20, 261–290 (2014). https://doi.org/10.1007/s10732-014-9241-6
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10732-014-9241-6