Skip to main content

Advertisement

Log in

A new co-evolutionary decomposition-based algorithm for bi-level combinatorial optimization

  • Published:
Applied Intelligence Aims and scope Submit manuscript

Abstract

Bi-Level Optimization Problems (BLOPs) are a class of challenging problems with two levels of optimization tasks. The main goal is to optimize the upper level problem which has another optimization problem as a constraint. The latter is called the lower level problem. In this way, the evaluation of each upper level solution requires finding an (near) optimal solution to the corresponding lower level problem, which is computationally very expensive. Many real world applications are bi-level by nature, ranging from logistics to software engineering. Further, proposed bi-level approaches have been restricted to solve linear BLOPs. This fact has attracted the evolutionary computation community to tackle such complex problems and many interesting works have recently been proposed. Unfortunately, most of these works are restricted to the continuous case. Motivated by this observation, we propose in this paper a new Co-evolutionary Decomposition Algorithm inspired from Chemical Reaction Optimization algorithm, called E-CODBA (Energy-based CODBA), to solve combinatorial bi-level problems. Our algorithm is based on our previous works within this research area. The main idea behind E-CODBA is to exploit co-evolution, decomposition, and energy laws to come up with good solution(s) within an acceptable execution time. The statistical analysis of the experimental results on the Bi-level Multi-Depot Vehicle Routing Problem (Bi-MDVRP) show the out-performance of our E-CODBA against four recently proposed works in terms of effectiveness and efficiency.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13

Similar content being viewed by others

References

  1. Colson B, Marcotte P, Savard G (2007) An overview of bilevel optimization. Ann Oper Res 153 (1):235–256

    Article  MathSciNet  MATH  Google Scholar 

  2. Abdoos M, Mozayani N, Bazzan AL (2014) Hierarchical control of traffic signals using q-learning with tile coding. Appl Intell 40(2):201–213

    Article  Google Scholar 

  3. Sinha A, Malo P, Frantsev A, Deb K (2014) Finding optimal strategies in a multi-period multi-leader–follower stacThlberg game using an evolutionary algorithm. Comput Oper Res 41:374–385

    Article  MathSciNet  MATH  Google Scholar 

  4. Migdalas A (1995) Bilevel programming in traffic planning: models, methods and challenge. J Glob Optim 7 (4):381–405

    Article  MathSciNet  MATH  Google Scholar 

  5. Srivastava S, Sahana SK (2016) Nested hybrid evolutionary model for traffic signal optimization. Appl Intell 46(1):113–123

    Article  Google Scholar 

  6. Sun D, Benekohal RF, Waller ST (2006) Bi-level programming formulation and heuristic solution approach for dynamic traffic signal optimization. Comput Aided Civ Inf Eng 21(5):321–333

    Article  Google Scholar 

  7. Lam AY, Leung YW, Chu X (2016) Autonomous-vehicle public transportation system: Scheduling and admission control. IEEE Trans Intell Transp Syst 17(5):1210–1226

    Article  Google Scholar 

  8. Cerrada M, Sánchez R V, Pacheco F, Cabrera D, Zurita G, Li C (2016) Hierarchical feature selection based on relative dependency for gear fault diagnosis. Appl Intell 44(3):687–703

    Article  Google Scholar 

  9. de Barros LN, Pinheiro WR, Delgado KV (2015) Learning to program using hierarchical model-based debugging. Appl Intell 43(3):544–563

    Article  Google Scholar 

  10. Kuhn H, TucKer A (1951) Non linear programming. In: Proceedings of the Second BerKeley Symposium on Mathematical Statistics and Probability, BerThley, University of California, pp 481–492

  11. Bard JF, Falk JE (1982) An explicit solution to the multi-level programming problem. Comput Oper Res 9(1):77–100

    Article  MathSciNet  Google Scholar 

  12. Pessoa AA, Poss M, Roboredo MC, Aizemberg L (2013) Solving bilevel combinatorial optimization as bilinear min-max optimization via a branch-and-cut algorithm. Anais do XLV Simpósio Brasileiro de Pesquisa Operacional

  13. Candler W, Townsley R (1982) A linear two-level programming problem. Comput Oper Res 9(1):59–76

    Article  MathSciNet  Google Scholar 

  14. Bialas W, Karwan M, Shaw J (1980) A parametric complementary pivot approach for two-level linear programming. State University of New York at Buffalo 57

  15. Savard G, Gauvin J (1994) The steepest descent direction for the nonlinear bilevel programming problem. Oper Res Lett 15(5):265–272

    Article  MathSciNet  MATH  Google Scholar 

  16. Aiyoshi E, Shimizu K (1981) Hierarchical decentralized systems and its new solution by a barrier method. IEEE Trans Syst Man Cybern 6:444–49

    MathSciNet  Google Scholar 

  17. Colson B, Marcotte P, Savard G (2005) A trust-region method for nonlinear bilevel programming: algorithm and computational experience. Comput Optim Appl 30(3):211–227

    Article  MathSciNet  MATH  Google Scholar 

  18. Sinha A, Malo P, Deb K (2013) Efficient evolutionary algorithm for single-objective bilevel optimization. arXiv:13033901

  19. Mathieu R, Pittard L, Anandalingam G (1994) Genetic algorithm based approach to bi-level linear programming. Revue franċaise d’automatique, d’informatique et de recherche opérationnelle Recherche opérationnelle 28(1):1–21

    MathSciNet  MATH  Google Scholar 

  20. Legillon F, Liefooghe A, Talbi EG (2012) Cobra: A cooperative coevolutionary algorithm for bi-level optimization. In: 2012 IEEE Congress on Evolutionary Computation, IEEE, pp 1–8

  21. Koh A (2013) A metaheuristic framework for bi-level programming problems with multi-disciplinary applications. In: Metaheuristics for Bi-level Optimization, Springer, pp 153–187

  22. Chaabani A, Bechikh S, Said LB (2015b) A co-evolutionary decomposition-based algorithm for bi-level combinatorial optimization. In: 2015 IEEE Congress on Evolutionary Computation (CEC), IEEE, pp 1659–1666

  23. Chaabani A, Bechikh S, Ben Said L, Azzouz R (2015a) An improved co-evolutionary decomposition-based algorithm for bi-level combinatorial optimization. In: Proceedings of the Companion Publication of the 2015 Annual Conference on Genetic and Evolutionary Computation. ACM, pp 1363–1364

  24. Lam AY, Li VO (2010) Chemical-reaction-inspired metaheuristic for optimization. IEEE Trans Evol Comput 14(3):381–399

    Article  Google Scholar 

  25. James J, Lam AY, Li VO (2011) Evolutionary artificial neural network based on chemical reaction optimization. In: 2011 IEEE Congress of Evolutionary Computation (CEC). IEEE, pp 2083–2090

  26. James J, Lam AY, Li VO (2015) Adaptive chemical reaction optimization for global numerical optimization. In: 2015 IEEE Congress on Evolutionary Computation (CEC), IEEE, pp 3192–3199

  27. Bechikh S, Chaabani A, Said LB (2015) An efficient chemical reaction optimization algorithm for multiobjective optimization. IEEE Trans Cybern 45(10):2051–2064

    Article  Google Scholar 

  28. Calvete HI, Galé C (2010) A multiobjective bilevel program for production-distribution planning in a supply chain. In: Multiple Criteria Decision Making for Sustainable Energy and Transportation Systems, Springer, pp 155–165

  29. Marinakis Y, Migdalas A, Pardalos PM (2007) A new bilevel formulation for the vehicle routing problem and a solution method using a genetic algorithm. J Glob Optim 38(4):555–580

    Article  MathSciNet  MATH  Google Scholar 

  30. Dempe S (2003) Annotated bibliography on bilevel programming and mathematical programs with equilibrium constraints

  31. Kalashnikov VV, Dempe S, Pérez-Valdés G A, Kalashnykova NI, Camacho-Vallejo JF (2015) Bilevel programming and applications. Math Probl Eng 2015:16

    MathSciNet  MATH  Google Scholar 

  32. Talbi EG (2013) Metaheuristics for bi-level optimization, vol 482. Springer, Berlin

    Book  MATH  Google Scholar 

  33. Yin Y (2000) Genetic-algorithms-based approach for bilevel programming models. J Transp Eng 126(2):115–120

    Article  Google Scholar 

  34. Gendreau M, Marcotte P, Savard G (1996) A hybrid tabu-ascent algorithm for the linear bilevel programming problem. J Glob Optim 8(3):217–233

    Article  MathSciNet  MATH  Google Scholar 

  35. Meng Q, Yang H, Bell M (2001) An equivalent continuously differentiable model and a locally convergent algorithm for the continuous network design problem. Transp Res B Methodol 35(1):83–105

    Article  Google Scholar 

  36. Dempe S, Kalashnikov VV, Kalashnykova N (2006) Optimality conditions for bilevel programming problems. In: Optimization with Multivalued Mappings, Springer, pp 3–28

  37. Fliege J, Vicente LN (2006) Multicriteria approach to bilevel optimization. J Optim Theory Appl 131 (2):209–225

    Article  MathSciNet  MATH  Google Scholar 

  38. Oduguwa V, Roy R (2002) Bi-level optimisation using genetic algorithm. In: 2002 IEEE International Conference on Artificial Intelligence Systems, 2002. (ICAIS 2002), IEEE, pp 322–327

  39. Lam AY, Li VO (2012) Chemical reaction optimization: a tutorial. Memetic Comput 4(1):3–17

    Article  Google Scholar 

  40. Lam AY, Li VO, Wei Z (2012b) Chemical reaction optimization for the fuzzy rule learning problem. In: 2012 IEEE Congress on Evolutionary Computation (CEC), IEEE, pp 1–8

  41. Hajek B (1988) Cooling schedules for optimal annealing. Math Oper Res 13(2):311–329

    Article  MathSciNet  MATH  Google Scholar 

  42. Rudolph G (1994) Convergence analysis of canonical genetic algorithms. IEEE Trans Neural Netw 5(1):96–101

    Article  MathSciNet  Google Scholar 

  43. Szeto W, Liu Y, Ho SC (2016) Chemical reaction optimization for solving a static bike repositioning problem. Trans Res Part D: Trans Environ 47:104–135

    Article  Google Scholar 

  44. Xu J, Lam AY, Li VO (2011) Chemical reaction optimization for task scheduling in grid computing. IEEE Trans Parallel Distrib Syst 22(10):1624–1631

    Article  Google Scholar 

  45. Truong TK, Li K, Xu Y (2013) Chemical reaction optimization with greedy strategy for the 0-1 knapsack problem. Appl Soft Comput 13(4):1774–1780

    Article  Google Scholar 

  46. Saifullah CK, Islam MR (2016) Chemical reaction optimization for solving shortest common supersequence problem. Comput Biol Chem 64:82–93

    Article  Google Scholar 

  47. Chaabani A, Bechikh S, Ben Said L (2014) An indicator-based chemical reaction optimization algorithm for multi-objective search. In: Proceedings of the Companion Publication of the 2014 Annual Conference on Genetic and Evolutionary Computation. ACM, pp 85–86

  48. Vicente LN, Calamai PH (1994) Bilevel and multilevel programming: A bibliography review. J Glob Optim 5(3):291–306

    Article  MathSciNet  MATH  Google Scholar 

  49. Cordeau JF, Gendreau M, Laporte G (1997) A tabu search heuristic for periodic and multi-depot vehicle routing problems. Networks 30(2):105–119

    Article  MATH  Google Scholar 

  50. Sorensen K (2015) Metaheuristics-the metaphor exposed. Int Trans Oper Res 22(1):3–18

    Article  MathSciNet  MATH  Google Scholar 

  51. Das I, Dennis JE (1998) Normal-boundary intersection: A new method for generating the pareto surface in nonlinear multicriteria optimization problems. SIAM J Optim 8(3):631–657

    Article  MathSciNet  MATH  Google Scholar 

  52. Asafuddoula M, Ray T, SarKer R (2015) A decomposition-based evolutionary algorithm for many objective optimization. IEEE Trans Evol Comput 19(3):445–460

    Article  Google Scholar 

  53. Zheng XW, Lu DJ, Wang XG, Liu H (2015) A cooperative coevolutionary biogeography-based optimizer. Appl Intell 43(1):95–111

    Article  Google Scholar 

  54. Eiben AE, Smit SK (2011) Parameter tuning for configuring and analyzing evolutionary algorithms. Swarm Evol Comput 1(1):19–31

    Article  Google Scholar 

  55. López-Ibánez M, Dubois-Lacoste J, Stützle T, Birattari M (2011) The irace package: Iterated racing for automatic algorithm configuration. IRIDIA, Université Libre de Bruxelles, Belgium, Tech Rep TR/IRIDIA/2011-004

  56. Potvin JY, Bengio S (1996) The vehicle routing problem with time windows part ii: genetic search. INFORMS J Comput 8(2):165–172

    Article  MATH  Google Scholar 

  57. Deb K, Goyal M (1996) A combined genetic adaptive search (geneas) for engineering design. Comput Sci Inf 26:30–45

    Google Scholar 

  58. Calvete HI, Galé C, Oliveros MJ (2013) A hybrid algorithm for solving a bilevel production-distribution planning problem. In: Modeling and Simulation in Engineering, Economics, and Management, Springer, pp 138–144

  59. Derrac J, García S, Molina D, Herrera F (2011) A practical tutorial on the use of nonparametric statistical tests as a methodology for comparing evolutionary and swarm intelligence algorithms. Swarm Evol Comput 1(1):3–18

    Article  Google Scholar 

  60. Cohen J (1977) Statistical power analysis for the behavioral sciences (Revised Edition). Academic Press, New York. ISBN: 978-0-12-179060-8

    Google Scholar 

  61. Caprara A, Carvalho M, Lodi A, Woeginger GJ (2013) A complexity and approximability study of the bilevel knapsack problem. In: International Conference on Integer Programming and Combinatorial Optimization, Springer, pp 98–109

  62. Lei L, Guang-nian X, Chen-xin L (2010) Research on problems bilevel programming for personnel allocation in enterprise. In: 2010 International Conference on Management Science and Engineering (ICMSE), IEEE, pp 293–298

  63. Bianco L, Caramia M, Giordani S (2009) A bilevel flow model for hazmat transportation network design. Trans Res Part C: Emerging Techn 17(2):175–196

    Article  Google Scholar 

  64. Zaefferer M, Stork J, Friese M, Fischbach A, Naujoks B, Bartz-Beielstein T (2014) Efficient global optimization for combinatorial problems. In: Proceedings of the 2014 Annual Conference on Genetic and Evolutionary Computation, ACM, pp 871–878

  65. Yin Y (2002) Multiobjective bilevel optimization for transportation planning and management problems. J Adv Transp 36(1):93–105

    Article  Google Scholar 

  66. Eldos T (2009) Simulated Annealing with Deterministic Decisions. J Comput Sci 5(12):974

    Article  Google Scholar 

  67. Rose K, Gurewitz E, Fox G (1990) A deterministic annealing approach to clustering. Pattern Recogn Lett 11(9):589–594

    Article  MATH  Google Scholar 

  68. Yasuda M (2017) Deterministic Annealing: A Variant of Simulated Annealing and its Application to Fuzzy Clustering. In: Peyvandi H (ed) Computational Optimization in Engineering-Paradigms and Applications. ISBN: 978-953-51-3082-6. https://doi.org/10.5772/66072

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Abir Chaabani.

Appendix: A CRO energy conditions

Appendix: A CRO energy conditions

This appendix defines the energy rules used in the variation operators. In this way each variation needs to satisfy the energy conservation condition in order to realize a new solution [40] as shown in Table 11.

Table 11 The energy management rules

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Chaabani, A., Bechikh, S. & Said, L.B. A new co-evolutionary decomposition-based algorithm for bi-level combinatorial optimization. Appl Intell 48, 2847–2872 (2018). https://doi.org/10.1007/s10489-017-1115-9

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10489-017-1115-9

Keywords

Navigation