Skip to main content
Log in

A new hyper-heuristic as a general problem solver: an implementation in HyFlex

  • Published:
Journal of Scheduling Aims and scope Submit manuscript

Abstract

This study provides a new hyper-heuristic design using a learning-based heuristic selection mechanism together with an adaptive move acceptance criterion. The selection process was supported by an online heuristic subset selection strategy. In addition, a pairwise heuristic hybridization method was designed. The motivation behind building an intelligent selection hyper-heuristic using these adaptive hyper-heuristic sub-mechanisms is to facilitate generality. Therefore, the designed hyper-heuristic was tested on a number of problem domains defined in a high-level framework, i.e., HyFlex. The framework provides a set of problems with a number of instances as well as a group of low-level heuristics. Thus, it can be considered a good environment to measure the generality level of selection hyper-heuristics. The computational results demonstrated the generic performance of the proposed strategy in comparison with other tested hyper-heuristics composed of the sub-mechanisms from the literature. Moreover, the performance and behavior analysis conducted for the hyper-heuristic clearly showed its adaptive characteristics under different search conditions. The principles comprising the here presented algorithm were at the heart of the algorithm that won the first international cross-domain heuristic search competition.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6

Similar content being viewed by others

Notes

  1. http://www.asap.cs.nott.ac.uk/external/chesc2011/

References

  • Alpaydin, E. (2010). Introduction to machine learning (2nd ed.). Cambridge, MA: MIT Press.

    Google Scholar 

  • Bader-El-Den, M., Poli, R.,& Fatima, S. (2009). Evolving timetabling heuristics using a grammar-based genetic programming hyper-heuristic framework. Memetic Computing, 1(3), 205– 219.

    Google Scholar 

  • Bilgin, B., Demeester, P., Mısır, M.,& Vancroonenburg, W. (2012). One hyperheuristic approach to two timetabling problems in health care. Journal of Heuristics, 18(3), 401–434.

    Google Scholar 

  • Bilgin, B., Demeester, P., Mısır, M., Vancroonenburg, W., Vanden Berghe, G.,& Wauters, T. (2010). A hyper-heuristic combined with a greedy shuffle approach to the nurse rostering competition. In The 8th international conference on the practice and theory of automated timetabling (PATAT’10)—the nurse rostering competition, Belfast.

  • Bowling, M.,& Veloso, M. (2001). Rational and convergent learning in stochastic games. In International joint conference on artificial intelligence (Vol. 17, pp. 1021–1026), Seattle, WA: Citeseer.

  • Burke, E.,& Bykov, Y. (2008). A late acceptance strategy in hill-climbing for exam timetabling problems. In Proceedings of the 7th international conference on the practice and theory of automated timetabling (PATAT’2008), Montreal.

  • Burke, E., Hart, E., Kendall, G., Newall, J., Ross, P.,& Schulenburg, S. (2003a). chap. hyper-heuristics: An emerging direction in modern search technology (pp. 457–474). Handbook of meta-heuristics. Dordrecht: Kluwer.

  • Burke, E., Hyde, M.,& Kendall, G. (2006a). Evolving bin packing heuristics with genetic programming. In T. Runarsson, H.-G. Beyer., E. Burke, J. Merelo-Guervos, L. Whitley,& X. Yao (Eds.), Proceedings of the 9th international conference on parallel problem solving from nature (PPSN’06). LNCS (Vol. 4193 pp. 860–869). Reykjavik: Springer.

  • Burke, E., Hyde, M., Kendall, G., Ochoa, G., Özcan, E.,& Woodward, J. (2010a). A classification of hyper-heuristic approaches. Handbook of metaheuristics (pp. 449–468). New York: Springer.

  • Burke, E., Hyde, M., Kendall, G.,& Woodward, J. (2007). Automatic heuristic generation with genetic programming: Evolving a jack-of-all-trades or a master of one. In H. Lipson (Ed.), Proceedings of genetic and evolutionary computation conference (GECCO’07) (pp. 1559–1565), London.

  • Burke, E., Hyde, M., Kendall, G.,& Woodward, J. (2010b). A genetic programming hyper-heuristic approach for evolving two dimensional strip packing heuristics. IEEE Transactions on Evolutionary Computation, 14(6), 942–958.

    Google Scholar 

  • Burke, E., Kendall, G., Silva, D., O’Brien, R.,& Soubeiga, E. (2005). An ant algorithm hyperheuristic for the project presentation scheduling problem. In Proceedings of the IEEE congress on evolutionary computation (CEC’05) (Vol. 3, pp. 2263–2270).

  • Burke, E., Kendall, G., Mısır, M.,& Özcan, E. (2012). Monte carlo hyper-heuristics for examination timetabling. Annals of Operations Research, 196(1), 73–90.

    Google Scholar 

  • Burke, E., Kendall, G.,& Soubeiga, E. (2003b). A tabu-search hyper-heuristic for timetabling and rostering. Journal of Heuristics, 9(3), 451–470.

    Google Scholar 

  • Burke, E., Petrovic, S.,& Qu, R. (2006b). Case based heuristic selection for timetabling problems. Journal of Scheduling, 9(2), 115–132.

    Google Scholar 

  • Chakhlevitch, K.,& Cowling, P. (2005). Choosing the fittest subset of low level heuristics in a hyperheuristic framework. In G. Raidl& J. Gottlieb (Eds.), Evolutionary computation in combinatorial optimization. LNCS (Vol. 3448, pp. 23–33). Berlin/Heidelberg: Springer.

  • Cowling, P., Kendall, G.,& Soubeiga, E. (2001). A hyperheuristic approach to scheduling a sales summit. In E. K. Burke& W. Erben (Eds.), Selected papers from the 3rd international conference on practice and theory of automated timetabling (PATAT’00). LNCS (Vol. 2079, pp. 176–190). London: Springer.

  • Curtois, T., Ochoa, G., Hyde, M.,& Vázquez-Rodríguez, J. A. (2010). A hyflex module for the personnel scheduling problem. CS Technical Report : University of Nottingham, Nottinghamshire.

    Google Scholar 

  • Demeester, P., Causmaecker, P. D.,& Vanden Berghe, G. (2010). A general approach for exam timetabling: A real-world and a benchmark case. In Proceedings of the 8th international conference on the practice and theory of automated timetabling (PATAT’10) (pp. 486–489), Belfast.

  • Dowsland, K., Soubeiga, E.,& Burke, E. (2007). A simulated annealing hyper-heuristic for determining shipper sizes. European Journal of Operational Research, 179(3), 759–774.

    Google Scholar 

  • Fukunaga, A. (2008). Automated discovery of local search heuristics for satisfiability testing. Evolutionary Computation, 16(1), 31–61.

    Google Scholar 

  • Han, L.,& Kendall, G. (2003). An investigation of a tabu assisted hyper-heuristic genetic algorithm. In Proceedings of the IEEE congress on evolutionary computation (CEC’03) (Vol. 3, pp. 2230–2237).

  • Hyde, M.,& Ochoa, G. (2011). HyFlex competition instance summary. CS Technical Report : University of Nottingham, Nottinghamshire.

    Google Scholar 

  • Hyde, M., Ochoa, G., Curtois, T.,& Vázquez-Rodríguez, J. A. (2010a). A hyflex module for the maximum satisfiability (MAX-SAT) problem. CS Technical Report : University of Nottingham, Nottinghamshire.

    Google Scholar 

  • Hyde, M., Ochoa, G., Curtois, T.,& Vázquez-Rodríguez, J. A. (2010b). A hyflex module for the one dimensional bin packing problem. CS Technical Report : University of Nottingham, Nottinghamshire.

    Google Scholar 

  • Kendall, G.,& Hussin, N. (2005a). An investigation of a tabu-search-based hyper-heuristic for examination timetabling. Selected papers from the 1st international conference on multidisciplinary scheduling: Theory and applications (MISTA’03) (pp. 309–328). Nottingham: Springer.

  • Kendall, G.,& Hussin, N. (2005b). A tabu search hyper-heuristic approach to the examination timetabling problem at the mara university of technology. In E. Burke& M. Trick (Eds.), Proceedings of the 5th international conference on practice and theory of automated timetabling (PATAT’04). LNCS (Vol. 3616, pp. 270–293). Berlin: Springer.

  • Kendall, G.,& Mohamad, M. (2004). Channel assignment in cellular communication using a great deluge hyper-heuristic. In Proceedings of the 12th IEEE international conference on network (ICON’04) (pp. 769–773).

  • Lee, D., Vassiliadis, V.,& Park, J. (2002). List-based threshold-accepting algorithm for zero-wait scheduling of multiproduct batch plants. Industrial& Engineering Chemistry Research, 41(25), 6579–6588.

    Google Scholar 

  • Marín-Blázquez, J.,& Schulenburg, S. (2007). A hyper-heuristic framework with XCS: Learning to create novel problem-solving algorithms constructed from simpler algorithmic ingredients. In T. Kovacs, X. Llorà, K. Takadama, P. Lanzi, W. Stolzmann,& S. Wilson (Eds.), Selected papers from the international workshops on learning classifier systems (IWLCS’03-05). LNCS (Vol. 4399, pp. 193–218). Berlin: Springer.

  • Mısır, M., Smet, P., Verbeeck, K.,& Vanden Berghe, G. (2011a). Security personnel routing and rostering: A hyper-heuristic approach. In Proceedings of the 3rd international conference on applied operational research (ICAOR’11). LNCS (Vol. 3, pp. 193–205), Istanbul.

  • Mısır, M., Vancroonenburg, W.,& Vanden Berghe, G. (2011b). A selection hyper-heuristic for scheduling deliveries of ready-mixed concrete. In Proceedings of the 9th metaheuristic international conference (MIC’11), Udine.

  • Mısır, M., Verbeeck, K., De Causmaecker, P.,& Vanden Berghe, G. (2010). Hyper-heuristics with a dynamic heuristic set for the home care scheduling problem. In Proceedings of the IEEE congress on evolutionary computation (CEC’10) (pp. 2875–2882), Barcelona.

  • Mısır, M., Wauters, T., Verbeeck, K.,& Vanden Berghe, G. (2009). A new learning hyper-heuristic for the traveling tournament problem. In Proceedings of the 8th metaheuristic international conference (MIC’09), Hamburg.

  • Nareyek, A. (2003). Metaheuristics: Computer decision-making, chap. Choosing search heuristics by non-stationary reinforcement learning (pp. 523–544). Dordrecht: Kluwer.

  • Ochoa, G., Hyde, M., Curtois, T., Vázquez-Rodríguez, J., Walker, J., Gendreau, M., Kendall, G., McCollum, B., Parkes, A., Petrovic, S.,& Burke, E. (2012). Hyflex: A benchmark framework for cross-domain heuristic search. In J.-K. Hao& M. Middendorf (Eds.), Proceedings of the 12th European conference on evolutionary computation in combinatorial optimisation (EvoCOP’12). LNCS (Vol. 7245, pp. 136–147). Berlin: Springer.

  • Özcan, E., Bilgin, B.,& Korkmaz, E. (2008). A comprehensive analysis of hyper-heuristics. Intelligent Data Analysis, 12(1), 3–23.

    Google Scholar 

  • Özcan, E., Mısır, M., Ochoa, G.,& Burke, E. (2010). A reinforcement learning–Great-deluge hyper-heuristic for examination timetabling. International Journal of Applied Metaheuristic Computing, 1(1), 39–59.

    Article  Google Scholar 

  • Ross, P., Schulenburg, S., Marín-Blázquez, J.,& Hart, E. (2002). Hyper-heuristics: Learning to combine simple heuristics in bin-packing problems. In W. B. Langdon, E. Cantú-Paz, K. Mathias, R. Roy, D. Davis, R. Poli, K. Balakrishnan, V. Honavar, G. Rudolph, J. Wegener, L. Bull, M. A. Potter, A. C. Schultz, J. F. Miller, E. Burke,& N. Jonoska (Eds.), Proceedings of the 4th annual conference on genetic and evolutionary computation (GECCO’02) (pp. 942–948). New York: Morgan Kaufmann Publishers.

    Google Scholar 

  • Thathachar, M.,& Sastry, P. (2004). Networks of learning automata: Techniques for online stochastic optimization. Boston: Kluwer.

    Book  Google Scholar 

  • Vázquez-Rodríguez, J. A., Ochoa, G., Curtois, T.,& Hyde, M. (2010). A hyflex module for the permutation flow shop problem. CS Technical Report : University of Nottingham, Nottinghamshire.

    Google Scholar 

  • Walker, J., Ochoa, G., Gendreau, M.,& Burke, E. (2012). Vehicle routing and adaptive iterated local search within the HyFlex hyper-heuristic framework. In Y. Hamadi& M. Schoenauer (Eds.), Proceedings of the 6th learning and intelligent optimization conference (LION’12). LNCS (Vol. 7219). Paris: Springer.

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Mustafa Mısır.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Mısır, M., Verbeeck, K., Causmaecker, P.D. et al. A new hyper-heuristic as a general problem solver: an implementation in HyFlex. J Sched 16, 291–311 (2013). https://doi.org/10.1007/s10951-012-0295-8

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10951-012-0295-8

Keywords

Navigation