Abstract
This study provides a new hyper-heuristic design using a learning-based heuristic selection mechanism together with an adaptive move acceptance criterion. The selection process was supported by an online heuristic subset selection strategy. In addition, a pairwise heuristic hybridization method was designed. The motivation behind building an intelligent selection hyper-heuristic using these adaptive hyper-heuristic sub-mechanisms is to facilitate generality. Therefore, the designed hyper-heuristic was tested on a number of problem domains defined in a high-level framework, i.e., HyFlex. The framework provides a set of problems with a number of instances as well as a group of low-level heuristics. Thus, it can be considered a good environment to measure the generality level of selection hyper-heuristics. The computational results demonstrated the generic performance of the proposed strategy in comparison with other tested hyper-heuristics composed of the sub-mechanisms from the literature. Moreover, the performance and behavior analysis conducted for the hyper-heuristic clearly showed its adaptive characteristics under different search conditions. The principles comprising the here presented algorithm were at the heart of the algorithm that won the first international cross-domain heuristic search competition.
Similar content being viewed by others
References
Alpaydin, E. (2010). Introduction to machine learning (2nd ed.). Cambridge, MA: MIT Press.
Bader-El-Den, M., Poli, R.,& Fatima, S. (2009). Evolving timetabling heuristics using a grammar-based genetic programming hyper-heuristic framework. Memetic Computing, 1(3), 205– 219.
Bilgin, B., Demeester, P., Mısır, M.,& Vancroonenburg, W. (2012). One hyperheuristic approach to two timetabling problems in health care. Journal of Heuristics, 18(3), 401–434.
Bilgin, B., Demeester, P., Mısır, M., Vancroonenburg, W., Vanden Berghe, G.,& Wauters, T. (2010). A hyper-heuristic combined with a greedy shuffle approach to the nurse rostering competition. In The 8th international conference on the practice and theory of automated timetabling (PATAT’10)—the nurse rostering competition, Belfast.
Bowling, M.,& Veloso, M. (2001). Rational and convergent learning in stochastic games. In International joint conference on artificial intelligence (Vol. 17, pp. 1021–1026), Seattle, WA: Citeseer.
Burke, E.,& Bykov, Y. (2008). A late acceptance strategy in hill-climbing for exam timetabling problems. In Proceedings of the 7th international conference on the practice and theory of automated timetabling (PATAT’2008), Montreal.
Burke, E., Hart, E., Kendall, G., Newall, J., Ross, P.,& Schulenburg, S. (2003a). chap. hyper-heuristics: An emerging direction in modern search technology (pp. 457–474). Handbook of meta-heuristics. Dordrecht: Kluwer.
Burke, E., Hyde, M.,& Kendall, G. (2006a). Evolving bin packing heuristics with genetic programming. In T. Runarsson, H.-G. Beyer., E. Burke, J. Merelo-Guervos, L. Whitley,& X. Yao (Eds.), Proceedings of the 9th international conference on parallel problem solving from nature (PPSN’06). LNCS (Vol. 4193 pp. 860–869). Reykjavik: Springer.
Burke, E., Hyde, M., Kendall, G., Ochoa, G., Özcan, E.,& Woodward, J. (2010a). A classification of hyper-heuristic approaches. Handbook of metaheuristics (pp. 449–468). New York: Springer.
Burke, E., Hyde, M., Kendall, G.,& Woodward, J. (2007). Automatic heuristic generation with genetic programming: Evolving a jack-of-all-trades or a master of one. In H. Lipson (Ed.), Proceedings of genetic and evolutionary computation conference (GECCO’07) (pp. 1559–1565), London.
Burke, E., Hyde, M., Kendall, G.,& Woodward, J. (2010b). A genetic programming hyper-heuristic approach for evolving two dimensional strip packing heuristics. IEEE Transactions on Evolutionary Computation, 14(6), 942–958.
Burke, E., Kendall, G., Silva, D., O’Brien, R.,& Soubeiga, E. (2005). An ant algorithm hyperheuristic for the project presentation scheduling problem. In Proceedings of the IEEE congress on evolutionary computation (CEC’05) (Vol. 3, pp. 2263–2270).
Burke, E., Kendall, G., Mısır, M.,& Özcan, E. (2012). Monte carlo hyper-heuristics for examination timetabling. Annals of Operations Research, 196(1), 73–90.
Burke, E., Kendall, G.,& Soubeiga, E. (2003b). A tabu-search hyper-heuristic for timetabling and rostering. Journal of Heuristics, 9(3), 451–470.
Burke, E., Petrovic, S.,& Qu, R. (2006b). Case based heuristic selection for timetabling problems. Journal of Scheduling, 9(2), 115–132.
Chakhlevitch, K.,& Cowling, P. (2005). Choosing the fittest subset of low level heuristics in a hyperheuristic framework. In G. Raidl& J. Gottlieb (Eds.), Evolutionary computation in combinatorial optimization. LNCS (Vol. 3448, pp. 23–33). Berlin/Heidelberg: Springer.
Cowling, P., Kendall, G.,& Soubeiga, E. (2001). A hyperheuristic approach to scheduling a sales summit. In E. K. Burke& W. Erben (Eds.), Selected papers from the 3rd international conference on practice and theory of automated timetabling (PATAT’00). LNCS (Vol. 2079, pp. 176–190). London: Springer.
Curtois, T., Ochoa, G., Hyde, M.,& Vázquez-Rodríguez, J. A. (2010). A hyflex module for the personnel scheduling problem. CS Technical Report : University of Nottingham, Nottinghamshire.
Demeester, P., Causmaecker, P. D.,& Vanden Berghe, G. (2010). A general approach for exam timetabling: A real-world and a benchmark case. In Proceedings of the 8th international conference on the practice and theory of automated timetabling (PATAT’10) (pp. 486–489), Belfast.
Dowsland, K., Soubeiga, E.,& Burke, E. (2007). A simulated annealing hyper-heuristic for determining shipper sizes. European Journal of Operational Research, 179(3), 759–774.
Fukunaga, A. (2008). Automated discovery of local search heuristics for satisfiability testing. Evolutionary Computation, 16(1), 31–61.
Han, L.,& Kendall, G. (2003). An investigation of a tabu assisted hyper-heuristic genetic algorithm. In Proceedings of the IEEE congress on evolutionary computation (CEC’03) (Vol. 3, pp. 2230–2237).
Hyde, M.,& Ochoa, G. (2011). HyFlex competition instance summary. CS Technical Report : University of Nottingham, Nottinghamshire.
Hyde, M., Ochoa, G., Curtois, T.,& Vázquez-Rodríguez, J. A. (2010a). A hyflex module for the maximum satisfiability (MAX-SAT) problem. CS Technical Report : University of Nottingham, Nottinghamshire.
Hyde, M., Ochoa, G., Curtois, T.,& Vázquez-Rodríguez, J. A. (2010b). A hyflex module for the one dimensional bin packing problem. CS Technical Report : University of Nottingham, Nottinghamshire.
Kendall, G.,& Hussin, N. (2005a). An investigation of a tabu-search-based hyper-heuristic for examination timetabling. Selected papers from the 1st international conference on multidisciplinary scheduling: Theory and applications (MISTA’03) (pp. 309–328). Nottingham: Springer.
Kendall, G.,& Hussin, N. (2005b). A tabu search hyper-heuristic approach to the examination timetabling problem at the mara university of technology. In E. Burke& M. Trick (Eds.), Proceedings of the 5th international conference on practice and theory of automated timetabling (PATAT’04). LNCS (Vol. 3616, pp. 270–293). Berlin: Springer.
Kendall, G.,& Mohamad, M. (2004). Channel assignment in cellular communication using a great deluge hyper-heuristic. In Proceedings of the 12th IEEE international conference on network (ICON’04) (pp. 769–773).
Lee, D., Vassiliadis, V.,& Park, J. (2002). List-based threshold-accepting algorithm for zero-wait scheduling of multiproduct batch plants. Industrial& Engineering Chemistry Research, 41(25), 6579–6588.
Marín-Blázquez, J.,& Schulenburg, S. (2007). A hyper-heuristic framework with XCS: Learning to create novel problem-solving algorithms constructed from simpler algorithmic ingredients. In T. Kovacs, X. Llorà, K. Takadama, P. Lanzi, W. Stolzmann,& S. Wilson (Eds.), Selected papers from the international workshops on learning classifier systems (IWLCS’03-05). LNCS (Vol. 4399, pp. 193–218). Berlin: Springer.
Mısır, M., Smet, P., Verbeeck, K.,& Vanden Berghe, G. (2011a). Security personnel routing and rostering: A hyper-heuristic approach. In Proceedings of the 3rd international conference on applied operational research (ICAOR’11). LNCS (Vol. 3, pp. 193–205), Istanbul.
Mısır, M., Vancroonenburg, W.,& Vanden Berghe, G. (2011b). A selection hyper-heuristic for scheduling deliveries of ready-mixed concrete. In Proceedings of the 9th metaheuristic international conference (MIC’11), Udine.
Mısır, M., Verbeeck, K., De Causmaecker, P.,& Vanden Berghe, G. (2010). Hyper-heuristics with a dynamic heuristic set for the home care scheduling problem. In Proceedings of the IEEE congress on evolutionary computation (CEC’10) (pp. 2875–2882), Barcelona.
Mısır, M., Wauters, T., Verbeeck, K.,& Vanden Berghe, G. (2009). A new learning hyper-heuristic for the traveling tournament problem. In Proceedings of the 8th metaheuristic international conference (MIC’09), Hamburg.
Nareyek, A. (2003). Metaheuristics: Computer decision-making, chap. Choosing search heuristics by non-stationary reinforcement learning (pp. 523–544). Dordrecht: Kluwer.
Ochoa, G., Hyde, M., Curtois, T., Vázquez-Rodríguez, J., Walker, J., Gendreau, M., Kendall, G., McCollum, B., Parkes, A., Petrovic, S.,& Burke, E. (2012). Hyflex: A benchmark framework for cross-domain heuristic search. In J.-K. Hao& M. Middendorf (Eds.), Proceedings of the 12th European conference on evolutionary computation in combinatorial optimisation (EvoCOP’12). LNCS (Vol. 7245, pp. 136–147). Berlin: Springer.
Özcan, E., Bilgin, B.,& Korkmaz, E. (2008). A comprehensive analysis of hyper-heuristics. Intelligent Data Analysis, 12(1), 3–23.
Özcan, E., Mısır, M., Ochoa, G.,& Burke, E. (2010). A reinforcement learning–Great-deluge hyper-heuristic for examination timetabling. International Journal of Applied Metaheuristic Computing, 1(1), 39–59.
Ross, P., Schulenburg, S., Marín-Blázquez, J.,& Hart, E. (2002). Hyper-heuristics: Learning to combine simple heuristics in bin-packing problems. In W. B. Langdon, E. Cantú-Paz, K. Mathias, R. Roy, D. Davis, R. Poli, K. Balakrishnan, V. Honavar, G. Rudolph, J. Wegener, L. Bull, M. A. Potter, A. C. Schultz, J. F. Miller, E. Burke,& N. Jonoska (Eds.), Proceedings of the 4th annual conference on genetic and evolutionary computation (GECCO’02) (pp. 942–948). New York: Morgan Kaufmann Publishers.
Thathachar, M.,& Sastry, P. (2004). Networks of learning automata: Techniques for online stochastic optimization. Boston: Kluwer.
Vázquez-Rodríguez, J. A., Ochoa, G., Curtois, T.,& Hyde, M. (2010). A hyflex module for the permutation flow shop problem. CS Technical Report : University of Nottingham, Nottinghamshire.
Walker, J., Ochoa, G., Gendreau, M.,& Burke, E. (2012). Vehicle routing and adaptive iterated local search within the HyFlex hyper-heuristic framework. In Y. Hamadi& M. Schoenauer (Eds.), Proceedings of the 6th learning and intelligent optimization conference (LION’12). LNCS (Vol. 7219). Paris: Springer.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Mısır, M., Verbeeck, K., Causmaecker, P.D. et al. A new hyper-heuristic as a general problem solver: an implementation in HyFlex. J Sched 16, 291–311 (2013). https://doi.org/10.1007/s10951-012-0295-8
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10951-012-0295-8