A simheuristic algorithm for solving the permutation flow shop problem with stochastic processing times

https://doi.org/10.1016/j.simpat.2014.02.005Get rights and content

Abstract

This paper describes a simulation–optimization algorithm for the Permutation Flow shop Problem with Stochastic processing Times (PFSPST). The proposed algorithm combines Monte Carlo simulation with an Iterated Local Search metaheuristic in order to deal with the stochastic behavior of the problem. Using the expected makespan as initial minimization criterion, our simheuristic approach is based on the assumption that high-quality solutions (permutations of jobs) for the deterministic version of the problem are likely to be high-quality solutions for the stochastic version – i.e., a correlation will exist between both sets of solutions, at least for moderate levels of variability in the stochastic processing times. No particular assumption is made on the probability distributions modeling each job-machine processing times. Our approach is able to solve, in just a few minutes or even less, PFSPST instances with hundreds of jobs and dozens of machines. Also, the paper proposes the use of reliability analysis techniques to analyze simulation outcomes or historical observations on the random variable representing the makespan associated with a given solution. This way, criteria other than the expected makespan can be considered by the decision maker when comparing different alternative solutions. A set of classical benchmarks for the deterministic version of the problem are adapted and tested under several scenarios, each of them characterized by a different level of uncertainty – variance level of job-machine processing times.

Introduction

The Flow Shop Scheduling Problem (FSP) is a well-known scheduling problem that can be described as follows: a set J of n jobs has to be processed by a set M of m machines. Each job i  J is composed by an ordered set of m operations, Oij, that must be sequentially performed by the m machines (one operation per machine). A special case of the FSP is the Permutation Flow Shop Scheduling Problem (PFSP), where the processing order of operations in machines is the same for all jobs – i.e., all jobs are processed by all machines in the same order. Each operation Oij requires a processing time. In the PFSP, the goal is to find a sequence (permutation) of jobs so that a given criterion is optimized. The most commonly and studied criterion is the minimization of the completion time or makespan, i.e., the time it requires to process all the jobs throughout all the machines (Fig. 1). Although the usual goal is to minimize the makespan, other goals can also be considered, e.g., the minimization of the total processing time – i.e., the sum of the individual processing times of each job in each machine, or the total tardiness of jobs with respect to their scheduled deadlines. In Framinan et al. [22] and Ruiz and Maroto [50] surveys about the PFSP with the objective to minimize the makespan are provided. Similarly, Vallada et al. [58] contains a survey for the PFSP with the objective of minimizing total tardiness. In addition, it is usually assumed that: (i) there is unlimited storage buffer between machines, and preemption (task interruption) is not considered; (ii) machines are always available for processing jobs, but each machine can process only one job at a time; (iii) a job cannot be processed more than once for each machine; and (iv) job processing times are independent. In most of the existing literature, the processing time of each job i in each machine j is considered to be a known constant value, pij. This problem, which is NP-hard [24], has many practical applications in both economic and industrial fields as it exists in many real-life scenarios, including, among others: the manufacturing and production industry, the services sector, the biochemical and pharmaceutical industries, the computing and telecommunication sector, etc. [52].

The PFSP with Stochastic Times (PFSPST) can be seen as a generalization of the PFSP in which the processing time of each job i in each machine j is not a constant value, but instead it is a random variable, Pij, following a non-negative probability distribution – e.g., Log-Normal, Exponential, Weibull, Gamma, etc. Since uncertainty is present in most real-life processes and systems, considering random processing times represents a more realistic scenario than simply considering deterministic times. In effect, unforeseen circumstances can lead to sudden changes in the processing time of certain jobs in certain machines, which is likely to have noticeable effects on the predicted makespan. Therefore, one goal that can be considered when dealing with the PFSPST is to determine a sequence (permutation) of jobs that minimizes the expected makespan or mean time to completion of all jobs.

The study of the PFSPST is within the practice of introducing randomness into combinatorial optimization problems as a way of describing more realistic problems in which most of the information and data cannot be known beforehand [59]. For these stochastic problems, efficient simulation–optimization methods have been developed during the last decades. Among these methods, we are particularly interested in the combination of simulation with metaheuristics (simheuristics), since this hybridization constitutes a promising approach yet to be explored in its full potential. Andradóttir [3] offers an overview of simulation–optimization using metaheuristics, while some recent articles combining simulation with metaheuristics can be found in Angelidis et al. [4] and Laroque et al. [40]. In the context of scheduling problems, several authors have discussed the role of simulation in solving real-life instances and have also proposed simulation-based approaches which are typically combined with optimization algorithms (including metaheuristics), among others: Azzaro-Pantel et al. [8], Deroussi et al. [19], Arakawa et al. [6], Fowler et al. [21], Klemmt et al. [39], Frantzén et al. [23], Hu and Zhang [29], Bassi et al. [13], or Kima and Choi [38].

Fig. 1 illustrates a simple PFSP with three jobs and three machines, where Oij represents the operation of job i in machine j (1  i  3, 1  j  3). Notice that, for a given permutation of jobs, even a single change in the processing time of one job in one machine (O12 and O21 in the figure, respectively) can have a noticeable impact on the value of the final makespan.

As with other combinatorial optimization problems, a number of different approaches and methodologies have been developed to deal with the PFSP. These approaches range from exact optimization methods – such as linear and constraint programming, which can provide solutions to small-size problems, to approximate methods – such as heuristics and metaheuristics, which can provide near-optimal solutions for medium- and large-sized problems. Moreover, some of these methodologies are able to provide a set of alternative solutions among which the decision-maker can choose according to his/her expertise. However, the situation with the PFSPST is different. To the best of our knowledge, there is a lack of methods able to provide high-quality solutions to the stochastic version of the PFSP. As discussed in the literature review section, most of the existing approaches are quite theoretical and require many assumptions on the probability distributions that model job processing times, while other approaches seem to be valid only for small-size instances. In the articles by Dodin [20], Honkomp et al. [28], Gourgand et al. [27], and Baker and Altheimer [10], simulation-based techniques have been used to get results for the PFSPST. In some of these articles, however, simulation was mainly used as a backup method to validate the results generated by other analytical methods (e.g., Markov chains). Consequently, only Normal or Exponential probability distributions were employed to model processing times. Moreover, these papers made strong assumptions on the size of the instances being analyzed.

Accordingly, the main contributions of this paper to the existing PFSPST literature can be summarized as follows:

  • (a)

    To introduce a simulation–optimization algorithm able to solve large-size instances in short computing times – just a few minutes or even less – regardless the probability distributions that model the stochastic processing times at each job-machine pair. Our approach does not make any assumption on the size of the instances or on the specific distributions employed to model processing times. In fact, in a real-life scenario, the specific distributions to be used will have to be fitted from historical data (observations). The assumption of processing times following a Normal distribution – quite common in the existing literature – is quite unrealistic and restrictive, since distributions such as the Log-Normal or the Weibull are usually much better candidates to model processing times with positive values.

  • (b)

    To discuss how real-life observations associated with a given permutation of jobs – or, alternatively, simulation outputs provided by our approach – can be analyzed using reliability techniques [30] to provide more information on the stochastic makespan. As we discuss later in more detail, it can be very convenient to use survival functions (inverses of cumulative probability functions) to compare alternative PFSPST solutions with similar expected makespans, specially in those scenarios in which percentile information on the makespan variable associated with a given permutation of jobs can be useful. Reliability analysis is preferred here over classical statistical techniques due to the fact that censored or incomplete observations might be present when real-life data are collected.

  • (c)

    To introduce a set of well-defined and easily replicable PFSPST instances based on well-tested PFSP benchmarks.

The rest of the paper is organized as follows: Section 2 offers a complete literature review on the PFSPST. Section 3 provides an (upper-level) overview of our simulation-based approach. Section 4 gives the (lower-level) details, which might be necessary for implementing a software version of the proposed method. Section 5 presents some numerical experiments that illustrate our methodology. Section 6 discusses the use of reliability analysis techniques to compare alternative solutions. Finally, Section 7 summarizes the main contributions of the paper.

Section snippets

Literature review on the PFSP with stochastic times

The literature on the Permutation Flow shop Problem with Stochastic Times (PFSPST) is not as extensive as for the deterministic case. Banerjee [12] and Makino [43] were the first to study the PFSP with stochastic times. The former proposed a decision rule for the single machine problem with random processing times following a known probability distribution, with the objective of minimizing the maximum probability of lateness. The latter studied the 2-jobs with 2-machines problem as well as the

Overview of the SIM-ESP simheuristic approach

Our approach is inspired by the following facts: (a) the PFSPST can be seen as a generalization of the PFSP or, to be more specific, the PFSP is just a PFSPST with constant demands – random demands with zero variance; and (b) while the PFSPST is yet an emerging research area, extremely efficient metaheuristics do already exist for solving the PFSP – in fact, state-of-the-art metaheuristics based on the use of Genetic Algorithms, Iterated Local Search, Tabu Search, Simulated Annealing, or Ant

Some additional details of our approach

While the previous section provided an overview of the SIM-ESP algorithm, this section offers some additional details that are relevant to completely understand our approach as well as to implement it as a computer application. One procedure used in different parts of the SIM-ESP algorithm is the local search (Fig. 4), which in our case is the same method used by many other authors, e.g., Ruiz and Stützle [51]. Roughly speaking, it consists in an iterative process with the following steps at

A numerical experiment varying the level of uncertainty

The SIM-ESP algorithm described in this paper was implemented as a Java application. An Intel Xeon at 2.0 GHz and 4 GB RAM was used to perform all tests, which were run directly on the Netbeans IDE platform for Java over Windows 7.

In the PFSP literature, there exists a classical set of very well-known benchmarks commonly used to test new algorithmic approaches. However, with the arguably exception of the somewhat limited benchmark proposed by Baker and Altheimer [10], there are no standard

Using reliability-based methods to compare different solutions

So far, we have been comparing solutions by using their respective expected makespan values. While this has been the most utilized criterion in the existing literature so far, decision-makers might be interested in considering additional information about the makespan associated with a given solution (permutation of jobs). Since this makespan is a random variable, a manager can ask him or herself questions such as: which is the variance and distribution of this makespan? and which is the

Conclusions and future work

In this paper we have presented a simheuristic algorithm, combining an Iterated Local Search metaheuristic with Monte Carlo simulation, to solve the Permutation Flow shop Problem with Stochastic Times (PFSPST). The basic idea behind our approach consists in: (a) to transform the initial stochastic problem into a deterministic one by considering constant processing times given by the expected values of the stochastic times; then (b) generate, using an efficient metaheuristic algorithm, a reduced

Acknowledgements

This work has been partially supported by the Spanish Ministry of Science and Innovation (TRA2010-21644-C03). It has been developed in the context of the IN3-ICSO program and the CYTED-HAROSA network (http://dpcs.uoc.edu).

References (68)

  • M. Frantzén et al.

    A simulation-based scheduling system for real-time optimization and decision making support

    Robot. Comput.-Integrated Manuf.

    (2011)
  • F. Ghezail et al.

    Analysis of robustness in proactive scheduling: a graphical approach

    Comput. Ind. Eng.

    (2010)
  • M. Gourgand et al.

    A contribution to the stochastic flow shop scheduling problem

    Eur. J. Oper. Res.

    (2003)
  • M. Gourgand et al.

    Markovian analysis for performance evaluation and scheduling in m machine stochastic flow shop with buffers of any capacity

    Eur. J. Oper. Res.

    (2005)
  • H. Hu et al.

    A simulation-based two-stage scheduling methodology for controlling semiconductor wafer fabs

    Expert Syst. Applic.

    (2012)
  • J. Kamburowski

    Stochastically minimizing the makespan in two machine flow shops without blocking

    Eur. J. Oper. Res.

    (1999)
  • K. Kianfar et al.

    Study of stochastic sequence-dependent flexible flow shop via developing a dispatching rule and a hybrid GA

    Eng. Applic. Artif. Intell.

    (2012)
  • A. Klemmt et al.

    Simulation-based optimization vs. mathematical programming: a hybrid approach for optimizing scheduling problems

    Robot. Comput.-Integrated Manuf.

    (2009)
  • M. Nawaz et al.

    A heuristic algorithm for the m-machine, n-job flowshop sequencing problem

    Omega

    (1983)
  • H. Pierreval et al.

    Robust simulation with a base environmental scenario

    Eur. J. Oper. Res.

    (2007)
  • I. Ribas et al.

    Comparing three-step heuristics for the permutation flow shop problem

    Comput. Oper. Res.

    (2010)
  • B. Roy

    Robustness in operational research and decision aiding: a multi-faceted issue

    Eur. J. Oper. Res.

    (2010)
  • R. Ruiz et al.

    A comprehensive review and evaluation of permutation flow shop heuristics

    Eur. J. Oper. Res.

    (2005)
  • R. Ruiz et al.

    A simple and effective iterated greedy algorithm for the permutation flow shop scheduling problem

    Eur. J. Oper. Res.

    (2007)
  • E. Taillard

    Some efficient heuristic methods for the flow shop sequencing problem

    Eur. J. Oper. Res.

    (1990)
  • E. Taillard

    Benchmarks for basic scheduling problems

    Eur. J. Oper. Res.

    (1993)
  • E. Vallada et al.

    Minimising total tardiness in the m-machine flowshop problem: a review and evaluation of heuristics and metaheuristics

    Comput. Oper. Res.

    (2008)
  • N.M. van Dijk et al.

    Practical optimization by OR and simulation

    Simul. Model. Pract. Theory

    (2008)
  • I. Al Kattan et al.

    Performance analysis of flowshop scheduling using genetic algorithm enhanced with simulation

    Int. J. Ind. Eng. – Theory, Applic. Pract.

    (2008)
  • H. Allaoui et al.

    A robustness framework for a stochastic hybrid flow shop to minimize the makespan

    Proc. Int. Conf. Service Syst. Service Manage.

    (2006)
  • E. Angelidis, D. Bohn, O. Rose, A simulation-based optimization heuristic using self-organization for complex assembly...
  • P.C. Bagga

    N-Job, 2-machine sequencing problem with stochastic service

    Oper. Res.

    (1970)
  • K.R. Baker et al.

    Three heuristic procedures for the stochastic, two-machine flow shop problem

    J. Sched.

    (2011)
  • B.P. Banerjee

    Single facility sequencing with random execution times

    Oper. Res.

    (1965)
  • Cited by (78)

    • Dispatching for batch chemical processes using Monte-Carlo simulations—A practical approach to scheduling in operations

      2022, Simulation and Optimization in Process Engineering: The Benefit of Mathematical Methods in Applications of the Chemical Industry
    • A simulation-based modified backtracking search algorithm for multi-objective stochastic flexible job shop scheduling problem with worker flexibility

      2021, Applied Soft Computing
      Citation Excerpt :

      While few researchers have investigated the latter problem in a flexible job shop environment [16,17], the application of human factors in other areas has demonstrated substantial benefits in terms of reduced costs and improved production efficiency [18,19]. Although the deterministic variant of the FJSSP has been widely studied, in a real manufacturing environment, there exists uncertainty in parameters, particularly the processing times of operations [20]. Uncertainties can be modeled employing deterministic, probabilistic, and possibilistic approaches [21].

    View all citing articles on Scopus
    View full text