Influence of Initialization on the Performance of Metaheuristic
  Optimizers
  All metaheuristic optimization algorithms require some initialization, and
the initialization for such optimizers is usually carried out randomly.
However, initialization can have some significant influence on the performance
of such algorithms. This paper presents a systematic comparison of 22 different
initialization methods on the convergence and accuracy of five optimizers:
differential evolution (DE), particle swarm optimization (PSO), cuckoo search
(CS), artificial bee colony (ABC) algorithm and genetic algorithm (GA). We have
used 19 different test functions with different properties and modalities to
compare the possible effects of initialization, population sizes and the
numbers of iterations. Rigorous statistical ranking tests indicate that 43.37\%
of the functions using the DE algorithm show significant differences for
different initialization methods, while 73.68\% of the functions using both PSO
and CS algorithms are significantly affected by different initialization
methods. The simulations show that DE is less sensitive to initialization,
while both PSO and CS are more sensitive to initialization. In addition, under
the condition of the same maximum number of function evaluations (FEs), the
population size can also have a strong effect. Particle swarm optimization
usually requires a larger population, while the cuckoo search needs only a
small population size. Differential evolution depends more heavily on the
number of iterations, a relatively small population with more iterations can
lead to better results. Furthermore, ABC is more sensitive to initialization,
while such initialization has little effect on GA. Some probability
distributions such as the beta distribution, exponential distribution and
Rayleigh distribution can usually lead to better performance. The implications
of this study and further research topics are also discussed in detail.
