Interactive Evolutionary Computation in Identification of Dynamical Systems
Interactive Evolutionary Computation in Identification of Dynamical Systems
Interactive Evolutionary Computation in Identification of Dynamical Systems
1 Introduction
the new generation. Because the genetic operators are stochastic, EAs are
stochastic optimization methods.
In the initialization step, EAs generate individuals randomly. In every
evolutionary-loop, all of the individuals are evaluated and their fitness values
are calculated based on an objective function. After that the selection oper-
ator selects randomly the best individuals to constitute the next generation.
The crossover (recombination) operator generates two new individuals by tak-
ing two selected individuals and recombining them. The mutation operator
changes randomly the individuals. Finally the old individuals are replaced by
the new individuals.
Generally, EAs are automated algorithms using a given objective function
to calculate the fitness values of the individuals and the selection operator
performs automatically the selection based on these calculated fitness values
(for example using roulette wheel selection). But sometimes instead of a given
objective function, a human user can make the valuation of the individuals,
which results in an interactive optimization.
Interactive Evolutionary Computation (IEC) is an optimization method
that adopts evolutionary computation among system optimization based on
subjective human evaluation [21]. In contrast to the automated evolutionary
optimization algorithms, IEC cannot use many individuals and searching gen-
erations because of resulting human fatigue. Hence, there is a need to develop
and tune an algorithm which effectively search with a few individuals within a
few searching generations. For this purpose, this paper presents an algorithm
based on Evolutionary Strategy (ES). In the following the IEC and the ES
will be described and then the structure of the developed IEC-Tune Toolbox
will be shown.
of the target system according to the distance between the target goal and the
system output in psychological space [20], on the other hand, the EA searches
in the parameter space.
These techniques were applied already in computer graphics [9], animation,
creating forms, textures, and motion [2]. Potential applications of interactive
evolution include artificial life design, e.g., development of components of bi-
ological nature [17, 6] and engineering construction design [13].
Although, IEC has been applied in knowledge acquisition and data mining,
according to our best knowledge, the applicability of this approach in system
identification has not been studied yet. However, in recent years, the applica-
tion of Evolutionary Computing to black-box and grey-box model identifica-
tion has received considerable interest since the seminal paper by Kristinsson
and Dumont [8]. Subsequent evolutionary system identification applications
are applied to build dominant structural identification with local parametric
tuning without the need of a differentiable performance index in the pres-
ence of noisy data. As the overview of Fleming [5] illustrates evolutionary
techniques provide an excellent fitting performance and is capable of accom-
modating multiple objectives such as to examine the relationships between
model complexity and fitting accuracy during the model building process.
These approaches can be extended to the identification of gray-box models,
to use of a priori knowledge [22].
Representation
An ES-individual aj = (xj , σ j ) consists of two components: the object vari-
ables xj = [xj,1 , . . . , xj,n ] and the strategy variables σ j = [σj,1 , . . . , σj,n ].
The strategy parameters allow the algorithm to adapt to the topology of the
objective function by controlling the mutation step size.
Interactive Evolutionary Computation 5
Mutation
As small changes occur frequently but large ones only rarely in the nature, the
mutation operator adds normal distributed random numbers zj,i ∼ N (0, σj,i )
to the individuals:
xj,i = xj,i + zj,i . (1)
Before the object variables are changed, the standard deviations are mutated
using a multiplicative normally distributed process:
(t) (t−1)
σj,i = σj,i exp(τ 0 N (0, 1) + τ Ni (0, 1)), (2)
with exp (τ 0 N (0, 1)) as a global factor which allows an overall change of the
mutability and exp (τ Ni (0, 1)) allowing for individual changes of the mean
step sizes σj,i . The τ 0 and τ parameters can be interpreted in the sense of
global learning rates. Schwefel suggests to set them as [16]:
1 1
τ0 = √ , τ = p √ . (3)
2n 2 n
Recombination
Recombination in ESs can be either sexual, where only two parents are in-
volved in the creation of an offspring, or global, where up to the whole popula-
tion contributes to a new offspring. Sexual recombination of just two individu-
als is often called local while the contribution of all individuals is called global
recombination. Traditional recombination operators are discrete recombina-
tion, intermediate recombination, and geometric recombination, all existing
in a sexual and global form. When F and M denote two randomly selected
individuals from the µ parent population, the following operators can be de-
fined:
xF,i no recombination
0 xF,i or xM,i discrete
xi = (4)
(x F,i + xM,i ) /2 intermediate
Pµ
k=1 xK,i /µ global avarage
σF,i no recombination
σ
F,i or x M,i discrete
σi0 = (σpF,i + σ M,i ) /2 intermediate . (5)
(σ σ ) geometric
Pµ F,i M,i
k=1 σK,i /µ global avarage
Throughout this work discrete recombination of the object variables and
global intermediate combination of the strategy parameters were used.
6 J. Abonyi, J. Madar, L. Nagy and F. Szeifert
3 Application Example
The jacket and the circulating liquid can be described using the common
lumped parameter enthalpy or heat balances given in the chemical engineering
literature. In the model, zero-volume distributors and mixers and are applied
and the overflow as well as the feed of the steam and the fresh cooling water
8 J. Abonyi, J. Madar, L. Nagy and F. Szeifert
are taken into account. The obtained simplified first principle model can be
regarded as the tendency model [4] of the most important phenomena and its
scheme is given on Figure 3.
3.3 Results
50 50 50 50 50 50 50 50 50
0 0 0 0 0 0 0 0 0
0 50 0 50 0 50 0 50 0 50 0 50 0 50 0 50 0 50
Time [sec] Time [sec] Time [sec] Time [sec] Time [sec] Time [sec] Time [sec] Time [sec] Time [sec]
100 100 100 100 100 100 100 100 100
Temp. [C]
50 50 50 50 50 50 50 50 50
0 0 0 0 0 0 0 0 0
100 150 200 100 150 200 100 150 200 100 150 200 100 150 200 100 150 200 100 150 200 100 150 200 100 150 200
Time [sec] Time [sec] Time [sec] Time [sec] Time [sec] Time [sec] Time [sec] Time [sec] Time [sec]
100 100 100 100 100 100 100 100 100
F1%, F2%
50 50 50 50 50 50 50 50 50
0 0 0 0 0 0 0 0 0
0 50 100 0 50 100 0 50 100 0 50 100 0 50 100 0 50 100 0 50 100 0 50 100 0 50 100
V1%, V2% V1%, V2% V1%, V2% V1%, V2% V1%, V2% V1%, V2% V1%, V2% V1%, V2% V1%, V2%
ISE: 15.1 ISE: 9.3 ISE: 38.8 ISE: 101.6 ISE: 339.2 ISE: 42.4 ISE: 213.2 ISE: 409.8 ISE: 3948.8
K1: 0.055 K1: 0.055 K1: 0.052 K1: 0.038 K1: 0.065 K1: 0.043 K1: 0.024 K1: 0.013 K1: 0.071
K2: 0.357 K2: 0.382 K2: 0.382 K2: 0.375 K2: 0.387 K2: 0.378 K2: 0.344 K2: 0.340 K2: 0.390
K3: 0.025 K3: 0.024 K3: 0.024 K3: 0.016 K3: 0.030 K3: 0.019 K3: 0.010 K3: 0.010 K3: 0.033
T0: 0.559 T0: 0.560 T0: 0.536 T0: 0.392 T0: 0.687 T0: 0.438 T0: 0.229 T0: 0.143 T0: 0.719
Th: 0.422 Th: 0.424 Th: 0.424 Th: 0.417 Th: 0.428 Th: 0.420 Th: 0.411 Th: 0.404 Th: 0.433
From an arbitrary initial value, the application of IEC resulted in 5.0 MSE
prediction error after 14 generations. This corresponds to 146 evaluations of
the model. If the same numbers of function calls are applied in SQP, the obtain
model results in 26.0 MSE. The drawback of IEC is that is slower than the
SQP method due to the time-requirement of the human evaluation. Hence
while the IEC procedure consumed about 8.5 minutes, the SQP consumed
only 2.5 minutes. (See the Table 1. and Figures 5, 6.)
10 J. Abonyi, J. Madar, L. Nagy and F. Szeifert
100
Temp. [C]
50
0
0 10 20 30 40 50 60
Time [sec]
100
Temp. [C]
50
0
80 100 120 140 160 180 200
Time [sec]
100
F1%, F2%
50
0
0 10 20 30 40 50 60 70 80 90 100
V1%, V2%
100
Temp. [C]
50
0
0 10 20 30 40 50 60
Time [sec]
100
Temp. [C]
50
0
80 100 120 140 160 180 200
Time [sec]
100
F1%, F2%
50
0
0 10 20 30 40 50 60 70 80 90 100
V %, V %
1 2
Our experiences and these results show that the proposed IEC approach
is extremely useful to find good initial conditions to SQP that is sensitive to
stacking in local minima.
4 Conclusions
Acknowledgement
References
1. J. Abonyi, R. Babuska, H.B. Verbruggen, and F. Szeifert. Constraint parameter
estimation in fuzzy modelling. In FUZZ-IEEE’99 Conference, pages 951–956.
Seoul, Korea, 1999.
2. K. Aoki, H. Takagi, and N. Fujimura. Interactive ga-based design support system
for lighting design in computer graphics. In Int’l Conf. on Soft Computing
(IIZUKA’96), Iizuka, Fukuoka, Japan, pages 533–536. World Scientic, 1996.
3. A.E. Eiben and M. Schoenauer. Evolutionary computing. Information Process-
ing Letters, 82, 2002.
4. C. Filippi-Bossy, C. Georgakis, J. Bordet, J. Villermaux, and S. Marchal-
Brassely. Batch reactor optimization by use of tendency models. Comp. &
Chem. Eng, 13:35–47, 1989.
5. P.J. Fleming and R.C. Purshouse. Evolutionary algorithms in control system
engineering: a survey. Control Engineering Practice, 10:1223–1241, 2002.
6. H. Furuta, K. Maeda, and E. Watanabe. Application of genetic algorithm to
aesthetic design of bridge structures. Microcomputers in Civil Engineering,
10(6):415–421, 1995.
12 J. Abonyi, J. Madar, L. Nagy and F. Szeifert