Jou nal o Global Op imiza ion 29: 157–172, 2004. 157
© 2004 Kluwe Academic Publishe s. P in ed in he Ne he lands.
Imp o ing In e al Analysis Bounds by T ansla ions
EMILIO CARRIZOSA1, PIERRE HANSEN2and FRÉDÉRIC MESSINE3
1Uni e si ad de Se illa, Facul ad de Ma ema icas, Se illa, Spain (e-mail: [email p o ec ed])
2GERAD, École des Hau es É udes Comme ciales o HEC Mon éal, Dépa emen des Mé hodes
Quan i a i es, Mon éal (Québec), Canada (e-mail: [email p o ec ed])
3Uni e si é de Pau e des Pays de l’Adou , Dépa emen d’In o ma ique, Pau, F ance e le
Labo a oi e d’Élec o echnique e d’Élec onique Indus ielle UMR 5828, Équipe EM2, Toulouse,
F ance (e-mail: [email p o ec ed] and [email p o ec ed])
(Recei ed 22 Ma ch 2002; accep ed 26 Augus 2003)
Abs ac . We explo e how a simple linea change o a iable a ec s he inclusion unc ions
ob ained wi h In e al Analysis me hods. Uni a ia e and mul i a ia e polynomial es unc ions a e
conside ed, showing ha ansla ion-based me hods imp o e conside ably he bounds compu ed by
s anda d inclusion unc ions. An In e al B anch-and-Bound me hod o global op imiza ion is hen
implemen ed o compa e he di e en p ocedu es, showing ha , al hough wi h imes highe han
hose gi en by Taylo o ms, he numbe o clus e s and i e a ions is s ongly educed.
Ma hema ics Subjec Classifica ions. 90C26, 68N30
Key wo ds. inclusion unc ions, in e al analysis, in e al b anch and bound, Taylo o ms.
1. In oduc ion
Designed as a echnique o con olling p opaga ion o e o s in compu ing [8],
In e al Analysis was soon ecognized as a powe ul ool o global op imiza-
ion [3, 5, 6, 10]. I s main use is hen in easibili y and op imali y es s o
B anch-and-Bound me hods [8, 10] o sol ing p oblems o he o m
min xgix⩾0i=12m
Indeed, a egion Xcan be disca ded as soon as one de ec s i is ei he in easible
(because an uppe bound o one o he unc ions gon Xis nega i e), o i canno
con ain op imal solu ions (because a lowe bound o x on X u ns ou o be
wo se han he alue o an al eady known easible solu ion). Hence, i is o g ea
impo ance o know, o a gi en unc ion , he di ec image X o X,
X= xx∈X
o , i his is no possible, an enclosu e o i . This leads o he concep o inclusion
unc ion, defined as ollows in he uni a ia e case: le deno e he se o in e als
Xo he o m X=xLxU, wi h −⩽xL⩽xU⩽+.
158 E. CARRIZOSA ET AL.
Gi en −→ , any F−→ con aining X is called an inclusion
unc ion o F.
A desi ed p ope y o an inclusion unc ion o is i s iso onici y: Fis said o
be an iso one inclusion unc ion o i
FY⊆FZ o all YZ wi h Y⊆Z
Some examples o (iso one) inclusion unc ions will be in oduced he e; he
eade is e e ed o [3, 9, 10] o u he de ails.
I an analy ical exp ession o is gi en, one o mally eplaces he a iable x
by he co esponding in e al a iable X, and all he algeb aic ope a ions in he
defini ion o by hei co esponding In e al A i hme ic ope a ions, hen one
ob ains he so-called Na u al Ex ension o , deno ed h oughou he pape by
NE.
Fo su ficien ly smoo h unc ions , i is possible o ob ain di e en inclusion
unc ions om Taylo expansions by cons uc ing enclosu es o he emainde .
Indeed, can hen be w i en as
x= x0+
k−1
i=1
x−x0i
i! ix0+x−x0k
k! k
o some ∈X.I Fk is an inclusion unc ion o k, hen k∈FkX,
yielding he Taylo inclusion unc ion o o de kcen e ed a x0T
kx0X,
defined as
Tkx0X= x0+
k−1
i=1
X−x0i
i! ix0+X−x0k
k!FkX (1)
The mos used in e al Taylo inclusion unc ions a e ob ained om he cen-
e ed expansions o fi s o second o de ,
T1X= m+X−mFX (2)
T2X= m+X−m m+X−m2
2FX (3)
(mbeing he midpoin o he in e al X=xLxU), o a non-cen e ed o m o
T1x0X T1B due o Baumann [1], consis ing o aking, in (1), o k=2,
x0gi en by
x0=
xUi FUX⩽0
xLi FLX⩾0
FUXxL−FLXxU
FUX−FLX o he wise
IMPROVING INTERVAL ANALYSIS BOUNDS BY TRANSLATIONS 159
o maximize he lowe bound and
x0=
xLi FUX⩽0
xUi FLX⩾0
FLXxL−FUXxU
FLX−FUX o he wise
o minimize he uppe bound.
These will be he inclusion unc ions aken as benchma k, wi h which he
inclusion unc ion we p opose in Sec ion 2 will be compa ed.
2. T ansla ion-based Me hods o Uni a ia e Polynomial Func ions
2.1. PROBLEM SETTING
In his sec ion we add ess he p oblem o finding inclusion unc ions P, yielding
sha p enclosu es o he ange o a eal uni a ia e polynomial unc ion p,
px=
n
k=0
akxkwi h ak∈and x∈X=xLxU∈(4)
Th oughou his sec ion, nwill deno e he deg ee o he polynomial unc ion
pconside ed.
In his case, he Na u al Ex ension NE o his exp ession o pbecomes
NEX=
n
k=0
akXkX=xLxU∈(5)
Ano he well-known choice is he Ho ne scheme H,
HX=a0+X···an−2+Xan−1+anX··· (6)
Obse e ha hese wo inclusion unc ions a e no compa able in e ms o he
enclosu es hey p o ide. Fo ins ance, o px=x2−xand X=−11, we ha e
NEX=X2−X
=−12
⊂−22=XX−1=HX
Ne e heless, o he same pand X=12, we ob ain
NEX=X2−X
=−13
⊃02=XX−1=HX
160 E. CARRIZOSA ET AL.
Howe e , an inclusion unc ion sha pe han bo h NE and His di ec ly ob ained
om H, by compu ing he ange in a box as he union o anges in sub-boxes
co e ing he box, [9, 10]:
DEFINITION 1. Gi en an iso one unc ion F −→ , and c∈, define
Fc−→ ,as
FcX=FxLc∪FcxU i c∈X
FX o he wise
LEMMA 1. Fcis an iso one unc ion sa is ying FcX⊆FX o all X∈.
P oo . Fi s obse e ha Fcis well defined; indeed, o c∈X=xLxU, since
Fis an inclusion unc ion, bo h FxLc and FcxU a e closed in e als
ha ing c as common poin ; hence, FcX∈.
Mo eo e , Fcis an inclusion unc ion. Indeed, i cX, one has FcX=FX⊇
X;i c∈X, one has
xLc⊆FxLc
cxU⊆FcxU
Hence,
X= xLc∪ cxU⊆FxLc∪FcxU=FcX
showing ha Fcis also an inclusion unc ion.
In o de o see ha Fcis iso one, conside YZ∈Y⊆Z. Th ee cases a e
conside ed:
1. I c∈Z, hen he iso onici y o Fimplies ha FcY =FY⊆FZ=FcZ.
2. I c∈Yand c∈Z hen ei he Y⊆zLc o Y⊆czU. In he fi s case one has
FcY =FY⊆FzLc⊆FzLc∪FczU=FcZ
whe eas in he la e case one has
FcY =FY⊆FczU⊆FzLc∪FczU=FcZ
3. I c∈Y( hus c∈Z) hen yLc⊆zLc, and cyU⊆czU.
Hence, FcY =FyLc∪FcyU⊆FzLc∪FczU=FcZ.
The e o e, Fcis iso one.
IMPROVING INTERVAL ANALYSIS BOUNDS BY TRANSLATIONS 161
T i ially FcX⊆FX i cX.I c∈X, hen he iso onici y o Fimplies ha
FxLc∪FcxU⊆FX, hus FcX⊆FX, as asse ed.
Pa icula ized o he inclusion unc ion H, spli ing by c=0, one ob ains he
inclusion unc ion H0, defined as:
H0X=
minHLxL0HL0xUmaxHUxL0HU0xU
i 0∈X
HX else
(7)
PROPOSITION 1. H0is an inclusion unc ion which is iso one and sa isfies o
all X∈
1. H0X⊆HX
2. H0X⊆NEX.
P oo .H0is an iso one inclusion unc ion sa is ying H0X⊆HX by
Lemma 1. By defining NE0 ollowing Defini ion 1, i su fices o show ha
H0X⊆NE0X o all X∈.
We show ha H0X⊆NEX by induc ion in he deg ee ko p. Fo k=01 he
inclusion is s aigh o wa d. We assume ha he inclusion holds o all polynomial
unc ions o deg ee smalle han k, and show he esul o he polynomial unc ion
px=a0+a1x+···+ak+1xk+1, (o deg ee k+1).
I 0X, hen
H0X=HX=a0+XH∗X=a0+XH∗
0X
whe e H∗X ( espec i ely H∗
0) ep esen s he Ho ne scheme H( espec i ely
H0) o he polynomial unc ion p∗o deg ee k,p∗x=a1+a2x+···+ak+1xk.
By he induc ion assump ion, one has
H∗
0X⊆NE∗X
whe e NE∗deno es he na u al ex ension o p∗. Hence,
a0+XH∗
0X⊆a0+XNE∗X⊆NEX
The e o e
H0X⊆NEX ∀Xwi h 0X
I 0∈X, a simila a gumen shows ha
H0xL0⊆NExL0
and
H00xU⊆NE0xU
Hence, H0X⊆NE0X⊆NEX, and he esul holds.
162 E. CARRIZOSA ET AL.
2.2. TRANSLATION-BASED METHODS
The idea o hese me hods is o ansla e he in e al Xconside ed in o he in e al
X!=xL+!xU+! by using an exp ession o px di e en om (4), and
hen choosing he alue o !yielding he sha pes enclosu e. Fi s , obse e ha ,
o any !∈,
px=
n
j=0
ajx+!−!j
=
n
j=0
x+!j
n−j
k=0
ak+jk+j
j−!k
=
n
j=0
j!x+!j(8)
wi h j! defined as
j!=
n−j
k=0
ak+jk+j
j−!k(9)
Fo each inclusion unc ion Fp e iously defined one ob ains now, o each
!∈, a new ansla ion-based inclusion unc ion TF!·. Fo ins ance, om
he Ho ne scheme H, one ob ains TH,
TH!X= 0!+X! 1!+X!··· n−1!+X! n! (10)
wi h X!=X+!
Fu he mo e, TH0is defined, ollowing Defini ion 1, as
TH0!X=TH!X0(11)
In he same way, TNETNE0TT1TTna e defined.
Gi en an inclusion unc ion F, we ob ain o each ! he inclusion unc ion
TF!·. By defini ion,
TF0X=FX (12)
hus by a ying he pa ame e !i may be possible o come up wi h mo e accu a e
enclosu es. This poses he p oblem o de e mining he alues o !yielding he
sha pes enclosu e.
Fo his we define, o an inclusion unc ion F, he op imal ansla ion-based
inclusion unc ion OTF as
OTFX=max
!∈TFL!X min
!∈TFU!X(13)
whe e TF!X=TFL!XTFU!X.
IMPROVING INTERVAL ANALYSIS BOUNDS BY TRANSLATIONS 163
Obse e ha , by (12),
OTFX⊆FX ∀X∈
Rema k 1. The unc ion OTF is only o in e es o heo e ical easons; indeed,
he p ac ical de e mina ion o OTF amoun s o sol ing wo op imiza ion p oblems
which can be non-di e en iable and non-con ex. Hence, in p ac ice, a ew s eps
o a local-sea ch algo i hm will be used, yielding an enclosu e possibly less sha p
han OTF bu wi h much less compu a ional e o .
PROPOSITION 2.
TH0!X⊆TNE!X=Tn−!X o all !∈X∈(14)
P oo . Le !∈and X∈. The inclusion TH0!X⊆TNE!X di ec ly
ollows om P oposi ion 1.
Since pnx=n!an o all x, one has ha PnX n!ann!anis an inclusion
unc ion o pn. By (1), Tn−!X can hen be w i en as
Tn−!X=p−!+
n−1
i=1
X+!i
i!pi−!+X+!n
n!PnX
=p−!+
n−1
i=1
X+!i
i!
n−i
k=0
k+i!
k!ak+i−!k+X+!n
n!n!an
=
n
i=0
X+!i
n−i
k=0k+i
iak+i−!k
=
n
i=0
X+!i i!=TNE!X
This shows he esul .
F om (14) one di ec ly has
PROPOSITION 3. OTH0X⊆OTNEX o all X∈.
2.3. NUMERICAL RESULTS
The di e en inclusion unc ions p e iously sugges ed ha e been compa ed
acco ding o he bounds hey p oduce. Table 1 summa izes he esul s ob ained
o a se ies o uni a ia e polynomial unc ions, ei he aken om he li e a u e,
[4, 11, 12], o andomly gene a ed. The fi s ones a e he ollowing:
1. p1x=1
10 −x−79
20 x2+71
10 x3+39
80 x4−52
25 x5+1
6x6X=−211, due o Wingo,
[11]. The e is a misp in in he exp ession o he unc ion in [11].
164 E. CARRIZOSA ET AL.
Table 1. Resul s o lowe o uppe bounds o polynomial unc ions.
Pb p1p2p3p4p5p6p7
lb ub lb lb lb lb ub lb
NE −334E5312E5−333E10 −170E4−500E2−499E3616E5−462E2
H−373E5868E4−248E10 −140E4−123E3−457E3377E4−109E3
H0−319E5161E4−248E10 −140E4−400E2−457E3377E4−362E2
T1−108E6108E6−151E16 −467E4−420E3−137E5261E8−37E3
T1B−103E6103E6−515E11 −371E4−329E3−142E4409E6−307E3
T2−119E6159E6−979E11 −215E4−150E3−156E4384E6−121E3
T3−127E6123E6−365E17 −186E4−300E3−463E4822E8−296E3
OTH0−546E4235E2−101E3−996E2−672E1192 −311E1−164E2
!−63−1−108 −535 −087 −017 −065 −045
2. p2x=50
i=1aixix∈12, he coe ficien s a e a1n =−500, 2.5,
1.666666666, 1.25, 1, 0.833333333, 0.714285714, 0.625, 0.555555555, 1,
−43636363636, 0.416666666, 0.384615384, 0.357142857, 0.333333333,
0.3125, 0.294117647, 0.277777777, 0.263157894, 0.25, 0.238095238,
0.227272727, 0.217391304, 0.208333333, 0.2, 0.192307692, 0.185185185,
0.178571428, 0.344827586, 0.666666666, −15483870970, 0.15625,
0.151515151, 0.147058823, 0.142857142, 0.138888888, 0.135135135,
0.131578947, 0.128205128, 0.125, 0.121951219, 0.119087619, 0.116279069,
0.113636363, 0.111111111, 0.108695652, 0.106382978, 0.208333333,
0.408163265, 08, he Moo e unc ion.
3. p3x =0000089248x−00218343x2+0998266x3−16995x4+02x5,x∈
010, he Wilkinson unc ion.
4. p4x=4x2−4x3+x4x∈−55, he Dixon and Szegö unc ion.
5. p5x=7x4−5x3+4x2+3x+2, X=010, gene a ed andomly wi h in ege
coe ficien s in he ange −1010.
6. p6x =−587x13 −232x12 −183x11 −1664x10 +771x9+871x8+526x7−
529x6−1769x5+347x4−124x3−1935x2−1937x+434X=077338,
gene a ed andomly wi h eal coe ficien s in he in e al −2020.
7. p7x=10x−15x2−3x3+x4x∈−55, he Dixon unc ion.
The inclusion unc ions conside ed a e NEHH0T1Band Tkk=123, ak-
ing as x0 he midpoin o he in e al X. Mo eo e , OTH0is compu ed using
minu o Ma Lab o pe o m a local sea ch, se ing !equal o 0 as s a ing poin ,
and pe o ming a mos 30 i e a ions. In o de o check he compu ed bounds,
an ou wa dly ounded in e al a i hme ic code mus be used [6–8]. He e, we
ha e de eloped in Ma Lab he needed ope a ions, i.e., addi ion and mul iplica-
ion o compu ing polynomial unc ions, wi h ou wa dly ounded compu a ions.
Hence, he esul s p esen ed a e nume ically co ec o each inclusion unc-
ion. I may be possible ha he floa ing compu a ions pe o ming he ansla ion
!p oduce some nume ical e o s and ha he esul di e s sligh ly, o in a e
IMPROVING INTERVAL ANALYSIS BOUNDS BY TRANSLATIONS 165
cases la gely, om he op imal alue. Bu no nega i e e ec can occu , because
TF!X is always an inclusion unc ion o all eal (o floa ing) alues o !.
In mos cases, ei he he lowe bound (lb) o he uppe bound (ub) imp o ed
conside ably wi h espec o he o he enclosu es, he op imal ! o he o he
bound being close o ze o. The bounds, oge he wi h he op imal ! o OTH0
a e gi en in he las wo ows o he able. I appea s ha some su p ising
imp o emen s o he bounds a e ob ained o polynomial unc ions bo h o low
deg ee (e.g. p5) and high deg ee (e.g. p2).
2.4. EXTENSION TO UNIVARIATE RATIONAL FUNCTIONS
The me hodology ex ends in a s aigh o wa d manne o unc ions gi en as he
a io o wo polynomial unc ions pq. Indeed, i THp
0!1X and THq
0!2X
ep esen ansla ion-based inclusion unc ions o pand qacco ding o (11), hen
one ob ains, o each !1!2, he inclusion unc ion
THp
0!1X
THq
0!2X
The op imiza ion in he ansla ion pa ame e s yields a new (and sha pe )
enclosu e,
OTH
p
q
0X=OTHp
0X
OTHq
0X (15)
=max!1∈THp
0L!1X min!1∈THp
0U!1X
max!2∈THq
0L!2X min!2∈THq
0U!2X
⊇max
!∈THp
0!X
THq
0!XL
min
!∈THp
0!X
THq
0!XU(16)
Rema k 2. Rema k ha he la es enclosu e, al hough less sha p, equi es he
esolu ion o wo ins ead o ou op imiza ion p oblems. Mo eo e , i jus one
ou o he wo bounds is needed, one has o sol e only one ins ead o ou
op imiza ion p oblems.
The imp o emen in p ecision o he enclosu es ob ained in his way is illus-
a ed in Table 2. We ha e compa ed OTH
p
q
0, as defined in (15) as well as he
enclosu e defined in (16) ( he wo las lines o he able) wi h he enclosu es
NEHp
0
Hq
0, he fi s -o de Taylo expansion T1and he Baumann inclusion unc ion
T1B.
The nume ical es s a e pe o med on he a ional unc ion x=p1x
p5x o e
di e en in e als. Obse e ha , o la ge in e als, he s anda d enclosu es canno
exclude ze o in he denomina o , yielding he i ial in e al −+using
ex ended a i hme ic.
172 E. CARRIZOSA ET AL.
Re e ences
1. Baumann, E. (1988), Op imal cen e ed o m, BIT, 28, 80–87.
2. Du, K. and Kea o , R.B. (1996), The clus e p oblem in mul i a ia e global op imiza ion,
Jou nal o Global Op imiza ion, 10, 27–32.
3. Hansen, E. (1992), Global Op imiza ion Using In e al Analysis, Ma cel Dekke , New Yo k.
4. Hansen, P., Jauma d, B. and Lu, S.-H. (1989), Global minimiza ion o uni a ia e unc ions
by sequen ial polynomial app oxima ion in e na ional, In e na ional Jou nal o Compu e
Ma hema ics, 28, 183–193.
5. Ichida, K. and Fujii, Y. (1979), An in e al a i hme ic me hod o global op imiza ion,
Compu ing, 23, 85–97.
6. Kea o , R.B. (1996), Rigo ous Global Sea ch: Con inuous P oblems, Kluwe Academic
Publishe s, Do d ech , Bos on, London.
7. Messine, F. (1997), Mé hodes d’op imisa ion globale basées su l’analyse d’in e alle pou la
ésolu ion de p oblèmes a ec con ain es, PhD Thesis, INPT-ENSEEIHT, Toulouse. A ailable
on he websi e: www.uni -pau. /∼messine
8. Moo e, R.E. (1996), In e al Analysis, P en ice Hall, Englewood Cli s, N.J.
9. Ra schek, H. and Rokne, J. (1984), Compu e Me hods o he Range o Func ions, Ellis
Ho wood, Chiches e , England.
10. Ra schek, H. and Rokne, J. (1988), New Compu e Me hods o Global op imiza ion, Ellis
Ho wood, Chiches e , England.
11. Visweswa an, V. and Floudas, C.A. (1992), Uncons ained and cons ained global op imiza ion
o polynomial unc ions in one a iable, Jou nal o Global Op imiza ion, 2(1), 73–100.
12. Wingo, D.R. (1985), Globally minimizing polynomials wi hou e alua ing de i a i es in e na-
ional, Jou nal o Compu e Ma hema ics, 17, 287–294.