Professional Documents
Culture Documents
Cours Optim Ch3
Cours Optim Ch3
M. MANSOUR
Labo 109
M.Mansour@city.ac.uk
• Unité d’enseignement:
d’enseignement: UEF 1.1
• VHS:: 45
VHS 45hh00 (Cours:
(Cours: 1h30
30,, TD:
TD: 1h30
30))
• Crédits:: 4
Crédits
• Coefficient:: 2
Coefficient
Chapitre III: Optimisation avec contraintes
With Equality constraints
Given the following optimization problem:
Minimise f ( x)
Subject to : h( x) = 0
Where h is continuous function supposed to be
differentiable on the subspace set.
The dimensions of h can be different of that of f.
Chapitre III: Optimisation avec contraintes
With Equality constraints
We form the lagrangian:
L( x, λ ) = f ( x) + λ * h( x)
Where λ is a Lagrange multiplier.
Chapitre III: Optimisation avec contraintes
With Equality constraints
The first order necessary conditions for optimality are:
∇f ( x ) + λ ∇h ( x ) = 0
* T *
∇Lx ( x, λ ) = 0
∇Lλ ( x, λ ) = 0
Chapitre III: Optimisation avec contraintes
With Equality constraints
Example 1:
Let f and h be:
f ( x) = x1x2 + x2 x3 + x1x3
h( x) = x1 + x2 + x3 − 3
Fx ( x ) + λ H ( x )
* T *
Is positive definite.
Chapitre III: Optimisation avec contraintes
With Equality constraints
Example 1:
Let f be:
f ( x) = x1x2 + x2 x3 + x1x3
h( x) = x1 + x2 + x3 − 3
Following the above optimization problem. Is the
solution found earlier is a minimum?
Minimize f ( x)
Subject to : x1 + x2 + x3 − 3 = 0
Chapitre III: Optimisation avec contraintes
With equality and inequality constraints
Given the following optimization problem:
Minimise f ( x)
Subject to : h( x) = 0
g ( x) ≤ 0
Where h and g are two continuous functions supposed to
be differentiable on the subspace set.
h and g can be of different dimensions.
Chapitre III: Optimisation avec contraintes
With equality and inequality constraints
We form the Hamiltonian:
M( x, λ , µ ) = f ( x) + λ * h( x) + µ * g ( x)
Where λ and μ are the Kuhn-Tucker multipliers.
Chapitre III: Optimisation avec contraintes
With equality and inequality constraints
The first order necessary conditions for optimality are
(Karush-Kuhn-Tucker Conditions):
µ ≥ 0,
∇f ( x* ) + λ t ∇h( x* ) + µ t ∇g ( x* ) = 0,
µ t g ( x* ) = 0,
Chapitre III: Optimisation avec contraintes
With equality and inequality constraints
The second order necessary conditions for optimality
are (Karush-Kuhn-Tucker Conditions):
µ ≥ 0,
∇f ( x* ) + λ t ∇h( x* ) + µ t ∇g ( x* ) = 0,
µ t g ( x* ) = 0,
And the Hessian matrix L( x* ) = F ( x* ) + λ t H ( x* ) + µ t G ( x* ),
is positive definite.
where F, H and G are the 2nd order derivatives of the
objective function f, the equality constraint h and
inequality constraint g respectively and λ and µ are the
Kuhn-Tucker multipliers.
INTERROGATION
Résoudre le problème d’optimisation suivant: