Constrained Optimization 16888 eSd ES077 Definitions Feasible design a design that satisfies all constraints Infeasible design: a design that violates one or more constraints Optimum design the choice of design variables that minimizes the objective function while satisfying all constraints In general, constrained optimization algorithms try to cast the problem as an unconstrained optimization and then use one of the techniques we looked at in Lecture 6 o Massachusetts Institute of Technology -Prof de Weck and Prof Willcox Engineering Systems Division and Dept of Aeronautics and Astronautics
6 © Massachusetts Institute of Technology - Prof. de Weck and Prof. Willcox Engineering Systems Division and Dept. of Aeronautics and Astronautics Constrained Optimization Constrained Optimization Definitions: • Feasible design: a design that satisfies all constraints • Infeasible design: a design that violates one or more constraints • Optimum design: the choice of design variables that minimizes the objective function while satisfying all constraints In general, constrained optimization algorithms try to cast the problem as an unconstrained optimization and then use one of the techniques we looked at in Lecture 6
Linear Programming 16888 Most engineering problems of interest are nonlinear Can often simplify nonlinear problem by linearization LP is often the basis for developing more complicated NLP algorithms Standard LP problem min√(x)=∑cX minJ(x)=c′x Ax=b ∑aX=bj=1…m X≥0 X≥0=1.…,n All LP problems can be converted to this form o Massachusetts Institute of Technology -Prof. de Weck and Prof Willcox Engineering Systems Division and Dept of Aeronautics and Astronautics
7 © Massachusetts Institute of Technology - Prof. de Weck and Prof. Willcox Engineering Systems Division and Dept. of Aeronautics and Astronautics Linear Programming Linear Programming Most engineering problems of interest are nonlinear • Can often simplify nonlinear problem by linearization • LP is often the basis for developing more complicated NLP algorithms Standard LP problem: All LP problems can be converted to this form. = = = = = ≥ = ∑ ∑ 1 1 mi n ( ) 1,.., 0 1,..., n i i i n ij i j i i J c x a x b j m x i n x min ( ) 0 1,..., T i J x i n = = ≥ = x c x Ax b
Linear Programming 16888 To convert inequality constraints to equality constraints, use additional design variables ∑ax≤ b. becomes∑ax+Xn=b Where x+1≥0 x. is called a slack variable e.g. the constraint X1+X,≤1 can be written ifx=0. this X1+X2-X2=1 constraint is X≥0,产=1,2,3 active o Massachusetts Institute of Technology -Prof de Weck and Prof Willcox Engineering Systems Division and Dept of Aeronautics and Astronautics
8 © Massachusetts Institute of Technology - Prof. de Weck and Prof. Willcox Engineering Systems Division and Dept. of Aeronautics and Astronautics Linear Programming Linear Programming To convert inequality constraints to equality constraints, use additional design variables: where xn+1 ≥ 0 xn+1 is called a slack variable e.g. the constraint x1+x 2 ≤ 1 can be written x1+x 2-x 3=1 xi ≥0, i=1,2,3 1 1 1 b ecom e s n n ji i j ji i n j i i a x b a x x + b = = ∑ ∑ ≤ + = if x3=0, this constraint is active
Simplex Method 16888 eSd ES077 Solutions at the vertices" of the design space are called basic feasible solutions The Simplex algorithm moves from BFS to BF S so that the objective always improves feasible region basic feasible solution o Massachusetts Institute of Technology -Prof de Weck and Prof Willcox Engineering Systems Division and Dept of Aeronautics and Astronautics
9 © Massachusetts Institute of Technology - Prof. de Weck and Prof. Willcox Engineering Systems Division and Dept. of Aeronautics and Astronautics Simplex Method Simplex Method Solutions at the “vertices” of the design space are called basic feasible solutions. The Simplex algorithm moves from BFS to BFS so that the objective always improves. feasible region basic feasible solution
esd Sequential Linear Programming 16888 Consider a general nonlinear problem linearized via first order Taylor series min√(x)≈√(x0)+VJ(x)yδx stg(x)≈g(x)+Vg(x)x≤0 h(x)≈h(x)+Vh2(x)x=0 X≤x1+x1≤x Where Sx=X-X This is an lp problem with the design variables contained in sx. the functions and gradients evaluated at X are constant coefficients o Massachusetts Institute of Technology -Prof. de Weck and Prof Willcox Engineering Systems Division and Dept of Aeronautics and Astronautics
10 © Massachusetts Institute of Technology - Prof. de Weck and Prof. Willcox Engineering Systems Division and Dept. of Aeronautics and Astronautics Sequential Linear Programming Sequential Linear Programming Consider a general nonlinear problem linearized via first order Taylor series: 0 0 0 0 0 0 mi n ( ) ( ) ( ) s.t. ( ) ( ) ( ) 0 ( ) ( ) ( ) 0 T T j j j T k k k u i i i i J J J g g g h h h x x x x δ δ δ δ ≈ + ∇ ≈ + ∇ ≤ ≈ + ∇ = ≤ + ≤ x x x x x x x x x x x x A 0 where δ x x = − x This is an LP problem with the design variables contained in δ x. The functions and gradients evaluated at x 0 are constant coefficients