Input Parameters

nbVar :

A double, denoting the number of variables

nbCon :

A double, denoting the number of constraints

H :

A symmetric matrix of doubles, representing the Hessian of the quadratic problem.

f :

A vector of doubles, representing coefficients of the linear terms in the quadratic problem.

lb :

A vector of doubles, containing the lower bounds of the variables.

ub :

A vector of doubles, containing the upper bounds of the variables.

A :

A matrix of doubles, representing the constraint matrix in conLB ≤ A⋅x ≤ conUB.

conLB :

A vector of doubles, containing the lower bounds of the constraints conLB ≤ A⋅x ≤ conUB.

conUB :

A vector of doubles, containing the upper bounds of the constraints conLB ≤ A⋅x ≤ conUB.

x0 :

A vector of doubles, containing the starting values of variables of size (1 X n) or (n X 1) where 'n' is the number of variables.

options :

A list, containing the option for user to specify. See below for details.

Outputs

xopt :

A vector of doubles, containing the computed solution of the optimization problem.

fopt :

A double, containing the value of the function at xopt.

exitflag :

An integer, containing the flag which denotes the reason for termination of algorithm. See below for details.

output :

A structure, containing the information about the optimization. See below for details.

lambda :

A structure, containing the Lagrange multipliers of the lower bounds, upper bounds and constraints at the optimized point. See below for details.

Description

Search the minimum of a constrained linear quadratic optimization problem specified by :

quadprog calls Ipopt, an optimization library written in C++, to solve the optimization problem.

Options

options= list("MaxIter", [---], "CpuTime", [---], "GradObj", ---, "Hessian", ---, "GradCon", ---);

The options should be defined as type "list" and consist of the following fields:

• MaxIter : A Scalar, specifying the maximum number of iterations that the solver should take.
• CpuTime : A Scalar, specifying the maximum amount of CPU time in seconds that the solver should take.

The default values for the various items are given as:

options = list("MaxIter", [3000], "CpuTime", [600]);

The exitflag allows the user to know the status of the optimization which is returned by Ipopt. The values it can take and what they indicate is described below:

• 0 : Optimal Solution Found
• 1 : Maximum Number of Iterations Exceeded. Output may not be optimal.
• 2 : Maximum amount of CPU Time exceeded. Output may not be optimal.
• 3 : Stop at Tiny Step.
• 4 : Solved To Acceptable Level.
• 5 : Converged to a point of local infeasibility.

For more details on exitflag, see the Ipopt documentation which can be found on http://www.coin-or.org/Ipopt/documentation/

The output data structure contains detailed information about the optimization process. It is of type "struct" and contains the following fields.

• output.iterations: The number of iterations performed.
• output.constrviolation: The max-norm of the constraint violation.

The lambda data structure contains the Lagrange multipliers at the end of optimization. In the current version, the values are returned only when the the solution is optimal. It has type "struct" and contains the following fields.

• lambda.lower: The Lagrange multipliers for the lower bound constraints.
• lambda.upper: The Lagrange multipliers for the upper bound constraints.
• lambda.eqlin: The Lagrange multipliers for the linear equality constraints.
• lambda.ineqlin: The Lagrange multipliers for the linear inequality constraints.

Example

We begin with a quadratic objective functions, subjected to two bounds for the functions, and two bounds for the constraints.

Find x in R^2 such that it minimizes:

//Example 1: Standard quadratic objective function
//(Ref : example 14)https://www.me.utexas.edu/~jensen/ORMM/supplements/methods/nlpmethod/S2_quadratic.pdf
// min. -8*x1^2 -16*x2^2 + x1 + 4*x2
// such that
//    x1 + x2 <= 5,
//    x1 <= 3,
//    x1 >= 0,
//    x2 >= 0
H = [-16 0; 0 8];
f = [-8; -16];
A = [1 1;1 0];
conUB = [5;3];
conLB = [-%inf; -%inf];
lb = [0; 0];
ub = [%inf; %inf];
nbVar = 2;
nbCon = 2;
[xopt,fopt,exitflag,output,lambda] = quadprog(nbVar,nbCon,H,f,lb,ub,A,conLB,conUB)
//Press ENTER to continue

Example

We build on the previous example by providing a starting point, to facilitate the computation.

//Example 2: Standard quadratic objective function with starting points
//Find x in R^2 such that:
H = [-16 0; 0 8];
f = [-8; -16];
A = [1 1;1 0];
conUB = [5;3];
conLB = [-%inf; -%inf];
lb = [0; 0];
ub = [%inf; %inf];
nbVar = 2;
nbCon = 2;
x0 = [1 ;1];
[xopt,fopt,exitflag,output,lambda]=quadprog(nbVar,nbCon,H,f,lb,ub,A,conLB,conUB,x0)

Example

We can further enhance the functionality of quadprog by setting input options. This provides us with the ability to control the solver parameters such as the maximum number of solver iterations and the max. CPU time allowed for the computation.

//Example 3: Standard quadratic objective function with starting points and options. H = [-16 0; 0 8]; f = [-8; -16]; A = [1 1;1 0]; conUB = [5;3]; conLB = [-%inf; -%inf]; lb = [0; 0]; ub = [%inf; %inf]; nbVar = 2; nbCon = 2; x0 = [1 ;1]; options = list("MaxIter", 300, "CpuTime", 100); [xopt,fopt,exitflag,output,lambda]=quadprog(nbVar,nbCon,H,f,lb,ub,A,conLB,conUB,x0,options)

Example

Infeasible Problems: Find x in R^2 such that it minimizes:

//Example 4: Infeasible Problem
//(Ref : example 14)https://www.me.utexas.edu/~jensen/ORMM/supplements/methods/nlpmethod/S2_quadratic.pdf
// min. -8*x1^2 -16*x2^2 + x1 + 4*x2
// such that
//    x1 + x2 <= 5,
//    x1 <= 3,
//    x1 >= 0,
//    x2 >= 0
H = [-16 0; 0 8];
f = [-8; -16];
A = [1 1;1 0]
conUB = [5;3];
conLB = [-%inf; -%inf];
lb = [4; 0];
ub = [%inf; %inf];
nbVar = 2;
nbCon = 2;
[xopt,fopt,exitflag,output,lambda] = quadprog(nbVar,nbCon,H,f,lb,ub,A,conLB,conUB)
//Press ENTER to continue

Example

Unbounded Problems: Find x in R^2 such that it minimizes:

//Example 5: Unbounded Problem
//Find x in R^2 such that:
H = [-16 0; 0 8];
f = [-8; -16];
A = [-2 0;0 1];
conUB = [5;3];
conLB = [-%inf; -%inf];
lb = [0; 0];
ub = [%inf; %inf];
nbVar = 2;
nbCon = 2;
x0 = [1 ;1];
[xopt,fopt,exitflag,output,lambda]=quadprog(nbVar,nbCon,H,f,lb,ub,A,conLB,conUB,x0)

Authors

• Keyur Joshi, Saikiran, Iswarya, Harpreet Singh