Modifying primal constraint in a LP problem

linear programming

Suppose we have a primal-dual pair in standard form, Add a scalar multiple of one primal constraint to another primal constraint. Does this change the dual solution?

Try

Supose we have primal $ \max cx $ subjeect to $Ax = b $, $x \geq 0$ and the ${\bf dual}$ then is given by $\min yb $ subject to $yA \geq c $ and $y \; free$. Consider rows $i$ and $j$ of $A$ :

$$ a^i x_k = b_i \; \; \; \; and \; \; \; \; \; a^j x_k = b_j $$

$k=1,…,n$. Let's perform what we are asked: Let $\alpha$ be scalar so that

$$ (a^i + \alpha a^j) x_k = b_i+\alpha b_j $$

So the ith dual variable coefficient changes. But, is it a multiple of $\alpha$ or not?

Best Answer

Let $E$ be the corresponding elementary matrix corresponding to adding $\alpha$ times the $j$-th row to the $i$-th row.

Let $w$ be the original dual variable, then we have

$$y=E^{-T}w$$

from the working here.

$E^T$ be the corresponding elementary matrix corresponding to adding $\alpha$ times the $i$-th row to the $j$-th row.

$E^{-T}$ be the corresponding elementary matrix corresponding to adding $-\alpha$ times the $i$-th row to the $j$-th row.

Hence the $j$-th entry of the dual would change, $$y_j = w_j-\alpha w_i.$$

Related Solutions

[Math] How does multiplying a primal constraint by a constant change the dual solution

The answer is $w_k = \lambda_k/\mu$ and $w_i = \lambda_i$ for $i \neq k$.

Multiplying the $k$th constraint of the primal by $\mu$ doesn't change the primal feasible region and so doesn't change the primal optimal solution. Thus the value $z^*$ of the optimal primal solution doesn't change.

The only change to the dual problem is that the $k$th variable is replaced by $\mu$ times that variable (in the constraints and the objective). Since $z^*$ is the value of the original dual optimal solution, letting $w_i = \lambda_i$ for $i \neq k$ and $w_k = \lambda_k/\mu$ yields a solution that is feasible for the new dual and that also has value $z^*$. Thus, by weak duality, $w$ must be optimal.

Optimization – Correct Dual to Given Primal Linear Programming Problem

Maybe it's worthwhile to talk through where the dual comes from. This will take a while, but hopefully the dual won't seem so mysterious when we're done.

Suppose we want to use the primal's constraints as a way to find an upper bound on the optimal value of the primal. If we multiply the first constraint by $9$, the second constraint by $1$, and add them together, we get $9(2x_1 - x_2) + 1(x_1 +3 x_2)$ for the left-hand side and $9(1) + 1(9)$ for the right-hand side. Since the first constraint is an equality and the second is an inequality, this implies $$19x_1 - 6x_2 \leq 18.$$ But since $x_1 \geq 0$, it's also true that $5x_1 \leq 19x_1$, and so $$5x_1 - 6x_2 \leq 19x_1 - 6x_2 \leq 18.$$ Therefore, $18$ is an upper-bound on the optimal value of the primal problem.

Surely we can do better than that, though. Instead of just guessing $9$ and $1$ as the multipliers, let's let them be variables. Thus we're looking for multipliers $y_1$ and $y_2$ to force $$5x_1 - 6x_2 \leq y_1(2x_1-x_2) + y_2(x_1 + 3x_2) \leq y_1(1) + y_2(9).$$

Now, in order for this pair of inequalities to hold, what has to be true about $y_1$ and $y_2$? Let's take the two inequalities one at a time.

The first inequality: $5x_1 - 6x_2 \leq y_1(2x_1-x_2) + y_2(x_1 + 3x_2)$

We have to track the coefficients of the $x_1$ and $x_2$ variables separately. First, we need the total $x_1$ coefficient on the right-hand side to be at least $5$. Getting exactly $5$ would be great, but since $x_1 \geq 0$, anything larger than $5$ would also satisfy the inequality for $x_1$. Mathematically speaking, this means that we need $2y_1 + y_2 \geq 5$.

On the other hand, to ensure the inequality for the $x_2$ variable we need the total $x_2$ coefficient on the right-hand side to be exactly $-6$. Since $x_2$ could be positive, we can't go lower than $-6$, and since $x_2$ could be negative, we can't go higher than $-6$ (as the negative value for $x_2$ would flip the direction of the inequality). So for the first inequality to work for the $x_2$ variable, we've got to have $-y_1 + 3y_2 = -6$.

The second inequality: $y_1(2x_1-x_2) + y_2(x_1 + 3x_2) \leq y_1(1) + y_2(9)$

Here we have to track the $y_1$ and $y_2$ variables separately. The $y_1$ variables come from the first constraint, which is an equality constraint. It doesn't matter if $y_1$ is positive or negative, the equality constraint still holds. Thus $y_1$ is unrestricted in sign. However, the $y_2$ variable comes from the second constraint, which is a less-than-or-equal to constraint. If we were to multiply the second constraint by a negative number that would flip its direction and change it to a greater-than-or-equal constraint. To keep with our goal of upper-bounding the primal objective, we can't let that happen. So the $y_2$ variable can't be negative. Thus we must have $y_2 \geq 0$.

Finally, we want to make the right-hand side of the second inequality as small as possible, as we want the tightest upper-bound possible on the primal objective. So we want to minimize $y_1 + 9y_2$.

Putting all of these restrictions on $y_1$ and $y_2$ together we find that the problem of using the primal's constraints to find the best upper-bound on the optimal primal objective entails solving the following linear program:

$$\begin{align*} \text{Minimize }\:\:\:\:\: y_1 + 9y_2& \\ \text{subject to }\:\:\:\:\: 2y_1 + y_2& \geq 5 \\ -y_1 + 3y_2& = -6\\ y_2 & \geq 0. \end{align*}$$

And that's the dual.

It's probably worth summarizing the implications of this argument for all possible forms of the primal and dual. The following table is taken from p. 214 of Introduction to Operations Research, 8th edition, by Hillier and Lieberman. They refer to this as the SOB method, where SOB stands for Sensible, Odd, or Bizarre, depending on how likely one would find that particular constraint or variable restriction in a maximization or minimization problem.

             Primal Problem                           Dual Problem
             (or Dual Problem)                        (or Primal Problem)

             Maximization                             Minimization

Sensible     <= constraint            paired with     nonnegative variable
Odd          =  constraint            paired with     unconstrained variable
Bizarre      >= constraint            paired with     nonpositive variable

Sensible     nonnegative variable     paired with     >= constraint
Odd          unconstrained variable   paired with     = constraint
Bizarre      nonpositive variable     paired with     <= constraint

Try

Best Answer

Related Solutions

[Math] How does multiplying a primal constraint by a constant change the dual solution

Optimization – Correct Dual to Given Primal Linear Programming Problem

Related Question