We are given the three equations
x + y + z = 2 , x + 2 y + 3 z = 5 , x + 3 y + λ z = μ . \begin{aligned}
x+y+z &= 2,\\
x+2y+3z &= 5,\\
x+3y+\lambda z &= \mu.
\end{aligned} x + y + z x + 2 y + 3 z x + 3 y + λ z = 2 , = 5 , = μ .
For a system of three linear equations in three unknowns to possess infinitely many solutions, two conditions must hold:
1. The coefficient matrix must be singular, that is, its determinant must vanish. (Rank < 3.)
2. The rank of the augmented matrix must be the same as the rank of the coefficient matrix, otherwise the system would be inconsistent.
We first write the coefficient matrix A A A and compute its determinant.
A = [ 1 1 1 1 2 3 1 3 λ ] . A=\begin{bmatrix}
1&1&1\\
1&2&3\\
1&3&\lambda
\end{bmatrix}. A = 1 1 1 1 2 3 1 3 λ .
The determinant of a 3 × 3 3\times3 3 × 3 matrix
[ a 11 a 12 a 13 a 21 a 22 a 23 a 31 a 32 a 33 ] \begin{bmatrix}
a_{11}&a_{12}&a_{13}\\
a_{21}&a_{22}&a_{23}\\
a_{31}&a_{32}&a_{33}
\end{bmatrix} a 11 a 21 a 31 a 12 a 22 a 32 a 13 a 23 a 33
is given by the expansion
det A = a 11 ( a 22 a 33 − a 23 a 32 ) − a 12 ( a 21 a 33 − a 23 a 31 ) + a 13 ( a 21 a 32 − a 22 a 31 ) . \det A = a_{11}(a_{22}a_{33}-a_{23}a_{32}) - a_{12}(a_{21}a_{33}-a_{23}a_{31}) + a_{13}(a_{21}a_{32}-a_{22}a_{31}). det A = a 11 ( a 22 a 33 − a 23 a 32 ) − a 12 ( a 21 a 33 − a 23 a 31 ) + a 13 ( a 21 a 32 − a 22 a 31 ) .
Applying this formula to our matrix we have
det A = 1 ( 2 λ − 3 ⋅ 3 ) − 1 ( 1 ⋅ λ − 3 ⋅ 1 ) + 1 ( 1 ⋅ 3 − 2 ⋅ 1 ) = 1 ( 2 λ − 9 ) − ( λ − 3 ) + ( 3 − 2 ) = 2 λ − 9 − λ + 3 + 1 = λ − 5. \begin{aligned}
\det A &= 1\bigl(2\lambda-3\cdot3\bigr)\;-\;1\bigl(1\cdot\lambda-3\cdot1\bigr)\;+\;1\bigl(1\cdot3-2\cdot1\bigr)\\
&= 1\bigl(2\lambda-9\bigr)\;-\;\bigl(\lambda-3\bigr)\;+\;\bigl(3-2\bigr)\\
&= 2\lambda-9-\lambda+3+1\\
&= \lambda-5.
\end{aligned} det A = 1 ( 2 λ − 3 ⋅ 3 ) − 1 ( 1 ⋅ λ − 3 ⋅ 1 ) + 1 ( 1 ⋅ 3 − 2 ⋅ 1 ) = 1 ( 2 λ − 9 ) − ( λ − 3 ) + ( 3 − 2 ) = 2 λ − 9 − λ + 3 + 1 = λ − 5.
For the determinant to vanish we set
λ − 5 = 0 ⟹ λ = 5. \lambda-5 = 0 \quad\Longrightarrow\quad \lambda = 5. λ − 5 = 0 ⟹ λ = 5.
Thus the first condition imposes λ = 5. \lambda=5. λ = 5.
Now we check the augmented matrix to ensure consistency. Substituting λ = 5 \lambda=5 λ = 5 into the original system we get
x + y + z = 2 , x + 2 y + 3 z = 5 , x + 3 y + 5 z = μ . \begin{aligned}
x+y+z &= 2,\\
x+2y+3z &= 5,\\
x+3y+5z &= \mu.
\end{aligned} x + y + z x + 2 y + 3 z x + 3 y + 5 z = 2 , = 5 , = μ .
We perform elementary row operations. First subtract the first equation from the second and third to eliminate x x x :
(Row2) − (Row1) : ( x + 2 y + 3 z ) − ( x + y + z ) = y + 2 z = 5 − 2 = 3 , (Row3) − (Row1) : ( x + 3 y + 5 z ) − ( x + y + z ) = 2 y + 4 z = μ − 2. \begin{aligned}
\text{(Row2)} &\;-\;\text{(Row1)}:\; & (x+2y+3z) - (x+y+z) &= y+2z &= 5-2 &= 3,\\[4pt]
\text{(Row3)} &\;-\;\text{(Row1)}:\; & (x+3y+5z) - (x+y+z) &= 2y+4z &= \mu-2.
\end{aligned} (Row2) (Row3) − (Row1) : − (Row1) : ( x + 2 y + 3 z ) − ( x + y + z ) ( x + 3 y + 5 z ) − ( x + y + z ) = y + 2 z = 2 y + 4 z = 5 − 2 = μ − 2. = 3 ,
So, after these operations the simplified system is
x + y + z = 2 , y + 2 z = 3 , 2 y + 4 z = μ − 2. \begin{aligned}
x+y+z &= 2,\\
y+2z &= 3,\\
2y+4z &= \mu-2.
\end{aligned} x + y + z y + 2 z 2 y + 4 z = 2 , = 3 , = μ − 2.
Notice that the third new equation is simply twice the second new equation provided that the right‐hand sides scale in the same way. Indeed, multiplying the second new equation by 2 2 2 gives
2 ( y + 2 z ) = 2 ⋅ 3 ⟹ 2 y + 4 z = 6. 2(y+2z) = 2\cdot3 \;\;\Longrightarrow\;\; 2y+4z = 6. 2 ( y + 2 z ) = 2 ⋅ 3 ⟹ 2 y + 4 z = 6.
For the third new equation to match this exactly we require
μ − 2 = 6 ⟹ μ = 8. \mu-2 = 6 \quad\Longrightarrow\quad \mu = 8. μ − 2 = 6 ⟹ μ = 8.
Thus consistency forces μ = 8. \mu=8. μ = 8.
Both conditions are now satisfied: the determinant is zero (making the coefficient matrix singular) and the augmented matrix has the same rank (two), giving infinitely many solutions.
Therefore, the required values are λ = 5 , μ = 8. \lambda = 5,\;\; \mu = 8. λ = 5 , μ = 8. Hence, the correct answer is Option C.