The three simultaneous equations are
x+5y+6z=4−(1)
2x+3y+4z=7−(2)
x+6y+az=b−(3)
For infinitely many solutions we need
rank(A)=rank(A∣B)<3,
where A is the coefficient matrix.
Hence \det(\mathbf A)=0.$</p>
<p>The coefficient matrix and its determinant:</p>
<p>\mathbf A=\begin{vmatrix}
1 & 5 & 6\\
2 & 3 & 4\\
1 & 6 & a
\end{vmatrix},\qquad
\Delta=\begin{vmatrix}
1 & 5 & 6\\
2 & 3 & 4\\
1 & 6 & a
\end{vmatrix}.</p><p>Expandingalongthefirstrow,</p><p>\Delta
=1\begin{vmatrix}3 & 4\\ 6 & a\end{vmatrix}
-5\begin{vmatrix}2 & 4\\ 1 & a\end{vmatrix}
+6\begin{vmatrix}2 & 3\\ 1 & 6\end{vmatrix}=(3a-24)-5(2a-4)+6(12-3)=(3a-24)-(10a-20)+54=-7a+50.</p><p>Setting\Delta=0gives</p><p>-7a+50=0\Longrightarrow a=750.</p><p>Because\det(\mathbf A)=0,thethreerowsof\mathbf Aarelinearlydependent.Letthethirdrowbealinearcombinationofthefirsttwo:</p><p>\text{Row}_3=\lambda\,\text{Row}_1+\mu\,Row2.</p><p>Comparingthecoefficientsofxandy:</p><p>λ+2μ=1 \qquad -(4)5λ+3μ=6 \qquad -(5)</p><p>Solving(4)and(5),</p><p>From(4):λ=1-2μ.Substitutein(5):5(1-2μ)+3μ=6\; \Longrightarrow\; -7μ=1\; \Longrightarrow\; μ=-71.Henceλ=1-7−2=79.</p><p>Nowequatethez−coefficientsandtheconstants.</p><p>Forz:6λ+4μ=a
\;\Longrightarrow\;6\!\left(79\right)+4\!\left(-71\right)=750,<br/>whichisexactlythevaluealreadyobtainedfora,confirmingconsistency.<br/><br/>Fortheconstants:4λ+7μ=b</p><p>b=4\!\left(79\right)+7\!\left(-71\right)=736-1=729.</p><p>Thustherequiredpointis</p><p>(a,b)=\left(750,\;729\right).</p><p>Checkwhichofthegivenstraightlinescontainsthispoint:</p><p>Forx-y=3: \; 750−729=3 \quad (satisfied).<br/>Fory-x=3: \; 729−750=-3 \quad (not satisfied).<br/>Forx+y=11: \; 750+729=779≈11.29 =11.<br/>Forx+y=12: \; 779≈11.29 =12.</p><p>Theonlylinethroughthepoint(a,b)is</p><p>x-y=3.</p><p>Hence,thecorrectchoiceis<br/><strong>OptionBwhichis:x - y = 3$$.