To ensure that the three given vectors are coplanar we recall the scalar-triple-product condition: for vectors p ⃗ , q ⃗ , r ⃗ \vec{p},\;\vec{q},\;\vec{r} p , q , r we must have p ⃗ ⋅ ( q ⃗ × r ⃗ ) = 0. \vec{p}\cdot(\vec{q}\times\vec{r})=0. p ⋅ ( q × r ) = 0.
Writing each vector in component form, we obtain the determinant
p ⃗ ⋅ ( q ⃗ × r ⃗ ) = ∣ a + 1 a a a a + 1 a a a a + 1 ∣ . \vec{p}\cdot(\vec{q}\times\vec{r})=
\begin{vmatrix}
a+1 & a & a\\
a & a+1 & a\\
a & a & a+1
\end{vmatrix}. p ⋅ ( q × r ) = a + 1 a a a a + 1 a a a a + 1 . $
Expanding this determinant along the first row, we get
( a + 1 ) [ ( a + 1 ) ( a + 1 ) − a 2 ] − ; ; a [ a ( a + 1 ) − a 2 ] + a [ a 2 − a ( a + 1 ) ] . \begin{aligned}
\bigl(a+1\bigr)\Bigl[(a+1)(a+1)-a^{2}\Bigr]
\;&-;; a\Bigl[a(a+1)-a^{2}\Bigr]
\;+\; a\Bigl[a^{2}-a(a+1)\Bigr].
\end{aligned} ( a + 1 ) [ ( a + 1 ) ( a + 1 ) − a 2 ] − ;; a [ a ( a + 1 ) − a 2 ] + a [ a 2 − a ( a + 1 ) ] . $
Simplifying each bracket separately,
( a + 1 ) ( a + 1 ) − a 2 = a 2 + 2 a + 1 − a 2 = 2 a + 1 , a ( a + 1 ) − a 2 = a 2 + a − a 2 = a , a 2 − a ( a + 1 ) = a 2 − a 2 − a = − a . \begin{aligned}
(a+1)(a+1)-a^{2}&=a^{2}+2a+1-a^{2}=2a+1,\\[2mm]
a(a+1)-a^{2}&=a^{2}+a-a^{2}=a,\\[2mm]
a^{2}-a(a+1)&=a^{2}-a^{2}-a=-a.
\end{aligned} ( a + 1 ) ( a + 1 ) − a 2 a ( a + 1 ) − a 2 a 2 − a ( a + 1 ) = a 2 + 2 a + 1 − a 2 = 2 a + 1 , = a 2 + a − a 2 = a , = a 2 − a 2 − a = − a . $
Substituting these back,
p ⃗ ⋅ ( q ⃗ × r ⃗ ) = ( a + 1 ) ( 2 a + 1 ) − a ( a ) + a ( − a ) = 2 a 2 + 3 a + 1 − a 2 − a 2 = 3 a + 1. \begin{aligned}
\vec{p}\cdot(\vec{q}\times\vec{r})
&=(a+1)(2a+1)-a(a)+a(-a)\\[2mm]
&=2a^{2}+3a+1-a^{2}-a^{2}\\[2mm]
&=3a+1.
\end{aligned} p ⋅ ( q × r ) = ( a + 1 ) ( 2 a + 1 ) − a ( a ) + a ( − a ) = 2 a 2 + 3 a + 1 − a 2 − a 2 = 3 a + 1. $
The coplanarity requirement 3 a + 1 = 0 3a+1=0 3 a + 1 = 0 therefore gives
a = − 1 3 . a=-\dfrac13. a = − 3 1 .
Next we evaluate p ⃗ ⋅ q ⃗ . \vec{p}\cdot\vec{q}. p ⋅ q . Using the usual dot-product formula,
p ⃗ ⋅ q ⃗ = ( a + 1 ) ( a ) + a ( a + 1 ) + a ⋅ a = a ( a + 1 ) + a ( a + 1 ) + a 2 = 2 a ( a + 1 ) + a 2 = 2 ( a 2 + a ) + a 2 = 3 a 2 + 2 a . \begin{aligned}
\vec{p}\cdot\vec{q}
&=(a+1)(a)+a(a+1)+a\cdot a\\[2mm]
&=a(a+1)+a(a+1)+a^{2}\\[2mm]
&=2a(a+1)+a^{2}\\[2mm]
&=2(a^{2}+a)+a^{2}\\[2mm]
&=3a^{2}+2a.
\end{aligned} p ⋅ q = ( a + 1 ) ( a ) + a ( a + 1 ) + a ⋅ a = a ( a + 1 ) + a ( a + 1 ) + a 2 = 2 a ( a + 1 ) + a 2 = 2 ( a 2 + a ) + a 2 = 3 a 2 + 2 a . $
Putting a = − 1 3 a=-\dfrac13 a = − 3 1 we obtain
p ⃗ ⋅ q ⃗ = 3 ( 1 9 ) + 2 ( − 1 3 ) = 1 3 − 2 3 = − 1 3 . \vec{p}\cdot\vec{q}=3\!\left(\dfrac{1}{9}\right)+2\!\left(-\dfrac13\right)
=\dfrac13-\dfrac23=-\dfrac13. p ⋅ q = 3 ( 9 1 ) + 2 ( − 3 1 ) = 3 1 − 3 2 = − 3 1 . $
We now compute r ⃗ × q ⃗ . \vec{r}\times\vec{q}. r × q . For components r ⃗ = ( a , a , a + 1 ) \vec{r}=(a,a,a+1) r = ( a , a , a + 1 ) and q ⃗ = ( a , a + 1 , a ) , \vec{q}=(a,a+1,a), q = ( a , a + 1 , a ) , the cross-product formula
r ⃗ × q ⃗ = ( r 2 q 3 − r 3 q 2 , r 3 q 1 − r 1 q 3 , r 1 q 2 − r 2 q 1 ) \vec{r}\times\vec{q}=\bigl(r_{2}q_{3}-r_{3}q_{2},\;r_{3}q_{1}-r_{1}q_{3},\;r_{1}q_{2}-r_{2}q_{1}\bigr) r × q = ( r 2 q 3 − r 3 q 2 , r 3 q 1 − r 1 q 3 , r 1 q 2 − r 2 q 1 ) $
gives
r 2 q 3 − r 3 q 2 = a ⋅ a − ( a + 1 ) ( a + 1 ) = a 2 − ( a + 1 ) 2 = − ( 2 a + 1 ) , r 3 q 1 − r 1 q 3 = ( a + 1 ) a − a ⋅ a = a ( a + 1 ) − a 2 = a , r 1 q 2 − r 2 q 1 = a ( a + 1 ) − a ⋅ a = a ( a + 1 ) − a 2 = a . \begin{aligned}
r_{2}q_{3}-r_{3}q_{2}&=a\cdot a-(a+1)(a+1)=a^{2}-(a+1)^{2}=-(2a+1),\\[2mm]
r_{3}q_{1}-r_{1}q_{3}&=(a+1)\,a-a\cdot a=a(a+1)-a^{2}=a,\\[2mm]
r_{1}q_{2}-r_{2}q_{1}&=a\,(a+1)-a\cdot a=a(a+1)-a^{2}=a.
\end{aligned} r 2 q 3 − r 3 q 2 r 3 q 1 − r 1 q 3 r 1 q 2 − r 2 q 1 = a ⋅ a − ( a + 1 ) ( a + 1 ) = a 2 − ( a + 1 ) 2 = − ( 2 a + 1 ) , = ( a + 1 ) a − a ⋅ a = a ( a + 1 ) − a 2 = a , = a ( a + 1 ) − a ⋅ a = a ( a + 1 ) − a 2 = a . $
Hence
r ⃗ × q ⃗ = ( − ( 2 a + 1 ) , a , a ) . \vec{r}\times\vec{q}=(-(2a+1),\,a,\,a). r × q = ( − ( 2 a + 1 ) , a , a ) .
The square of its magnitude is therefore
∣ r ⃗ × q ⃗ ∣ 2 = ( 2 a + 1 ) 2 + a 2 + a 2 = 4 a 2 + 4 a + 1 + 2 a 2 = 6 a 2 + 4 a + 1. \begin{aligned}
\bigl|\vec{r}\times\vec{q}\bigr|^{2}
&=(2a+1)^{2}+a^{2}+a^{2}\\[2mm]
&=4a^{2}+4a+1+2a^{2}\\[2mm]
&=6a^{2}+4a+1.
\end{aligned} r × q 2 = ( 2 a + 1 ) 2 + a 2 + a 2 = 4 a 2 + 4 a + 1 + 2 a 2 = 6 a 2 + 4 a + 1. $
Substituting a = − 1 3 , a=-\dfrac13, a = − 3 1 ,
∣ r ⃗ × q ⃗ ∣ 2 = 6 ( 1 9 ) + 4 ( − 1 3 ) + 1 = 2 3 − 4 3 + 1 = 1 3 . \bigl|\vec{r}\times\vec{q}\bigr|^{2}=6\!\left(\dfrac19\right)+4\!\left(-\dfrac13\right)+1
=\dfrac23-\dfrac43+1=\dfrac13. r × q 2 = 6 ( 9 1 ) + 4 ( − 3 1 ) + 1 = 3 2 − 3 4 + 1 = 3 1 . $
The problem states that
3 ( p ⃗ ⋅ q ⃗ ) 2 − λ ∣ r ⃗ × q ⃗ ∣ 2 = 0. 3(\vec{p}\cdot\vec{q})^{2}-\lambda\bigl|\vec{r}\times\vec{q}\bigr|^{2}=0. 3 ( p ⋅ q ) 2 − λ r × q 2 = 0.
Using ( p ⃗ ⋅ q ⃗ ) 2 = ( − 1 3 ) 2 = 1 9 (\vec{p}\cdot\vec{q})^{2}=\left(-\dfrac13\right)^{2}=\dfrac19 ( p ⋅ q ) 2 = ( − 3 1 ) 2 = 9 1 and
∣ r ⃗ × q ⃗ ∣ 2 = 1 3 , \bigl|\vec{r}\times\vec{q}\bigr|^{2}=\dfrac13, r × q 2 = 3 1 , we have
3 ( 1 9 ) − λ ( 1 3 ) = 0 ⟹ 1 3 − λ 3 = 0. 3\!\left(\dfrac19\right)-\lambda\!\left(\dfrac13\right)=0
\;\;\Longrightarrow\;\;
\dfrac13-\dfrac{\lambda}{3}=0. 3 ( 9 1 ) − λ ( 3 1 ) = 0 ⟹ 3 1 − 3 λ = 0. $
Multiplying by 3 gives 1 − λ = 0 , 1-\lambda=0, 1 − λ = 0 , so
λ = 1. \lambda=1. λ = 1.
Hence, the correct answer is Option A.