Let the required foot of the “oblique” perpendicular be the point Q on the first line
1x−1=2y−1=−1z, whose direction vector is a=(1,2,−1).
Parameterise this line as
Q(1+t,1+2t,−t),t∈R.
We must reach this line from the given point
P(−2,−8,6)
along the second line
1x+5=−1y+5=2z,
whose direction vector is b=(1,−1,2).
Hence the vector QP=PQ has to be a scalar multiple of b:
PQ=P−Q=λb,λ∈R.
Write PQ component-wise:
P−Q=(−2−(1+t),−8−(1+2t),6−(−t))=(−3−t,−9−2t,6+t).
Equate each component to λ(1,−1,2):
−3−t−9−2t6+t=λ=−λ=2λ−(1)−(2)−(3)
From (1), λ=−3−t.
Insert this in (2):
−9−2t=−(−3−t)=3+t⟹−12−3t=0⟹t=−4.
Therefore λ=−3−(−4)=1.
Check with (3): 6+t=6−4=2=2λ, so all three equations agree.
Thus PQ=1⋅b=b, so the distance is
∣PQ∣=∣b∣=12+(−1)2+22=6.
The question asks for the square of this distance:
∣PQ∣2=(6)2=6.
Option B which is: 6