We have the fixed points A(1,−1) and B(0,2) and a variable point P(x′,y′) that lies on the straight line
3x+y−4λ=0.
Therefore every such point must satisfy
3x′+y′=4λ.−(1)
The area of the triangle formed by the three points is given to be 5 square units.
For three points P(x1,y1),A(x2,y2),B(x3,y3) the area formula is
Area=21∣x1(y2−y3)+x2(y3−y1)+x3(y1−y2)∣.
Putting P(x′,y′),A(1,−1),B(0,2) into the formula, we get
Area=21∣x′(−1−2)+1(2−y′)+0(y′+1)∣.
Simplifying the expression inside the modulus step by step,
x′(−1−2)=x′(−3)=−3x′,
1(2−y′)=2−y′,
and the last term is zero.
Hence
Area=21∣−3x′+2−y′∣.
Given that this area equals 5, we write
21∣−3x′+2−y′∣=5.
Multiplying by 2 gives
∣−3x′+2−y′∣=10.
Because a modulus is unchanged by an overall sign, we may reverse the order to obtain
∣3x′+y′−2∣=10.−(2)
Now we substitute the line condition (1), namely 3x′+y′=4λ, into (2):
∣4λ−2∣=10.
Removing the absolute value leads to the two equations
4λ−2=10or4λ−2=−10.
Solving each, we get
First case: 4λ=12⇒λ=3.
Second case: 4λ=−8⇒λ=−2.
Among the answer choices only λ=3 is listed.
Hence, the correct answer is Option B.