We have been given
y ( x ) = cot − 1 ( 1 + sin x + 1 − sin x 1 + sin x − 1 − sin x ) , x ∈ ( π 2 , π ) . y(x)=\cot^{-1}\!\left(\dfrac{\sqrt{1+\sin x}+\sqrt{1-\sin x}}{\sqrt{1+\sin x}-\sqrt{1-\sin x}}\right),\qquad x\in\left(\dfrac{\pi}{2},\pi\right). y ( x ) = cot − 1 ( 1 + sin x − 1 − sin x 1 + sin x + 1 − sin x ) , x ∈ ( 2 π , π ) .
Put
A = 1 + sin x A=\sqrt{1+\sin x} A = 1 + sin x , B = 1 − sin x \qquad B=\sqrt{1-\sin x} B = 1 − sin x
so that
y = cot − 1 ( A + B A − B ) . y=\cot^{-1}\!\left(\dfrac{A+B}{A-B}\right). y = cot − 1 ( A − B A + B ) .
Let
R ( x ) = A + B A − B . R(x)=\dfrac{A+B}{A-B}. R ( x ) = A − B A + B .
Then y = cot − 1 ( R ) . y=\cot^{-1}(R). y = cot − 1 ( R ) .
To find d y d x \dfrac{dy}{dx} d x d y we first differentiate R ( x ) . R(x). R ( x ) .
Since A = ( 1 + sin x ) 1 / 2 , A=(1+\sin x)^{1/2}, A = ( 1 + sin x ) 1/2 , by the chain rule
d A d x = 1 2 ( 1 + sin x ) − 1 / 2 ⋅ cos x = cos x 2 1 + sin x = cos x 2 A . \dfrac{dA}{dx}=\dfrac{1}{2}(1+\sin x)^{-1/2}\cdot\cos x=\dfrac{\cos x}{2\sqrt{1+\sin x}}=\dfrac{\cos x}{2A}. d x d A = 2 1 ( 1 + sin x ) − 1/2 ⋅ cos x = 2 1 + sin x cos x = 2 A cos x .
Similarly, B = ( 1 − sin x ) 1 / 2 , B=(1-\sin x)^{1/2}, B = ( 1 − sin x ) 1/2 , so
d B d x = 1 2 ( 1 − sin x ) − 1 / 2 ⋅ ( − cos x ) = − cos x 2 1 − sin x = − cos x 2 B . \dfrac{dB}{dx}=\dfrac{1}{2}(1-\sin x)^{-1/2}\cdot(-\cos x)=\dfrac{-\cos x}{2\sqrt{1-\sin x}}=\dfrac{-\cos x}{2B}. d x d B = 2 1 ( 1 − sin x ) − 1/2 ⋅ ( − cos x ) = 2 1 − sin x − cos x = 2 B − cos x .
Write the numerator and denominator of R R R as
N = A + B , D = A − B , N=A+B,\qquad D=A-B, N = A + B , D = A − B ,
so R = N D . R=\dfrac{N}{D}. R = D N .
Using the quotient rule,
d R d x = D d N d x − N d D d x D 2 , \dfrac{dR}{dx}=\dfrac{D\dfrac{dN}{dx}-N\dfrac{dD}{dx}}{D^{2}}, d x d R = D 2 D d x d N − N d x d D ,
where
d N d x = d A d x + d B d x , d D d x = d A d x − d B d x . \dfrac{dN}{dx}= \dfrac{dA}{dx}+\dfrac{dB}{dx},\qquad
\dfrac{dD}{dx}= \dfrac{dA}{dx}-\dfrac{dB}{dx}. d x d N = d x d A + d x d B , d x d D = d x d A − d x d B .
Now we evaluate every quantity at x = 5 π 6 . x=\dfrac{5\pi}{6}. x = 6 5 π .
At this point
sin ( 5 π 6 ) = 1 2 , cos ( 5 π 6 ) = − 3 2 . \sin\!\left(\dfrac{5\pi}{6}\right)=\dfrac12,\qquad
\cos\!\left(\dfrac{5\pi}{6}\right)=-\dfrac{\sqrt3}{2}. sin ( 6 5 π ) = 2 1 , cos ( 6 5 π ) = − 2 3 .
Therefore
A 0 = A ∣ x = 5 π / 6 = 1 + 1 2 = 3 2 = 3 2 , A_{0}=A\Big|_{x=5\pi/6}=\sqrt{1+\dfrac12}=\sqrt{\dfrac32}
=\dfrac{\sqrt3}{\sqrt2}, A 0 = A x = 5 π /6 = 1 + 2 1 = 2 3 = 2 3 ,
B 0 = B ∣ x = 5 π / 6 = 1 − 1 2 = 1 2 = 1 2 . B_{0}=B\Big|_{x=5\pi/6}=\sqrt{1-\dfrac12}=\sqrt{\dfrac12}
=\dfrac1{\sqrt2}. B 0 = B x = 5 π /6 = 1 − 2 1 = 2 1 = 2 1 .
The derivatives become
d A d x ∣ x = 5 π / 6 = cos x 2 A ∣ x = 5 π / 6 = − 3 2 2 3 2 = − 2 4 , \dfrac{dA}{dx}\Bigg|_{x=5\pi/6}=
\dfrac{\cos x}{2A}\Bigg|_{x=5\pi/6}=
\dfrac{-\dfrac{\sqrt3}{2}}{2\dfrac{\sqrt3}{\sqrt2}}
=-\dfrac{\sqrt2}{4}, d x d A x = 5 π /6 = 2 A cos x x = 5 π /6 = 2 2 3 − 2 3 = − 4 2 ,
d B d x ∣ x = 5 π / 6 = − cos x 2 B ∣ x = 5 π / 6 = + 3 2 2 1 2 = 3 2 2 = 6 4 . \dfrac{dB}{dx}\Bigg|_{x=5\pi/6}=
\dfrac{-\cos x}{2B}\Bigg|_{x=5\pi/6}=
\dfrac{+\dfrac{\sqrt3}{2}}{2\dfrac1{\sqrt2}}
=\dfrac{\sqrt3}{2\sqrt2}=\dfrac{\sqrt6}{4}. d x d B x = 5 π /6 = 2 B − cos x x = 5 π /6 = 2 2 1 + 2 3 = 2 2 3 = 4 6 .
Hence
N 0 = A 0 + B 0 = 3 + 1 2 , D 0 = A 0 − B 0 = 3 − 1 2 , N_{0}=A_{0}+B_{0}=\dfrac{\sqrt3+1}{\sqrt2},\qquad
D_{0}=A_{0}-B_{0}=\dfrac{\sqrt3-1}{\sqrt2}, N 0 = A 0 + B 0 = 2 3 + 1 , D 0 = A 0 − B 0 = 2 3 − 1 ,
d N d x ∣ 0 = − 2 4 + 6 4 = − 2 + 6 4 , \dfrac{dN}{dx}\Bigg|_{0}=
-\dfrac{\sqrt2}{4}+\dfrac{\sqrt6}{4}
=\dfrac{-\sqrt2+\sqrt6}{4}, d x d N 0 = − 4 2 + 4 6 = 4 − 2 + 6 ,
d D d x ∣ 0 = − 2 4 − 6 4 = − 2 − 6 4 . \dfrac{dD}{dx}\Bigg|_{0}=
-\dfrac{\sqrt2}{4}-\dfrac{\sqrt6}{4}
=\dfrac{-\sqrt2-\sqrt6}{4}. d x d D 0 = − 4 2 − 4 6 = 4 − 2 − 6 .
The derivative of R R R at the point is
d R d x ∣ 0 = D 0 ( d N d x ) 0 − N 0 ( d D d x ) 0 D 0 2 = 3 − 1 2 ⋅ − 2 + 6 4 − 3 + 1 2 ⋅ − 2 − 6 4 ( 3 − 1 2 ) 2 = 2 2 − 3 . \begin{aligned}
\dfrac{dR}{dx}\Bigg|_{0}
&=\dfrac{D_{0}\big(\dfrac{dN}{dx}\big)_{0}-N_{0}\big(\dfrac{dD}{dx}\big)_{0}}
{D_{0}^{2}}\\[4pt]
&=\dfrac{\dfrac{\sqrt3-1}{\sqrt2}\cdot\dfrac{-\sqrt2+\sqrt6}{4}
-\dfrac{\sqrt3+1}{\sqrt2}\cdot\dfrac{-\sqrt2-\sqrt6}{4}}
{\left(\dfrac{\sqrt3-1}{\sqrt2}\right)^{2}}\\[6pt]
&=\dfrac{2}{\;2-\sqrt3\;}.
\end{aligned} d x d R 0 = D 0 2 D 0 ( d x d N ) 0 − N 0 ( d x d D ) 0 = ( 2 3 − 1 ) 2 2 3 − 1 ⋅ 4 − 2 + 6 − 2 3 + 1 ⋅ 4 − 2 − 6 = 2 − 3 2 .
Next we need d y d x . \dfrac{dy}{dx}. d x d y . The standard derivative formula for the inverse cotangent is
d d x [ cot − 1 u ] = − u ′ 1 + u 2 . \dfrac{d}{dx}\bigl[\cot^{-1}u\bigr]=-\dfrac{u'}{1+u^{2}}. d x d [ cot − 1 u ] = − 1 + u 2 u ′ .
Here u = R ( x ) , u=R(x), u = R ( x ) , so
d y d x = − d R d x 1 + R 2 . \dfrac{dy}{dx}=-\dfrac{\dfrac{dR}{dx}}{1+R^{2}}. d x d y = − 1 + R 2 d x d R .
At x = 5 π 6 x=\dfrac{5\pi}{6} x = 6 5 π we already have d R d x = 2 2 − 3 . \dfrac{dR}{dx}=\dfrac{2}{2-\sqrt3}. d x d R = 2 − 3 2 .
We still need R 0 = R ( 5 π 6 ) . R_{0}=R\bigl(\tfrac{5\pi}{6}\bigr). R 0 = R ( 6 5 π ) .
Using R 0 = A 0 + B 0 A 0 − B 0 = 3 + 1 3 − 1 = 2 + 3 , R_{0}=\dfrac{A_{0}+B_{0}}{A_{0}-B_{0}}
=\dfrac{\sqrt3+1}{\sqrt3-1}
=2+\sqrt3, R 0 = A 0 − B 0 A 0 + B 0 = 3 − 1 3 + 1 = 2 + 3 ,
so
1 + R 0 2 = 1 + ( 2 + 3 ) 2 = 1 + ( 4 + 4 3 + 3 ) = 8 + 4 3 = 4 ( 2 + 3 ) . 1+R_{0}^{2}=1+(2+\sqrt3)^{2}
=1+\bigl(4+4\sqrt3+3\bigr)
=8+4\sqrt3
=4(2+\sqrt3). 1 + R 0 2 = 1 + ( 2 + 3 ) 2 = 1 + ( 4 + 4 3 + 3 ) = 8 + 4 3 = 4 ( 2 + 3 ) .
Consequently
d y d x ∣ x = 5 π / 6 = − 2 2 − 3 4 ( 2 + 3 ) = − 2 4 ( 2 − 3 ) ( 2 + 3 ) . \dfrac{dy}{dx}\Bigg|_{x=5\pi/6}
=-\dfrac{\dfrac{2}{2-\sqrt3}}{4(2+\sqrt3)}
=-\dfrac{2}{4(2-\sqrt3)(2+\sqrt3)}. d x d y x = 5 π /6 = − 4 ( 2 + 3 ) 2 − 3 2 = − 4 ( 2 − 3 ) ( 2 + 3 ) 2 .
Because ( 2 − 3 ) ( 2 + 3 ) = 4 − 3 = 1 , (2-\sqrt3)(2+\sqrt3)=4-3=1, ( 2 − 3 ) ( 2 + 3 ) = 4 − 3 = 1 , the expression simplifies to
d y d x ∣ x = 5 π / 6 = − 2 4 = − 1 2 . \dfrac{dy}{dx}\Bigg|_{x=5\pi/6}
=-\dfrac{2}{4}
=-\dfrac12. d x d y x = 5 π /6 = − 4 2 = − 2 1 .
Hence, the correct answer is Option C.