We have to evaluate the definite integral
I = ∫ π 6 π 3 tan 3 x sin 2 3 x ( 2 sec 2 x sin 2 3 x + 3 tan x sin 6 x ) d x . I=\int_{\frac{\pi}{6}}^{\frac{\pi}{3}}\tan^{3}x\;\sin^{2}3x\;\bigl(2\sec^{2}x\;\sin^{2}3x+3\tan x\;\sin 6x\bigr)\;dx. I = ∫ 6 π 3 π tan 3 x sin 2 3 x ( 2 sec 2 x sin 2 3 x + 3 tan x sin 6 x ) d x .
The expression inside the integral looks as if it might be the product of some function and its derivative. So we try to create a single simple function whose derivative reproduces the bracket.
Let us define
u = tan 2 x sin 2 3 x . u=\tan^{2}x\;\sin^{2}3x. u = tan 2 x sin 2 3 x .
Before using this substitution, we carefully find its derivative with respect to x x x . We use the product rule and the standard derivatives
d d x ( tan x ) = sec 2 x , d d x ( sin 2 3 x ) = 2 sin 3 x cos 3 x ( 3 ) = 6 sin 3 x cos 3 x = 3 sin 6 x , \frac{d}{dx}\bigl(\tan x\bigr)=\sec^{2}x, \qquad
\frac{d}{dx}\bigl(\sin^{2}3x\bigr)=2\sin 3x\;\cos 3x\;(3)=6\sin 3x\cos 3x=3\sin 6x, d x d ( tan x ) = sec 2 x , d x d ( sin 2 3 x ) = 2 sin 3 x cos 3 x ( 3 ) = 6 sin 3 x cos 3 x = 3 sin 6 x ,
because sin 6 x = 2 sin 3 x cos 3 x \sin 6x=2\sin 3x\cos 3x sin 6 x = 2 sin 3 x cos 3 x .
Applying the product rule, we get
d u d x = d d x ( tan 2 x ) sin 2 3 x + tan 2 x d d x ( sin 2 3 x ) = 2 tan x sec 2 x sin 2 3 x + tan 2 x ( 3 sin 6 x ) . \frac{du}{dx}
=\frac{d}{dx}\bigl(\tan^{2}x\bigr)\;\sin^{2}3x+\tan^{2}x\;\frac{d}{dx}\bigl(\sin^{2}3x\bigr)
=2\tan x\;\sec^{2}x\;\sin^{2}3x+\tan^{2}x\;(3\sin 6x). d x d u = d x d ( tan 2 x ) sin 2 3 x + tan 2 x d x d ( sin 2 3 x ) = 2 tan x sec 2 x sin 2 3 x + tan 2 x ( 3 sin 6 x ) .
So
d u d x = 2 tan x sec 2 x sin 2 3 x + 3 tan 2 x sin 6 x . \frac{du}{dx}=2\tan x\sec^{2}x\sin^{2}3x+3\tan^{2}x\sin 6x. d x d u = 2 tan x sec 2 x sin 2 3 x + 3 tan 2 x sin 6 x .
Now multiply both sides by u = tan 2 x sin 2 3 x u=\tan^{2}x\sin^{2}3x u = tan 2 x sin 2 3 x :
u d u d x = ( tan 2 x sin 2 3 x ) ( 2 tan x sec 2 x sin 2 3 x + 3 tan 2 x sin 6 x ) . u\;\frac{du}{dx}
=\bigl(\tan^{2}x\sin^{2}3x\bigr)\Bigl(2\tan x\sec^{2}x\sin^{2}3x+3\tan^{2}x\sin 6x\Bigr). u d x d u = ( tan 2 x sin 2 3 x ) ( 2 tan x sec 2 x sin 2 3 x + 3 tan 2 x sin 6 x ) .
Carry out the multiplication term by term:
u d u d x = 2 tan 3 x sec 2 x sin 4 3 x + 3 tan 4 x sin 2 3 x sin 6 x . \displaystyle
u\;\frac{du}{dx}
=2\tan^{3}x\;\sec^{2}x\;\sin^{4}3x
+3\tan^{4}x\;\sin^{2}3x\;\sin 6x. u d x d u = 2 tan 3 x sec 2 x sin 4 3 x + 3 tan 4 x sin 2 3 x sin 6 x .
Compare this with the integrand:
tan 3 x sin 2 3 x ( 2 sec 2 x sin 2 3 x + 3 tan x sin 6 x ) = 2 tan 3 x sec 2 x sin 4 3 x + 3 tan 4 x sin 2 3 x sin 6 x . \tan^{3}x\;\sin^{2}3x\;\bigl(2\sec^{2}x\;\sin^{2}3x+3\tan x\;\sin 6x\bigr)
=2\tan^{3}x\;\sec^{2}x\;\sin^{4}3x
+3\tan^{4}x\;\sin^{2}3x\;\sin 6x. tan 3 x sin 2 3 x ( 2 sec 2 x sin 2 3 x + 3 tan x sin 6 x ) = 2 tan 3 x sec 2 x sin 4 3 x + 3 tan 4 x sin 2 3 x sin 6 x .
The two expressions are exactly the same. Therefore
tan 3 x sin 2 3 x ( 2 sec 2 x sin 2 3 x + 3 tan x sin 6 x ) = u d u d x . \tan^{3}x\;\sin^{2}3x\;\bigl(2\sec^{2}x\;\sin^{2}3x+3\tan x\;\sin 6x\bigr)=u\;\frac{du}{dx}. tan 3 x sin 2 3 x ( 2 sec 2 x sin 2 3 x + 3 tan x sin 6 x ) = u d x d u .
Hence, inside our integral, d x dx d x times the integrand becomes u d u u\,du u d u :
I = ∫ π 6 π 3 u d u d x d x = ∫ u ( x = π 6 ) u ( x = π 3 ) u d u . I=\int_{\frac{\pi}{6}}^{\frac{\pi}{3}}u\;\frac{du}{dx}\;dx=\int_{u(x=\frac{\pi}{6})}^{u(x=\frac{\pi}{3})}u\;du. I = ∫ 6 π 3 π u d x d u d x = ∫ u ( x = 6 π ) u ( x = 3 π ) u d u .
We now evaluate the new limits. First for x = π 6 x=\frac{\pi}{6} x = 6 π :
tan π 6 = 1 3 , tan 2 π 6 = 1 3 , sin 3 ( π 6 ) = sin π 2 = 1 , sin 2 π 2 = 1. \tan\frac{\pi}{6}=\frac{1}{\sqrt3},\qquad
\tan^{2}\frac{\pi}{6}=\frac13,\qquad
\sin 3\left(\frac{\pi}{6}\right)=\sin\frac{\pi}{2}=1,\qquad
\sin^{2}\frac{\pi}{2}=1. tan 6 π = 3 1 , tan 2 6 π = 3 1 , sin 3 ( 6 π ) = sin 2 π = 1 , sin 2 2 π = 1.
Thus
u ( π 6 ) = 1 3 ⋅ 1 = 1 3 . u\Bigl(\tfrac{\pi}{6}\Bigr)=\frac13\cdot1=\frac13. u ( 6 π ) = 3 1 ⋅ 1 = 3 1 .
Next for x = π 3 x=\frac{\pi}{3} x = 3 π :
tan π 3 = 3 , tan 2 π 3 = 3 , sin 3 ( π 3 ) = sin π = 0 , sin 2 π = 0. \tan\frac{\pi}{3}=\sqrt3,\qquad
\tan^{2}\frac{\pi}{3}=3,\qquad
\sin 3\left(\frac{\pi}{3}\right)=\sin\pi=0,\qquad
\sin^{2}\pi=0. tan 3 π = 3 , tan 2 3 π = 3 , sin 3 ( 3 π ) = sin π = 0 , sin 2 π = 0.
Hence
u ( π 3 ) = 3 ⋅ 0 = 0. u\Bigl(\tfrac{\pi}{3}\Bigr)=3\cdot0=0. u ( 3 π ) = 3 ⋅ 0 = 0.
So the integral becomes
I = ∫ 1 3 0 u d u . I=\int_{\frac13}^{0}u\;du. I = ∫ 3 1 0 u d u .
We know the elementary integral
∫ u d u = u 2 2 . \int u\;du=\frac{u^{2}}{2}. ∫ u d u = 2 u 2 .
Applying the limits:
I = u 2 2 ∣ u = 1 3 u = 0 = 0 2 2 − ( 1 3 ) 2 2 = 0 − 1 9 2 = − 1 18 . I=\left.\frac{u^{2}}{2}\right|_{u=\frac13}^{u=0}
=\frac{0^{2}}{2}-\frac{\left(\frac13\right)^{2}}{2}
=0-\frac{\frac19}{2}
=-\frac{1}{18}. I = 2 u 2 u = 3 1 u = 0 = 2 0 2 − 2 ( 3 1 ) 2 = 0 − 2 9 1 = − 18 1 .
Hence, the correct answer is Option C.