We are given f(x)=x−1 and g(x)=ex.
First simplify the composition that appears in the differential equation.
f(f(x))=f(x−1)=(x−1)−1=x−2
Therefore g(f(f(x)))=ex−2.
Substituting in the differential equation,
dxdy=e−2xex−2−xy=ex−2−2x−xy.
Write it in standard linear form dxdy+P(x)y=Q(x).
Here P(x)=x1,Q(x)=ex−2−2x.
Integrating factor
The integrating factor (I.F.) is exp(∫P(x)dx).
∫P(x)dx=∫x−1/2dx=2x,
so I.F.=e2x.
Multiply the differential equation by this integrating factor:
e2xdxdy+x1e2xy=e2xex−2−2x=ex−2.
The left-hand side is the derivative of ye2x, because
dxd(ye2x)=e2xdxdy+ye2xdxd(2x)=e2xdxdy+ye2xx1.
Hence
dxd(ye2x)=ex−2.
Integrate both sides from 0 to x:
ye2x−y(0)e20=∫0xet−2dt.
Given y(0)=0 and e20=1, so
ye2x=e−2∫0xetdt=e−2(ex−1).
Therefore
y(x)=e−2xe−2(ex−1)=ex−2−2x−e−2−2x.
Value at x=1
For x=1, 1=1, so
y(1)=e1−2−2−e−2−2=e−3−e−4.
Factor out e−4:
y(1)=e−4(e1−1)=e4e−1.
Thus y(1)=e4e−1.
This matches Option C.