Let us denote the angle between the unit vectors a ⃗ \vec a a and b ⃗ \vec b b by θ \theta θ . By definition of the dot product we have
a ⃗ ⋅ b ⃗ = ∣ a ⃗ ∣ ∣ b ⃗ ∣ cos θ = 1 ⋅ 1 ⋅ cos θ = cos θ . \vec a\cdot\vec b \;=\; |\vec a|\,|\vec b|\cos\theta \;=\; 1\cdot1\cdot\cos\theta \;=\; \cos\theta. a ⋅ b = ∣ a ∣ ∣ b ∣ cos θ = 1 ⋅ 1 ⋅ cos θ = cos θ .
First we use the fact that ( a ⃗ + 3 b ⃗ ) \bigl(\vec a+3\vec b\bigr) ( a + 3 b ) is perpendicular to ( 7 a ⃗ − 5 b ⃗ ) \bigl(7\vec a-5\vec b\bigr) ( 7 a − 5 b ) . Two vectors are perpendicular exactly when their dot product is zero, so
( a ⃗ + 3 b ⃗ ) ⋅ ( 7 a ⃗ − 5 b ⃗ ) = 0. \bigl(\vec a+3\vec b\bigr)\cdot\bigl(7\vec a-5\vec b\bigr)=0. ( a + 3 b ) ⋅ ( 7 a − 5 b ) = 0.
We expand this dot product term by term:
( a ⃗ + 3 b ⃗ ) ⋅ ( 7 a ⃗ − 5 b ⃗ ) = a ⃗ ⋅ ( 7 a ⃗ ) + a ⃗ ⋅ ( − 5 b ⃗ ) + 3 b ⃗ ⋅ ( 7 a ⃗ ) + 3 b ⃗ ⋅ ( − 5 b ⃗ ) = 7 a ⃗ ⋅ a ⃗ − 5 a ⃗ ⋅ b ⃗ + 21 b ⃗ ⋅ a ⃗ − 15 b ⃗ ⋅ b ⃗ . \begin{aligned}
\bigl(\vec a+3\vec b\bigr)\cdot\bigl(7\vec a-5\vec b\bigr)
&= \vec a\cdot(7\vec a) \;+\; \vec a\cdot(-5\vec b)\;+\; 3\vec b\cdot(7\vec a)\;+\; 3\vec b\cdot(-5\vec b)\\[4pt]
&= 7\,\vec a\cdot\vec a \;-\; 5\,\vec a\cdot\vec b \;+\; 21\,\vec b\cdot\vec a \;-\; 15\,\vec b\cdot\vec b.\\
\end{aligned} ( a + 3 b ) ⋅ ( 7 a − 5 b ) = a ⋅ ( 7 a ) + a ⋅ ( − 5 b ) + 3 b ⋅ ( 7 a ) + 3 b ⋅ ( − 5 b ) = 7 a ⋅ a − 5 a ⋅ b + 21 b ⋅ a − 15 b ⋅ b .
Since ∣ a ⃗ ∣ 2 = a ⃗ ⋅ a ⃗ = 1 |\vec a|^2=\vec a\cdot\vec a=1 ∣ a ∣ 2 = a ⋅ a = 1 and ∣ b ⃗ ∣ 2 = b ⃗ ⋅ b ⃗ = 1 |\vec b|^2=\vec b\cdot\vec b=1 ∣ b ∣ 2 = b ⋅ b = 1 , and because b ⃗ ⋅ a ⃗ = a ⃗ ⋅ b ⃗ = cos θ , \vec b\cdot\vec a=\vec a\cdot\vec b=\cos\theta, b ⋅ a = a ⋅ b = cos θ , this becomes
7 ( 1 ) − 5 ( cos θ ) + 21 ( cos θ ) − 15 ( 1 ) = 0. 7(1)\;-\;5(\cos\theta)\;+\;21(\cos\theta)\;-\;15(1)=0. 7 ( 1 ) − 5 ( cos θ ) + 21 ( cos θ ) − 15 ( 1 ) = 0.
Simplifying we get
7 − 15 + ( − 5 + 21 ) cos θ = 0 ⟹ − 8 + 16 cos θ = 0. 7-15 \;+\; (-5+21)\cos\theta \;=\; 0 \quad\Longrightarrow\quad -8\;+\;16\cos\theta=0. 7 − 15 + ( − 5 + 21 ) cos θ = 0 ⟹ − 8 + 16 cos θ = 0.
So
16 cos θ = 8 ⟹ cos θ = 8 16 = 1 2 . 16\cos\theta = 8 \quad\Longrightarrow\quad \cos\theta = \frac{8}{16} = \frac12. 16 cos θ = 8 ⟹ cos θ = 16 8 = 2 1 .
Now we use the second given perpendicularity: ( a ⃗ − 4 b ⃗ ) \bigl(\vec a-4\vec b\bigr) ( a − 4 b ) is perpendicular to ( 7 a ⃗ − 2 b ⃗ ) \bigl(7\vec a-2\vec b\bigr) ( 7 a − 2 b ) , giving
( a ⃗ − 4 b ⃗ ) ⋅ ( 7 a ⃗ − 2 b ⃗ ) = 0. \bigl(\vec a-4\vec b\bigr)\cdot\bigl(7\vec a-2\vec b\bigr)=0. ( a − 4 b ) ⋅ ( 7 a − 2 b ) = 0.
Again we expand fully:
( a ⃗ − 4 b ⃗ ) ⋅ ( 7 a ⃗ − 2 b ⃗ ) = a ⃗ ⋅ ( 7 a ⃗ ) + a ⃗ ⋅ ( − 2 b ⃗ ) − 4 b ⃗ ⋅ ( 7 a ⃗ ) − 4 b ⃗ ⋅ ( − 2 b ⃗ ) = 7 a ⃗ ⋅ a ⃗ − 2 a ⃗ ⋅ b ⃗ − 28 b ⃗ ⋅ a ⃗ + 8 b ⃗ ⋅ b ⃗ . \begin{aligned}
\bigl(\vec a-4\vec b\bigr)\cdot\bigl(7\vec a-2\vec b\bigr)
&= \vec a\cdot(7\vec a)\;+\;\vec a\cdot(-2\vec b)\;-\;4\vec b\cdot(7\vec a)\;-\;4\vec b\cdot(-2\vec b)\\[4pt]
&= 7\,\vec a\cdot\vec a \;-\; 2\,\vec a\cdot\vec b \;-\; 28\,\vec b\cdot\vec a \;+\; 8\,\vec b\cdot\vec b.\\
\end{aligned} ( a − 4 b ) ⋅ ( 7 a − 2 b ) = a ⋅ ( 7 a ) + a ⋅ ( − 2 b ) − 4 b ⋅ ( 7 a ) − 4 b ⋅ ( − 2 b ) = 7 a ⋅ a − 2 a ⋅ b − 28 b ⋅ a + 8 b ⋅ b .
Substituting a ⃗ ⋅ a ⃗ = 1 \vec a\cdot\vec a=1 a ⋅ a = 1 , b ⃗ ⋅ b ⃗ = 1 \vec b\cdot\vec b=1 b ⋅ b = 1 and a ⃗ ⋅ b ⃗ = cos θ \vec a\cdot\vec b=\cos\theta a ⋅ b = cos θ gives
7 ( 1 ) − 2 ( cos θ ) − 28 ( cos θ ) + 8 ( 1 ) = 0. 7(1)\;-\;2(\cos\theta)\;-\;28(\cos\theta)\;+\;8(1)=0. 7 ( 1 ) − 2 ( cos θ ) − 28 ( cos θ ) + 8 ( 1 ) = 0.
Combining like terms:
15 − 30 cos θ = 0 ⟹ 30 cos θ = 15 ⟹ cos θ = 1 2 . 15 \;-\;30\cos\theta = 0 \quad\Longrightarrow\quad 30\cos\theta = 15 \quad\Longrightarrow\quad \cos\theta = \frac12. 15 − 30 cos θ = 0 ⟹ 30 cos θ = 15 ⟹ cos θ = 2 1 .
Both independent conditions agree on cos θ = 1 2 \cos\theta=\frac12 cos θ = 2 1 . For 0 ∘ ≤ θ ≤ 180 ∘ , 0^\circ\le\theta\le 180^\circ, 0 ∘ ≤ θ ≤ 18 0 ∘ , the value cos θ = 1 2 \cos\theta=\frac12 cos θ = 2 1 corresponds to
θ = 60 ∘ . \theta = 60^\circ. θ = 6 0 ∘ .
So, the answer is 60 ∘ 60^\circ 6 0 ∘ .