We know that for any data set of size n, the (population) variance formula is stated as
σ2=ni=1∑nxi2−μ2,
where μ is the mean (μ=n∑xi). We first apply this to the original five students. Their mean height is given as μ1=150 cm and their variance is σ12=18 cm2. Substituting in the formula, we get
∑i=15xi2=n(σ12+μ12)=5(18+1502)=5(18+22500)=5×22518=112590.
The sum of their heights is simply ∑i=15xi=nμ1=5×150=750.
Now a sixth student of height x6=156 cm joins the group. So the new number of students is n2=6. The new total height becomes
∑i=16xi=750+156=906,
leading to the new mean
μ2=6906=151 cm.
In the same way, the new sum of squares is
∑i=16xi2=112590+1562=112590+24336=136926.
Applying the variance formula once more, we obtain
σ22=6136926−μ22=22821−1512=22821−22801=20 cm2.
Hence, the correct answer is Option D.