Why 55 questions on one topic are really 7 questions
We took one chapter — 3D Geometry, straight line in space — tagged every past question by hand, then by machine, and compared the two. The hand count said seven distinct ideas. So did the machine, on the fifth attempt.
Open any question bank, pick 3D Geometry, and ask for the questions on a straight line in space. You will get fifty-five. A student reads that number and plans four evenings around it.
We read all fifty-five. Eleven of them ask for the shortest distance between two skew lines. Not eleven variations on a theme — eleven instances of the same procedure, with the direction ratios changed. Solve one properly and you have solved eleven.
QUESTIONS PER DISTINCT IDEA · 3D GEOMETRY · STRAIGHT LINE IN SPACE
The hand count came first, on purpose
We did not start with the machine. Starting with the machine means you tune it until the answer looks tidy, and tidy is not the same as true. So the fifty-five were sorted on paper first, by someone who had to justify every pile out loud.
That gave seven piles. Then we ran the tagger and asked it the same question. It said eleven. It had split “foot of perpendicular from a point” into three piles because the questions phrased the point differently — as coordinates, as a position vector, and as the intersection of two planes.
A machine that splits one idea into three is not being careful. It is reading the sentence instead of the problem.
Four more passes got it to seven. The fix was not a better model; it was telling the tagger to name the procedure a question needs, then group on the procedure — not on the words.
What this does not prove
One chapter. One subject. We checked 250 tags by hand across the whole bank afterwards and the firm error rate was 5.0% — which on a page promising “no repeats” shows up as the occasional idea appearing twice, or one quietly missing.
So the Unique Concepts sheet prints how many ideas in a chapter have no tagged question yet. A gap you can see is a gap you can work around. A gap we hide is one you find in the exam hall.
Questions read
55
Distinct ideas
7
Tagging error
5.0%
See it on your own chapter
Free to read, on screen, no account. The printable sheet is part of the ₹199 plan.
Open Unique Concepts