Isn't it common sense only a genius can reliably predict how genius someone else?

So how do we know the smartest man in the world is the smartest when he's smarter than technically all the rest of us?

IQ tests are deeply flawed after a point