There are only two honest metrics when it comes to benchmarking intelligence: novelty and efficiency.

You don't need intelligence to solve a known problem (only memory). And you don't need intelligence to solve a problem via brute force. But to solve a novel problem efficiently, intelligence is the only way.