I had this conversation with a club pro the other day, as we were discussing the USGA's past reluctance/but sudden openness about a reduced-distance competition ball.
I know most of those guys on tour can find the sweet spot of just about every club, but (imo) you'd see the distance factor reeled back automatically if they'd simply regulate a competition driver head to be no bigger than 200-250 cc.
I'm obviously not nowhere near that level of proficiency, but comparatively speaking - my swing speed would be considerably slower if I had to put the ball somewhere in the middle of a club face about 1/3 the size as it is now. Landon's picture comparing driver head sizes hammers that point home in a hurry.