I'm speaking from the consumer side of it. To be honest, I don't care nearly as much about how the hosts themselves feel -- my concern is the experience of the players.
Also, your point is flawed in terms of real world examples. Most top movie critics have never directed a film themselves. Same with art critics (painting), food critics (being chefs), etc. To the same end, I wasn't aware that I needed to have flown a plane before to provide comments on my in-flight experience flying commercial. In fact, this is literally an Appeal to Accomplishment in terms of a logical fallacy yourself.