@nimh,
There's definitely something to what you say. "Sophistication" or the respect for that thing as perceived can, and often is, a reflection of a certain sort of class-consciousness. Cruder voices can have more value, intellectual or social, than voices that match a "high culture" description. But of course the recognition of that, or the distaste for it, ought not to lead to a converse formulation (eg Palin and "common sense"). One has to try and tease these things apart and that's not always easy. Hunter Thompson could be very rude and crude but was a genius.
One rather wonderful example here is a debate from years ago between John Cleese and Michael Palin on the one hand and Malcolm Muggeridge with the Bishop of Southwark on the other.
https://www.youtube.com/watch?v=tl8acXl3qVs&t=5s
Muggeridge comes off as just the sort of high class twit that Monty Python skewered so perfectly. The Bishop was even worse. Palin is relatively silent in this but Cleese is taking no crap whatsoever. He's brilliant.
But it is also the case that Cleese and Palin had very high quality education behind them which is quite evident in this wonderful debate.
For me, the criterion is who can I learn from? Who provides ideas and perspectives that provide clarity and revelation?