Nope, you're wrong. It kind of depends on the name of the group. Using a definite article is not necessary incorrect.
The Bird Watchers of America
The Green Party
The Dog Lovers of Utah
The Friends of Athabasca Library
The Tone-arms Band
The Oshkosh Swamp Lizards Football Club
Tom, Dick, and Harry