@imsak,
While it is not wrong grammatically, why not try this expression which is a little less awkward:
"You told me there are a lot of them in this town, but
(no comma) so far, why have
I never once found such a thing?"
Also you might consider using
not once, as an alternate phrase..but there's nothing wrong with
never once, either.