Some Atheists blame religion for everything
True. And some blame it for lots of things, and others for a few things, and the rest don't care.
but religion is simply a belief system that typically revolve around 'gods'. Get rid of the religious belief systems (as the athiests keep encouraging) and it will be replaced by other belief systems that don't revolve around a god.
Well it's unlikely we'll ever know, but if it did at least it would be a belief system open to challenge and debate, and, god forbid, testing and review.
The religious violence and abuse would return, it would just be stemmed from the form of hate crimes and the like.
Well it wouldn't be religious violence for a start. I'm an atheist who doesn't blame religion for all ills but I look at your last statement like this. We already have hate crimes, and a bunch of other triggers for violence, including religion. Why not get rid of one of those triggers? Your logic is that there is no point to removing any point of conflict because it will just be replaced by another. You may be right, but if so what purpose does religion serve if nothing changes when we get rid of it?