Our dirt is actually not too bad. Surprisingly so. I have a huge pile from what was excavated during the french drain process that I composted some stuff into that stands at the ready. The ivy had overtaken and killed a lot of shrubs that, I guess self-composted, so those areas are really nice.
There is a lot of clay though. Fortunately if you don't mind hard work and getting dirty, great dirt can be had here for a song. Dirt and hard work are my middle names.
I'm really not a gardener though. I don't know much about it. In Oregon you can spit out a seed and grow a plant as long as you spit in the proper lighting.