@hingehead,
I recall that, after moving into my current place, although the Colourbond fences were high, the bloody cat dug his way out underneath them. I had to go along the length of the back fence and concrete in the gap between fence and ground, and a bit either side, to make it too difficult / annoying to dig out!
And then the trees grew - and he could climb them to get over the fence.
Current cat is too fat / lazy / arthritic to get over the fence, but I still worry that other cats, you are not quite so f/l/a, can get into the yard from outside.