Looking for Good Primary School in Sydney

After a decade of wondering around, my wife and I is considering moving from Scotland back to Australia. Initial, we intended to stay in an apartment in Sydney CBD which would be available to us until we find permanent accommodation in Sydney Metro.
My key considering of selecting a suburb is school and my son is going to primary 1 for the moment.
While I am familiar with Sydney, I have no idea on the primary education system in Sydney as I did not grown up in NSW.
Can someone advice me on good public and private primary school and where they are?
Are there any good primary schools near Millers Point/Observatory Hill areas?