Based on my rather limited knowledge

, I'd say "I doubt it, friend."
Breast composition seems to be something mostly genetic. This amount of fibrous tissue, this amount of fat. Water and not much else.
If it is mostly fatty tissue, you can swell them up as you gain weight.
Mostly fibrous, you end up with that situation of no matter how skinny you get your boobs stay nearly the same size!
Add to that a basically genetic disposition to where your fat will settle or not.
Guess I'm saying - since there is no bone or muscle in breasts, I doubt your early starvation would have effect on how large they would grow.
The early starvation more likely would worry to me to the growth of my bones, tissues, and brain.
Ain't no doctor, just going off what I have learned and observed about boobs and body.
I'm glad you are healthy.