@Broken-Man,
Perhaps most importantly, in relation to your anxiety - have you been to see a doctor / psychologist about this? Anxiety had impact every aspect of your life, including how you react to events in your relationships, how you view life, how personally you take things, etc. The more severe the anxiety, the more detrimental it is to your life - I hope you consider addressing it as a priority issue (moreso even than your ladylove - because it will impact that relationship, and all others)
Secondly, you have never met this woman, but seem to be hanging on each minute waiting to talk to her. This isn't healthy - we all need our sense of individuality to compliment our sense of togetherness.
- it is who we are / our individuality / the world that we create / our sense of self / our friends / our values / our character / our life etc, that they are attracted to. If you sacrifice all that to live in their world (ie living only for them) they slowly lose attraction to all those things they found attractive in the first place (because they are slowly disappearing)
-Without our individuality, we live in the other 'half's' world...and that becomes a drain on that other person.
That is to say - take time to look after who you are / what you are / the things you love in life (other than her), your passions, your interests & hobbies, friends, etc
Also:
I can't work out why meeting her = walking out on your kids
I can't work out why you are feeling badly hurt every day