Lack of sexual attraction in marriage

Hi,
I am 34 and my husband is 38, we are married for last 7 months. We get along well with each other and I don't see any major differences between us. My problem is that till now we have had sex just 10 -11 times. Although, I don't feel sexually starved but somewhere I get worried after reading articles and hearing from friends that in the first few months of marriage couples are sexually attracted to each other and this is the time when the foundation of any relationship is laid. This is my husband's second marriage. He got divorced a year back. His previous marriage lasted for 7 years and he was very much in love with his ex-wife. She was the one who decided to end the marriage. In the first few days of our marriage he used to come close to me and then suddenly he will be lost and would go all quiet. On the 3rd day of our marriage he looked very upset and casually mentioned that when you spend time together and fall in love with someone thats when you start enjoying sex even more. I immediately inferred that he was missing his ex-wife but decided to give him sometime. But things don't seem to be picking up. However, otherwise he never talks about his ex and mostly keeps to himself. I want to know if I should try to change things here or is it going just fine and I am over reacting. I come from a conservative family and it would be hard for me to demand sex. Please guide me if you feel there is any problem to be addressed in my case.