Am I wrong?

My husband was speaking to his brother on speakerphone while I was standing near by. My husband informed his brother that he would be going to my mother’s home with me and my family for Christmas dinner. The brother, not realizing he was on speaker, proceeded to say: ‘Don’t say nothing about it but watch what you eat.’ My husband responded nervously: ‘We will talk about it later.’ I patiently waited until they ended their phone call. I then said to my husband “you know I heard him right?” My husband, in my opinion, was not going to say anything to me and hoped that I did not hear what I just heard. My husband then stated ‘oh you’re taking this out of context, don’t read anything into what he said.’ That set me off more because at this point I feel disrespected by my husband. My husband is very close to his brother and knows that his brother isn’t my cup of tea. After basically arguing for most of the night, my husband finally agreed to call the brother the next morning, putting him back on speakerphone and asked him what he meant by the earlier statement. This time, the brother knew that I was on speaker as well. Of course he fixed up some cute little excuse to say he was just concerned about his stomach issues. I didn’t buy it and I’m so furious that my husband chose to believe the BS that he was served. I feel that he places his brother’s feelings above mine and that he could care less that I’m hurt. I find it very disrespectful that they could go on the next day laughing and talking as if nothing ever happened. This is a form of disrespect and he would rather ensure that his brother’s feelings are intact and let me, as his wife, suffer am I wrong?