What do you mean ‘special needs?’
My younger son is autistic, he has special needs.
You shouldn’t use the term unless you’re talking about someone who genuinely has special needs, not just someone who is a complete pain.
If your brother really did have special needs you should have been more understanding.
If not then please stop using it in a pejorative manner, it’s offensive.