I agree that's true, you could use either. But I think it's more clearly stated to use babies, especially if you're assuming he's having both babies with one person - a singular 'whom'.
Although I acknowledge, he could be having these babies with more than one unidentified 'whom'.
Grammatically both work - but using one or the other dependent upon the truth you're trying to communicate about the situation - would enhance clarity.