I take your point. I wonder if we use any phonemes purposefully. Stop t's, aspirated t's and flap t's exist because of their local physical environments in the utterance, and I don't think we have any minimal pairs that depend on the differences between these /t/ sounds.
It's obvious, though, that I will have to start considering the bigger picture. Thanks.