Yes--it seems it is your right. It's just so terribly bad mannered and an unutterable nuisance. Imagine the game being played by others who are ignoring some of the players.
Are you trying to bring the game to an end? You're ignoring Intrepid now you said and Intrepid plays the game from time to time. You'll end up playing just with Dutchy because he doesn't do arguing and then you'll get fed up with it and leave him high and dry.
You would get thrown out of every pub I've ever been in with tactics like that.