Tolerance is a moral or ethic, not a contract. Like other aspects of morality, it continues to apply to people who violate it, otherwise it would be legitimate to, e.g., lie to a liar, steal from a thief or, indeed, to murder a murderer.

If you don’t believe those responses are legitimate, you have to construct an argument as to why tolerance is a special case among the other morals.