It becomes a lot less complicated when you consider tolerance a social contract: I tolerate you, as long as you tolerate me.
When someone supports policy that does not meet these criteria they no longer adhere to the social contract, and are thus also no longer protected by it.