Yes, that is the only legal meaning of "freedom of speech" in America, but apparently a fair amount of people believe individuals should voluntarily grant the freedom to each other more often. Now, if you want to say "I will not be tolerant of intolerance" or "When they ask for that freedom, it's code for demanding they get what they want", fine, but at least it's now a conversation, instead of just shutting it down with this response every time.