Freedom of Speech also means Freedom to not listen to what you have to say.

Just because you can say whatever you want. Doesn't mean that other people have to agree with your speech, read or listen to it even.