Lots of places already exclude hate speech from free speech, for an example I am familiar with (because I live there), Australia has a right to freedom of expression and opinion but does not protect speech that incites discrimination, among other things. As far as I’m concerned that is still a right to free speech, not the least because hate speech inherently limits the voice of its victims.