Reform insisted people would ‘sympathise’ with the comments, but councillors say it has sparked fear in the community