Pinarayi Vijayan says he was only criticising ‘political betrayal’ and questions backlash over his choice of words