‘I am quitting from all works related to the association. This is not out of fear,’ says Baburaj in a social media post