Clare Balding was left "most annoyed" by her guesses of who the Celebrity Traitors were after she was banished in the fourth episode of the BBC primetime programme