It was always going to be a tough night for fans of the BBC1 show but the celebrity voted out of the quarter finals proved hugely controversial