Simon Cowell’s Britain’s Got Talent co-star insisted he was surprised by how others perceive the judge after working behind the scenes on the latest series