The former Britain’s Got Talent judge has been accused of sexual misconduct and grooming girls as young as 15