The mum-of-five previously revealed her upset that Harvey wouldn't be able to return to his £350,000 a year residential college because of his behaviour