King Charles' brother Andrew Mountbatten-Windsor's former home at Royal Lodge is like a 'ghost town' after his move, according to a new report.