EXCLUSIVE: Lady Cathy, who hated the detective series, stormed off saying she would not let him take the job