Ralf Little spent four series playing Detective Inspector Neville Parker on Death in Paradise before quitting the show last year, leaving his own mum worried about his future career