The children's hospice charity says it would be inappropriate for the former wife of Prince Andrew to continue as a patron of the charity.