Prince's Harry's spokesperson says an offer to stay was "withdrawn at the last moment," which the Palace denies