Uganda had quit Prince Harry's Invictus Games but returned after a personal call from King Charles' most senior aide.