Prince Harry will stay at Buckingham Palace but without Meghan Markle, Prince Archie and Princess Lilibet.