A royal expert has expressed his fears for the future of the iconic London royal residence as the King and Queen seem content in Clarence House, while the Prince and Princess of Wales have made their home in Windsor