Stacey Solomon and Joe Swash have been married for four years and share three children together, but the couple have said that they wish they could get away together more