Would-be buyers have endured a wild year for mortgage rates, and borrowing costs could climb even higher.