A rate hike could increase borrowing costs, but experts seem to believe things cannot get much worse for homebuyers than they are.