"I'm hopeful that it holds," the former president said, while raising concern that the U.S. is "worse" off.