The former president said Americans have votes for a ‘politics that brings people together rather than divides them’