Any loss in support from the bulk of the electorate could spell trouble for the President in next year’s midterms.