The Republicans are set to lose 36 lawmakers going into the midterms, which is almost double the number of Democrats leaving.