Midterms are usually not something for investors to worry about. Yes, the political noise can drives volatility, but rarely do they have a long-term impact on market direction.