Several high-profile food recalls have been issued this summer, and it could be denting consumer confidence.