The comments were widely condemned by Democrats and a lone Republican running for Congress in San Diego