‘I don’t want to be on camera this week, and I’ve been on camera more than any other week,’ Colorado Republican says