Andrew's time as special representative for international trade and investment has faced increased scrutiny, and now it's been claimed that he once made a "gratuitously rude" comment