OpenAI has updated its spider/crawler it uses for ChatGPT, OAI-SearchBot. The AI company updated the description and details of the crawler information removing that it is used for links and to train OpenAI's generative AI foundation models.