Large language models (LLMs), such as ChatGPT and Claude, are increasingly being used to provide health information to the public.