Before diving into solutions, it helps to understand the scale of the problem.Take a common production pattern: a customer support bot that processes 10,000 messages per day, each with a 2,000-token system prompt and a 200-token user message.