Cached input helps repeated prompts
Some models offer lower pricing for cached or reused input tokens. This matters for apps that send the same system instructions, policy text or tool schema on many requests.
Enter stable prompt content as system instruction tokens and adjust cached input percentage in Advanced Settings to estimate the impact.
| Reusable input | Good caching candidate? | Reason |
|---|---|---|
| System prompt | Yes | Often repeated on every request |
| Tool schema | Yes | Usually stable across calls |
| User message | No | Usually different each request |