What to include in a RAG cost estimate
A RAG request usually includes the user question, system instructions, retrieved document chunks and the generated answer. The retrieved chunks are often the biggest hidden cost because they are sent on every query.
For a practical first estimate, paste a typical user question plus representative retrieved context into the calculator, then scale it by expected monthly queries.
| RAG component | Typical token range | Why it matters |
|---|---|---|
| User question | 20-150 | Usually small, but present on every request |
| System instructions | 200-800 | Can often be cached or shortened |
| Retrieved context | 1,000-8,000 | Main driver of input-token cost |
| Generated answer | 200-800 | Drives output-token cost |