prompt caching

[ prompt KASH-ing ]noun

Sending the unchanging chunk of your prompt over and over at a discount, instead of paying full price every time.

Explanation

The biggest saving most solo builders never switch on. Put the parts that never change first and the parts that do change last, and the savings arrive without you rewriting a word.

Related words

• token — The unit an AI reads and writes: roughly a short word, or a piece of a longer one.
• system prompt — Standing instructions that apply to every message in a conversation, sitting behind whatever you type.