Prompt Caching in the API

Offering automatic discounts on inputs that the model has recently seen