Prompt Caching #33
Description
Users should have a way to cache prompts so that they can improve the performance of their app and reduce GPT query spend.
MVP should be a local query, suitable for local development.
Enhancements will probably start with Redis, possibly with VSS.
If you have another use case or idea, please leave a comment.