GPTCache
Semantic cache for LLM queries that reuses similar past responses — cuts token cost by up to 100x and improves latency for ChatGPT, LangChain, and OpenAI apps.
Tags
Open Source · LLM Cache · Cost Optimization · Free · Self-Hostable · Semantic Search · GPTCache · free tools · free ai tools · no cost