https://github.com/zilliztech/GPTCache

Semantic cache for LLMs. Fully integrated with LangChain and llama_index.
https://github.com/zilliztech/GPTCache

aigc autogpt babyagi chatbot chatgpt chatgpt-api dolly gpt langchain llama llama-index llm memcache milvus openai redis semantic-search similarity-search vector-search

Last synced: about 1 month ago
JSON representation

Semantic cache for LLMs. Fully integrated with LangChain and llama_index.

• Host: GitHub
• URL: https://github.com/zilliztech/GPTCache
• Owner: zilliztech
• License: mit
• Created: 2023-03-24T05:51:16.000Z (over 1 year ago)
• Default Branch: main
• Last Pushed: 2024-07-26T03:29:44.000Z (about 2 months ago)
• Last Synced: 2024-07-30T02:09:40.692Z (about 1 month ago)
• Topics: aigc, autogpt, babyagi, chatbot, chatgpt, chatgpt-api, dolly, gpt, langchain, llama, llama-index, llm, memcache, milvus, openai, redis, semantic-search, similarity-search, vector-search
• Language: Python
• Homepage: https://gptcache.readthedocs.io
• Size: 22.3 MB
• Stars: 6,961
• Watchers: 59
• Forks: 491
• Open Issues: 64
• Metadata Files:
  • Readme: README.md
  • Contributing: docs/contributing.md
  • License: LICENSE

Awesome Lists containing this project

• awesome - zilliztech/GPTCache - Semantic cache for LLMs. Fully integrated with LangChain and llama\_index. (Python)
• awesome-open-gpt - GPTCache
• awesome-langchain-zh - GPTCache
• awesome-chatgpt - GPTCache - Semantic cache to store responses from LLM queries. (Packages / Python)
• awesome - zilliztech/GPTCache - Semantic cache for LLMs. Fully integrated with LangChain and llama_index. (Python)
• awesome-llmops - GPTCache - square) | (LLMOps / Observability)
• Awesome-AITools - GitHub
• awesome-llm-eval - GPTCache
• AiTreasureBox - zilliztech/GPTCache - 09-08_7063_0](https://img.shields.io/github/stars/zilliztech/GPTCache.svg) |GPTCache is a library for creating semantic cache to store responses from LLM queries.| (Repos)
• awesome-langchain - GPTCache
• StarryDivineSky - zilliztech/GPTCache
• awesome-chatgpt - GPTCache - Semantic cache to store responses from LLM queries. (Packages / Python)
• awesome-chatgpt - zilliztech/GPTCache - GPTCache is a Python library that provides a semantic cache for large language models (LLMs). It integrates with projects like LangChain and llama_index, helping developers optimize LLM API costs and boost response speed. (SDK, Libraries, Frameworks / Python)
• awesome-gpt - GPTCache
• awesome-production-machine-learning - GPTCache - GPTCache is a library for creating semantic cache for large language model queries. (Data Storage Optimisation)
• jimsghstars - zilliztech/GPTCache - Semantic cache for LLMs. Fully integrated with LangChain and llama_index. (Python)
• Awesome-ChatGPT - GPTCache