https://github.com/memodb-io/memory-benchmark
Run benchmark results for long-term memory backends
https://github.com/memodb-io/memory-benchmark
Last synced: 3 months ago
JSON representation
Run benchmark results for long-term memory backends
- Host: GitHub
- URL: https://github.com/memodb-io/memory-benchmark
- Owner: memodb-io
- License: mit
- Created: 2025-02-25T10:44:13.000Z (4 months ago)
- Default Branch: main
- Last Pushed: 2025-03-20T15:12:35.000Z (3 months ago)
- Last Synced: 2025-03-20T16:26:44.020Z (3 months ago)
- Language: Python
- Homepage:
- Size: 18.6 KB
- Stars: 0
- Watchers: 0
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: readme.md
- License: LICENSE
Awesome Lists containing this project
README
memory-benchmark
Run benchmark results for long-term memory backends
## Get Started
### 1. Install
```bash
# from source
git clone https://github.com/memodb-io/memory-benchmark.git
cd memory-benchmark
pip install -e .
# install from pypi
pip install memory-benchmark
```
### 2. Setup
```python
from memory_benchmark import CONFIG
CONFIG.llm_api_key = "YOUR OPENAI KEY"
```
### 3. Run the default benchmark.
```python
import asyncio
from memory_benchmark import run_memory_benchmark
asyncio.run(run_memory_benchmark())
```
### Expected Results
```python
TODO
```
## Support Datasets
- [ ] [LOCOMO](https://snap-research.github.io/locomo/) (default)
## Support Methods
- [ ] Long-context LLM (default)
- [ ] [Memobase](https://github.com/memodb-io/memobase)
- [ ] [AgenticMemory](https://github.com/WujiangXu/AgenticMemory/tree/main)
- [ ] [Mem0](https://github.com/mem0ai/mem0)
- [ ] [MemGPT](https://github.com/letta-ai/letta)
- [ ] [Zep](https://github.com/getzep/zep)