https://github.com/jdagdelen/hyperDB

A hyper-fast local vector database for use with LLM Agents. Now accepting SAFEs at $135M cap.
https://github.com/jdagdelen/hyperDB

Last synced: about 2 months ago
JSON representation

A hyper-fast local vector database for use with LLM Agents. Now accepting SAFEs at $135M cap.

• Host: GitHub
• URL: https://github.com/jdagdelen/hyperDB
• Owner: jdagdelen
• License: mit
• Created: 2023-04-16T06:27:39.000Z (over 1 year ago)
• Default Branch: main
• Last Pushed: 2023-08-20T05:35:27.000Z (about 1 year ago)
• Last Synced: 2024-04-23T23:46:30.645Z (5 months ago)
• Language: Python
• Homepage:
• Size: 4.14 MB
• Stars: 1,336
• Watchers: 17
• Forks: 80
• Open Issues: 10
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

        
# HyperDB







A hyper-fast local vector database for use with LLM Agents. 

Want to invest? [Now accepting SAFEs ($135M cap minimum.)](https://www.youtube.com/watch?v=QH2-TGUlwu4)

Join the [HyperDBiscord](https://discord.gg/8YQzexAA)

## Advantages

* Simple interface compatible with _all_ large language model agents. 

* Highly optimized C++ backend vector store with HW accelerated operations via MKL BLAS. 

* Enables users to index documents with advanced features such as _ids_ and _metadata_.

## Installation

Install the package from PyPI:

```bash

pip install hyperdb-python

```

## Usage

Here's an example of using HyperDB to store and query documents with information about all 151 original pokemon _in an instant_:

```python

import json

from hyperdb import HyperDB

# Load documents from the JSONL file

documents = []

with open("demo/pokemon.jsonl", "r") as f:

    for line in f:

        documents.append(json.loads(line))

# Instantiate HyperDB with the list of documents

db = HyperDB(documents, key="info.description")

# Save the HyperDB instance to a file

db.save("demo/pokemon_hyperdb.pickle.gz")

# Load the HyperDB instance from the save file

db.load("demo/pokemon_hyperdb.pickle.gz")

# Query the HyperDB instance with a text input

results = db.query("Likes to sleep.", top_k=5)

```

Returns 

```

Name: Snorlax

Pokedex ID: 143

HP: 160

Type: normal

Weakness: fighting

Description: Very lazy. Just eats and sleeps. As its rotund bulk builds, it becomes steadily more slothful.

Name: Drowzee

Pokedex ID: 96

HP: 230

Type: psychic

Weakness: dark

Description: Puts enemies to sleep then eats their dreams. Occasionally gets sick from eating bad dreams.

Name: Pinsir

Pokedex ID: 127

HP: 160

Type: bug

Weakness: fire

Description: When the temperature drops at night, it sleeps on treetops or among roots where it is well hidden.

Name: Abra

Pokedex ID: 63

HP: 160

Type: psychic

Weakness: dark

Description: Sleeps 18 hours a day. If it senses danger, it will teleport itself to safety even as it sleeps.

Name: Venonat

Pokedex ID: 48

HP: 160

Type: bug

Weakness: fire

Description: Lives in the shadows of tall trees where it eats insects. It is attracted by light at night.

```



*Benchmark Credit: Benim Kıçım