https://github.com/patw/breadrank

A small reranker service using mixedbread.ai reranker model
https://github.com/patw/breadrank

mixedbread rag reranker

Last synced: 29 days ago
JSON representation

A small reranker service using mixedbread.ai reranker model

• Host: GitHub
• URL: https://github.com/patw/breadrank
• Owner: patw
• License: mit
• Created: 2024-04-03T00:06:27.000Z (9 months ago)
• Default Branch: main
• Last Pushed: 2024-04-03T00:53:03.000Z (9 months ago)
• Last Synced: 2024-05-07T18:23:06.907Z (8 months ago)
• Topics: mixedbread, rag, reranker
• Language: Python
• Homepage:
• Size: 4.88 KB
• Stars: 2
• Watchers: 2
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

        
# BreadRank

A small reranker API service powered by mixedbred.ai reranker model.  It's currently using the mxbai-rerank-xsmall-v1 model.

## Local Installation

```

pip install -r requirements.txt

```

## Local Running

```

uvicorn main:app --host 0.0.0.0 --port 3007

```

## Docker

```

docker build -t breadrank .

docker run -d -p 3007:3007 breadrank

```

**Warning**: The first run will be VERY slow to load

Visit `http://localhost:3007/docs` in a browser once it's loaded

Call it in python like this:

```

import requests

import json

# Define the URL of your FastAPI endpoint

url = "http://localhost:3007/rerank/"

# Define the data you want to send to the endpoint

query = "Your query here"

documents = ["Document 1", "Document 2", "Document 3"]

top_k = 2

data = {"query": query, "documents": documents, "top_k": top_k}

# Make the POST request

response = requests.post(url, json=data)

# Print the response

if response.status_code == 200:

    print(json.dumps(response.json(), indent=4))

else:

    print(f"Request failed with status code {response.status_code}")

```