https://github.com/adrianliechti/llama-embeddings
Embeddings API
https://github.com/adrianliechti/llama-embeddings
ai embeddings huggingface jinaai transformer
Last synced: 3 months ago
JSON representation
Embeddings API
- Host: GitHub
- URL: https://github.com/adrianliechti/llama-embeddings
- Owner: adrianliechti
- License: mit
- Created: 2024-09-15T11:00:14.000Z (9 months ago)
- Default Branch: main
- Last Pushed: 2024-09-16T07:28:43.000Z (9 months ago)
- Last Synced: 2024-09-16T13:25:45.023Z (9 months ago)
- Topics: ai, embeddings, huggingface, jinaai, transformer
- Language: Python
- Homepage:
- Size: 10.7 KB
- Stars: 0
- Watchers: 2
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# LLM Platform Embeddings
A simple FastAPI/Transformers Embeddings implementation mimics the [Jina AI Embeddings API](https://jina.ai/embeddings).
Defaults to [jinaai/jina-embeddings-v3](https://huggingface.co/jinaai/jina-embeddings-v3). Can be overwritten using `MODEL` environment variable.
```bash
# Using Embeddings Model
docker run -it --rm -p 8000:8000 -e MODEL=jinaai/jina-embeddings-v3 ghcr.io/adrianliechti/llama-embeddings
# Using CLIP Model
docker run -it --rm -p 8000:8000 -e MODEL=jinaai/jina-clip-v2 ghcr.io/adrianliechti/llama-embeddings
```
## Text Embeddings
Using [jinaai/jina-embeddings-v3](https://huggingface.co/jinaai/jina-embeddings-v3)
```bash
curl http://localhost:8000/v1/embeddings \
-H "Content-Type: application/json" \
-d '{
"input": [
"A blue cat",
"A red dog",
{"text": "btw to represent image u can either use URL or encode image into base64 like below."}
]
}'
```
```json
{
"object": "list",
"model": "jinaai/jina-embeddings-v3",
"data": [
{
"object": "embedding",
"index": 0,
"embedding": [
-0.008155452087521553,
0.004017454106360674,
...
]
},
{
"object": "embedding",
"index": 1,
"embedding": [
-0.03279036656022072,
0.005651661194860935,
...
]
},
{
"object": "embedding",
"index": 2,
"embedding": [
-0.04352213442325592,
0.014829625375568867,
...
]
}
]
}
```
## Mixed Embeddings
Using [jinaai/jina-clip-v2](https://huggingface.co/jinaai/jina-clip-v2)
```bash
curl http://localhost:8000/v1/embeddings \
-H "Content-Type: application/json" \
-d '{
"input": [
"A blue cat",
"A red dog",
{"text": "btw to represent image u can either use URL or encode image into base64 like below."},
{"image": "https://i.pinimg.com/600x315/21/48/7e/21487e8e0970dd366dafaed6ab25d8d8.jpg"},
{"image": "R0lGODlhEAAQAMQAAORHHOVSKudfOulrSOp3WOyDZu6QdvCchPGolfO0o/XBs/fNwfjZ0frl3/zy7////wAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAACH5BAkAABAALAAAAAAQABAAAAVVICSOZGlCQAosJ6mu7fiyZeKqNKToQGDsM8hBADgUXoGAiqhSvp5QAnQKGIgUhwFUYLCVDFCrKUE1lBavAViFIDlTImbKC5Gm2hB0SlBCBMQiB0UjIQA7"}
]
}'
```
```json
{
"object": "list",
"model": "jinaai/jina-clip-v2",
"data": [
{
"object": "embedding",
"index": 0,
"embedding": [
-0.008155452087521553,
0.004017454106360674,
...
]
},
{
"object": "embedding",
"index": 1,
"embedding": [
-0.03279036656022072,
0.005651661194860935,
...
]
},
{
"object": "embedding",
"index": 2,
"embedding": [
-0.04352213442325592,
0.014829625375568867,
...
]
},
{
"object": "embedding",
"index": 3,
"embedding": [
-0.02155349962413311,
0.010659383609890938,
...
]
},
{
"object": "embedding",
"index": 4,
"embedding": [
-0.04216967895627022,
0.017293065786361694,
...
]
}
]
}
```