https://github.com/pnocera/cembedd

Embeddings rust API serving intfloat/multilingual-e5-large using huggingface/candle with CUDA enabled
https://github.com/pnocera/cembedd

bert cuda huggingface

Last synced: 5 months ago
JSON representation

Embeddings rust API serving intfloat/multilingual-e5-large using huggingface/candle with CUDA enabled

• Host: GitHub
• URL: https://github.com/pnocera/cembedd
• Owner: pnocera
• Created: 2023-09-15T13:22:14.000Z (almost 3 years ago)
• Default Branch: main
• Last Pushed: 2023-09-15T13:31:04.000Z (almost 3 years ago)
• Last Synced: 2024-01-27T18:04:43.790Z (over 2 years ago)
• Topics: bert, cuda, huggingface
• Language: Rust
• Homepage:
• Size: 24.4 KB
• Stars: 2
• Watchers: 1
• Forks: 1
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

          
cargo new cembedd

cd cembedd

cargo add --git https://github.com/huggingface/candle.git candle-core --rename candle --features "cuda"

cargo add --git https://github.com/huggingface/candle.git candle-nn --rename candle_nn --features "cuda"

cargo add hf-hub --rename hf_hub --features "tokio"

cargo add serde_json

cargo add lazy_static

cargo add anyhow

cargo add tokenizers --default-features=false --features="hf-hub"

cargo add warp

cargo add serde --features derive

cargo add chrono --features serde

cargo add tokio --features full

cargo add pretty_env_logger

## build and run

cargo build --release

./target/release/cembedd

see test.http for example requests