https://github.com/no9/clowt

A sample RAG implementation in Rust
https://github.com/no9/clowt

Last synced: 5 days ago
JSON representation

A sample RAG implementation in Rust

• Host: GitHub
• URL: https://github.com/no9/clowt
• Owner: No9
• License: mit
• Created: 2023-12-25T00:08:25.000Z (almost 1 year ago)
• Default Branch: main
• Last Pushed: 2023-12-27T23:36:58.000Z (12 months ago)
• Last Synced: 2024-10-31T06:06:43.133Z (about 2 months ago)
• Language: Rust
• Size: 8.79 KB
• Stars: 1
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

        
# clowt

A sample RAG implementation in Rust based on the watsonx example.

https://dataplatform.cloud.ibm.com/exchange/public/entry/view/ebeb9fc0-9844-4838-aff8-1fa1997d0c13?context=wx&audience=wdp

## notes

1. Services used in this example can be provisioned using OpenTofu and the definitions in the [infra](./infra) of this project

1. Only tested on Linux

1. Install libtorch 

   Download https://download.pytorch.org/libtorch/cu118/libtorch-cxx11-abi-shared-with-deps-2.1.0%2Bcu118.zip and set up exports

   ```

   export LIBTORCH=/DOWNLOAD_PATH/libtorch-cxx11-abi-shared-with-deps-2.1.0+cu118/libtorch

   export LD_LIBRARY_PATH=${LIBTORCH}/lib:$LD_LIBRARY_PATH

   ```

   It's recommmended to add these to your global environment variables so that rust-analyzer doesn't produce warnings.