https://github.com/unknownrori/llm-wrapper

Rust LLM GGML Crate Wrapper
https://github.com/unknownrori/llm-wrapper

Last synced: about 4 hours ago
JSON representation

Rust LLM GGML Crate Wrapper

• Host: GitHub
• URL: https://github.com/unknownrori/llm-wrapper
• Owner: UnknownRori
• License: bsd-3-clause
• Created: 2023-08-12T20:52:58.000Z (over 1 year ago)
• Default Branch: main
• Last Pushed: 2023-08-15T04:47:04.000Z (over 1 year ago)
• Last Synced: 2023-08-15T05:50:30.932Z (over 1 year ago)
• Language: Rust
• Homepage:
• Size: 9.77 KB
• Stars: 0
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

        
# LLM Wrapper

A simple wrapper of [LLM Crate](https://crates.io/crates/llm) to simplify text generation, prompts and other stuff

## 🛠️ Development

```bash

# Clone the repository and enter the directory

git clone https://github.com/UnknownRori/llm-wrapper

cd llm-wrapper

# Build the project

cargo build --release

# Download the ggml model from https://github.com/rustformers/llm#getting-models

# or using the ./scripts using instruction from https://github.com/ggerganov/ggml/tree/master/examples

```

## 🚀 Usage on other project

```bash

# Add this package to your project

cargo add --git https://github.com/UnknownRori/llm-wrapper

```

## 🌟 Contribution

Feel free to contribute, send pull request or issue and i will take a look