https://github.com/ak9024/ask-llm-rs

CLI build with Rust to interact with any LLM services.
https://github.com/ak9024/ask-llm-rs

llm rust

Last synced: 12 days ago
JSON representation

CLI build with Rust to interact with any LLM services.

• Host: GitHub
• URL: https://github.com/ak9024/ask-llm-rs
• Owner: ak9024
• License: mit
• Created: 2024-09-18T06:56:02.000Z (2 months ago)
• Default Branch: main
• Last Pushed: 2024-09-18T07:10:07.000Z (2 months ago)
• Last Synced: 2024-09-18T09:25:28.974Z (2 months ago)
• Topics: llm, rust
• Language: Rust
• Homepage:
• Size: 333 KB
• Stars: 0
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

        
# ask-llm-rs

![GitHub Actions Workflow Status](https://img.shields.io/github/actions/workflow/status/ak9024/ask-llm-rs/rust.yml) 

![GitHub License](https://img.shields.io/github/license/ak9024/ask-llm-rs)

![demo](./demo.png)

CLI build with Rust to interact with any LLM services.

## Usage

```bash

# create .env

cp .env.example .env

cargo run

```

Using Local LLM services

- [localAi](https://localai.io/)

```

LLM_BASE_URL=http://localhost:3928/v1/chat/completions

LLM_API_KEY=

LLM_MODEL=

```

Using Managed [LLM](https://en.wikipedia.org/wiki/Large_language_model) Services

- [OpenAI](https://platform.openai.com/)

```

LLM_BASE_URL=https://api.openai.com/v1/chat/completions

LLM_API_KEY=

LLM_MODEL=gpt-3.5-turbo

```

- [Claude](https://www.anthropic.com/api)

```

LLM_BASE_URL=https://api.anthropic.com/v1/messages

LLM_API_KEY=

LLM_MODEL=claude-3-5-sonnet-20240620

```

## License

MIT