https://github.com/ghostwalker562/rust_local_llm

https://github.com/ghostwalker562/rust_local_llm

Last synced: 23 days ago
JSON representation

• Host: GitHub
• URL: https://github.com/ghostwalker562/rust_local_llm
• Owner: GhostWalker562
• Created: 2024-06-01T05:59:52.000Z (7 months ago)
• Default Branch: master
• Last Pushed: 2024-06-01T06:00:16.000Z (7 months ago)
• Last Synced: 2024-12-15T07:30:46.906Z (27 days ago)
• Language: Rust
• Size: 291 KB
• Stars: 0
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

        
# CSS498 - Rust Local LLM Project

This is a project for the CSS498 course at the University of Washington. The project is a Rust implementation of interfaces to local LLMs that can provide an end-to-end speech-to-text system.

## Pre-requisites

You must have the following programs installed on your machine to run the project:

- [Ollama](https://ollama.com/)

- [TTS](https://github.com/coqui-ai/TTS)

- [Whisper](https://github.com/openai/whisper)

- [Rust](https://www.rust-lang.org/)

## Usage

To use the project, you must have the pre-requisites installed on your machine. You can then run the project with the following command:

```bash

cargo run

```

## Architecture

The project is divided into the following modules:

- `ollama`: This module contains the interface to the Ollama LLM.

- `tts`: This module contains the interface to the TTS LLM.

- `whisper`: This module contains the interface to the Whisper LLM.

### Visual Representation