https://github.com/aianytime/llm-inference-api-in-rust

LLM Inference API in Rust. It also has a streamlit app that requests the running API in Rust.
https://github.com/aianytime/llm-inference-api-in-rust

Last synced: 11 months ago
JSON representation

LLM Inference API in Rust. It also has a streamlit app that requests the running API in Rust.

• Host: GitHub
• URL: https://github.com/aianytime/llm-inference-api-in-rust
• Owner: AIAnytime
• License: mit
• Created: 2023-09-24T14:25:35.000Z (over 2 years ago)
• Default Branch: main
• Last Pushed: 2023-09-24T14:30:36.000Z (over 2 years ago)
• Last Synced: 2025-03-26T17:47:39.156Z (about 1 year ago)
• Language: Rust
• Size: 21.5 KB
• Stars: 20
• Watchers: 1
• Forks: 8
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

          
# LLM-Inference-API-in-Rust

LLM Inference API in Rust. It also has a streamlit app that requests the running API in Rust.