https://github.com/wronai/llm-demo
minimalne rozwiązanie z Ollama + Streamlit, by stworzyć własny model LLM
https://github.com/wronai/llm-demo
cline codemistral codestral cursor demo devmistral hf huggingface llm local mistral model ollama windsur
Last synced: 2 months ago
JSON representation
minimalne rozwiązanie z Ollama + Streamlit, by stworzyć własny model LLM
- Host: GitHub
- URL: https://github.com/wronai/llm-demo
- Owner: wronai
- License: apache-2.0
- Created: 2025-06-04T13:35:47.000Z (about 1 year ago)
- Default Branch: main
- Last Pushed: 2025-06-04T22:04:04.000Z (about 1 year ago)
- Last Synced: 2025-08-25T04:04:21.236Z (10 months ago)
- Topics: cline, codemistral, codestral, cursor, demo, devmistral, hf, huggingface, llm, local, mistral, model, ollama, windsur
- Language: Python
- Homepage: https://wronai.github.io/llm-demo/
- Size: 317 KB
- Stars: 0
- Watchers: 0
- Forks: 1
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- Contributing: CONTRIBUTING.md
- License: LICENSE
- Code of conduct: CODE_OF_CONDUCT.md
Awesome Lists containing this project
README
---
license: apache-2.0
base_model:
- mistralai/Mistral-7B-Instruct-v0.3
pipeline_tag: translation
tags:
- llm
- devops
- development
- polish
- english
- python
- iac
---
# 🚀 WronAI - End-to-End LLM Toolkit
[](https://pypi.org/project/wronai/)
[](https://python.org)
[](https://github.com/wronai/llm-demo/blob/main/LICENSE)
[](https://github.com/wronai/llm-demo/actions)
[](https://github.com/psf/black)
[](https://wronai.readthedocs.io/)
[](https://hub.docker.com/r/wronai/wronai)
> A comprehensive toolkit for creating, fine-tuning, and deploying large language models with support for both Polish and English.
## 🌟 Features
- **Ready-to-use WronAI package** - All functionality available through the `wronai` package
- **Model Management** - Easy installation and management of LLM models
- **Multiple Model Support** - Works with various models via Ollama
- **Optimizations** - 4-bit quantization, LoRA, FP16 support
- **CLI Tools** - Command-line interface for all operations
- **Production Ready** - Easy deployment with Docker
- **Web Interface** - User-friendly Streamlit-based web UI
## 🚀 Quick Start
### Prerequisites
- Python 3.8+
- [Ollama](https://ollama.ai/) installed and running
- CUDA (optional, for GPU acceleration)
### Installation
```bash
# Install the package
pip install wronai
# Start Ollama (if not already running)
ollama serve &
# Pull the required model (e.g., mistral:7b-instruct)
ollama pull mistral:7b-instruct
```
### Basic Usage
#### Using Python Package
```python
from wronai import WronAI
# Initialize with default settings
wron = WronAI()
# Chat with the model
response = wron.chat("Explain quantum computing in simple terms")
print(response)
```
#### Command Line Interface
```bash
# Start interactive chat
wronai chat
# Run a single query
wronai query "Explain quantum computing in simple terms"
```
#### Web Interface
```bash
# Start the web UI
wronai web
```
## 🔧 Model Management
List available models:
```bash
ollama list
```
Pull a model (if not already available):
```bash
ollama pull mistral:7b-instruct
```
## 🐳 Docker Support
Run with Docker:
```bash
docker run -p 8501:8501 wronai/wronai web
```
## 🛠️ Development
### Installation from Source
```bash
# Clone the repository
git clone https://github.com/wronai/llm-demo.git
cd llm-demo
# Install in development mode
pip install -e ".[dev]"
# Install pre-commit hooks
pre-commit install
```
### Running Tests
```bash
# Run all tests
pytest
# Run with coverage
pytest --cov=wronai --cov-report=term-missing
```
## 🤝 Contributing
Contributions are welcome! Please see our [Contributing Guide](CONTRIBUTING.md) for details.
## 📜 License
This project is licensed under the Apache 2.0 License - see the [LICENSE](LICENSE) file for details.
## 📧 Contact
For questions or support, please open an issue on GitHub or contact us at [email protected]