https://github.com/sirredbeard/gnomephichat
Simple .NET LLM chat application.
https://github.com/sirredbeard/gnomephichat
dotnet gtk gtksharp linux llm phi3 windows
Last synced: about 1 year ago
JSON representation
Simple .NET LLM chat application.
- Host: GitHub
- URL: https://github.com/sirredbeard/gnomephichat
- Owner: sirredbeard
- License: mit
- Created: 2024-09-09T16:29:30.000Z (almost 2 years ago)
- Default Branch: main
- Last Pushed: 2024-10-02T21:04:21.000Z (over 1 year ago)
- Last Synced: 2024-10-10T17:01:34.334Z (over 1 year ago)
- Topics: dotnet, gtk, gtksharp, linux, llm, phi3, windows
- Language: C#
- Homepage:
- Size: 704 KB
- Stars: 2
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# GNOME Phi Chat
Simple GTK3 LLM chat application written using .NET powered by Phi-3-mini.
Uses:
* .NET 9
* GTK# for Linux and Windows (bundles GTK# Runtime for Windows)
* [ONNX Runtime GenAI](https://github.com/microsoft/onnxruntime-genai)
Supports:
* Windows and Linux on x64
* Windows on Arm only functions via emulation due to a limitation in GTK#
* Linux on Arm requires building QNNX dependencies from source
## Download model and data:
```
huggingface-cli download microsoft/Phi-3-mini-4k-instruct-onnx --include cpu_and_mobile/cpu-int4-rtn-block-32-acc-level-4/* --local-dir Phi-3-mini-4k-instruct-onnx
```
## Build
```
dotnet restore
dotnet build
dotnet run
```