https://github.com/sirredbeard/gnomephichat

Simple .NET LLM chat application.
https://github.com/sirredbeard/gnomephichat

dotnet gtk gtksharp linux llm phi3 windows

Last synced: 3 months ago
JSON representation

Simple .NET LLM chat application.

• Host: GitHub
• URL: https://github.com/sirredbeard/gnomephichat
• Owner: sirredbeard
• License: mit
• Created: 2024-09-09T16:29:30.000Z (5 months ago)
• Default Branch: main
• Last Pushed: 2024-10-02T21:04:21.000Z (4 months ago)
• Last Synced: 2024-10-10T17:01:34.334Z (4 months ago)
• Topics: dotnet, gtk, gtksharp, linux, llm, phi3, windows
• Language: C#
• Homepage:
• Size: 704 KB
• Stars: 2
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

        
# GNOME Phi Chat

Simple GTK3 LLM chat application written using .NET powered by Phi-3-mini.

![image](https://github.com/user-attachments/assets/e75189ba-cbb7-4e18-b58a-1a99703d48cb)

Uses:

* .NET 9

* GTK# for Linux and Windows (bundles GTK# Runtime for Windows)

* [ONNX Runtime GenAI](https://github.com/microsoft/onnxruntime-genai)

## Download model and copy into place:

```

huggingface-cli download microsoft/Phi-3-mini-4k-instruct-onnx --include cpu_and_mobile/cpu-int4-rtn-block-32-acc-level-4/* --local-dir temp-dir

mv temp-dir/cpu_and_mobile/cpu-int4-rtn-block-32-acc-level-4/* Phi-3-mini-4k-instruct-onnx/cpu-int4-rtn-block-32-acc-level-4/

rm temp-dir

```

## Build

```

dotnet restore

dotnet build

dotnet run

```