https://github.com/bruceunx/llama-python-gui

llama python gui
https://github.com/bruceunx/llama-python-gui

chatbot chatgpt llama2 llamacpp pyside6

Last synced: 5 months ago
JSON representation

llama python gui

• Host: GitHub
• URL: https://github.com/bruceunx/llama-python-gui
• Owner: bruceunx
• Created: 2024-02-21T10:17:26.000Z (over 2 years ago)
• Default Branch: main
• Last Pushed: 2024-04-17T11:10:44.000Z (about 2 years ago)
• Last Synced: 2026-01-12T18:12:11.921Z (6 months ago)
• Topics: chatbot, chatgpt, llama2, llamacpp, pyside6
• Language: Python
• Homepage:
• Size: 858 KB
• Stars: 1
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

          
## 🦙LLama 离线chat版本

![](./screenshot3.png)

![](./screenshot1.png)

![](./screenshot2.png)

- 使用LLama2 模型的离线chat版本

- 下载对应的模型文件，放到`model`文件夹下, 配置config.json, 设置对应的模型文件.

- 个人比较喜欢两个模型一个是`openhermes-2.5-mistral-7b.Q5_K_M.gguf`, 另一个是`tinyllama-1.1b-chat-v0.3.Q5_K_M.gguf`

> 其实模型都差不多，如果机器性能好，找一个大一点的模型，性能一般，找一个小一点的模型.

> 方便使用就可以。

#### 使用方法

- 如果使用poetry

  > git clone https://github.com/bruceunx/llama-python-gui && poetry install

- 如果pip

  > pip install llama-cpp-python pyside6 markdown pygments

- 运行

  > python llama_python_gui

#### TODO

- [ ] add RAG?

- [ ] add Image