Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/furthersecrets24680/groqt
A standalone Python QT application to chat with Groq AI by using various open-source models.
https://github.com/furthersecrets24680/groqt
ai chatbot chatbot-application chatbots groq-ai groq-ai-api groq-api groq-integration groqai groqapi python python-app qt6 qt6-app qt6-application
Last synced: about 1 month ago
JSON representation
A standalone Python QT application to chat with Groq AI by using various open-source models.
- Host: GitHub
- URL: https://github.com/furthersecrets24680/groqt
- Owner: FurtherSecrets24680
- Created: 2024-07-29T12:19:04.000Z (5 months ago)
- Default Branch: main
- Last Pushed: 2024-07-30T14:53:19.000Z (5 months ago)
- Last Synced: 2024-10-12T01:20:49.697Z (2 months ago)
- Topics: ai, chatbot, chatbot-application, chatbots, groq-ai, groq-ai-api, groq-api, groq-integration, groqai, groqapi, python, python-app, qt6, qt6-app, qt6-application
- Language: Python
- Homepage:
- Size: 22.5 KB
- Stars: 0
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# Overview
A standalone Python Qt6 application to chat with Groq AI by using various open-source models. An API key is required to chat, which is free.
> Dark Mode
> Light Mode
# Features
- Model Selection Dropdown. Currently available models:
> *Llama 3.1 405B **(NOT AVAILABLE IN THE GROQ API YET)**
- Llama 3.1 70B (Preview) by Meta
- Llama 3.1 8B (Preview) by Meta
- Llama 3 Groq 70B Tool Use (Preview) by Meta, refined by Groq
- Llama 3 Groq 8B Tool Use (Preview) by Meta, refined by Groq
- Meta Llama 3 70B (Default) by Meta
- Meta Llama 3 8B by Meta
- Mixtral 8x7B by Mistral AI
- Gemma 7B by Google
- Gemma 2 9B by Google
- Dark/Light mode switcher
- Configuring the "System Prompt" (from the config.py file)
- Markdown Support
- Chat area and input box obviously
# Prerequisites
* Python (3.6 or higher)
Use the commands below to install the following libraries: **Groq**, **PyQt6**, **Markdown2**
- Groq Library
```
pip install groq
```
- PyQt6 Library
```
pip install PyQt6
```
- Markdown2 Library
```
pip install markdown2
```
# Installation
Download directly from GitHub or by using the git command:
```
> git clone https://github.com/FurtherSecrets24680/GroQt.git
> cd GroQt
> python main.py
```
**If you are running this for the first time, you must provide your Groq API key in the config.py folder, then run main.py to start chatting.**
# Getting the API Key
* Go to https://console.groq.com/keys and sign up or log in to your account.
* Click **Create API Key**, then enter a name for the key.
* Click **Submit** , copy he key, then put it in the **config.py** file.
(**MAKE SURE TO COPY THE KEY IMMEDIATELY, IT WONT SHOW IT AFTER CLOSING THE BOX.**)
# Planned Features
- [ ] Chat history - View/Delete/Export Chat history
- [ ] Clear chat
- [ ] Ability to provide API key within the app
- [ ] Ability to provide System Prompt within the app
- [ ] Custom bots with custom system prompts
- [ ] More UI improvements
and More...
# Known issues
- When asked to write poem or code, it tries to do it within one line/paragraph. Seems like a markdown issue.
# Not So Frequently Asked Questions
- **Q: Why should I even use this?**
- **A:** It's your choice. If you like open-source AI models, too lazy to open a browser and don't have high end PC to run it locally, this application is just for you. Also, Groq is something special. It uses an LPU (Language Processing Unit) , which has a greater capacity than CPU or GPU. As a result, the replies of the models are as fast as instant. Learn more at https://wow.groq.com/why-groq
- **Q: Why isn't [Put a model name here] working? I have active internet connection and also provided an API key.**
- **A:** Maybe that specific model(s) got removed, or changed to a new name. Just go to the [Groq models documentation](https://console.groq.com/docs/models) to find the changes, then modify the code; or wait for me to update the app.
# Credits
- Inspired by **vn33**'s **PyQt6-Groq-Chatbot** - https://github.com/vn33/PyQt6-Groq-Chatbot
# References
- Groq API documentation - https://console.groq.com/docs
- Groq-python GitHub repo - https://github.com/groq/groq-python