https://github.com/gapi505/sparky-2

This is a discord bot running on llama cpp with the llama 3 model and image geneartion
https://github.com/gapi505/sparky-2

ai cuda llama3 llamacpp stable-diffusion torch transformers

Last synced: 8 days ago
JSON representation

This is a discord bot running on llama cpp with the llama 3 model and image geneartion

• Host: GitHub
• URL: https://github.com/gapi505/sparky-2
• Owner: Gapi505
• License: gpl-2.0
• Created: 2024-04-27T16:29:45.000Z (9 months ago)
• Default Branch: main
• Last Pushed: 2024-05-15T21:09:40.000Z (9 months ago)
• Last Synced: 2025-01-20T16:09:16.270Z (11 days ago)
• Topics: ai, cuda, llama3, llamacpp, stable-diffusion, torch, transformers
• Language: Python
• Homepage:
• Size: 55.7 KB
• Stars: 5
• Watchers: 2
• Forks: 2
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE
  • Security: SECURITY.md

Awesome Lists containing this project

README

        
# Sparky 2

The original Sparky was a complete mess. I have now refactored the code to be more manageable.

Sparky 2.0 is now powered by the Llama 3 model. but can be changed easily because of the not so spaghetti like code which was present in the first version.

## Installation

To install you have to:

* Clone the repo

* Create a conda environment and activate it

* Install the requirements:

  * pytorch (CUDA support recommended)

  * python-llama-cpp (Install with CUDA support. If you don't know how - look it up)

  * python-dotenv

  * discord

  * if errors show up install those too. I forgor which are installed by default

* create a .env with `BOT_TOKEN={your discord bot token}`

* run