https://github.com/regular-baf/bafchat

Bringing local LLMs to a Minecraft front-end through commands.
https://github.com/regular-baf/bafchat

ai api gpt llama llm llm-inference minecraft minecraft-mod redpajama

Last synced: about 1 month ago
JSON representation

Bringing local LLMs to a Minecraft front-end through commands.

• Host: GitHub
• URL: https://github.com/regular-baf/bafchat
• Owner: Regular-Baf
• License: gpl-3.0
• Created: 2023-06-14T03:36:49.000Z (over 1 year ago)
• Default Branch: master
• Last Pushed: 2023-06-14T23:00:18.000Z (over 1 year ago)
• Last Synced: 2024-10-18T23:15:48.396Z (2 months ago)
• Topics: ai, api, gpt, llama, llm, llm-inference, minecraft, minecraft-mod, redpajama
• Language: Kotlin
• Homepage:
• Size: 107 KB
• Stars: 0
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE.txt

Awesome Lists containing this project

README

        
# Bafchat

While there are already plenty of mods around which bring OpenAI's API into Minecraft, there hasn't yet been the same abundance of mods seeking to bring local LLMs into the game. Bafchat is here to save the day! Ask your new AI buddy questions, or maybe get some help when you've forgotten a command or crafting recipe. If your model can do it, Bafchat can do it too (provided you have the prompt correctly configured in Bafmod3Config.json).

Also, OpenAI's API doesn't have unlimited free use, so once you run out of credits you have to pay. Bafchat is powered by LLMs hosted on your own computer (or local network), so you can experiment without worry of racking up charges.

## Default Configuration

By default, Bafchat is pre-configured to work with [local.ai's server](https://github.com/louisgv/local.ai), but I believe it should work with others such as those provided by Kobold and Oobabooga.

The recommended model as of right now is [RedPajama-INCITE-Chat-3B-v1](https://huggingface.co/rustformers/redpajama-3b-ggml/blob/main/RedPajama-INCITE-Chat-3B-v1-q4_0.bin) because it is a small model that processes prompts relatively fast on CPU, however as a trade-off, its responses leave much to be desired.

**NOTE:** If you do elect to choose a different model, you will have to modify the prompting style in Bafmod3Config.json, otherwise you may get unexpected results.

**OTHER NOTE:** When editing the prompt in Bafmod3Config.json, please ensure you keep the placeholder {{message}} in the prompt, placing it where you want your in-game messages to go in the template.

## Features

* A mostly functional front-end for locally hosted APIs of large language models.

* Use `/llm` to send a message to your model.

* Modify the Bafmod3Config.json in-game! Just use `/bafmod set`, or if you mess it up you can use `/bafmod reset` to return it to default.

* Prompts and API URL can be adjusted in the Bafmod3Config.json located in your .minecraft/config

### Requirements

* A locally hosted API for an LLM

* Fabric Kotlin

* Fabric API

* Fabric

* Minecraft 1.20 and newer

#### Slight issues

* If the API is hosted on the same machine as your Minecraft server (which includes the client if playing singleplayer) and your computer isn't particularly powerful, your game may temporarily slow down while the prompt is processed. Using smaller, and quantised language models can help counteract this.