https://github.com/locaal-ai/obs-brain
AI Brain in OBS: Summarize, Highlight, Chat, Translate, and Memorize using LLMs
https://github.com/locaal-ai/obs-brain
ai brain llm obs plugin
Last synced: about 1 year ago
JSON representation
AI Brain in OBS: Summarize, Highlight, Chat, Translate, and Memorize using LLMs
- Host: GitHub
- URL: https://github.com/locaal-ai/obs-brain
- Owner: locaal-ai
- License: gpl-2.0
- Archived: true
- Created: 2023-09-30T15:42:05.000Z (over 2 years ago)
- Default Branch: master
- Last Pushed: 2024-01-26T02:48:43.000Z (over 2 years ago)
- Last Synced: 2025-04-15T17:21:47.346Z (about 1 year ago)
- Topics: ai, brain, llm, obs, plugin
- Language: CMake
- Homepage:
- Size: 237 KB
- Stars: 27
- Watchers: 3
- Forks: 2
- Open Issues: 1
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# brAIn - AI Brain for your OBS
[](https://github.com/occ-ai/obs-brain/blob/main/LICENSE)
[](https://github.com/occ-ai/obs-brain/actions/workflows/push.yaml)
[](https://github.com/occ-ai/obs-brain/releases)
[](https://github.com/occ-ai/obs-brain/releases)
[](https://discord.gg/KbjGU2vvUz)
## Introduction
brAIn AI assistant plugin allows you to run AI / LLMs (Large Language Models), locally on your machine, to perform various language processing functions on text. ✅ No GPU required, ✅ no AI vendor costs! Privacy first - all data stays on your machine.
If this free plugin has been valuable to you consider adding a ⭐ to this GH repo, subscribing to [my YouTube channel](https://www.youtube.com/@royshilk) where I post updates, and supporting my work: https://github.com/sponsors/royshil
Current Features:
- LLM inference on GGMF (.gguf v2) model
- Connect to OpenAI API to run inference on GPT-3 models (need to provide your own API key)
Roadmap:
- Run many other LLMs and even e.g. LLaVA (vision-language) models
Internally the plugin is running ([llama.cpp](https://github.com/ggerganov/llama.cpp)) locally to inference in real-time on the CPU or GPU.
Check out our other plugins:
- [Background Removal](https://github.com/occ-ai/obs-backgroundremoval) removes background from webcam without a green screen.
- 🚧 Experimental 🚧 [CleanStream](https://github.com/occ-ai/obs-cleanstream) for real-time filler word (uh,um) and profanity removal from live audio stream
- [URL/API Source](https://github.com/occ-ai/obs-urlsource) that allows fetching live data from an API and displaying it in OBS.
- [LocalVocal](https://github.com/occ-ai/obs-localvocal) for real-time speech to text transcription in OBS.
## Download
Check out the [latest releases](https://github.com/occ-ai/obs-brain/releases) for downloads and install instructions.
## Building
The plugin was built and tested on Mac OSX (Intel & Apple silicon), Windows and Linux.
Start by cloning this repo to a directory of your choice.
Remember to sync and fetch the submodules before building, e.g.
```sh
$ git submodule sync --recursive
$ git update --init --recursive
```
### Mac OSX
Using the CI pipeline scripts, locally you would just call the zsh script. By default this builds a universal binary for both Intel and Apple Silicon. To build for a specific architecture please see `.github/scripts/.build.zsh` for the `-arch` options.
```sh
$ ./.github/scripts/build-macos -c Release
```
#### Install
The above script should succeed and the plugin files (e.g. `obs-urlsource.plugin`) will reside in the `./release/Release` folder off of the root. Copy the `.plugin` file to the OBS directory e.g. `~/Library/Application Support/obs-studio/plugins`.
To get `.pkg` installer file, run for example
```sh
$ ./.github/scripts/package-macos -c Release
```
(Note that maybe the outputs will be in the `Release` folder and not the `install` folder like `pakage-macos` expects, so you will need to rename the folder from `build_x86_64/Release` to `build_x86_64/install`)
### Linux (Ubuntu)
Use the CI scripts again
```sh
$ ./.github/scripts/build-linux.sh
```
Copy the results to the standard OBS folders on Ubuntu
```sh
$ sudo cp -R release/RelWithDebInfo/lib/* /usr/lib/x86_64-linux-gnu/
$ sudo cp -R release/RelWithDebInfo/share/* /usr/share/
```
Note: The official [OBS plugins guide](https://obsproject.com/kb/plugins-guide) recommends adding plugins to the `~/.config/obs-studio/plugins` folder.
### Windows
Use the CI scripts again, for example:
```powershell
> .github/scripts/Build-Windows.ps1 -Target x64 -CMakeGenerator "Visual Studio 17 2022"
```
The build should exist in the `./release` folder off the root. You can manually install the files in the OBS directory.
#### Building with CUDA support on Windows
To build with CUDA support on Windows, you need to install the CUDA toolkit from NVIDIA. The CUDA toolkit is available for download from [here](https://developer.nvidia.com/cuda-downloads).
After installing the CUDA toolkit, you need to set variables to point CMake to the CUDA toolkit installation directory. For example, if you have installed the CUDA toolkit in `C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v11.4`, you need to set `CUDA_TOOLKIT_ROOT_DIR` to `C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v11.4` and `brAIn_WITH_CUDA` to `ON` when running `.github/scripts/Build-Windows.ps1`.
For example
```powershell
.github/scripts/Build-Windows.ps1 -Target x64 -ExtraCmakeArgs '-D','brAIn_WITH_CUDA=ON','-D',"CUDA_TOOLKIT_ROOT_DIR='C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2'"
```
You will need to copy a few CUDA .dll files to the location of the plugin .dll for it to run. The required .dll files from CUDA (which are located in the `bin` folder of the CUDA toolkit installation directory) are:
- `cudart64_NN.dll`
- `cublas64_NN.dll`
- `cublasLt64_NN.dll`
where `NN` is the CUDA major version number. For example, if you have installed CUDA 12.2 as in example above, then `NN` is `12`.