Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/bit-gpt/app
BitGPT it's your personal AI in your pocket
https://github.com/bit-gpt/app
ai candle localai onpremise rust self-hosted
Last synced: 8 days ago
JSON representation
BitGPT it's your personal AI in your pocket
- Host: GitHub
- URL: https://github.com/bit-gpt/app
- Owner: bit-gpt
- License: mit
- Created: 2023-04-25T18:52:39.000Z (over 1 year ago)
- Default Branch: main
- Last Pushed: 2023-11-16T11:57:45.000Z (about 1 year ago)
- Last Synced: 2024-11-21T17:46:22.082Z (about 1 month ago)
- Topics: ai, candle, localai, onpremise, rust, self-hosted
- Language: TypeScript
- Homepage: https://bitgpt.network
- Size: 9.65 MB
- Stars: 458
- Watchers: 13
- Forks: 40
- Open Issues: 36
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# 🤖 Prem - Self Sovereign AI Infrastructure
[](https://github.com/premAI-io/prem-app/releases)
[](https://github.com/premAI-io/prem-app/actions/workflows/on-tag.yaml)
[](https://twitter.com/premai_io)
[](https://discord.com/invite/kpKk6vYVAn)
Prem provides a unified environment to develop AI applications and deploy AI models on your infrastructure. Abstracting away all technical complexities for AI deployment and ushering in a new era of privacy-centric AI applications - users can finally retain control and ownership of their models.
## 🚀 Getting started
- Install Prem on your Linux server for **Production** (Ubuntu, Debian) - [Installer script](#install-on-linux)
- Install Prem on your MacOS or Linux for **local development** - [Dowload the latest Prem Desktop App](https://github.com/premAI-io/prem-app/releases)
- Try out on the live demo instance - [app.prem.ninja](https://app.prem.ninja)
## 📄 Usage
In-depth documentation for installing and using Prem is available at [dev.premai.io](https://dev.premai.io)
## Demo
https://github.com/premAI-io/prem-app/assets/29598954/e2c4f9d9-636d-4bbb-ae62-e6eb929495ee
## Install on Linux
Install everything needed to run Prem on Ubuntu/Debian server.
```bash
wget -q https://get.prem.ninja/install.sh -O install.sh; sudo bash ./install.sh
```
## Product Roadmap
### Basic Cloud Primitives
The idea is to offer a fully open-source and functional PaaS specifically designed for AI services management and deployment. For this reason, we are working on the Basic Cloud Primitives necessary to offer a full solution:
- [x] [Domains and SSL Management](https://github.com/premAI-io/prem-gateway).
- [x] Basic Authentication
- [ ] API Keys Management
- [ ] Payments (Fiat, BTC, Crypto)
- [ ] Multiple Orchestrators Support (k8s, docker swarm)
The AI services expose an HTTP API interface, standardized for their interface type. For example, all models of type `Chat` expose the OpenAI API for easy of integration of existing tool and AI app ecosystem.
Each service we support it's published on the [Prem Registry](https://registry.premai.io).
> Anyone can implement, package and publish an AI service on Prem. You can check how [here](https://dev.premai.io/docs/registry).
Let us know which Model / Feature you wanna see in Prem [here](https://feedback.prem.ninja)
### Interfaces
- [x] 😃 Chat
- [x] 📕 Embedding
- [x] 🏛️ Vector Store
- [x] 🎨 Diffuser
- [x] 💻 Coder
- [x] 🎵 Text to Audio
- [x] 🎵 Audio to Text
- [x] 🖼️ Upscaler
- [ ] 📷 Vision
- [ ] 📖 Summary
- [ ] 📹 Video
## Contributing
### Requirements
- [Rust](https://www.rust-lang.org/tools/install)
- [Node](https://nodejs.org/en/download)
- [Docker](https://docs.docker.com/engine/install/)
- [Tauri](https://tauri.app/v1/guides/getting-started/prerequisites#installing)
### Run the app with Tauri (Desktop App)
> Make sure to remove any value in the `.env` file.
```bash
npm i
npm run tauri dev
```
### Run the app with React (Browser App)
```bash
# run the daemon
docker-compose up -d premd
# copy .env.example file in .env
cp .env.example
npm i
npm run dev
```
### Environment Variables
- `VITE_BACKEND_URL` : destination of the premd
- `IS_PACKAGED` : `true` | `false` used for server packaging.
- `VITE_DEVELOPER_MODE`: 0 | 1
## Contributing to Prem Daemon
### Running the Daemon locally
```bash
git clone https://github.com/premAI-io/prem-daemon.git
cd ./prem-daemon
# create a python virtual environment and activate it
virtualenv venv -p=3.10
source ./venv/bin/activate
# install the necessary dependencies
pip install -r requirements.txt
# configure pre-commit hooks
pre-commit install
# run the webserver
cp .env.example .env
python main.py
```
### Mock Registry
In order to use the mock registry, you can specify the `REGISTRY_URL` environment variable as following:
```bash
PREM_REGISTRY_URL=https://raw.githubusercontent.com/premAI-io/prem-daemon/main/resources/mocks/manifests.json
```
> The mock registry is not fully tested. Few interfaces could be broken.
### Running the test cases
```bash
pytest
```
### Release Checklist
- [ ] Create a tag with the new version in `prem-daemon`
- [ ] Create a tag with the new version in `prem-app`
- [ ] Manually set the new tag as latest in `prem-app`
- [ ] Update the version in `prem-box` using the `bump.sh` command.
## Acknowledgments
Thank You ❤️
- [llama-cpp-python](https://github.com/abetlen/llama-cpp-python)
- [gpt4all](https://github.com/nomic-ai/gpt4all)
- [dolly-v2-12b](https://huggingface.co/databricks/dolly-v2-12b)
- [Open-Assistant](https://github.com/LAION-AI/Open-Assistant)
- [all-MiniLM-L6-v2](https://huggingface.co/sentence-transformers/all-MiniLM-L6-v2)
- [vicuna-7b](https://github.com/lm-sys/FastChat)
- [replit](https://huggingface.co/replit)
- [stabilityai](https://huggingface.co/stabilityai)
- [whisper](https://github.com/openai/whisper)
- [bark](https://github.com/bark-simulator/bark)
- [salesforce](https://github.com/salesforce/CodeT5)
- [redis](https://redis.com/solutions/use-cases/vector-database/)
- [qdrant](https://github.com/qdrant/qdrant)