https://github.com/strawberry-computer/vibe-server
A multi-tenant API proxy for LLM services with integrated authentication, caching, and realtime capabilities.
https://github.com/strawberry-computer/vibe-server
Last synced: 8 months ago
JSON representation
A multi-tenant API proxy for LLM services with integrated authentication, caching, and realtime capabilities.
- Host: GitHub
- URL: https://github.com/strawberry-computer/vibe-server
- Owner: Strawberry-Computer
- Created: 2025-04-09T21:35:49.000Z (11 months ago)
- Default Branch: main
- Last Pushed: 2025-05-03T00:50:07.000Z (11 months ago)
- Last Synced: 2025-06-23T03:43:18.344Z (9 months ago)
- Language: JavaScript
- Homepage:
- Size: 386 KB
- Stars: 6
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# Vibe Server
A multi-tenant API proxy for LLM services with integrated authentication, caching, and realtime capabilities.
## Project Structure
Vibe Server uses a modular "stacks" architecture powered by [vibe-compiler](https://github.com/vgrichina/vibe-compiler) to compile specifications into runnable code:
- `stacks/` - Feature specifications and documentation
- `output/` - Generated implementation code
- `vibec.json` - Build configuration
## Core Features
### Web Server (001)
- Multi-tenant Koa-based web server
- Tenant-specific configuration in Redis
### Chat Completions (003)
- OpenAI-compatible chat API
- Multiple LLM provider support
- Token usage tracking
### Realtime WebSockets (004)
- Bidirectional streaming for voice/text
- Session management
- Tool integration
### Caching System (005)
- Tenant-configurable caching
- TTL-based response caching
- Fee adjustments for cached responses
### SSO Integration (006)
- OAuth with multiple providers (Google, Apple)
- JWT token management
- Stripe subscription integration
## Development
Each stack has corresponding tests in the `stacks/tests/` directory.
## Build System
The application uses `vibec` to assemble the final application from stack specifications.