https://github.com/transformerlab/transformerlab-app
Open Source Application for Advanced LLM Engineering: interact, train, fine-tune, and evaluate large language models on your own computer.
https://github.com/transformerlab/transformerlab-app
electron llama llms lora mlx rlhf transformers
Last synced: 3 months ago
JSON representation
Open Source Application for Advanced LLM Engineering: interact, train, fine-tune, and evaluate large language models on your own computer.
- Host: GitHub
- URL: https://github.com/transformerlab/transformerlab-app
- Owner: transformerlab
- License: agpl-3.0
- Created: 2023-12-24T22:09:14.000Z (over 2 years ago)
- Default Branch: main
- Last Pushed: 2025-05-15T17:41:14.000Z (12 months ago)
- Last Synced: 2025-05-15T18:43:03.794Z (12 months ago)
- Topics: electron, llama, llms, lora, mlx, rlhf, transformers
- Language: TypeScript
- Homepage: https://transformerlab.ai/
- Size: 9.48 MB
- Stars: 3,287
- Watchers: 29
- Forks: 270
- Open Issues: 53
-
Metadata Files:
- Readme: README.md
- Funding: .github/FUNDING.yml
- License: LICENSE
- Code of conduct: CODE_OF_CONDUCT.md
Awesome Lists containing this project
- StarryDivineSky - transformerlab/transformerlab-app
- awesome-github-projects - transformerlab-app - The open source research environment for AI researchers to seamlessly train, evaluate, and scale models from local hardware to GPU clusters. โญ4,934 `Python` ๐ฅ (๐ค AI & Machine Learning)
- awesome-LLM-resources - Transformer Lab - tune, and evaluate large language models on your own computer. (ๅพฎ่ฐ Fine-Tuning)
- alan_awesome_llm - Transformer Lab - tune, and evaluate large language models on your own computer. (ๅพฎ่ฐ Fine-Tuning)
- awesome-production-machine-learning - Transformer Lab - app.svg?style=social) - Transformer Lab is an open-source LLM workspace for finetuning, evaluating, exporting, and testing models locally across inference engines and platforms. (Deployment and Serving)
- AiTreasureBox - transformerlab/transformerlab-app - 11-03_4477_0](https://img.shields.io/github/stars/transformerlab/transformerlab-app.svg)|Open Source Application for Advanced LLM Engineering: interact, train, fine-tune, and evaluate large language models on your own computer.| (Repos)
- Awesome-LLMOps - Transformer Lab - tune, and evaluate large language models on your own computer.    (Training / FineTune)
- awesome-mlx - transformerlab-app
README
The Operating System for AI Research Labs
Designed for ML Researchers. Local, on-prem, or in the cloud. Open source.
โฌ๏ธ Install for Individuals
ย ยทย
๐ข Install for Teams
ย ยทย
๐ Documentation
ย ยทย
๐ฌ Demo
ย ยทย
๐ฌ Discord
---
## โจ What is Transformer Lab?
Transformer Lab is an open-source machine learning platform that unifies the fragmented AI tooling landscape into a single, elegant interface. It is available in two editions:
### ๐ค For Individuals
**Perfect for researchers and hobbyists working on a single machine.**
- **Local Privacy:** No data leaves your machine.
- **Full Toolkit:** Train, fine-tune, chat, and evaluate models.
- **Cross-Platform:** Runs natively on macOS (Apple Silicon), Linux, and Windows (WSL2).
- **No Cloud Costs:** Use your own hardware.
### ๐ข For Teams
**Built for research labs scaling across GPU clusters.**
- **Unified Orchestration:** Submit jobs to **Slurm** clusters or **SkyPilot** clouds (AWS, GCP, Azure) from one UI.
- **Collaborative:** Centralized experiment tracking, model registry, and artifact management.
- **Interactive Compute:** One-click Jupyter, VSCode, and SSH sessions on remote nodes.
- **Resilience:** Auto-recovery from checkpoints and spot instance preemption.
---
## ๐ ๏ธ Key Capabilities
๐ง Foundation Models & LLMs
- **Universal Support:** Download and run Llama 3, DeepSeek, Mistral, Qwen, Phi, and more.
- **Inference Engines:** Support for MLX, vLLM, Ollama, and HuggingFace Transformers.
- **Format Conversion:** Seamlessly convert between HuggingFace, GGUF, and MLX formats.
- **Chat Interface:** Multi-turn chat, batched querying, and function calling support.
๐ Training & Fine-tuning
- **Unified Interface:** Train on local hardware or submit tasks to remote clusters using the same UI.
- **Methods:** Full fine-tuning, LoRA/QLoRA, RLHF (DPO, ORPO, SIMPO), and Reward Modeling.
- **Hardware Agnostic:** Optimized trainers for Apple Silicon (MLX), NVIDIA (CUDA), and AMD (ROCm).
- **Hyperparameter Sweeps:** Define parameter ranges in YAML and automatically schedule grid searches.
๐จ Diffusion & Image Generation
- **Generation:** Text-to-Image, Image-to-Image, and Inpainting using Stable Diffusion and Flux.
- **Advanced Control:** Full support for ControlNets and IP-Adapters.
- **Training:** Train custom LoRA adaptors on your own image datasets.
- **Dataset Management:** Auto-caption images using WD14 taggers.
๐ Evaluation & Analytics
- **LLM-as-a-Judge:** Use local or remote models to score outputs on bias, toxicity, and faithfulness.
- **Benchmarks:** Built-in support for EleutherAI LM Evaluation Harness (MMLU, HellaSwag, GSM8K, etc.).
- **Red Teaming:** Automated vulnerability testing for PII leakage, prompt injection, and safety.
๐ Plugins & Extensibility
- **Plugin System:** Extend functionality with a robust Python plugin architecture.
- **Lab SDK:** Integrate your existing Python training scripts (`import lab`) to get automatic logging, progress bars, and artifact tracking.
- **CLI:** Power-user command line tool for submitting tasks and monitoring jobs without a browser.
๐ฃ๏ธ Audio Generation
- **Text-to-Speech:** Generate speech using Kokoro, Bark, and other state-of-the-art models.
- **Training:** Fine-tune TTS models on custom voice datasets.
---
## ๐ฅ Quick Start
### 1. Install
```bash
curl https://lab.cloud/install.sh | bash
```
### 2. Run
```bash
cd ~/.transformerlab/src
./run.sh
```
### 3. Access
Open your browser to `http://localhost:8338`.
#### Requirements
| Platform | Requirements |
|----------|-------------|
| **macOS** | Apple Silicon (M1/M2/M3/M4) |
| **Linux** | NVIDIA or AMD GPU |
| **Windows** | NVIDIA GPU via WSL2 ([setup guide](https://lab.cloud/docs/install/windows-wsl-cuda)) |
---
## ๐ข Enterprise & Cluster Setup
Transformer Lab for Teams runs as an overlay on your existing infrastructure. It does not replace your scheduler; it acts as a modern control plane for it.
To configure Transformer Lab to talk to **Slurm** or **SkyPilot**:
1. Follow the [Teams Install Guide](https://lab.cloud/for-teams/install).
2. Configure your compute providers in the Team Settings.
3. Use the CLI (`lab`) or Web UI to queue tasks across your cluster.
---
## ๐ฉโ๐ป Development
Frontend
```bash
# Requires Node.js v22
npm install
npm start
```
Backend (API)
```bash
cd api
./install.sh # Sets up Conda env + Python deps
./run.sh # Start the API server
```
Lab SDK
```bash
pip install transformerlab
```
---
## ๐ค Contributing
We are an open-source initiative backed by builders who care about the future of AI research. We welcome contributions! Please check our [issues](https://github.com/transformerlab/transformerlab-app/issues) for open tasks.
---
## ๐ License
AGPL-3.0 ยท See [LICENSE](LICENSE) for details.
---
## ๐ Citation
```bibtex
@software{transformerlab,
author = {Asaria, Ali and Salomone, Tony},
title = {Transformer Lab: The Operating System for AI Research},
year = 2023,
url = {https://github.com/transformerlab/transformerlab-app}
}
```
---
## ๐ฌ Community
Built with โค๏ธ by Transformer Lab in Canada ๐จ๐ฆ