Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

https://github.com/transformerlab/transformerlab-app

Open Source Application for Advanced LLM Engineering: interact, train, fine-tune, and evaluate large language models on your own computer.
https://github.com/transformerlab/transformerlab-app

electron llama llms lora mlx rlhf transformers

Last synced: 5 days ago
JSON representation

Open Source Application for Advanced LLM Engineering: interact, train, fine-tune, and evaluate large language models on your own computer.

Host: GitHub
URL: https://github.com/transformerlab/transformerlab-app
Owner: transformerlab
License: agpl-3.0
Created: 2023-12-24T22:09:14.000Z (11 months ago)
Default Branch: main
Last Pushed: 2024-10-25T20:34:29.000Z (18 days ago)
Last Synced: 2024-10-30T05:57:07.741Z (14 days ago)
Topics: electron, llama, llms, lora, mlx, rlhf, transformers
Language: TypeScript
Homepage: https://transformerlab.ai/
Size: 3.62 MB
Stars: 402
Watchers: 7
Forks: 23
Open Issues: 61
Metadata Files:
- Readme: README.md
- License: LICENSE
- Code of conduct: CODE_OF_CONDUCT.md

Awesome Lists containing this project

awesome-LLM-resourses - Transformer Lab - tune, and evaluate large language models on your own computer. (微调 Fine-Tuning)
alan_awesome_llm - Transformer Lab - tune, and evaluate large language models on your own computer. (微调 Fine-Tuning)
alan_awesome_llm - Transformer Lab - tune, and evaluate large language models on your own computer. (微调 Fine-Tuning)

README

Transformer Lab

Download, interact, and finetune models locally.

Explore the docs »

View Demo
·
Report Bugs
·
Suggest Features
·
Join Discord
·
Follow on Twitter

Note: Transformer Lab is actively being worked on. Please join our Discord or follow us on Twitter for updates. Questions, feedback and contributions are highly valued!

## Download Now

[![Download Icon]][Download URL]

## About The Project

![Product Screen Shot](assets/screenshot.png)

Transformer Lab is an app that allows anyone to experiment with Large Language Models.

## Backed by Mozilla

Transformer Lab is proud to be supported by Mozilla through the Mozilla Builders Program

## Features

Transformer Lab allows you to:

- 💕 **One-click Download Hundreds of Popular Models**:
- Llama3, Phi3, Mistral, Mixtral, Gemma, Command-R, and dozens more
- ⬇ **Download any LLM from Huggingface**
- 🎶 **Finetune / Train Across Different Hardware**
- Finetune using MLX on Apple Silicon
- Finetune using Huggingface on GPU
- ⚖️ **RLHF and Preference Optimization**
- DPO
- ORPO
- SIMPO
- Reward Modeling
- 💻 **Work with LLMs Across Operating Systems**:
- Windows App
- MacOS App
- Linux
- 💬 **Chat with Models**
- Chat
- Completions
- Preset (Templated) Prompts
- Chat History
- Tweak generation parameters
- Batched Inference
- Tool Use / Function Calling (in alpha)
- 🚂 **Use Different Inference Engines**
- MLX on Apple Silicon
- Huggingface Transformers
- vLLM
- Llama CPP
- 🧑‍🎓 **Evaluate models**
- 📖 **RAG (Retreival Augmented Generation)**
- Drag and Drop File UI
- Works on Apple MLX, Transformers, and other engines
- 📓 **Build Datasets for Training**
- Pull from hundreds of common datasets available on HuggingFace
- Provide your own dataset using drag and drop
- 🔢 **Calculate Embeddings**
- 💁 **Full REST API**
- 🌩 **Run in the Cloud**
- You can run the user interface on your desktop/laptop while the engine runs on a remote or cloud machine
- Or you can run everything locally on a single machine
- 🔀 **Convert Models Across Platforms**
- Convert from/to Huggingface, MLX, GGUF
- 🔌 **Plugin Support**
- Easily pull from a library of existing plugins
- Write your own plugins to extend functionality
- 🧑‍💻 **Embedded Monaco Code Editor**
- Edit plugins and view what's happening behind the scenes
- 📝 **Prompt Editing**
- Easily edit System Messages or Prompt Templates
- 📜 **Inference Logs**
- While doing inference or RAG, view a log of the raw queries sent to the LLM

And you can do the above, all through a simple cross-platform GUI.

## Getting Started

Click here to download Transformer Lab.

Read this page to learn how to install and use.

### Built With

- [![Electron][Electron]][Electron-url]
- [![React][React.js]][React-url]
- [![HuggingFace][HuggingFace]][HuggingFace-url]

## Developers

### Building from Scratch

To build the app yourself, pull this repo, and follow the steps below:

```bash
npm install
```

```bash
npm start
```

## Packaging for Production

To package apps for the local platform:

```bash
npm run package
```

## License

Distributed under the AGPL V3 License. See `LICENSE.txt` for more information.

## Reference

If you found Transformer Lab useful in your research or applications, please cite using the following BibTeX:

```
@software{transformerlab,
author = {Asaria, Ali},
title = {Transformer Lab: Experiment with Large Language Models},
month = December,
year = 2023,
url = {https://github.com/transformerlab/transformerlab-app}
}
```

## Contact

- [@aliasaria](https://twitter.com/aliasaria) - Ali Asasria
- [@dadmobile](https://github.com/dadmobile) - Tony Salomone

[product-screenshot]: https://transformerlab.ai/assets/images/screenshot01-53ecb8c52338db3c9246cf2ebbbdc40d.png
[React.js]: https://img.shields.io/badge/React-20232A?style=for-the-badge&logo=react&logoColor=61DAFB
[React-url]: https://reactjs.org/
[Electron]: https://img.shields.io/badge/Electron-20232A?style=for-the-badge&logo=electron&logoColor=61DAFB
[Electron-url]: https://www.electronjs.org/
[HuggingFace]: https://img.shields.io/badge/🤗_HuggingFace-20232A?style=for-the-badge
[HuggingFace-url]: https://huggingface.co/
[Download Icon]: https://img.shields.io/badge/Download-EF2D5E?style=for-the-badge&logoColor=white&logo=DocuSign
[Download URL]: https://transformerlab.ai/docs/download