Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/lucasavila00/LmScript
Controllable Language Model Interactions in TypeScript
https://github.com/lucasavila00/LmScript
ai guidance llm outlines sglang typescript
Last synced: 4 months ago
JSON representation
Controllable Language Model Interactions in TypeScript
- Host: GitHub
- URL: https://github.com/lucasavila00/LmScript
- Owner: lucasavila00
- License: mit
- Created: 2024-03-06T05:00:52.000Z (11 months ago)
- Default Branch: main
- Last Pushed: 2024-04-08T01:03:54.000Z (10 months ago)
- Last Synced: 2024-04-14T03:09:14.584Z (10 months ago)
- Topics: ai, guidance, llm, outlines, sglang, typescript
- Language: TypeScript
- Homepage: https://lucasavila00.github.io/LmScript/
- Size: 1.54 MB
- Stars: 5
- Watchers: 1
- Forks: 0
- Open Issues: 4
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
- awesome-local-ai - LmScript - UI for SGLang and Outlines (Inference UI)
README
# LmScript
Controllable Language Model Interactions in TypeScript
- A suite of tools for easy, fast, and controllable interactions with language models.
- Open models and open source.
- Supports [SGLang](https://github.com/sgl-project/sglang/) and
[vLLM](https://github.com/vllm-project/vllm)
([Outlines](https://github.com/outlines-dev/outlines)).
## Documentation, Tutorial, Examples
Check out the [LmScript Docs](https://lucasavila00.github.io/LmScript/)
## Projects
| Project | Description |
| -------------------------------------------------------------------------------------------------------------- | ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- |
| [Typescript Client](https://github.com/lucasavila00/LmScript/tree/main/packages/client) | Dependency-free client that creates and executes LmScript programs with different backends. |
| [GUI](https://github.com/lucasavila00/LmScript/tree/main/apps/egui) | Desktop Application that creates and executes LmScript programs. |
| [Runpod Serverless SGLang](https://github.com/lucasavila00/LmScript/tree/main/docker/runpod-serverless-sglang) | Docker image that runs [SGLang](https://github.com/sgl-project/sglang/) on [Runpod Serverless](https://www.runpod.io/serverless-gpu). |
| [Docker SGLang](https://github.com/lucasavila00/LmScript/tree/main/docker/sglang) | Docker image that runs [SGLang](https://github.com/sgl-project/sglang/) |
| [Runpod Serverless vLLM](https://github.com/lucasavila00/LmScript/tree/main/docker/runpod-serverless-vllm) | Docker image that runs [vLLM](https://github.com/vllm-project/vllm) ([Outlines](https://github.com/outlines-dev/outlines)) on [Runpod Serverless](https://www.runpod.io/serverless-gpu). |