Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/bluecannonball/llm-job-server
Use multiple machines to prompt an LLM.
https://github.com/bluecannonball/llm-job-server
Last synced: 9 days ago
JSON representation
Use multiple machines to prompt an LLM.
- Host: GitHub
- URL: https://github.com/bluecannonball/llm-job-server
- Owner: BlueCannonBall
- License: mpl-2.0
- Created: 2023-12-10T19:15:28.000Z (11 months ago)
- Default Branch: main
- Last Pushed: 2024-04-14T00:05:20.000Z (7 months ago)
- Last Synced: 2024-04-14T00:21:47.800Z (7 months ago)
- Language: C++
- Size: 191 KB
- Stars: 0
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# LLM Job Server
Use multiple machines to prompt an LLM.
## Usage
```sh
$ ./server input.txt output.txt # Defaults to port 8000
$ ./server input.txt output.txt 8080 # Port 8080 is explicitly specified
```
The output consists of lines of the input file followed by lines produced by the LLM. Prompts and responses are separated by tabs.