https://github.com/opencsgs/llm-scheduler-api

llm jobs api based on slurm restful api
https://github.com/opencsgs/llm-scheduler-api

Last synced: about 1 year ago
JSON representation

llm jobs api based on slurm restful api

• Host: GitHub
• URL: https://github.com/opencsgs/llm-scheduler-api
• Owner: OpenCSGs
• Created: 2024-05-06T05:57:58.000Z (almost 2 years ago)
• Default Branch: main
• Last Pushed: 2024-05-17T03:52:28.000Z (almost 2 years ago)
• Last Synced: 2025-03-25T21:37:56.236Z (about 1 year ago)
• Language: Python
• Homepage:
• Size: 40 KB
• Stars: 4
• Watchers: 1
• Forks: 1
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

          
# LLM Scheduler API

## Prerequisite

Slurm engine was installed. Reference: [Slurm Installation](./docs/slurm_install.md)

## Installation

1. Install dependency：

Python 3.10+

```bash

pip install -r requirements.txt

```

2. API

```bash

python main.py

```

or 

```bash

uvicorn main:app --host 0.0.0.0 --port 3000

```

## API document

http://localhost:3000/docs