https://github.com/itk-dev/ai_launchpad_vllm

https://github.com/itk-dev/ai_launchpad_vllm

Last synced: 12 months ago
JSON representation

• Host: GitHub
• URL: https://github.com/itk-dev/ai_launchpad_vllm
• Owner: itk-dev
• Created: 2024-07-16T13:21:58.000Z (over 1 year ago)
• Default Branch: main
• Last Pushed: 2024-10-08T12:42:14.000Z (over 1 year ago)
• Last Synced: 2025-02-13T08:17:13.282Z (about 1 year ago)
• Language: HTML
• Size: 12.7 KB
• Stars: 0
• Watchers: 3
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

          
# vLLM

[vLLM](https://docs.vllm.ai/) hosting setup configured to work in our setup with

Traefik and nginx to limit exposed end-points.

## Security

This setup does not come with any authentication, but relies on correctly 

configured server firewalls to protect the exposed end-points.