Ecosyste.ms: Awesome

https://github.com/sgl-project/sglang

SGLang is a fast serving framework for large language models and vision language models.

cuda inference llama llama2 llama3 llama3-1 llava llm llm-serving moe pytorch transformer vlm

Last synced: 18 Nov 2024

https://github.com/sgl-project/sgl-learning-materials

Materials for learning SGLang

Last synced: 12 Nov 2024

https://github.com/sgl-project/tensorrt-demo

Last synced: 12 Nov 2024

https://github.com/sgl-project/sgl-project.github.io

This is the documentation repository for SGLang. It is auto-generated from https://github.com/sgl-project/sglang/tree/main/docs.

Last synced: 12 Nov 2024