Projects in Awesome Lists tagged with serverless-inference
A curated list of projects in awesome lists tagged with serverless-inference .
https://github.com/ServerlessLLM/ServerlessLLM
Serverless LLM Serving for Everyone.
cuda huggingface-transformers large-language-models model-as-a-service model-serving pytorch serverless-inference
Last synced: 07 May 2025
https://github.com/serverlessllm/serverlessllm
Serverless LLM Serving for Everyone.
cuda huggingface-transformers large-language-models model-as-a-service model-serving pytorch serverless-inference
Last synced: 15 May 2025
https://github.com/picovoice/serverless-picollm
LLM Inference on AWS Lambda
aws-lambda llm llm-compression llm-inference serverless serverless-inference
Last synced: 19 Apr 2025
https://github.com/tensorchord/modelz-py
Python SDK and CLI for modelz.ai, which is a developer-first platform for prototyping and deploying machine learning models.
inference llm machine-learning serverless serverless-inference
Last synced: 18 Oct 2025
