Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/bentoml/bentoml
The most flexible way to serve AI/ML models in production - Build Model Inference Service, LLM APIs, Inference Graph/Pipelines, Compound AI systems, Multi-Modal, RAG as a Service, and more!
https://github.com/bentoml/bentoml
deep-learning generative-ai inference-platform llm llm-inference llm-serving llmops machine-learning ml-engineering mlops model-inference-service model-serving multimodal python
Last synced: about 8 hours ago
JSON representation
The most flexible way to serve AI/ML models in production - Build Model Inference Service, LLM APIs, Inference Graph/Pipelines, Compound AI systems, Multi-Modal, RAG as a Service, and more!
- Host: GitHub
- URL: https://github.com/bentoml/bentoml
- Owner: bentoml
- License: apache-2.0
- Created: 2019-04-02T01:39:27.000Z (over 5 years ago)
- Default Branch: main
- Last Pushed: 2024-05-10T08:38:37.000Z (5 months ago)
- Last Synced: 2024-05-13T03:01:03.781Z (5 months ago)
- Topics: deep-learning, generative-ai, inference-platform, llm, llm-inference, llm-serving, llmops, machine-learning, ml-engineering, mlops, model-inference-service, model-serving, multimodal, python
- Language: Python
- Homepage: https://bentoml.com
- Size: 79.5 MB
- Stars: 6,591
- Watchers: 73
- Forks: 742
- Open Issues: 229
-
Metadata Files:
- Readme: README.md
- Contributing: CONTRIBUTING.md
- License: LICENSE
- Code of conduct: CODE_OF_CONDUCT.md
- Citation: CITATION.cff
- Codeowners: .github/CODEOWNERS
- Security: SECURITY.md
- Governance: GOVERNANCE.md