https://github.com/kingabzpro/deploying-llms-with-bentoml

Serving and deploying LLMs with Bento Ecosystem.
https://github.com/kingabzpro/deploying-llms-with-bentoml

bentoml llm llmops mlops phi3-mini

Last synced: about 1 month ago
JSON representation

Serving and deploying LLMs with Bento Ecosystem.

• Host: GitHub
• URL: https://github.com/kingabzpro/deploying-llms-with-bentoml
• Owner: kingabzpro
• License: apache-2.0
• Created: 2024-12-15T09:44:44.000Z (5 months ago)
• Default Branch: main
• Last Pushed: 2025-01-27T20:14:04.000Z (3 months ago)
• Last Synced: 2025-02-12T11:16:36.709Z (3 months ago)
• Topics: bentoml, llm, llmops, mlops, phi3-mini
• Language: Python
• Homepage: https://www.datacamp.com/tutorial/deploy-llms-with-bentoml
• Size: 16.6 KB
• Stars: 0
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

        
# Deploying-LLMs-with-BentoML

Serving and deploying LLMs with Bento Ecosystem. 

Read the blog to learn more: https://www.datacamp.com/tutorial/deploy-llms-with-bentoml