https://github.com/santhoshtr/llm-web

Dockerized Flask based application for BLOOM optimized with CTranslate2
https://github.com/santhoshtr/llm-web

bloom gpt llm

Last synced: 9 days ago
JSON representation

Dockerized Flask based application for BLOOM optimized with CTranslate2

• Host: GitHub
• URL: https://github.com/santhoshtr/llm-web
• Owner: santhoshtr
• Created: 2023-03-17T07:21:15.000Z (over 3 years ago)
• Default Branch: master
• Last Pushed: 2023-03-17T10:59:31.000Z (over 3 years ago)
• Last Synced: 2025-02-28T15:16:15.592Z (over 1 year ago)
• Topics: bloom, gpt, llm
• Language: Python
• Homepage:
• Size: 14.6 KB
• Stars: 1
• Watchers: 2
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

          
# BLOOM LLM demo

```

docker build -t llm-demo .

docker run -dp 9999:9999 llm-demo:latest

```

Open http://0.0.0.0:9999/ using browser