https://github.com/shjwudp/huggingface-model-service
https://github.com/shjwudp/huggingface-model-service
Last synced: 4 months ago
JSON representation
- Host: GitHub
- URL: https://github.com/shjwudp/huggingface-model-service
- Owner: shjwudp
- License: mit
- Created: 2022-10-13T03:07:34.000Z (almost 3 years ago)
- Default Branch: main
- Last Pushed: 2022-11-03T13:09:37.000Z (over 2 years ago)
- Last Synced: 2025-01-20T00:19:21.309Z (6 months ago)
- Language: Python
- Size: 14.6 KB
- Stars: 0
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# Huggingface-Model-Service
## GET ON
Install requirements.
```
git clone https://github.com/shjwudp/Huggingface-Model-Service && cd Huggingface-Model-Service
git submodule update --init --recursive
pip install -r requirements.txt
```
Load huggingface model, start HTTP restful service.
```
python generate-server.py --huggingface_model bigscience/bloom-560m --port YOUR_GENERATE_SERVER_PORT
```
Run streamlit server.
```
streamlit run streamlit-server.py -- --backend http://localhost:YOUR_GENERATE_SERVER_PORT/generate
```
View your Streamlit app in your browser.
