https://github.com/gaborvecsei/gptj-demo-restapi

https://github.com/gaborvecsei/gptj-demo-restapi

Last synced: 9 months ago
JSON representation

• Host: GitHub
• URL: https://github.com/gaborvecsei/gptj-demo-restapi
• Owner: gaborvecsei
• Created: 2021-12-22T08:46:34.000Z (over 4 years ago)
• Default Branch: main
• Last Pushed: 2022-12-13T15:50:34.000Z (over 3 years ago)
• Last Synced: 2025-10-06T23:47:27.843Z (9 months ago)
• Language: Python
• Size: 6.84 KB
• Stars: 1
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

          
# GPT-J Demo

This is just a super quick demo for `GPT-J` (included in the *Huggingface* `transformers` package) 

if anyone wants to try it out.

Not suitable for anything other then experimentation and demo.

Pay attention that this repo does not contain a lot of things including:

- Optimizations

- Error handlings

## Usage

```

# Build

docker-compose build

# Run

docker-compose up -d

# Then wait until each service is fully started (e.g.: GPT-J model needs to be loaded)

```

Then you can access the following:

- Swagger UI: `localhost:8008/docs`

- Streamlit App: `localhost:8050`