Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/enot-autodl/gpt-j-6b-tensorrt-int8
GPT-J 6B inference on TensorRT with INT-8 precision
https://github.com/enot-autodl/gpt-j-6b-tensorrt-int8
enot-autodl gpt-j gpt-j-6b inference int8-inference quantization tensorrt transformers
Last synced: 13 days ago
JSON representation
GPT-J 6B inference on TensorRT with INT-8 precision
- Host: GitHub
- URL: https://github.com/enot-autodl/gpt-j-6b-tensorrt-int8
- Owner: ENOT-AutoDL
- Created: 2023-03-28T12:27:51.000Z (over 1 year ago)
- Default Branch: main
- Last Pushed: 2023-04-05T08:15:30.000Z (over 1 year ago)
- Last Synced: 2023-05-26T19:26:33.367Z (over 1 year ago)
- Topics: enot-autodl, gpt-j, gpt-j-6b, inference, int8-inference, quantization, tensorrt, transformers
- Language: Python
- Homepage:
- Size: 24.4 KB
- Stars: 9
- Watchers: 2
- Forks: 0
- Open Issues: 0