https://github.com/tomekkorbak/kl-gpt3
A modular library for evaluating KL between a Huggingface Transformers models and GPT3
https://github.com/tomekkorbak/kl-gpt3
gpt3 language-models
Last synced: about 1 year ago
JSON representation
A modular library for evaluating KL between a Huggingface Transformers models and GPT3
- Host: GitHub
- URL: https://github.com/tomekkorbak/kl-gpt3
- Owner: tomekkorbak
- License: apache-2.0
- Created: 2022-09-09T19:34:22.000Z (almost 4 years ago)
- Default Branch: main
- Last Pushed: 2022-12-19T14:42:47.000Z (over 3 years ago)
- Last Synced: 2025-02-10T01:44:46.524Z (over 1 year ago)
- Topics: gpt3, language-models
- Language: Python
- Homepage:
- Size: 22.5 KB
- Stars: 1
- Watchers: 3
- Forks: 2
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# kl-gpt3
# Quickstart
```bash
pip install git+https://github.com/tomekkorbak/kl-gpt3.git transformers
export OPENAI_API_KEY=sk-YOURKEY
```
```python
from transformers import AutoModelForCausalLM
from kl_gpt3.kl_gpt3 import evaluate_forward_kl
gpt2 = AutoModelForCausalLM.from_pretrained('gpt2')
kl = evaluate_forward_kl(gpt2, max_tokens=32, num_samples=4)
print(kl)
```
# todos
- [ ] handle gpt3 api timeout nicely
- [ ] docstrings
- [ ] add tests