https://github.com/guillemram97/neural-caching
https://github.com/guillemram97/neural-caching
Last synced: about 1 month ago
JSON representation
- Host: GitHub
- URL: https://github.com/guillemram97/neural-caching
- Owner: guillemram97
- Created: 2023-10-19T13:37:11.000Z (over 1 year ago)
- Default Branch: main
- Last Pushed: 2023-12-12T13:28:43.000Z (over 1 year ago)
- Last Synced: 2023-12-12T14:33:08.451Z (over 1 year ago)
- Language: Python
- Size: 45.9 KB
- Stars: 6
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
- Awesome-LLM-Ensemble - [Official
README
# Cache for LLM calls
## Setting up environment
```
conda create -n cache python=3.8
conda activate cache
conda install pip
pip install torch torchvision torchaudio --extra-index-url https://download.pytorch.org/whl/cu116
pip install -r requirements.txt
```
## Usage
Export the arguments you want to change with respect to default values, following `scripts/run.sh`. For instance,
```
export TASK_NAME=isear
export BUDGET=1500
```
We use [Neptune](http://neptune.ai/) for logging. We recommend setting file `scripts/cluster.sh` with the following arguments:
```
export DATA_PATH=
export PROJECT_NAME_NEPTUNE=
export API_TOKEN_NEPTUNE=
```
Then, run the code:
```
bash scripts/run.sh
```