https://github.com/epfl-dlab/forc
Framework for Cost-Effective Language Model Choice
https://github.com/epfl-dlab/forc
Last synced: about 1 month ago
JSON representation
Framework for Cost-Effective Language Model Choice
- Host: GitHub
- URL: https://github.com/epfl-dlab/forc
- Owner: epfl-dlab
- License: mit
- Created: 2023-08-10T19:30:59.000Z (almost 2 years ago)
- Default Branch: main
- Last Pushed: 2023-12-12T15:58:23.000Z (over 1 year ago)
- Last Synced: 2024-04-28T02:15:31.624Z (about 1 year ago)
- Language: Python
- Size: 42 KB
- Stars: 10
- Watchers: 2
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
- Awesome-LLM-Ensemble - [Official
README
# FORC
This repository contains the cost-effective framework for language model choice, described in [Fly-Swat or Cannon? Cost-Effective Language Model Choice via Meta-Modeling](https://arxiv.org/pdf/2308.06077.pdf).
```
@inproceedings{šakota2024flyswat,
title={Fly-Swat or Cannon? Cost-Effective Language Model Choice via Meta-Modeling},
author={Marija Šakota and Maxime Peyrard and Robert West},
booktitle={Proceedings of The International ACM Conference on Web Search and Data Mining (WSDM)}
year={2024}
}
```
Please consider citing our work, if you found the provided resources useful.
## Setup instructions
Start by cloning the repository:
```
git clone https://github.com/epfl-dlab/forc.git
```
### Environment setup
We recomment creating a new conda virtual environment:
```
conda env create -n forc
conda activate forc
```
Install the packages using:
```
pip install -r pip_requirements.txt
```
## License
Distributed under the MIT License. See [LICENSE](https://github.com/epfl-dlab/forc/blob/main/LICENSE) for more information.