https://github.com/zphang/hf_benchmark_sample
https://github.com/zphang/hf_benchmark_sample
Last synced: 9 months ago
JSON representation
- Host: GitHub
- URL: https://github.com/zphang/hf_benchmark_sample
- Owner: zphang
- Created: 2023-11-20T09:11:51.000Z (about 2 years ago)
- Default Branch: main
- Last Pushed: 2023-11-20T09:26:25.000Z (about 2 years ago)
- Last Synced: 2025-01-29T13:43:36.401Z (11 months ago)
- Language: Python
- Size: 3.91 KB
- Stars: 0
- Watchers: 2
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# Sample HF Benchmark
- Interface: `src/hf_benchmark_sample/task_base.py`
- Interface for Tasks
- Task: `src/hf_benchmark_sample/tasks/sample_rte_task.py`
- Sample implementation of RTE task
- Sample run script: `sample_run.py`
- Sample script that runs the evaluation and uploads the results to a dataset repo on the Hub