https://github.com/13point5/swe-grep-oss
https://github.com/13point5/swe-grep-oss
Last synced: 8 months ago
JSON representation
- Host: GitHub
- URL: https://github.com/13point5/swe-grep-oss
- Owner: 13point5
- Created: 2025-10-23T07:01:40.000Z (9 months ago)
- Default Branch: main
- Last Pushed: 2025-10-24T06:12:09.000Z (9 months ago)
- Last Synced: 2025-10-24T08:18:42.001Z (9 months ago)
- Language: Python
- Size: 452 KB
- Stars: 2
- Watchers: 0
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# swe-grep-oss
### Overview
- **Environment ID**: `swe-grep-oss`
- **Short description**: Environment for evaluating and developing models like [SWE-grep](https://cognition.ai/blog/swe-grep)
### Datasets
- **Primary dataset(s)**: [SWE-Bench Lite](https://huggingface.co/datasets/princeton-nlp/SWE-bench_Lite)
### Task
- **Type**:
- **Parser**:
- **Rubric overview**:
### Quickstart
Clone a sample SWE-Bench Lite repository:
```bash
uv run scripts/clone_repos.py --max-repos 1 --max-instances 1
```
Run an evaluation with your model of choice:
```bash
uv run vf-eval swe-grep-oss \
--api-base-url https://generativelanguage.googleapis.com/v1beta/openai/ \
--header 'Content-Type: application/json' \
--api-key-var GEMINI_API_KEY \
--model "gemini-2.5-flash" \
--num-examples 1 \
--rollouts-per-example 1
```