{"id":28168767,"url":"https://github.com/kchousos/llm-harness","last_synced_at":"2025-05-15T15:14:18.337Z","repository":{"id":288464053,"uuid":"968196902","full_name":"kchousos/llm-harness","owner":"kchousos","description":"Automatic LLM-generated fuzzing harnesses for your C/C++ project.","archived":false,"fork":false,"pushed_at":"2025-05-08T11:55:55.000Z","size":738,"stargazers_count":2,"open_issues_count":7,"forks_count":0,"subscribers_count":1,"default_branch":"master","last_synced_at":"2025-05-08T12:41:15.911Z","etag":null,"topics":["c-projects","cpp-projects","fuzzing","harness","llm","neurosymbolic-ai"],"latest_commit_sha":null,"homepage":"https://kchousos.github.io/llm-harness/","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"gpl-3.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/kchousos.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null}},"created_at":"2025-04-17T17:04:03.000Z","updated_at":"2025-04-29T14:06:05.000Z","dependencies_parsed_at":null,"dependency_job_id":"e18f218d-6ac6-45c9-9cf4-e4aa3834785a","html_url":"https://github.com/kchousos/llm-harness","commit_stats":null,"previous_names":["kchousos/llm-harness"],"tags_count":1,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/kchousos%2Fllm-harness","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/kchousos%2Fllm-harness/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/kchousos%2Fllm-harness/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/kchousos%2Fllm-harness/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/kchousos","download_url":"https://codeload.github.com/kchousos/llm-harness/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":254364231,"owners_count":22058880,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["c-projects","cpp-projects","fuzzing","harness","llm","neurosymbolic-ai"],"created_at":"2025-05-15T15:14:10.973Z","updated_at":"2025-05-15T15:14:18.326Z","avatar_url":"https://github.com/kchousos.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"\u003ch1 align=\"center\"\u003eLLM-Harness (TBD)\u003c/h1\u003e\n\n\u003cdiv align=\"center\"\u003e\n\nUse LLMs to automatically generate fuzzing harnesses for your\nC/C++ project.\n    \n\u003cp\u003e\u003ca href=\"https://www.repostatus.org/#wip\"\u003e\u003cimg\nsrc=\"https://www.repostatus.org/badges/latest/wip.svg\"\nalt=\"Project Status: WIP – Initial development is in progress, but there has not yet been a stable, usable release suitable for the public.\" /\u003e\u003c/a\u003e\n\u003cimg\nsrc=\"https://img.shields.io/badge/Python-%3E%3D%0A3.10-3776AB.svg?logo=python\u0026amp;logoColor=white\"\nalt=\"python\" /\u003e \u003cimg\nsrc=\"https://img.shields.io/github/license/kchousos/llm-harness\"\nalt=\"GitHub License\" /\u003e \u003cimg\nsrc=\"https://img.shields.io/github/actions/workflow/status/kchousos/llm-harness/tests.yml?label=tests\"\nalt=\"GitHub Actions Workflow Status\" /\u003e \u003cimg\nsrc=\"https://img.shields.io/coverallsCoverage/github/kchousos/llm-harness?branch=master\"\nalt=\"Coveralls\" /\u003e\n\u003ca href=\"https://docs.astral.sh/ruff/\"\u003e\n\u003cimg src=\"https://img.shields.io/badge/code%20formatter-ruff-d7ff64\"\nalt=\"code formatter: ruff\" /\u003e\u003c/a\u003e \n\u003ca href=\"http://mypy-lang.org/\"\u003e\u003cimg\nsrc=\"https://img.shields.io/badge/type%20check-mypy-blue\"\nalt=\"type check: mypy\" /\u003e\u003c/a\u003e\u003c/p\u003e\n\n\u003c/div\u003e\n\n- Collects information of your project structure and files.\n- Gives relevant context to LLM.\n- Automatically writes generated harness.\n- Builds any generated harness and evaluates it.\n- Supports OpenAI's models.\n\n# Getting Started\n\n## Installation\n\n### Dependencies\n\n- Python \u003e=3.10\n- [uv](https://docs.astral.sh/uv/)\n\n    ```bash\n    pipx install uv\n    ```\n\n### Installation Steps\n\n1. Clone the repository:\n\n    ```bash\n    git clone https://github.com/kchousos/llm-harness.git\n    ```\n\n2. Install the project:\n\n    ```bash\n    uv sync\n    ```\n\n## Usage\n\n1. Add an OpenAI API key in `.env`, such as:\n\n    ```bash\n    # cat .env\n    OPENAI_API_KEY=\u003cAPI-key-here\u003e\n    ```\n2. Execute the main script:\n\n    ```bash\n    uv run python main.py \u003crepo-name\u003e\n    ```\n\n### Command-Line Options\n\n```\n$ python main.py --help\nusage: main.py [-h] [-m MODEL] [-f FILES [FILES ...]] project\n\nGenerate fuzzing harnesses for C/C++ projects\n\npositional arguments:\n  project               Name of the project under the `assets/` directory, for which harnesses are to be generated.\n\noptions:\n  -h, --help            show this help message and exit\n  -m MODEL, --model MODEL\n                        LLM model to be used. Available: gpt-4.1-mini, o4-mini, o3-mini, gpt-4o, gpt-4o-mini\n  -f FILES [FILES ...], --files FILES [FILES ...]\n                        File patterns to include in analysis (e.g. *.c *.h)\n```","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fkchousos%2Fllm-harness","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fkchousos%2Fllm-harness","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fkchousos%2Fllm-harness/lists"}