{"id":13574733,"url":"https://github.com/mnns/LLMFuzzer","last_synced_at":"2025-04-04T18:31:55.437Z","repository":{"id":167648881,"uuid":"643275640","full_name":"mnns/LLMFuzzer","owner":"mnns","description":"🧠 LLMFuzzer - Fuzzing Framework for Large Language Models 🧠 LLMFuzzer is the first open-source fuzzing framework specifically designed for Large Language Models (LLMs), especially for their integrations in applications via LLM APIs. 🚀💥","archived":false,"fork":false,"pushed_at":"2024-02-12T07:22:56.000Z","size":52,"stargazers_count":230,"open_issues_count":3,"forks_count":33,"subscribers_count":4,"default_branch":"main","last_synced_at":"2024-11-05T10:44:33.056Z","etag":null,"topics":["ai","cybersecurity","llm","llmsecurity"],"latest_commit_sha":null,"homepage":"","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/mnns.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2023-05-20T16:40:00.000Z","updated_at":"2024-11-01T20:11:42.000Z","dependencies_parsed_at":"2024-11-05T10:57:09.680Z","dependency_job_id":null,"html_url":"https://github.com/mnns/LLMFuzzer","commit_stats":null,"previous_names":["mnns/llmfuzzer"],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/mnns%2FLLMFuzzer","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/mnns%2FLLMFuzzer/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/mnns%2FLLMFuzzer/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/mnns%2FLLMFuzzer/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/mnns","download_url":"https://codeload.github.com/mnns/LLMFuzzer/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":247229582,"owners_count":20905076,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["ai","cybersecurity","llm","llmsecurity"],"created_at":"2024-08-01T15:00:54.231Z","updated_at":"2025-04-04T18:31:55.181Z","avatar_url":"https://github.com/mnns.png","language":"Python","funding_links":[],"categories":["资源列表","QA","LLM SECURITY / AI SECURITY","Tools","Attack Techniques \u0026 Red Teaming","Table of Contents","LLM and AI System Testing"],"sub_categories":["项目","LLM Vulnerability Testing","Survey","Detecting","LLM \u0026 GenAI Red Teaming","🤖 AI Security / AI Red Teaming"],"readme":"\u003cdiv align=\"center\"\u003e\n\n# 🧠 LLMFuzzer - Fuzzing Framework for Large Language Models 🧠\n\n![LLMFuzzer-shell](https://github.com/mnns/LLMFuzzer/assets/1796080/71b006df-706c-43f6-acd1-49646dbcb0e5)\n\n![Version](https://img.shields.io/badge/version-1.0.0-blue)\n![License](https://img.shields.io/badge/license-MIT-green)\n![Stars](https://img.shields.io/github/stars/mnns/LLMFuzzer)\n![Forks](https://img.shields.io/github/forks/mnns/LLMFuzzer)\n![Issues](https://img.shields.io/github/issues/mnns/LLMFuzzer)\n\n\n[![forthebadge](https://forthebadge.com/images/badges/built-with-love.svg)](https://forthebadge.com)\n[![forthebadge](https://forthebadge.com/images/badges/contains-cat-gifs.svg)](https://forthebadge.com)\n[![forthebadge](https://forthebadge.com/images/badges/not-a-bug-a-feature.svg)](https://forthebadge.com)\n\u003c/div\u003e\n\n----------------------------------------------------------------\n\n## Project Status: Unmaintained\n\nThis project is no longer actively maintained. You are welcome to fork and continue its development on your own. Thank you for your interest and support.\n\n----------------------------------------------------------------\n\nLLMFuzzer is the first open-source fuzzing framework specifically designed for Large Language Models (LLMs), especially for their integrations in applications via LLM APIs. 🚀💥\n\n## 🎯 Who is this for?\n\nIf you're a security enthusiast, a pentester, or a cybersec researcher who loves to find and exploit vulnerabilities in AI systems, LLMFuzzer is the perfect tool for you. It's built to make your testing process streamlined and efficient. 🕵️‍♀️\n\n![Untitled](https://github.com/mnns/LLMFuzzer/assets/1796080/a143897d-383c-4ed9-8b2f-65f4cdc5aa63)\n\n## 🌟 Features\n\n- Robust fuzzing for LLMs 🧪\n- LLM API integration testing 🛠️\n- Wide range of fuzzing strategies 🌀\n- Modular architecture for easy extendability 📚\n\n## 🔥 Roadmap\n* Adding more attacks\n* HTML Report as output\n* Multiple Connectors (JSON-POST, RAW-POST, QUERY-GET)\n* Multiple Comparers\n* Proxy Support\n* Dual-LLM (Side LLM observation)\n* Autonomous Attack Mode\n\n## 🚀 Get Started\n\n1. Clone the repo\n```bash\ngit clone https://github.com/mnns/LLMFuzzer.git\n```\n\n2. Navigate to the project directory\n```bash\ncd LLMFuzzer\n```\n\n3. Install dependencies\n```bash\npip install -r requirements.txt\n```\n\n4. Edit **llmfuzzer.cfg** with your LLM API endpoint (LLMFuzzer -\u003e Your Application -\u003e LLM)\n```bash\nConnection: \n  Type: HTTP-API\n  Url: \"http://localhost:3000/chat\" # Your LLM API\n  Content: JSON\n  Query-Attribute: \"query\" # Your JSON query attribute\n  Output-Attribute: \"answer\" # Your JSON response attribute\n  Headers: {'enwiki_session': '17ab96bd8ffbe8ca58a78657a918558'} # Add HTTP Headers if needed \n  Cookie: {'enwiki_session': '17ab96bd8ffbe8ca58a78657a918558'} # Add Cookies if needed\n```\n\n5. Run LLMFuzzer\n```bash\npython main.py\n```\n\n## 📚 Documentation\nWe are working on full documentation. It will cover detailed information about the architecture, different fuzzing strategies, examples, and how to extend the tool.\n\n## 🤝 Contributing\nWe welcome all contributors who are passionate about improving LLMFuzzer. See our contributing guidelines for ways to get started. 🤗\n\n## 💼 License\nLLMFuzzer is licensed under the MIT License. See the LICENSE file for more details.\n\n## 🎩 Acknowledgments\nLLMFuzzer couldn't exist without the community. We appreciate all our contributors and supporters. Let's make AI safer together! 💖\n\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fmnns%2FLLMFuzzer","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fmnns%2FLLMFuzzer","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fmnns%2FLLMFuzzer/lists"}