{"id":28022758,"url":"https://github.com/LLAMATOR-Core/llamator","last_synced_at":"2025-05-10T23:01:45.317Z","repository":{"id":256843933,"uuid":"852792241","full_name":"LLAMATOR-Core/llamator","owner":"LLAMATOR-Core","description":"Framework for testing vulnerabilities of large language models (LLM).","archived":false,"fork":false,"pushed_at":"2025-05-10T10:59:34.000Z","size":4265,"stargazers_count":108,"open_issues_count":8,"forks_count":9,"subscribers_count":2,"default_branch":"release","last_synced_at":"2025-05-10T11:31:32.171Z","etag":null,"topics":["agent","ai","ai-security","attack","hallucinations","jailbreak","llm","llm-read-team","llm-security","llm-testing","misinformation","nlp","owasp","python","rag","rag-evaluation","red-team","red-team-tools","security-tools","vulnerability"],"latest_commit_sha":null,"homepage":"https://llamator-core.github.io/llamator/","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"other","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/LLAMATOR-Core.png","metadata":{"files":{"readme":"README-dev.md","changelog":null,"contributing":"CONTRIBUTING.md","funding":null,"license":"LICENSE.md","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null}},"created_at":"2024-09-05T12:40:35.000Z","updated_at":"2025-05-07T19:59:30.000Z","dependencies_parsed_at":"2024-09-13T11:07:34.075Z","dependency_job_id":"8a7e83e2-a013-4485-90d1-39f4bb517c4d","html_url":"https://github.com/LLAMATOR-Core/llamator","commit_stats":null,"previous_names":["romiconez/llamator","llamator-core/llamator"],"tags_count":11,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/LLAMATOR-Core%2Fllamator","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/LLAMATOR-Core%2Fllamator/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/LLAMATOR-Core%2Fllamator/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/LLAMATOR-Core%2Fllamator/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/LLAMATOR-Core","download_url":"https://codeload.github.com/LLAMATOR-Core/llamator/tar.gz/refs/heads/release","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":253411467,"owners_count":21904141,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["agent","ai","ai-security","attack","hallucinations","jailbreak","llm","llm-read-team","llm-security","llm-testing","misinformation","nlp","owasp","python","rag","rag-evaluation","red-team","red-team-tools","security-tools","vulnerability"],"created_at":"2025-05-10T23:01:05.321Z","updated_at":"2025-05-10T23:01:45.268Z","avatar_url":"https://github.com/LLAMATOR-Core.png","language":"Python","readme":"# LLAMATOR\n\n# Setup developer environment\n\nTo start, you need to setup your local machine.\n\n## Setup venv\n\nYou need to setup virtual environment, simplest way is to run from project root directory:\n\n```bash\n$ . ./setup_dev_env.sh\n$ source venv/bin/activate\n```\nThis will create a new venv and run `pip install -r requirements-dev.txt`.\nLast line shows how to activate the environment.\n\n## Install pre-commit\n\nTo ensure code quality we use pre-commit hook with several checks. Setup it by:\n\n```\npre-commit install\n```\n\nAll updated files will be reformatted and linted before the commit.\n\nTo reformat and lint all files in the project, use:\n\n`pre-commit run --all-files`\n\nThe used linters are configured in `.pre-commit-config.yaml`. You can use `pre-commit autoupdate` to bump tools to the latest versions.\n\n## Autoreload within notebooks\n\nWhen you install project's package add below code (before imports) in your notebook:\n```\n# Load the \"autoreload\" extension\n%load_ext autoreload\n# Change mode to always reload modules: you change code in src, it gets loaded\n%autoreload 2\n```\nRead more about different modes in [documentation](https://ipython.org/ipython-doc/3/config/extensions/autoreload.html).\n\nAll code should be in `src/` to make reusability and review straightforward, keep notebooks simple for exploratory data analysis.\nSee also [Cookiecutter Data Science opinion](https://drivendata.github.io/cookiecutter-data-science/#notebooks-are-for-exploration-and-communication).\n# Project documentation\n\nIn `docs/` directory are Sphinx RST/Markdown files.\n\nTo build documentation locally, in your configured environment, you can use `build_docs.sh` script:\n\n```bash\n$ ./build_docs.sh\n```\n\nThen open `public/index.html` file.\n\nPlease read the official [Sphinx documentation](https://www.sphinx-doc.org/en/master/) for more details.\n\n\n### Github Actions Documentation\n\nBy default **Github Actions** pipelines have `documentation` workflow which will build sphinx documentation automatically on main branch - and it will push it to a branch - it can be hosted on **Github Pages** if you enable it.\n\nTo access it, you need to enable it, on **Github repository -\u003e Settings -\u003e Pages** page select **Deploy from a branch** and select **gh-pages**. Link will appear here after deployment.\n\n**WARNING:** Only on Github Enterprise you can make it private so only people with repository access can view it.\n\nPlease read more about it [here](https://docs.github.com/en/pages/quickstart).\n# Semantic version bump\n\nTo bump version of the library please use `bump2version` which will update all version strings.\n\nNOTE: Configuration is in `.bumpversion.cfg` and **this is a main file defining version which should be updated only with bump2version**.\n\nFor convenience there is bash script which will create commit, to use it call:\n\n\u003cimg src=\"assets/img.png\" alt=\"img\" width=\"250\"/\u003e\n\n```bash\n# to create a new commit by increasing one semvar:\n$ ./bump_version.sh minor\n$ ./bump_version.sh major\n$ ./bump_version.sh patch\n# to see what is going to change run:\n$ ./bump_version.sh --dry-run major\n```\nScript updates **VERSION** file and setup.cfg automatically uses that version.\n\nYou can configure it to update version string in other files as well - please check out the bump2version configuration file.\n\n## Publishing a New Version to PyPI\n\nFollow these steps to build your Python package and upload a new version to PyPI:\n\n1. **Commit the latest changes**\n   Ensure all your recent changes are committed to your local repository.\n\n2. **Bump the package version**\n   Run the version bump script:\n   ```bash\n   ./bump_version.sh {minor/major/patch}\n   ```\n\n3. **Commit the version bump**\n   Add and commit the version change to your repository.\n\n4. **Remove the `dist` directory**\n   Delete the existing `dist` directory to clean previous builds.\n\n5. **Build the package**\n   Create the source and wheel distributions using the `build` package:\n   ```bash\n   python -m build\n   ```\n\n6. **Publish the package**\n   Upload the new version to PyPI using Twine:\n   ```bash\n   twine upload dist/*\n   ```\n\n7. **Push to the remote GitHub repository**\n   Push all your commits to the remote repository.","funding_links":[],"categories":["AI Red Teaming (Testing AI Targets)","Attack Techniques \u0026 Red Teaming"],"sub_categories":["LLM \u0026 GenAI Red Teaming"],"project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2FLLAMATOR-Core%2Fllamator","html_url":"https://awesome.ecosyste.ms/projects/github.com%2FLLAMATOR-Core%2Fllamator","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2FLLAMATOR-Core%2Fllamator/lists"}