{"id":42732714,"url":"https://github.com/rhesis-ai/rhesis-sdk","last_synced_at":"2026-01-29T17:19:59.319Z","repository":{"id":274352368,"uuid":"922625299","full_name":"rhesis-ai/rhesis-sdk","owner":"rhesis-ai","description":"Open-source test generation SDK for LLM applications. Access curated test sets. Build context-specific test sets and collaborate with subject matter experts.","archived":false,"fork":false,"pushed_at":"2025-05-17T14:28:40.000Z","size":430,"stargazers_count":18,"open_issues_count":0,"forks_count":0,"subscribers_count":1,"default_branch":"main","last_synced_at":"2025-05-17T15:31:12.528Z","etag":null,"topics":["application-insights","compliance","llm-evaluation","llm-testing","open-source","quality-assessment","reliability","responsible-ai","robustness","trustworthiness","validation"],"latest_commit_sha":null,"homepage":"https://www.rhesis.ai/","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/rhesis-ai.png","metadata":{"files":{"readme":"README.md","changelog":"CHANGELOG.md","contributing":"CONTRIBUTING.md","funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null}},"created_at":"2025-01-26T17:43:49.000Z","updated_at":"2025-05-17T14:28:43.000Z","dependencies_parsed_at":null,"dependency_job_id":"68acbb2f-b833-4c2e-a856-16441072c86c","html_url":"https://github.com/rhesis-ai/rhesis-sdk","commit_stats":null,"previous_names":["rhesis-ai/rhesis-sdk"],"tags_count":9,"template":false,"template_full_name":null,"purl":"pkg:github/rhesis-ai/rhesis-sdk","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/rhesis-ai%2Frhesis-sdk","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/rhesis-ai%2Frhesis-sdk/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/rhesis-ai%2Frhesis-sdk/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/rhesis-ai%2Frhesis-sdk/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/rhesis-ai","download_url":"https://codeload.github.com/rhesis-ai/rhesis-sdk/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/rhesis-ai%2Frhesis-sdk/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":28881726,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-01-29T16:41:59.663Z","status":"ssl_error","status_checked_at":"2026-01-29T16:39:39.641Z","response_time":59,"last_error":"SSL_connect returned=1 errno=0 peeraddr=140.82.121.6:443 state=error: unexpected eof while reading","robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":false,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["application-insights","compliance","llm-evaluation","llm-testing","open-source","quality-assessment","reliability","responsible-ai","robustness","trustworthiness","validation"],"created_at":"2026-01-29T17:19:58.704Z","updated_at":"2026-01-29T17:19:59.311Z","avatar_url":"https://github.com/rhesis-ai.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"# ⚠️ DEPRECATED\n\nThis repository is no longer maintained.\n\nPlease use the new repository: [github.com/rhesis-ai/rhesis](https://github.com/rhesis-ai/rhesis)\n\n# Rhesis SDK 🧠\n\u003cmeta name=\"google-site-verification\" content=\"muyrLNdeOT9KjYaOnfpOmGi8K5xPe8o7r_ov3kEGdXA\" /\u003e\n\u003cp align=\"center\"\u003e\n  \u003cimg src=\"https://cdn.prod.website-files.com/66f422128b6d0f3351ce41e3/66fcfdf2e263aab9f4a19e52_Logo%20Rhesis%20Blue.png\" alt=\"Rhesis Blue\" width=\"300\"/\u003e\n\u003c/p\u003e\n\u003cp align=\"center\"\u003e\n  \u003ca href=\"https://github.com/rhesis-ai/rhesis-sdk/blob/main/LICENSE\"\u003e\n    \u003cimg src=\"https://img.shields.io/github/license/rhesis-ai/rhesis-sdk\" alt=\"License\"\u003e\n  \u003c/a\u003e\n  \u003ca href=\"https://pypi.org/project/rhesis-sdk/\"\u003e\n    \u003cimg src=\"https://img.shields.io/pypi/v/rhesis-sdk\" alt=\"PyPI Version\"\u003e\n  \u003c/a\u003e\n  \u003ca href=\"https://pypi.org/project/rhesis-sdk/\"\u003e\n    \u003cimg src=\"https://img.shields.io/pypi/pyversions/rhesis-sdk\" alt=\"Python Versions\"\u003e\n  \u003c/a\u003e\n  \u003ca href=\"https://discord.rhesis.ai\"\u003e\n    \u003cimg src=\"https://img.shields.io/discord/1340989671601209408?color=7289da\u0026label=Discord\u0026logo=discord\u0026logoColor=white\" alt=\"Discord\"\u003e\n  \u003c/a\u003e\n  \u003ca href=\"https://www.linkedin.com/company/rhesis-ai\"\u003e\n    \u003cimg src=\"https://img.shields.io/badge/LinkedIn-Rhesis_AI-blue?logo=linkedin\" alt=\"LinkedIn\"\u003e\n  \u003c/a\u003e\n  \u003ca href=\"https://huggingface.co/rhesis\"\u003e\n    \u003cimg src=\"https://img.shields.io/badge/🤗-Rhesis-yellow\" alt=\"Hugging Face\"\u003e\n  \u003c/a\u003e\n  \u003ca href=\"https://docs.rhesis.ai\"\u003e\n    \u003cimg src=\"https://img.shields.io/badge/docs-rhesis.ai-blue\" alt=\"Documentation\"\u003e\n  \u003c/a\u003e\n\u003c/p\u003e\n\n\u003e Gen AI applications that deliver value, not surprises.\n\nThe Rhesis SDK enables developers to access curated test sets and generate dynamic ones for GenAI applications. It provides tools to tailor validations to your needs and integrate seamlessly to keep your Gen AI robust, reliable \u0026 compliant.\n\n\u003cimg src=\"https://cdn.prod.website-files.com/66f422128b6d0f3351ce41e3/67ea61119543db5f3fa4776e_Screenshot%20Rhesis%20AI%20Platform.png\" \n     loading=\"lazy\" \n     width=\"1392\" \n     sizes=\"(max-width: 479px) 100vw, (max-width: 767px) 95vw, (max-width: 991px) 94vw, 95vw\" \n     alt=\"Dashboard mockup\" \n     srcset=\"https://cdn.prod.website-files.com/66f422128b6d0f3351ce41e3/67ea61119543db5f3fa4776e_Screenshot%20Rhesis%20AI%20Platform.png 2939w\" \n     class=\"uui-layout41_lightbox-image-01-2\"\u003e\n\n## 📑 Table of Contents\n\n- [Features](#-features)\n- [Installation](#-installation)\n- [Getting Started](#-getting-started)\n  - [Obtain an API Key](#1-obtain-an-api-key-)\n  - [Configure the SDK](#2-configure-the-sdk-%EF%B8%8F)\n- [Quick Start](#-quick-start)\n  - [Working with Test Sets](#working-with-test-sets-)\n  - [Generating Custom Test Sets](#generating-custom-test-sets-%EF%B8%8F)\n- [About Rhesis AI](#-about-rhesis-ai)\n- [Community](#-community-)\n- [Hugging Face](#-hugging-face)\n- [Support](#-support)\n- [License](#-license)\n\n## ✨ Features\n\nThe Rhesis SDK currently provides functionality to work with Rhesis test sets through routine operations:\n\n- **List Test Sets**: Browse through available curated test sets\n- **Load Test Sets**: Load specific test sets for your use case\n- **Download Test Sets**: Download test set data for offline use\n- **Generate Test Sets**: Generate new test sets from basic prompts\n\n## 🚀 Installation\n\nInstall the Rhesis SDK using pip:\n\n```bash\npip install rhesis-sdk\n```\n\n## 🏁 Getting Started\n\n### 1. Obtain an API Key 🔑\n\n1. Visit [https://app.rhesis.ai](https://app.rhesis.ai)\n2. Sign up for a Rhesis account\n3. Navigate to your account settings\n4. Generate a new API key\n\nYour API key will be in the format `rh-XXXXXXXXXXXXXXXXXXXX`. Keep this key secure and never share it publicly.\n\n\u003e **Note:** On the Rhesis App, you can also create test sets for your own use cases and access them via the SDK. You only need to connect your GitHub account to create a test set.\n\n### 2. Configure the SDK ⚙️\n\nYou can configure the Rhesis SDK either through environment variables or direct configuration:\n\n#### Using Environment Variables\n\n```bash\nexport RHESIS_API_KEY=\"your-api-key\"\nexport RHESIS_BASE_URL=\"https://api.rhesis.ai\"  # optional\n```\n\n#### Direct Configuration\n\n```python\nimport rhesis \n\n# Set configuration directly\nrhesis.base_url = \"https://api.rhesis.ai\"  # optional\nrhesis.api_key = \"rh-XXXXXXXXXXXXXXXXXXXX\"\n```\n\n## ⚡ Quick Start\n\nBefore you start, you can configure the Rhesis SDK either through environment variables or direct configuration, as described above.\n\n### Working with Test Sets 📋\n\n```python\nfrom rhesis.entities import TestSet\n\n# List all test sets\nfor test_set in TestSet().all():\n    print(test_set)\n\n# Load a specific test set\ntest_set = TestSet(id=\"agent-or-industry-fraud-harmful\")\ntest_set.load()\n\n# Download test set data\ntest_set.download()\n\n# Generate a new test set\nprompt_synthesizer = PromptSynthesizer(prompt=\"Generate tests for an insurance chatbot that can answer questions about the company's policies.\")\ntest_set = prompt_synthesizer.generate(num_tests=5)\n\n```\n\nFor more detailed examples, check out our [example notebooks](examples/).\n\n### Generating Custom Test Sets 🛠️\n\nIf none of the existing test sets fit your needs, you can generate your own.\n\nYou can check out [app.rhesis.ai](http://app.rhesis.ai). There you can define requirements, scenarios and personas, and even import your existing GitHub repository.\n\n## 🧪 About Rhesis AI\n\nRhesis AI helps organizations build Gen AI applications that deliver value, not surprises. Our platform enables you to:\n- Access curated test sets\n- Generate custom test sets\n- Upload your custom test sets to the cloud\n- Tailor validations to your specific needs\n- Integrate testing seamlessly into your workflow\n- Keep your Gen AI applications robust, reliable \u0026 compliant\n\nMade in Potsdam, Germany 🇩🇪\n\nVisit [rhesis.ai](https://rhesis.ai) to learn more about our platform and services.\n\n## 👥 Community 💬\n\nJoin our [Discord server](https://discord.rhesis.ai) to connect with other users and developers.\n\n## 🤗 Hugging Face\n\nYou can also find us on [Hugging Face](https://huggingface.co/rhesis). There, you can find our test sets across multiple use cases.\n\n## 🆘 Support\n\nFor questions, issues, or feature requests:\n- Visit our [documentation](https://docs.rhesis.ai)\n- Contact us at hello@rhesis.ai\n- Create an issue in this repository\n\n## 📝 License\n\nThis project is licensed under the MIT License - see the [LICENSE](LICENSE) file for details.\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Frhesis-ai%2Frhesis-sdk","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Frhesis-ai%2Frhesis-sdk","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Frhesis-ai%2Frhesis-sdk/lists"}