{"id":48622008,"url":"https://github.com/nvidia/isv-ncp-validation-suite","last_synced_at":"2026-05-15T21:01:43.299Z","repository":{"id":348530258,"uuid":"1145656893","full_name":"NVIDIA/ISV-NCP-Validation-Suite","owner":"NVIDIA","description":"Validation and management tools for NVIDIA ISV Lab environments.","archived":false,"fork":false,"pushed_at":"2026-05-08T18:58:07.000Z","size":2272,"stargazers_count":11,"open_issues_count":113,"forks_count":9,"subscribers_count":1,"default_branch":"main","last_synced_at":"2026-05-08T20:45:22.331Z","etag":null,"topics":["gpu","kubernetes","nvidia","slurm","testing","validation"],"latest_commit_sha":null,"homepage":"https://www.nvidia.com/en-us/data-center/isv-validation-program/","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"apache-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/NVIDIA.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":"CONTRIBUTING.md","funding":null,"license":"LICENSE","code_of_conduct":"CODE_OF_CONDUCT.md","threat_model":null,"audit":null,"citation":null,"codeowners":".github/CODEOWNERS","security":"SECURITY.md","support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null,"notice":null,"maintainers":null,"copyright":null,"agents":"AGENTS.md","dco":null,"cla":null}},"created_at":"2026-01-30T03:49:08.000Z","updated_at":"2026-05-08T18:58:10.000Z","dependencies_parsed_at":null,"dependency_job_id":"fb29b842-3fee-4d35-9c8d-9f2377ad7df7","html_url":"https://github.com/NVIDIA/ISV-NCP-Validation-Suite","commit_stats":null,"previous_names":["nvidia/isv-ncp-validation-suite"],"tags_count":20,"template":false,"template_full_name":null,"purl":"pkg:github/NVIDIA/ISV-NCP-Validation-Suite","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/NVIDIA%2FISV-NCP-Validation-Suite","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/NVIDIA%2FISV-NCP-Validation-Suite/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/NVIDIA%2FISV-NCP-Validation-Suite/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/NVIDIA%2FISV-NCP-Validation-Suite/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/NVIDIA","download_url":"https://codeload.github.com/NVIDIA/ISV-NCP-Validation-Suite/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/NVIDIA%2FISV-NCP-Validation-Suite/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":33080346,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-05-15T20:25:35.270Z","status":"ssl_error","status_checked_at":"2026-05-15T20:25:34.732Z","response_time":103,"last_error":"SSL_connect returned=1 errno=0 peeraddr=140.82.121.5:443 state=error: unexpected eof while reading","robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":false,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["gpu","kubernetes","nvidia","slurm","testing","validation"],"created_at":"2026-04-09T04:00:44.478Z","updated_at":"2026-05-15T21:01:43.294Z","avatar_url":"https://github.com/NVIDIA.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"# NVIDIA ISV NCP Validation Suite\n\n[![License](https://img.shields.io/badge/License-Apache_2.0-blue.svg)](LICENSE)\n\nValidation and management tools for NVIDIA ISV Lab environments.\n\n\u003e [!WARNING]\n\u003e **Experimental Preview Release**\n\u003e This is an experimental/preview release of ISV-NCP-Validation-Suite. Use at your own risk in production environments. The software is provided \"as is\" without warranties of any kind. Features, APIs, and configurations may change without notice in future releases. For production deployments, thoroughly test in non-critical environments first.\n\n## What Is This?\n\nThe ISV NCP Validation Suite is a test framework for validating that developers and compute providers get the most from their NVIDIA hardware across a range of common compute offerings.\n\nIt consists of a very flexible set of tests, which ensure that a system is able to support AI training, inferencing, and running AI-enabled applications, along with more traditional cloud services.\n\nThis validation suite is meant to be run against an existing cloud system, specifically one that is running NVIDIA hardware. This suite is not itself a cloud software platform, nor does it target a single specific cloud platform. Instead, it maps high-level requirements to a set of *stub* functions, which allow you to run high-level operations (like \"Create a Virtual Machine\") which you can then use for direct validation, or as steps in validating more complex specifications.\n\n## Quick Start\n\nThe fastest way to try running parts of the validation suite is against an existing cloud service, such as AWS. This can be run by setting up your environment with your AWS keys and running a simple test, as follows:\n\n### Prerequisites\n\n- [uv](https://docs.astral.sh/uv/getting-started/installation/) (Python package manager)\n\nInstall:\n\n```bash\ngit clone https://github.com/NVIDIA/ISV-NCP-Validation-Suite.git\ncd ISV-NCP-Validation-Suite\nuv sync\n```\n\nConfigure credentials:\n\n```bash\nexport AWS_ACCESS_KEY_ID=...\nexport AWS_SECRET_ACCESS_KEY=...\nexport AWS_REGION=...\nexport AWS_SESSION_TOKEN=...  # only required for temporary/SSO credentials\n```\n\nExecution:\n\n```bash\n$ uv run isvctl test run -f isvctl/configs/providers/aws/config/control-plane.yaml\nLoaded configuration (1 import).\nValidating configuration...\n\nRunning phases: ['setup', 'test', 'teardown']\n... [~80 lines abridged]\n------------------------------------------------------------\n[PASS] All phases completed successfully\n```\n\n## Adding your own platform\n\nSee the **[my-isv scaffold](isvctl/configs/providers/my-isv/scripts/README.md)** --\ncopy-and-fill-in stubs with a demo-mode fallback. Preview the whole pipeline\nbefore writing any code:\n\n```bash\nmake demo-test\n```\n\n## Documentation\n\nSee [docs/](docs/) for full documentation:\n\n- [Getting Started](docs/getting-started.md) - Installation and first steps\n\n### Guides\n\n- [Configuration](docs/guides/configuration.md) - Config file format and options\n- [External Validation](docs/guides/external-validation-guide.md) - Create custom validations without modifying the repo\n- [Remote Deployment](docs/guides/remote-deployment.md) - Deploy and run tests remotely\n- [Local Development](docs/guides/local-development.md) - MicroK8s setup for local testing\n\n### References\n\n- [my-isv Scaffold](isvctl/configs/providers/my-isv/scripts/README.md) - Copy-and-fill-in stubs for adding your own platform\n- [Validation Test Suites](isvctl/configs/suites/README.md) - Provider-agnostic validation contract\n- [AWS Reference Implementation](docs/references/aws.md) - Working AWS examples for all validation domains\n\n### Package Reference\n\n- [isvctl](docs/packages/isvctl.md) - Controller documentation\n- [isvtest](docs/packages/isvtest.md) - Validation framework\n- [isvreporter](docs/packages/isvreporter.md) - Reporter documentation\n\n## Development\n\n```bash\nmake help      # Show available targets\nmake test      # Run tests for all packages\nmake lint      # Run linting\nmake build     # Build all packages\nmake plan      # Render docs/test-plan.yaml to AsciiDoc and interactive HTML\n```\n\nSee [Contributing](CONTRIBUTING.md) for development setup and guidelines.\n\n## Environment Variables\n\n| Variable | Description |\n| -------- | ----------- |\n| `ISV_SERVICE_ENDPOINT` | Required for ISV Lab Service uploads |\n| `ISV_SSA_ISSUER` | Required for ISV Lab Service uploads |\n| `ISV_CLIENT_ID` | Required for ISV Lab Service uploads |\n| `ISV_CLIENT_SECRET` | Required for ISV Lab Service uploads |\n| `NGC_API_KEY` | Required for NIM model benchmarks |\n\n## Security\n\nReport vulnerabilities via the [NVIDIA Security Vulnerability Submission Form](https://www.nvidia.com/object/submit-security-vulnerability.html) or email psirt@nvidia.com. **Do not open a public GitHub issue for security vulnerabilities.** See [SECURITY.md](SECURITY.md) for details.\n\n## License\n\nThis project is licensed under the [Apache License 2.0](LICENSE).\n\nThis project will download and install additional third-party open source software projects. Review the license terms of these open source projects before use.\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fnvidia%2Fisv-ncp-validation-suite","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fnvidia%2Fisv-ncp-validation-suite","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fnvidia%2Fisv-ncp-validation-suite/lists"}