{"id":14969350,"url":"https://github.com/openshift/verification-tests","last_synced_at":"2025-05-16T15:07:48.546Z","repository":{"id":37458375,"uuid":"151291406","full_name":"openshift/verification-tests","owner":"openshift","description":"Blackbox test suite for OpenShift.","archived":false,"fork":false,"pushed_at":"2025-05-14T04:38:06.000Z","size":62910,"stargazers_count":58,"open_issues_count":4,"forks_count":172,"subscribers_count":14,"default_branch":"main","last_synced_at":"2025-05-14T06:06:52.759Z","etag":null,"topics":["cloud","cucumber","iaas","openshift","ruby","test-automation","tests"],"latest_commit_sha":null,"homepage":null,"language":"Gherkin","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"gpl-3.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/openshift.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null}},"created_at":"2018-10-02T17:01:04.000Z","updated_at":"2025-05-14T04:46:47.000Z","dependencies_parsed_at":"2023-09-28T12:12:57.909Z","dependency_job_id":"286d63d6-f8c6-4859-b54e-2a17b14c5851","html_url":"https://github.com/openshift/verification-tests","commit_stats":{"total_commits":3575,"total_committers":140,"mean_commits":"25.535714285714285","dds":0.8537062937062937,"last_synced_commit":"34d672b54f748bb1558e7223ef8c1752a607b9c0"},"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/openshift%2Fverification-tests","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/openshift%2Fverification-tests/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/openshift%2Fverification-tests/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/openshift%2Fverification-tests/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/openshift","download_url":"https://codeload.github.com/openshift/verification-tests/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":254553958,"owners_count":22090417,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["cloud","cucumber","iaas","openshift","ruby","test-automation","tests"],"created_at":"2024-09-24T13:41:43.947Z","updated_at":"2025-05-16T15:07:43.537Z","avatar_url":"https://github.com/openshift.png","language":"Gherkin","readme":"# Cucumber based blackbox testing framework for OpenShift\n\n## Getting started\n\nMore info you can find in [Overview document](doc/overview.adoc).\n\n### Create local dev environment in container\n\n```\n# you can replace oc418 with expected version you want\npodman run --env LANG=en_US.UTF-8  --env LANGUAGE=en_US.UTF-8  --env LC_ALL=en_US.UTF-8 \\\n\t   --user root --shm-size 2g --interactive --tty --rm \\\n\t   --entrypoint bash \\\n\t   --volume \"$REPLACE_ME/local/path/to/verification-tests:/verification-tests:z\" \\\n\t   --volume \"$REPLACE_ME/local/path/to/cucushift:/verification-tests/features/tierN:z\" \\\n\t   --volume \"$REPLACE_ME/local/path/to/cucushift-internal:/verification-tests/private:z\" \\\n       images.paas.redhat.com/aos-qe-ci/jenkins-agent-rhel8-cucushift-oc418:latest\nbash-4.4# cd /verification-tests/\n```\nThen follow steps in [Test scenario execution](#test-scenario-execution)\n\n### Create local dev environment\n\n1. Install git if not installed already, install ruby 2.7 if not installed\n2. git clone git@github.com:openshift/verification-tests.git\n3. cd verification-tests\n4. tools/install_os_deps.sh # need sudo; you may need to login again to terminal if ruby was installed via rvm during this phase (see below for RVM usage)\n5. tools/hack_bundle.rb # normal user\n6. Install OKD or OpenShift Container Platform client tools\n7. Install the web driver if you desire to run tests which work with the Web UI. See [Web Driver](doc/configuration.adoc)\n\n### Update local dev environment\n\n```\nbundle update\n```\n\n### Test scenario execution\n\nCheck [Configuring a BushSlicer v3 run](doc/configuration.adoc)\n\nThis is an example:\n\n```\nexport BUSHSLICER_DEFAULT_ENVIRONMENT=ocp4\nexport OPENSHIFT_ENV_OCP4_HOSTS=api.*.openshift.com:lb\nexport OPENSHIFT_ENV_OCP4_USER_MANAGER_USERS=user1:redhat,user2:redhat\nexport OPENSHIFT_ENV_OCP4_ADMIN_CREDS_SPEC=file:///home/path-to/kubeconfig\nexport BUSHSLICER_CONFIG='\nglobal:\n  browser: chrome\nenvironments:\n  ocp4:\n    version: \"4.9.0\"\n    #api_port: 443\t# For HA clusters, both 3.x and 4.x\n    #api_port: 6443\t# For non-HA 4.x clusters\n    #api_port: 8443\t# For non-HA 3.x clusters\n    #web_console_url: https://console-openshift-console.apps.*.openshift.com\n'\n\n# execute a whole feature file\nbundle exec cucumber features/cli/create.feature\n# or execute a single scenario\nbundle exec cucumber features/cli/create.feature:5\n# or execute the smoke tests\nbundle exec cucumber --tags @smoke\n```\n\nYou can check which environments are defined in [config/config.yaml](config/config.yaml).\n\nYou could also use the BUSHSLICER_CONFIG variable to override other\nconfiguration options. Add YAML/JSON into it and it will be merged with\nconfiguration file.\n\n### Debugging failures\n\nIf any step fails, you will fall into a `pry` shell where you can investigate what's going on. This behavior depends on Cucumber profile that you enable during execution.\n\n1. running steps using `step 'Step name'`\n2. inspecting the `@result` variable\n3. calling and methods in World\n\n### Running tests from outside this repository\n\nYou can put your private test scenarios under `features/tierN` directory.\nIt is in [.gitignore](.gitignore) so that you can keep your test scenarios under the same file system tree without git messing them up.\n\n## Contributing\n\nPlease submit issues and pull requests to the project. You can discuss and ask questions on [OpenShift mailing list](https://lists.openshift.redhat.com/openshiftmm/listinfo/dev).\n\n\n### RVM for dependency management\n\nIf you are planning on installing dependencies for verification Tests on your system, it is often a good idea to use some kind of Version Manager/Package manager, like RVM.\n\nRVM is analogous to virtualenv in python and it stands for Ruby Version Manager.\n\nYou can install RVM and read more abou it on https://rvm.io/\n\nUsually once RVM is installed, you would want to create/install a new `rvm` interpreter using:\n\n```\n`rvm install \"ruby-2.7.6\" \u0026\u0026 rvm  --create use 2.7.6@verification-tests` which will install Ruby 2.7.6 and create a new interpreter as well as a Gemset.\nWhen we install Ruby 2.7.6, it creates a local directory for your user with Ruby 2.7.6 under `~/.rvm/rubies/ruby-2.7.6`.\nOnce that is done, the Gemset creation is basically an attempt to have dependencies for various apps under same interpreter `2.7.6`. So in this case,\nwe are creating Gemset `verification-tests` for this repo dependencies. If you had multiple repos, you would use similar command as above to create a new Gemset under 2.7.6\nand give it a name that you can recognize. Then for each respective app you may choose to use different gemset as `rvm use 2.7.6@verification-tests` or `rvm use 2.7.6@my-other-repo-or-app`.\n\nFeel free to read about interpreter and gemset in the Ruby docs or elsewhere on the internet.\n\nOnce ruby is installed, interpreter is created and gemset is present and activated, you can run `which ruby` to validate if the correct ruby is used and `ruby -v` to check version.\nFollowing this, you may continue the steps as mentioned above, to run `bundle` commands to install gems listed in Gemfile to your Gemset.\n\nAlso if you are wondering what does `bundle` command do, search and read about `ruby bundler` on the internet.\n```\n","funding_links":[],"categories":[],"sub_categories":[],"project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fopenshift%2Fverification-tests","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fopenshift%2Fverification-tests","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fopenshift%2Fverification-tests/lists"}