{"id":13716080,"url":"https://olcf.github.io/olcf-test-harness/","last_synced_at":"2025-05-07T05:32:22.368Z","repository":{"id":41320295,"uuid":"328808943","full_name":"olcf/olcf-test-harness","owner":"olcf","description":"OLCF Test Harness","archived":false,"fork":false,"pushed_at":"2025-03-26T15:02:29.000Z","size":8169,"stargazers_count":12,"open_issues_count":45,"forks_count":5,"subscribers_count":12,"default_branch":"devel","last_synced_at":"2025-03-26T16:23:06.274Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":"https://olcf.github.io/olcf-test-harness/","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"other","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/olcf.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2021-01-11T22:35:39.000Z","updated_at":"2025-03-26T15:02:37.000Z","dependencies_parsed_at":"2023-02-17T06:31:06.374Z","dependency_job_id":"6c387ebe-6457-47ff-911d-fecb23d80331","html_url":"https://github.com/olcf/olcf-test-harness","commit_stats":null,"previous_names":[],"tags_count":1,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/olcf%2Folcf-test-harness","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/olcf%2Folcf-test-harness/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/olcf%2Folcf-test-harness/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/olcf%2Folcf-test-harness/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/olcf","download_url":"https://codeload.github.com/olcf/olcf-test-harness/tar.gz/refs/heads/devel","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":252823139,"owners_count":21809700,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2024-08-03T00:01:06.840Z","updated_at":"2025-05-07T05:32:17.344Z","avatar_url":"https://github.com/olcf.png","language":"Python","funding_links":[],"categories":["Miscellaneous"],"sub_categories":[],"readme":"# OLCF Test Harness (OTH)\n\nThis repository hosts the source code and documentation of the OLCF Test Harness (OTH).\nThe full OTH documentation can be found at [](https://olcf.github.io/olcf-test-harness),\nor can be viewed locally by cloning this repository and launching a Python HTTP server in the `docs` directory:\n\n```\ngit clone https://github.com/olcf/olcf-test-harness\ncd olcf-test-harness/docs\npython3 -m http.server 8080\n# Then, navigate to localhost:8080 in a browser on your computer\n```\n\nSample tests can be found at https://github.com/olcf/olcf-test-harness-examples.\n\n## Quick-Start\n\n### Obtaining the OTH source code\n\nTo obtain the OTH source code, run the following commands on the machine you are testing:\n```\ngit clone git@github.com:olcf/olcf-test-harness.git  \ncd olcf-test-harness\nexport OLCF_HARNESS_DIR=`pwd`  \nmodule use $OLCF_HARNESS_DIR/modulefiles  \nmodule load olcf_harness\nexport OLCF_HARNESS_MACHINE=\u003cmachine\u003e\n```\n\n### Configuring the machine settings\n\nIf you are using an OLCF machine, there are machine configuration files provided in `${OLCF_HARNESS_DIR}/configs/olcf_examples`.\nPlease copy these into the `configs` directory.\nIf you are using a machine which is not provided in the `${OLCF_HARNESS_DIR}/configs/olcf_examples` directory, please see the [OTH User Guide](https://olcf.github.io/olcf-test-harness).\n\n### Specifying tests to run\n\nOnce the `${OLCF_HARNESS_MACHINE}.ini` file is placed in the `${OLCF_HARNESS_DIR}/configs` directory, construct an input file to provide the OTH at run-time.\nIn this example, we will name it `rgt.inp`, but the name is not important, as long as you specify the correct name with the `-i` command-line flag.\n\nFirst, clone the OLCF Test Harness examples:\n```\nmkdir -p /home/auser/oth/applications\ngit clone https://github.com/olcf/olcf-test-harness-examples.git /home/auser/oth/applications/olcf-test-harness-examples\n```\n\nrgt.inp:\n```\n# Within the Path_to_tests directory, you will place application repositories\n# Inside each application is one or more tests that can be called\n# In this case, the OTH examples are nested deeply to support \u003e1 machine,\n# so we have to specify the Frontier applications directory\nPath_to_tests = /home/auser/oth/applications/olcf-test-harness-examples/frontier\n\n# Syntax for defining a test to run:\n# Test = \u003cappname\u003e \u003ctestname\u003e\n# This test is in the olcf-test-harness-examples repo for Frontier:\nTest = lammps test_1node_4mil_reax\n# Multiple tests may be defined by copying the above line and changing the test name\n```\n\n### Launching a test\n\nTo launch one of the examples from the [OTH Examples Repo](https://github.com/olcf/olcf-test-harness-examples) on Frontier:\n\n```\n# Optional: replace with your own instance of the OTH\nexport OLCF_HARNESS_DIR=\"/sw/acceptance/olcf-test-harness\"\nmodule use $OLCF_HARNESS_DIR/modulefiles\nmodule load olcf_harness\nexport OLCF_HARNESS_MACHINE=\"frontier\"\n# Set this to an account that you have permission to submit to:\nexport RGT_SUBMIT_ACCT=\"YOURACCOUNT123\"\n# Launch the test!\nruntests -i rgt.inp --mode start stop\n```\n\nAt the end of the output on your screen, you should see a a few lines like the following:\n```\nPath to Source: /home/auser/oth/applications/olcf-test-harness-examples/frontier/lammps/Source\nPath to Build Dir: /\u003cyour RGT_PATH_TO_SSPACE\u003e/lammps/test_1node_4mil_reax/1695761632.2935946/build_directory\nSubmitting job from SLURM class using batchfilename run.sh\nsbatch  -p batch  -A \u003cyour RGT_SUBMIT_ACCT\u003e run.sh\nSLURM jobID =  \u003csome schedulerJob ID\u003e\nbuild exit value = 0\nsubmit exit value = 0\nSkipped 0, launched 1.\n```\n\nWhen you see `submit exit value = 0`, you know your job was successfully launched.\n\n### Checking Test Results\n\nTo find the results of the test, you may go to `\u003cyour Path_to_tests\u003e/\u003capp\u003e/\u003ctest\u003e/Run_Archive/latest` (in this case, `/home/auser/oth/applications/olcf-test-harness-examples/frontier/lammps/test_1node_4mil_reax/Run_Archive/latest`).\nThis is the directory your job launched from, and it is the directory your job stdout/stderr will go to and any output files will be copied back to.\nWhen the job completes, you should see all output files in this directory as well as an `output_check.txt`.\nThis file contains the output from your check script, which parses your output files to check the result of the test for correctness and performance.\n\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/olcf.github.io%2Folcf-test-harness%2F","html_url":"https://awesome.ecosyste.ms/projects/olcf.github.io%2Folcf-test-harness%2F","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/olcf.github.io%2Folcf-test-harness%2F/lists"}