{"id":14985548,"url":"https://github.com/yaml/libyaml-test-suite","last_synced_at":"2025-03-25T12:33:08.675Z","repository":{"id":66047229,"uuid":"268858674","full_name":"yaml/libyaml-test-suite","owner":"yaml","description":"Testing libyaml against yaml-test-suite","archived":false,"fork":false,"pushed_at":"2020-06-15T17:31:59.000Z","size":14,"stargazers_count":4,"open_issues_count":0,"forks_count":2,"subscribers_count":4,"default_branch":"devel","last_synced_at":"2025-03-17T11:53:52.623Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":null,"language":"Shell","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/yaml.png","metadata":{"files":{"readme":"ReadMe.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2020-06-02T16:56:48.000Z","updated_at":"2025-02-12T03:06:13.000Z","dependencies_parsed_at":"2023-03-29T00:19:58.504Z","dependency_job_id":null,"html_url":"https://github.com/yaml/libyaml-test-suite","commit_stats":{"total_commits":15,"total_committers":1,"mean_commits":15.0,"dds":0.0,"last_synced_commit":"b1626d85a6fe778c8288790f5ccd182a4b52621a"},"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/yaml%2Flibyaml-test-suite","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/yaml%2Flibyaml-test-suite/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/yaml%2Flibyaml-test-suite/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/yaml%2Flibyaml-test-suite/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/yaml","download_url":"https://codeload.github.com/yaml/libyaml-test-suite/tar.gz/refs/heads/devel","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":245463011,"owners_count":20619596,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2024-09-24T14:11:11.551Z","updated_at":"2025-03-25T12:33:08.636Z","avatar_url":"https://github.com/yaml.png","language":"Shell","funding_links":[],"categories":[],"sub_categories":[],"readme":"run-test-suite\n==============\n\nBranch to support testing libyaml with yaml-test-suite\n\n# Synopsis\n\nFrom libyaml master branch:\n\n```\n./bootstrap\n./configure\nmake test\nmake test-suite\n```\n\n# Overview\n\nThis code lives in the `libyaml` git repository on the `run-test-suite` branch.\nIt is used to test libyaml against the YAML Test Suite.\nThe master branch has a Makefile rule to run this using `make test-suite`.\n\nThat command will checkout this branch under the `tests/run-test-suite` directory and then call this Makefile's `make test`.\n\nSee:\n\n* https://github.com/yaml/yaml-test-suite\n\n# Pinning a Test Environment\n\nBy default, the test system will look for a file called `env/pin-\u003ccommit\u003e` where `\u003ccommit\u003e` is a git ref of the libyaml source code being tested (usually master).\nWhen a commit is pushed to master, an entry should be added to the `env` directory for that commit.\nThe pin file contains information about how the tests should be run and will be sourced by the test runner.\n\nSpecifically, the pin file names the test suite repo, the commit to use, and which tests to use (blacklist/whitelist info).\nThe test suite repo is usually https://github.com/yaml/yaml-test-suite/, but could be a fork if you need to try something.\n\nThere are 2 commands: `whitelist` and `blacklist` which can be used to identify the appropriate tests to run.\n\nHere is an example pin file:\n```\n# First set these 2 variables:\nLIBYAML_TEST_SUITE_DATA_REPO=https://github.com/yaml/yaml-test-suite\nLIBYAML_TEST_SUITE_DATA_COMMIT=data-2019-09-17\n\n# Start by including all the tests:\nwhitelist all\n\n# Next, blacklist or whitelist for `emitter`, `parser` and `parser-error`:\n\n# Args can be a multiline string of IDs and descriptions:\nblacklist parser \"\\\nXXX1: A test\nXXX2: Another test\n\"\n\n# Use a predefined set of blacklists:\nsource \"$ENV/blacklist-123\"\n\n# Args can also be a list of IDs:\nwhitelist emitter AAA1 AAA2 AAA3\nwhitelist parser-error XXX8 XXX9\n```\n\nHere's a pin file for just running a single parser test:\n```\nLIBYAML_TEST_SUITE_DATA_REPO=https://github.com/yaml/yaml-test-suite\nLIBYAML_TEST_SUITE_DATA_COMMIT=data-2019-09-17\nwhitelist parser AAA1\n```\n\n## Overriding the Pin File\n\nThere are a few ways to specify which pinning to use.\nThey involve setting the `LIBYAML_TEST_SUITE_ENV` variable.\n\nTo use a specific pin file for testing, use an absolute path to some file:\n```\nmake test-suite LIBYAML_TEST_SUITE_ENV=/tmp/my-pin-file\n```\n\nNOTE: You can use `env` instead of `LIBYAML_TEST_SUITE_ENV` with a `make test` command.\n\nTo use a specific pin file, name the file that lives in the `env` directory:\n```\nmake test-suite env=pin-0032321756cee86a67171de425267c1d0d406092\n```\n\n## Specifying the Pin Info for a Pull Request\n\nIf you are submitting a PR, you can put the pin file content in your log message.\nAdd this exact line to your log message:\n```\n*** yaml-test-suite\n```\n\nEverything after that will be placed into a pin file.\n\n## Pin Debugging\n\nYou can turn on debugging info for the pin `lookup` utility:\n```\nmake test-suite debug=1\n```\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fyaml%2Flibyaml-test-suite","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fyaml%2Flibyaml-test-suite","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fyaml%2Flibyaml-test-suite/lists"}