{"id":21047098,"url":"https://github.com/stakx/testcasefilterinvalidformatbugrepro","last_synced_at":"2025-05-15T19:31:39.171Z","repository":{"id":131344575,"uuid":"199009138","full_name":"stakx/TestCaseFilterInvalidFormatBugRepro","owner":"stakx","description":"Repro to demonstrate an issue with VS 16.2.0 Test Explorer not executing some parameterized NUnit 3 tests.","archived":true,"fork":false,"pushed_at":"2019-07-26T12:16:54.000Z","size":5,"stargazers_count":0,"open_issues_count":0,"forks_count":0,"subscribers_count":1,"default_branch":"master","last_synced_at":"2025-05-10T09:38:57.258Z","etag":null,"topics":["bug","nunit","nunit3","nunit3testadapter","reproduction","test-explorer","visual-studio","visual-studio-2019"],"latest_commit_sha":null,"homepage":"https://developercommunity.visualstudio.com/content/problem/663145/test-explorer-in-vs-1620-can-no-longer-run-certain.html","language":"C#","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/stakx.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2019-07-26T12:00:41.000Z","updated_at":"2024-10-13T11:27:07.000Z","dependencies_parsed_at":"2023-07-31T12:15:09.197Z","dependency_job_id":null,"html_url":"https://github.com/stakx/TestCaseFilterInvalidFormatBugRepro","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/stakx%2FTestCaseFilterInvalidFormatBugRepro","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/stakx%2FTestCaseFilterInvalidFormatBugRepro/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/stakx%2FTestCaseFilterInvalidFormatBugRepro/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/stakx%2FTestCaseFilterInvalidFormatBugRepro/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/stakx","download_url":"https://codeload.github.com/stakx/TestCaseFilterInvalidFormatBugRepro/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":254407378,"owners_count":22066229,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["bug","nunit","nunit3","nunit3testadapter","reproduction","test-explorer","visual-studio","visual-studio-2019"],"created_at":"2024-11-19T14:35:26.719Z","updated_at":"2025-05-15T19:31:39.164Z","avatar_url":"https://github.com/stakx.png","language":"C#","funding_links":[],"categories":[],"sub_categories":[],"readme":"# TestCaseFilterInvalidFormatBugRepro\n\nThis repository contains a minimal NUnit test project with a single test that Visual Studio 16.2.0's Test Explorer won't be able to execute.\n\n\n## When the test is run in Visual Studio 16.2.0 Test Explorer\n\nTrying to run the test will result in the following error (visible in the *Output* window when *Show output from* is set to *Tests*):\n\n\u003e ```\n\u003e [26 Jul 2019 2:03:16.285 PM Informational] ---------- Discovery started ----------\n\u003e [26 Jul 2019 2:03:16.300 PM Informational] ========== Discovery skipped: All test containers are up to date ==========\n\u003e [26 Jul 2019 2:03:16.306 PM Informational] ---------- Run started ----------\n\u003e [26 Jul 2019 2:03:17.418 PM Informational] NUnit Adapter 3.13.0.0: Test execution started\n\u003e [26 Jul 2019 2:03:17.427 PM Error] An exception occurred while invoking executor 'executor://nunit3testexecutor/': Incorrect format for TestCaseFilter Error: Invalid Condition 'FullyQualifiedName=Tests.Test =\u003e True'. Specify the correct format and try again. Note that the incorrect format can lead to no test getting executed.\n\u003e [26 Jul 2019 2:03:17.498 PM Informational] ========== Run finished: 0 tests run (0:00:01,1892526) ==========\n\u003e ```\n\nThe problem appears to be caused by the way how the arguments produced by the test case source (LINQ expression trees in this case here) are formatted as strings: [see here](https://github.com/stakx/TestCaseFilterInvalidFormatBugRepro/blob/b30781ba3fdf6b9d068cb8a2e6f685b3b48fec8a/TestCaseFilterInvalidFormatBugRepro/Program.cs#L48-L55).\n\n\n## When run on the console using `vstest.console`\n\nWorks fine:\n\n\u003e ```\n\u003e vstest.console .\\TestCaseFilterInvalidFormatBugRepro.dll\n\u003e ```\n\u003e\n\u003e ```\n\u003e Microsoft (R) Test Execution Command Line Tool Version 16.2.0\n\u003e Copyright (c) Microsoft Corporation.  All rights reserved.\n\u003e \n\u003e Starting test execution, please wait...\n\u003e NUnit Adapter 3.13.0.0: Test execution started\n\u003e Running all tests in ...\\TestCaseFilterInvalidFormatBugRepro\\bin\\Debug\\netcoreapp2.2\\.\\TestCaseFilterInvalidFormatBugRepro.dll\n\u003e    NUnit3TestExecutor converted 1 of 1 NUnit test cases\n\u003e NUnit Adapter 3.13.0.0: Test execution complete\n\u003e   √ Test(() =\u003e True) [6ms]\n\n\u003e Test Run Successful.\n\u003e Total tests: 1\n\u003e      Passed: 1\n\u003e  Total time: 1,0082 Seconds\n\u003e ```\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fstakx%2Ftestcasefilterinvalidformatbugrepro","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fstakx%2Ftestcasefilterinvalidformatbugrepro","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fstakx%2Ftestcasefilterinvalidformatbugrepro/lists"}