{"id":18612404,"url":"https://github.com/winvector/campaignplanner_v3","last_synced_at":"2025-04-10T23:31:19.644Z","repository":{"id":142726344,"uuid":"109193927","full_name":"WinVector/CampaignPlanner_v3","owner":"WinVector","description":"Shiny demo of A/B test planning and evaluation (improved UI for A/B testing method taught in free video course)","archived":false,"fork":false,"pushed_at":"2020-06-22T21:10:07.000Z","size":142,"stargazers_count":17,"open_issues_count":0,"forks_count":9,"subscribers_count":7,"default_branch":"main","last_synced_at":"2025-03-25T06:14:38.049Z","etag":null,"topics":["r"],"latest_commit_sha":null,"homepage":"https://www.youtube.com/playlist?list=PLAKBwakacHbRRw278HMXpCsOOIIcLYGX5","language":"R","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"gpl-3.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/WinVector.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null}},"created_at":"2017-11-01T23:13:17.000Z","updated_at":"2023-07-25T14:12:33.000Z","dependencies_parsed_at":"2023-04-09T13:47:24.863Z","dependency_job_id":null,"html_url":"https://github.com/WinVector/CampaignPlanner_v3","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/WinVector%2FCampaignPlanner_v3","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/WinVector%2FCampaignPlanner_v3/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/WinVector%2FCampaignPlanner_v3/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/WinVector%2FCampaignPlanner_v3/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/WinVector","download_url":"https://codeload.github.com/WinVector/CampaignPlanner_v3/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":248316046,"owners_count":21083371,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["r"],"created_at":"2024-11-07T03:17:01.344Z","updated_at":"2025-04-10T23:31:16.989Z","avatar_url":"https://github.com/WinVector.png","language":"R","readme":"# CampaignPlanner_v3\n\nShiny demo of A/B test planning and evaluation\n\nImproved user interface for A/B testing theory taught in this\nfree video course [Bayesian A/B campaign testing (and design)](https://www.youtube.com/playlist?list=PLAKBwakacHbRRw278HMXpCsOOIIcLYGX5).\n\nAlso available as a [public running app](https://www.youtube.com/playlist?list=PLAKBwakacHbRRw278HMXpCsOOIIcL).\n\n\n#  [Win-Vector LLC's free  video lecture on Bayesian A/B testing](https://www.youtube.com/playlist?list=PLAKBwakacHbRRw278HMXpCsOOIIcLYGX5)\n\n[![](img.jpeg)](https://www.youtube.com/playlist?list=PLAKBwakacHbRRw278HMXpCsOOIIcLYGX5)\n\nSource code: https://github.com/WinVector/CampaignPlanner/\nApp hosted online at: https://win-vector.shinyapps.io/CampaignPlanner/\n\nNewer (better) online app: https://win-vector.shinyapps.io/CampaignPlanner_v3/\nNewer (better) source code: https://github.com/WinVector/CampaignPlanner_v3/\n\n\nThe course emphasizes how to design A/B tests using prior \"guestimates\" of effect sizes (often you have these from prior campaigns, or somebody claims an effect size and it is merely your job to confirm it) using Bayesian tools.\n\nThe solution is coded in R and Nina Zumel has contributed an updated Shiny user interface demonstrating the technique.\n\nThis sort of fills out our survey of ways to think about A/B testing:\n\n\n * Classic frequentist theory: emphasizes correct decision over expected returns/value. http://www.win-vector.com/blog/2014/05/a-clear-picture-of-power-and-significance-in-ab-tests/\n * Bandit Formulations: great utility theory based solution to the problem. http://www.win-vector.com/blog/2014/04/bandit-formulations-for-ab-tests-some-intuition/\n * Dynamic programming methods: more involved tracking of utility. http://www.win-vector.com/blog/2015/07/dynamic-prog-ab-test-design/\n * Sequential analysis: operationalizing many of the above ideas. http://www.win-vector.com/blog/2015/12/sequential-analysis/\n * Bayesian methods: correct distribution inference for individual test runs. (this course/playlist).\n\nSee here for another survey of our on the topic: http://www.win-vector.com/blog/2015/06/designing-ab-tests/\n\n","funding_links":[],"categories":[],"sub_categories":[],"project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fwinvector%2Fcampaignplanner_v3","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fwinvector%2Fcampaignplanner_v3","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fwinvector%2Fcampaignplanner_v3/lists"}