{"id":24942191,"url":"https://github.com/yanny-alt/cookie-cats-a-b-testing-project","last_synced_at":"2025-03-28T18:42:03.810Z","repository":{"id":269822796,"uuid":"908568573","full_name":"yanny-alt/Cookie-Cats-A-B-Testing-Project","owner":"yanny-alt","description":"This project analyzes the impact of gate placement in the mobile game Cookie Cats on player retention, focusing on A/B testing results to understand the effects on 1-day and 7-day retention","archived":false,"fork":false,"pushed_at":"2024-12-26T13:30:36.000Z","size":1083,"stargazers_count":0,"open_issues_count":0,"forks_count":0,"subscribers_count":1,"default_branch":"main","last_synced_at":"2025-02-02T18:59:09.217Z","etag":null,"topics":["ab-testing","data-science"],"latest_commit_sha":null,"homepage":"https://favourigwezeke.vercel.app/","language":"Jupyter Notebook","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"apache-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/yanny-alt.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2024-12-26T11:46:19.000Z","updated_at":"2024-12-26T13:41:02.000Z","dependencies_parsed_at":"2024-12-26T12:37:24.148Z","dependency_job_id":null,"html_url":"https://github.com/yanny-alt/Cookie-Cats-A-B-Testing-Project","commit_stats":null,"previous_names":["yanny-alt/cookie-cats-a-b-testing-project"],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/yanny-alt%2FCookie-Cats-A-B-Testing-Project","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/yanny-alt%2FCookie-Cats-A-B-Testing-Project/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/yanny-alt%2FCookie-Cats-A-B-Testing-Project/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/yanny-alt%2FCookie-Cats-A-B-Testing-Project/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/yanny-alt","download_url":"https://codeload.github.com/yanny-alt/Cookie-Cats-A-B-Testing-Project/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":246082851,"owners_count":20720863,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["ab-testing","data-science"],"created_at":"2025-02-02T18:59:16.990Z","updated_at":"2025-03-28T18:42:03.771Z","avatar_url":"https://github.com/yanny-alt.png","language":"Jupyter Notebook","funding_links":[],"categories":[],"sub_categories":[],"readme":"# Cookie Cats Mobile Games: A/B Testing \u0026 Player Retention Analysis\n\n![Cookie Cats Banner](https://github.com/yanny-alt/Cookie-Cats-A-B-Testing-Project/blob/main/images/cookiecats.jpg)\n\n---\n\n## Introduction\n\n[**Cookie Cats**](https://www.google.com/url?q=https%3A%2F%2Fwww.facebook.com%2Fcookiecatsgame) is a widely popular mobile puzzle game developed by [Tactile Entertainment](https://www.google.com/url?q=http%3A%2F%2Ftactile.dk%2F). The goal of this analysis is to evaluate the impact of moving the first gate in the game from level 30 to level 40 through an A/B testing approach.\n\nAs players progress through the game, gates occasionally require them to wait a non-trivial amount of time or make an in-app purchase to proceed. These gates serve dual purposes: encouraging purchases and enhancing player enjoyment by enforcing breaks.\n\n---\n\n## Problem Statement\n\nThe initial placement of the gate was at level 30. A change was proposed to move the gate to level 40, raising the question:\n\n- **Does moving the gate affect player retention?**\n\n![Cookie Cats Banner](https://github.com/yanny-alt/Cookie-Cats-A-B-Testing-Project/blob/main/images/cc_gates.png)\n---\n\n## Project Objectives\n\n- Evaluate the impact of gate placement on **1-day retention** and **7-day retention**.\n- Provide actionable insights for improving player retention.\n- Explore potential reasons for the observed trends and propose recommendations.\n\n---\n\n## The Data\n\nThe dataset for this project includes player retention metrics collected during the A/B testing phase. The data is available in the repository under the file [cookie_cats.csv](https://github.com/yanny-alt/Cookie-Cats-A-B-Testing-Project/blob/main/data/cookie_cats.csv).\n\n---\n\n## Skills/Technologies Used\n\n- **Languages**: Python\n- **Libraries**: Pandas, Matplotlib\n- **Methodologies**: A/B Testing, Bootstrapping, Z-tests, Hypothesis testing\n\n---\n\n## Project Methodology\n\n1. **Data Exploration**:\n   - Overview of dataset structure and summary statistics.\n\n2. **A/B Testing**:\n   - Calculation of **1-day** and **7-day retention** for both groups.\n   - Bootstrapping analysis for uncertainty estimation.\n   - Z-tests to formally compare groups.\n\n3. **Results Interpretation**:\n   - Evaluation of retention differences and associated probabilities.\n\n4. **Conclusions and Recommendations**:\n   - Summarization of findings and actionable insights.\n\n---\n\n## Results\n\n### 1-Day Retention\n- **Gate at Level 30**: Retention = 19.0%\n- **Gate at Level 40**: Retention = 18.2%\n- **Insights**: Retention is higher when the gate is at level 30, with a 96% probability that the difference is significant.\n\n### 7-Day Retention\n- **Gate at Level 30**: Retention = 19.0%\n- **Gate at Level 40**: Retention = 18.2%\n- **Insights**: Retention remains higher at level 30, with a 99.8% probability of significance.\n\n---\n\n## 📌 Conclusion\n\nThe analysis provides strong evidence that **both 1-day and 7-day retention are higher when the gate is placed at level 30**. Based on the results:\n\n- **Recommendation**: Keep the gate at level 30 to maximize retention.\n- **Possible Explanation**: Hedonic adaptation suggests earlier gates prolong enjoyment and prevent boredom, enhancing player engagement.\n\n---\n\n## 🚀 Future Recommendations\n\n1. Analyze additional metrics like **in-game purchases** or **game rounds played**.\n2. Test alternative gate placements beyond levels 30 and 40.\n3. Perform a cost-benefit analysis to evaluate the financial implications of gate placement.\n\n---\n\n## References\n\n- [Cookie Cats](https://www.google.com/url?q=https%3A%2F%2Fwww.facebook.com%2Fcookiecatsgame)\n- **Hedonic Adaptation**: A theory explaining the diminishing enjoyment from continuous activities.\n\n## Contributions\n\nContributions, issues, and feature requests are welcome! Also feel free to fork this project or reach out if you have any questions or suggestions!\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fyanny-alt%2Fcookie-cats-a-b-testing-project","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fyanny-alt%2Fcookie-cats-a-b-testing-project","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fyanny-alt%2Fcookie-cats-a-b-testing-project/lists"}