{"id":18553560,"url":"https://github.com/quantumudit/analyzing-beerwulf-beers","last_synced_at":"2025-08-12T13:06:26.795Z","repository":{"id":128744172,"uuid":"415521183","full_name":"quantumudit/Analyzing-Beerwulf-Beers","owner":"quantumudit","description":"This project focuses on scraping all the beers related information available on the BeerWulf website by using its backend private API; making necessary data transformations on the scraped data and then, analyzing \u0026 visualizing the data with Jupyter Notebook and Power BI.","archived":false,"fork":false,"pushed_at":"2022-06-18T14:56:45.000Z","size":1899,"stargazers_count":3,"open_issues_count":0,"forks_count":0,"subscribers_count":1,"default_branch":"master","last_synced_at":"2025-05-15T11:50:12.352Z","etag":null,"topics":["api","data-analytics","power-bi","python","webscraping"],"latest_commit_sha":null,"homepage":"","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"other","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/quantumudit.png","metadata":{"files":{"readme":"readme.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2021-10-10T07:56:04.000Z","updated_at":"2022-06-05T10:47:03.000Z","dependencies_parsed_at":"2023-03-26T01:33:04.374Z","dependency_job_id":null,"html_url":"https://github.com/quantumudit/Analyzing-Beerwulf-Beers","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/quantumudit/Analyzing-Beerwulf-Beers","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/quantumudit%2FAnalyzing-Beerwulf-Beers","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/quantumudit%2FAnalyzing-Beerwulf-Beers/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/quantumudit%2FAnalyzing-Beerwulf-Beers/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/quantumudit%2FAnalyzing-Beerwulf-Beers/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/quantumudit","download_url":"https://codeload.github.com/quantumudit/Analyzing-Beerwulf-Beers/tar.gz/refs/heads/master","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/quantumudit%2FAnalyzing-Beerwulf-Beers/sbom","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":270065428,"owners_count":24520946,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","status":"online","status_checked_at":"2025-08-12T02:00:09.011Z","response_time":80,"last_error":null,"robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":true,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["api","data-analytics","power-bi","python","webscraping"],"created_at":"2024-11-06T21:17:33.868Z","updated_at":"2025-08-12T13:06:26.765Z","avatar_url":"https://github.com/quantumudit.png","language":"Python","funding_links":["https://www.patreon.com/quantumudit"],"categories":[],"sub_categories":[],"readme":"# ![Project Logo][project_logo]\n\n---\n\n\u003ch4 align=\"center\"\u003eScraping \u0026 Analyzing beers from \u003ca href=\"https://www.beerwulf.com/en-gb/c/all-beers\" target=\"_blank\"\u003eBeerwulf\u003c/a\u003e website with \u003ca href=\"https://en.wikipedia.org/wiki/Python_(programming_language)\" target=\"_blank\"\u003ePython\u003c/a\u003e and \u003ca href=\"https://en.wikipedia.org/wiki/Microsoft_Power_BI\" target=\"_blank\"\u003ePower BI\u003c/a\u003e\u003c/h4\u003e\n\n\u003cp align='center'\u003e\n\u003cimg src=\"https://i.ibb.co/KxfMMsP/built-with-love.png\" alt=\"built-with-love\" border=\"0\"\u003e\n\u003cimg src=\"https://i.ibb.co/MBDK1Pk/powered-by-coffee.png\" alt=\"powered-by-coffee\" border=\"0\"\u003e\n\u003cimg src=\"https://i.ibb.co/CtGqhQH/cc-nc-sa.png\" alt=\"cc-nc-sa\" border=\"0\"\u003e\n\u003c/p\u003e\n\n\u003cp align=\"center\"\u003e\n  \u003ca href=\"#overview\"\u003eOverview\u003c/a\u003e •\n  \u003ca href=\"#prerequisites\"\u003ePrerequisites\u003c/a\u003e •\n  \u003ca href=\"#architecture\"\u003eArchitecture\u003c/a\u003e •\n  \u003ca href=\"#demo\"\u003eDemo\u003c/a\u003e •\n  \u003ca href=\"#support\"\u003eSupport\u003c/a\u003e •\n  \u003ca href=\"#license\"\u003eLicense\u003c/a\u003e\n\u003c/p\u003e\n\n## Overview\n\nThis project focuses on scraping the varieties of beers and their associated metrics from [Beerwulf][website_link], performing exploratory data analysis to generate insights and visualize them with the help of Power BI.\n\n[![Website Snippet][website_snippet]][website_link]\n\n\nThe repository directory structure is as follows:\n\nAnalyzing-Beerwulf-Beers\u003cbr\u003e\n├─ 01_WEBSCRAPING\u003cbr\u003e\n├─ 02_ETL\u003cbr\u003e\n├─ 03_DATA\u003cbr\u003e\n├─ 04_ANALYSIS\u003cbr\u003e\n├─ 05_DASHBOARD\u003cbr\u003e\n├─ 06_RESOURCES\u003cbr\u003e\n\nThe type of content present in the directories is as follows:\n\n**01_WEBSCRAPING**\n\nThis directory contains the python script to scrape data from the website along with flat file that has the scraped data.\n\n**02_ETL**\n\nThis directory contains the ETL script that takes the scraped dataset as input, transforms it and exports an analysis-ready dataset into the _03_DATA_ directory.\n\n**03_DATA**\n\nThis directory contains the data that can be directly used for exploratory data analysis and data visualization purposes.\n\n**04_ANALYSIS**\n\nThis directory contains the python notebooks that analyzes the clean dataset to generate insights\n\n**05_DASHBOARD**\n\nThis directory contains the python notebook with an embedded Power BI report that visualizes the data. The Power BI dashboard contains slicers, cross-filtering and other advance capabilities that end user can play with to visualize a specific facet of the data or, to get additional insights.\n\n**06_RESOURCES**\n\nThis directory contains images, icons, layouts, etc. that are used in this project\n\n## Prerequisites\n\nThe major skills that are required as prerequisite to fully understand this project are as follows:\n\n- Basics of Python \u0026 Jupyter Notebook\n- Understanding of Python libraries mentioned in [requirements.txt][requirements] file\n- Basics of HTML \u0026 CSS\n- Basics of Power BI\n\n\u003e The choice of applications \u0026 their installation might vary based on individual preferences \u0026 system settings.\n\n## Architecture\n\nThe project architecture is quite straight forward and can be explained through the below image:\n\n![Process Architecture][process_workflow]\n\nAs per the above workflow suggests; we are first scraping the data from the website using the Python script and collecting the same in a flat file which is then processed and cleaned with another ETL specific Python script.\n\nFinally; we leverage the clean \u0026 analysis-ready dataset for some exploratory data analysis (EDA) using Jupyter Notebook and creating an insightful report using Power BI\n\n## Demo\n\nThe below graphic shows scraping of data from the website:\n\n![Scraping Graphic][scraping_graphic]\n\nThe interactive Power BI dashboard can be viewed here:\n\n[![Power BI Dashboard][dashboard_image]][dashboard_link]\n\n## Support\n\nIf you have any doubts, queries or, suggestions then, please connect with me in any of the following platforms:\n\n[![Linkedin Badge][linkedinbadge]][linkedin] [![Twitter Badge][twitterbadge]][twitter]\n\nIf you like my work then, you may support me at [Patreon][patreon]:\n\n\u003ca href=\"https://www.patreon.com/quantumudit\" target=\"_blank\"\u003e\n\u003cimg src=\"https://i.ibb.co/94bkJwp/become-a-patreon.png\" alt=\"become-a-patreon\" border=\"0\" width=\"170\" height=\"50\"\u003e\n\u003c/a\u003e\n\n## License\n\n\u003ca href = 'https://creativecommons.org/licenses/by-nc-sa/4.0/' target=\"_blank\"\u003e\n    \u003cimg src=\"https://i.ibb.co/mvmWGkm/by-nc-sa.png\" alt=\"by-nc-sa\" border=\"0\" width=\"88\" height=\"31\"\u003e\n\u003c/a\u003e\n\nThis license allows reusers to distribute, remix, adapt, and build upon the material in any medium or format for noncommercial purposes only, and only so long as attribution is given to the creator. If you remix, adapt, or build upon the material, you must license the modified material under identical terms.\n\n\u003c!-- Image Links --\u003e\n\n[project_logo]: 06_RESOURCES/project_cover_image.png\n[process_workflow]: 06_RESOURCES/process_architecture.png\n[scraping_graphic]: 06_RESOURCES/scraping_graphic.gif\n[website_snippet]: 06_RESOURCES/website_snip.png\n[dashboard_image]: 06_RESOURCES/dashboard_image.png\n\n\u003c!-- External Links --\u003e\n\n[website_link]: https://www.beerwulf.com/en-gb/c/all-beers\n[requirements]: ./requirements.txt\n[dashboard_link]: https://app.powerbi.com/view?r=eyJrIjoiZDk0MmNkOWQtODAwYS00YzIyLWIzYWYtNWNmMGI2MDI4OGY2IiwidCI6IjcwODlkNGIxLTQyMmUtNDYzZi1hNGM3LTViY2FiOTk0MGRiZCJ9\n\n\u003c!-- Profile Links --\u003e\n\n[linkedin]: https://www.linkedin.com/in/uditkumarchatterjee/\n[twitter]: https://twitter.com/quantumudit\n[patreon]: https://www.patreon.com/quantumudit\n\n\u003c!-- Shields Profile Links --\u003e\n\n[linkedinbadge]: https://img.shields.io/badge/-uditkumarchatterjee-0e76a8?style=flat\u0026labelColor=0e76a8\u0026logo=linkedin\u0026logoColor=white\n[twitterbadge]: https://img.shields.io/badge/-@quantumudit-1ca0f1?style=flat\u0026labelColor=1ca0f1\u0026logo=twitter\u0026logoColor=white\u0026link=https://twitter.com/quantumudit","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fquantumudit%2Fanalyzing-beerwulf-beers","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fquantumudit%2Fanalyzing-beerwulf-beers","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fquantumudit%2Fanalyzing-beerwulf-beers/lists"}