{"id":24702966,"url":"https://github.com/minhduc29/leetcode-contest-analytics","last_synced_at":"2025-03-22T04:25:22.562Z","repository":{"id":272556411,"uuid":"915843268","full_name":"minhduc29/leetcode-contest-analytics","owner":"minhduc29","description":"A data engineering project to extract, transform, and load LeetCode contest ranking and contest problems data","archived":false,"fork":false,"pushed_at":"2025-01-20T00:59:21.000Z","size":5938,"stargazers_count":0,"open_issues_count":0,"forks_count":0,"subscribers_count":2,"default_branch":"main","last_synced_at":"2025-01-27T05:51:36.699Z","etag":null,"topics":["amazon-redshift","amazon-s3","analytics","apache-airflow","aws","aws-glue","dag","data-engineering","data-pipeline","elt","etl","leetcode","leetcode-contest","pandas"],"latest_commit_sha":null,"homepage":"","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/minhduc29.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2025-01-12T23:55:22.000Z","updated_at":"2025-01-20T01:02:52.000Z","dependencies_parsed_at":"2025-01-15T08:47:13.478Z","dependency_job_id":null,"html_url":"https://github.com/minhduc29/leetcode-contest-analytics","commit_stats":null,"previous_names":["minhduc29/leetcode-contest-analytics"],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/minhduc29%2Fleetcode-contest-analytics","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/minhduc29%2Fleetcode-contest-analytics/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/minhduc29%2Fleetcode-contest-analytics/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/minhduc29%2Fleetcode-contest-analytics/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/minhduc29","download_url":"https://codeload.github.com/minhduc29/leetcode-contest-analytics/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":244905520,"owners_count":20529641,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["amazon-redshift","amazon-s3","analytics","apache-airflow","aws","aws-glue","dag","data-engineering","data-pipeline","elt","etl","leetcode","leetcode-contest","pandas"],"created_at":"2025-01-27T05:51:42.692Z","updated_at":"2025-03-22T04:25:22.539Z","avatar_url":"https://github.com/minhduc29.png","language":"Python","readme":"# LeetCode Contest Analytics\r\n\r\n## Overview\r\n- A data engineering project to extract, transform, and load LeetCode contest ranking data and contest problems data.\r\n- This project was created to analyze data from past LeetCode contests and top contestants, aiming to set the basis \r\nfor efficient contest practice and further data analytics from each user profile.\r\n- Data were collected from the top **50,000** users of LeetCode global contest ranking and **2334** problems of \r\n**585** contests.\r\n- Some analytics with visualizations are provided in `analytics/analytics.md`.\r\n- The collected data are stored in the `data/` folder.\r\n\r\n## Technology Stack\r\n- Orchestration: **Apache Airflow**\r\n- Storage: **Amazon S3**\r\n- ETL jobs: **Pandas**, **AWS Glue**\r\n- Data warehouse \u0026 Analytics: **Amazon Redshift**\r\n- For additional libraries, please consult `requirements.txt`.\r\n\r\n## Potential Ideas\r\n- Machine Learning/Deep Learning models.\r\n- User profile analysis and ranking prediction.\r\n- Further analytics and statistics from other LeetCode data.\r\n- Data pipelines and analytics for other platforms.","funding_links":[],"categories":[],"sub_categories":[],"project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fminhduc29%2Fleetcode-contest-analytics","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fminhduc29%2Fleetcode-contest-analytics","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fminhduc29%2Fleetcode-contest-analytics/lists"}