{"id":25950094,"url":"https://github.com/nambukeerthi/youtube_dataproject","last_synced_at":"2026-04-09T17:57:22.922Z","repository":{"id":247485370,"uuid":"825971319","full_name":"Nambukeerthi/youtube_dataproject","owner":"Nambukeerthi","description":"Build a Streamlit App – A user-friendly interface. Use Google API – Fetch YouTube channel data. Store in SQL Database – Save channel details for easy access. Search \u0026 Join Tables – Allow users to query and view data","archived":false,"fork":false,"pushed_at":"2025-03-01T16:56:05.000Z","size":104,"stargazers_count":0,"open_issues_count":0,"forks_count":0,"subscribers_count":1,"default_branch":"main","last_synced_at":"2025-03-01T17:35:39.543Z","etag":null,"topics":["api","numpy","pandas","python","sql","streamlit"],"latest_commit_sha":null,"homepage":"https://youtubedataproject-mkjagva9qhyswv8gukrxaq.streamlit.app/","language":"Jupyter Notebook","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/Nambukeerthi.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2024-07-08T21:29:03.000Z","updated_at":"2025-03-01T16:56:08.000Z","dependencies_parsed_at":"2025-02-15T21:34:21.867Z","dependency_job_id":null,"html_url":"https://github.com/Nambukeerthi/youtube_dataproject","commit_stats":null,"previous_names":["nambukeerthi/youtube_dataproject"],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Nambukeerthi%2Fyoutube_dataproject","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Nambukeerthi%2Fyoutube_dataproject/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Nambukeerthi%2Fyoutube_dataproject/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Nambukeerthi%2Fyoutube_dataproject/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/Nambukeerthi","download_url":"https://codeload.github.com/Nambukeerthi/youtube_dataproject/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":241852152,"owners_count":20030969,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["api","numpy","pandas","python","sql","streamlit"],"created_at":"2025-03-04T12:52:40.891Z","updated_at":"2025-12-30T22:36:13.191Z","avatar_url":"https://github.com/Nambukeerthi.png","language":"Jupyter Notebook","funding_links":[],"categories":[],"sub_categories":[],"readme":"\u003ch1\u003e YouTube_Data_Harvesting_and_Warehousing \u003c/h1\u003e\r\n\r\n\r\n\u003ch1 align=\"center\"\u003e\r\n  \u003cbr\u003e\r\n  \u003ca href=\"\"\u003e\u003cimg src=\"youtube_project.jpeg\" alt=\"Youtube Data warehousing\" width=\"400\"\u003e\u003c/a\u003e\r\n  \u003ch2  align=\"center\"\u003e\r\n  Link: https://youtubedataproject-mkjagva9qhyswv8gukrxaq.streamlit.app/\r\n  \u003c/h2\u003e \r\n  \u003cbr\u003e\r\n \r\n  \u003cbr\u003e\r\n\u003c/h1\u003e\r\n\r\n\r\n\u003cp align=\"center\"\u003e\r\n  \u003ca href=\"#Introduction\"\u003e\u003c/a\u003e\r\n  \u003ca href=\"#Technologies Applied\"\u003e\u003c/a\u003e  \r\n\u003c/p\u003e\r\n\r\nVideo Link: [Linked-IN Video](https://www.linkedin.com/posts/nambu-keerthi-r-9b8839283_project-name-youtube-data-harvesting-and-activity-7296598343412068352-Hz1X?utm_source=share\u0026utm_medium=member_android\u0026rcm=ACoAABMFg5wB3AA0b9CHRbG1E_77kFaZB8cVz7c)\r\n\r\nPortfolio: [Nambu Keerthi](https://portfolio-b5zieg8xn5nhwau5b4bhp8.streamlit.app/)\r\n\r\n## Introduction \r\nThe purpose of this project is to create an intuitive Streamlit app that pulls data about a YouTube channel from the Google API, stores it in a MongoDB database, moves it to a SQL data warehouse, and then lets users perform searches for channel details and join tables to view the data.\r\n\r\n**Domain** : *Social Media*\r\n\r\n## Technologies Applied\r\n* Virtual environment (.venv)\r\n* Python\r\n* Streamlit \r\n* Youtube Api \r\n* AWS RDS Database\r\n* MySQL\r\n\r\n\r\n## Project Setup\r\n1. Firstly install all the required extensions in the requirements.txt\r\n```\r\npip install -r requirements.txt\r\n```\r\n\r\n2. Now one need setup a Google Cloud Project on Google Cloud Console, and then enable the Youtube API v3, after that generate the credentials and copy the api_key. Now below is the Python code to use that API.\r\n```\r\nyoutube = build('youtube', 'v3', developerKey=\"your api_key goes here\")\r\n```\r\n\r\n3. After that one need to create a MySQL Database in there local system. Now below is the Python code to connect to that SQL Database\r\n```\r\nhostname = \"your host name goes here\"\r\ndatabase = \"your database name goes here\"\r\nusername = \"your username goes here\"\r\npwd = \"your password goes here\"\r\n\r\nmydb = sql.connect(host=hostname, user=username, password=pwd, database=database)\r\n                   \r\ncursor1 = mydb.cursor()\r\n```\r\n\r\n4. To run the application\r\n```\r\nstreamlit run youtube.py\r\n```\r\n\r\n   \r\n## Project Methodology\r\n\r\n1. First click the \"Create DB\" button after that the database will created\r\n\r\n2. Enter a YouTube channel ID in the input field and click the \"Details\" button. The channel details will then be displayed. After that, click the \"Upload\" button to upload channel details such as Channel ID, Channel Name, Playlist ID, Subscribers, Views, Total Videos, \r\n   Description, and more, to the SQL database.\r\n\r\n3. Now from the sidebar select the Task Menu and Select the required statement.\r\n\r\n3. According to the selected statement the data will be queried from the SQL Database and will be displayed here on the screen in the streamlit application\r\n\r\n4. through the click the \"Drob DB\" button the created database and details will droped. \r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fnambukeerthi%2Fyoutube_dataproject","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fnambukeerthi%2Fyoutube_dataproject","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fnambukeerthi%2Fyoutube_dataproject/lists"}