https://github.com/nambukeerthi/youtube_dataproject
Build a Streamlit App – A user-friendly interface. Use Google API – Fetch YouTube channel data. Store in SQL Database – Save channel details for easy access. Search & Join Tables – Allow users to query and view data
https://github.com/nambukeerthi/youtube_dataproject
api numpy pandas python sql streamlit
Last synced: 3 months ago
JSON representation
Build a Streamlit App – A user-friendly interface. Use Google API – Fetch YouTube channel data. Store in SQL Database – Save channel details for easy access. Search & Join Tables – Allow users to query and view data
- Host: GitHub
- URL: https://github.com/nambukeerthi/youtube_dataproject
- Owner: Nambukeerthi
- Created: 2024-07-08T21:29:03.000Z (almost 2 years ago)
- Default Branch: main
- Last Pushed: 2025-03-01T16:56:05.000Z (over 1 year ago)
- Last Synced: 2025-03-01T17:35:39.543Z (over 1 year ago)
- Topics: api, numpy, pandas, python, sql, streamlit
- Language: Jupyter Notebook
- Homepage: https://youtubedataproject-mkjagva9qhyswv8gukrxaq.streamlit.app/
- Size: 102 KB
- Stars: 0
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
YouTube_Data_Harvesting_and_Warehousing
Link: https://youtubedataproject-mkjagva9qhyswv8gukrxaq.streamlit.app/
Video Link: [Linked-IN Video](https://www.linkedin.com/posts/nambu-keerthi-r-9b8839283_project-name-youtube-data-harvesting-and-activity-7296598343412068352-Hz1X?utm_source=share&utm_medium=member_android&rcm=ACoAABMFg5wB3AA0b9CHRbG1E_77kFaZB8cVz7c)
Portfolio: [Nambu Keerthi](https://portfolio-b5zieg8xn5nhwau5b4bhp8.streamlit.app/)
## Introduction
The purpose of this project is to create an intuitive Streamlit app that pulls data about a YouTube channel from the Google API, stores it in a MongoDB database, moves it to a SQL data warehouse, and then lets users perform searches for channel details and join tables to view the data.
**Domain** : *Social Media*
## Technologies Applied
* Virtual environment (.venv)
* Python
* Streamlit
* Youtube Api
* AWS RDS Database
* MySQL
## Project Setup
1. Firstly install all the required extensions in the requirements.txt
```
pip install -r requirements.txt
```
2. Now one need setup a Google Cloud Project on Google Cloud Console, and then enable the Youtube API v3, after that generate the credentials and copy the api_key. Now below is the Python code to use that API.
```
youtube = build('youtube', 'v3', developerKey="your api_key goes here")
```
3. After that one need to create a MySQL Database in there local system. Now below is the Python code to connect to that SQL Database
```
hostname = "your host name goes here"
database = "your database name goes here"
username = "your username goes here"
pwd = "your password goes here"
mydb = sql.connect(host=hostname, user=username, password=pwd, database=database)
cursor1 = mydb.cursor()
```
4. To run the application
```
streamlit run youtube.py
```
## Project Methodology
1. First click the "Create DB" button after that the database will created
2. Enter a YouTube channel ID in the input field and click the "Details" button. The channel details will then be displayed. After that, click the "Upload" button to upload channel details such as Channel ID, Channel Name, Playlist ID, Subscribers, Views, Total Videos,
Description, and more, to the SQL database.
3. Now from the sidebar select the Task Menu and Select the required statement.
3. According to the selected statement the data will be queried from the SQL Database and will be displayed here on the screen in the streamlit application
4. through the click the "Drob DB" button the created database and details will droped.