https://github.com/shafaq-aslam/data-gathering
A hands on collection of notebooks exploring multiple techniques of data gathering, from reading CSV, Excel, JSON, and SQL files to exporting data in various formats and fetching real time data through APIs. This repository documents my complete learning journey of data ingestion, preparation, and extraction for data analysis workflows.
https://github.com/shafaq-aslam/data-gathering
api data-analysis data-export data-gathering data-import data-science jupyter-notebook machine-learning pandas python python3
Last synced: 22 days ago
JSON representation
A hands on collection of notebooks exploring multiple techniques of data gathering, from reading CSV, Excel, JSON, and SQL files to exporting data in various formats and fetching real time data through APIs. This repository documents my complete learning journey of data ingestion, preparation, and extraction for data analysis workflows.
- Host: GitHub
- URL: https://github.com/shafaq-aslam/data-gathering
- Owner: shafaq-aslam
- Created: 2025-11-24T07:36:07.000Z (7 months ago)
- Default Branch: main
- Last Pushed: 2025-11-29T17:03:39.000Z (6 months ago)
- Last Synced: 2025-12-30T19:49:35.995Z (5 months ago)
- Topics: api, data-analysis, data-export, data-gathering, data-import, data-science, jupyter-notebook, machine-learning, pandas, python, python3
- Language: Jupyter Notebook
- Homepage:
- Size: 4.97 MB
- Stars: 0
- Watchers: 0
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
📊 Collecting Data — From Files, Web, APIs & More 🌐
> A complete hands-on journey into **Data Gathering**, covering everything from loading local files to fetching live data from APIs — the first step of every data science workflow.
---
## 🧠 Tech Stack Badges
---
## 🧩 Mission Statement
This repository is my **Data Gathering Lab**, where I practice how to collect data from different sources:
- 📁 Local file formats (CSV, Excel, TXT)
- 🌐 Web formats (HTML, JSON)
- 🗄️ Databases (SQL)
- 🔗 APIs
- 📤 Exporting data into multiple formats
Mastering data gathering is essential in data science — it’s the **foundation of every analysis, visualization, and ML pipeline**.
---
## 📂 Folder Structure
data-gathering-lab/
│
├── Import Data from different sources/
│ ├── working_with_csv
│ ├── working_with_xlsx_and_txt
│ └── working_with_json_and_sql
│
├── Export Data in a different Format/
│ ├── Export_as_csv
│ ├── Export_as_html
│ └── Export_as_json_and_sql
│
└── Data gathering through API/
└── Data_gathering_through_api
---
## 🧮 Topics Covered
### 🔹 **Importing Data from Multiple Sources**
| Topic | Description |
|-------|-------------|
| **working_with_csv** | Reading CSV files using multiple methods & parameters. |
| **working_with_xlsx_and_txt** | Working with Excel sheets and text-based data. |
| **working_with_json_and_sql** | Loading JSON files & fetching data from SQL databases. |
---
### 🔹 **Exporting Data in Various Formats**
| Topic | Description |
|-------|-------------|
| **Export_as_csv** | Saving DataFrames into CSV format with custom settings. |
| **Export_as_html** | Exporting tables into HTML pages. |
| **Export_as_json_and_sql** | Exporting to JSON files & writing data to SQL tables. |
---
### 🔹 **Data Gathering Through APIs**
| Topic | Description |
|-------|-------------|
| **Data_gathering_through_api** | Making API requests, parsing JSON data, authentication (if required). |
---
## 📚 Learning Resources
- 🔹 *CampusX — Data Gathering*
- 🔹 Pandas Official Docs: https://pandas.pydata.org/pandas-docs/stable/index.html
---
## 🧰 Tools & Environment
- **Python 3.x**
- **Pandas**
- **Requests (for APIs)**
- **Jupyter Notebook**
---
## ✨ Author
**Shafaq Aslam**
📍 Passionate about Data Science, Analytics, and Python — building a strong foundation through hands-on learning.
---
## 🔖 Tags for SEO
`data-gathering` `python` `pandas` `api` `rest-api` `json` `csv` `sql` `data-collection` `data-import` `data-export` `data-engineering` `jupyter-notebook` `learning-lab`
---
“Data is the new oil — gather it well, and everything else becomes easier.”