{"id":35142300,"url":"https://github.com/shafaq-aslam/data-gathering","last_synced_at":"2026-05-21T03:31:27.888Z","repository":{"id":326118784,"uuid":"1102906343","full_name":"shafaq-aslam/data-gathering","owner":"shafaq-aslam","description":"A hands on collection of notebooks exploring multiple techniques of data gathering, from reading CSV, Excel, JSON, and SQL files to exporting data in various formats and fetching real time data through APIs. This repository documents my complete learning journey of data ingestion, preparation, and extraction for data analysis workflows.","archived":false,"fork":false,"pushed_at":"2025-11-29T17:03:39.000Z","size":5213,"stargazers_count":0,"open_issues_count":0,"forks_count":0,"subscribers_count":0,"default_branch":"main","last_synced_at":"2025-12-30T19:49:35.995Z","etag":null,"topics":["api","data-analysis","data-export","data-gathering","data-import","data-science","jupyter-notebook","machine-learning","pandas","python","python3"],"latest_commit_sha":null,"homepage":"","language":"Jupyter Notebook","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/shafaq-aslam.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null,"notice":null,"maintainers":null,"copyright":null,"agents":null,"dco":null,"cla":null}},"created_at":"2025-11-24T07:36:07.000Z","updated_at":"2025-11-29T17:11:51.000Z","dependencies_parsed_at":null,"dependency_job_id":null,"html_url":"https://github.com/shafaq-aslam/data-gathering","commit_stats":null,"previous_names":["shafaq-aslam/data-gathering"],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/shafaq-aslam/data-gathering","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/shafaq-aslam%2Fdata-gathering","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/shafaq-aslam%2Fdata-gathering/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/shafaq-aslam%2Fdata-gathering/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/shafaq-aslam%2Fdata-gathering/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/shafaq-aslam","download_url":"https://codeload.github.com/shafaq-aslam/data-gathering/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/shafaq-aslam%2Fdata-gathering/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":33287420,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-05-21T02:57:32.698Z","status":"ssl_error","status_checked_at":"2026-05-21T02:57:31.990Z","response_time":62,"last_error":"SSL_read: unexpected eof while reading","robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":false,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["api","data-analysis","data-export","data-gathering","data-import","data-science","jupyter-notebook","machine-learning","pandas","python","python3"],"created_at":"2025-12-28T12:05:11.232Z","updated_at":"2026-05-21T03:31:27.883Z","avatar_url":"https://github.com/shafaq-aslam.png","language":"Jupyter Notebook","funding_links":[],"categories":[],"sub_categories":[],"readme":"\u003cp align=\"center\"\u003e\n  \u003cimg src=\"https://capsule-render.vercel.app/api?type=waving\u0026color=0:0EA5E9,100:4F46E5\u0026height=200\u0026section=header\u0026text=Data%20Gathering%20Lab%20📥\u0026fontSize=40\u0026fontColor=ffffff\" alt=\"Data Gathering Lab Banner\"/\u003e\n\u003c/p\u003e\n\n\u003ch2 align=\"center\"\u003e📊 Collecting Data — From Files, Web, APIs \u0026 More 🌐\u003c/h2\u003e\n\n\u003e A complete hands-on journey into **Data Gathering**, covering everything from loading local files to fetching live data from APIs — the first step of every data science workflow.\n\n---\n\n## 🧠 Tech Stack Badges\n\n\u003cp align=\"center\"\u003e\n  \u003cimg src=\"https://img.shields.io/badge/Python-3776AB?style=for-the-badge\u0026logo=python\u0026logoColor=white\"/\u003e\n  \u003cimg src=\"https://img.shields.io/badge/Pandas-150458?style=for-the-badge\u0026logo=pandas\u0026logoColor=white\"/\u003e\n  \u003cimg src=\"https://img.shields.io/badge/Jupyter-FF8C00?style=for-the-badge\u0026logo=jupyter\u0026logoColor=white\"/\u003e\n  \u003cimg src=\"https://img.shields.io/badge/JSON-000000?style=for-the-badge\u0026logo=json\u0026logoColor=white\"/\u003e\n  \u003cimg src=\"https://img.shields.io/badge/API-0052CC?style=for-the-badge\u0026logo=fastapi\u0026logoColor=white\"/\u003e\n\u003c/p\u003e\n\n---\n\n## 🧩 Mission Statement\n\nThis repository is my **Data Gathering Lab**, where I practice how to collect data from different sources:\n\n- 📁 Local file formats (CSV, Excel, TXT)\n- 🌐 Web formats (HTML, JSON)\n- 🗄️ Databases (SQL)\n- 🔗 APIs\n- 📤 Exporting data into multiple formats  \n\nMastering data gathering is essential in data science — it’s the **foundation of every analysis, visualization, and ML pipeline**.\n\n---\n\n## 📂 Folder Structure\n\n\u003cpre\u003e\n  data-gathering-lab/\n│\n├── Import Data from different sources/\n│ ├── working_with_csv\n│ ├── working_with_xlsx_and_txt\n│ └── working_with_json_and_sql\n│\n├── Export Data in a different Format/\n│ ├── Export_as_csv\n│ ├── Export_as_html\n│ └── Export_as_json_and_sql\n│\n└── Data gathering through API/\n  └── Data_gathering_through_api\n\u003c/pre\u003e\n\n\n---\n\n## 🧮 Topics Covered\n\n### 🔹 **Importing Data from Multiple Sources**\n| Topic | Description |\n|-------|-------------|\n| **working_with_csv** | Reading CSV files using multiple methods \u0026 parameters. |\n| **working_with_xlsx_and_txt** | Working with Excel sheets and text-based data. |\n| **working_with_json_and_sql** | Loading JSON files \u0026 fetching data from SQL databases. |\n\n---\n\n### 🔹 **Exporting Data in Various Formats**\n| Topic | Description |\n|-------|-------------|\n| **Export_as_csv** | Saving DataFrames into CSV format with custom settings. |\n| **Export_as_html** | Exporting tables into HTML pages. |\n| **Export_as_json_and_sql** | Exporting to JSON files \u0026 writing data to SQL tables. |\n\n---\n\n### 🔹 **Data Gathering Through APIs**\n| Topic | Description |\n|-------|-------------|\n| **Data_gathering_through_api** | Making API requests, parsing JSON data, authentication (if required). |\n\n---\n\n## 📚 Learning Resources\n\n- 🔹 *CampusX — Data Gathering*  \n- 🔹 Pandas Official Docs: https://pandas.pydata.org/pandas-docs/stable/index.html  \n\n---\n\n## 🧰 Tools \u0026 Environment\n\n- **Python 3.x**\n- **Pandas**\n- **Requests (for APIs)**\n- **Jupyter Notebook**\n\n---\n\n## ✨ Author\n\n**Shafaq Aslam**  \n📍 Passionate about Data Science, Analytics, and Python — building a strong foundation through hands-on learning.\n\n---\n\n## 🔖 Tags for SEO\n\n`data-gathering` `python` `pandas` `api` `rest-api` `json` `csv` `sql` `data-collection` `data-import` `data-export` `data-engineering` `jupyter-notebook` `learning-lab`\n\n---\n\n\u003cp align=\"center\"\u003e\u003ci\u003e“Data is the new oil — gather it well, and everything else becomes easier.”\u003c/i\u003e\u003c/p\u003e\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fshafaq-aslam%2Fdata-gathering","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fshafaq-aslam%2Fdata-gathering","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fshafaq-aslam%2Fdata-gathering/lists"}