{"id":26047892,"url":"https://github.com/magnus0969/wikipedia-web-scraping","last_synced_at":"2026-04-18T22:04:36.845Z","repository":{"id":281035705,"uuid":"943990118","full_name":"Magnus0969/Wikipedia-Web-Scraping","owner":"Magnus0969","description":"A web scraping project that extracts text, tables, and links from Wikipedia using BeautifulSoup, Requests, and Pandas. The scraped data is structured and saved in text formats for analysis.","archived":false,"fork":false,"pushed_at":"2025-03-06T16:07:24.000Z","size":16,"stargazers_count":0,"open_issues_count":0,"forks_count":0,"subscribers_count":1,"default_branch":"main","last_synced_at":"2025-03-06T17:21:39.023Z","etag":null,"topics":["data-science","python","web-scraping","wikipedia-api","wikipedia-scraper"],"latest_commit_sha":null,"homepage":"","language":"Jupyter Notebook","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/Magnus0969.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2025-03-06T15:48:59.000Z","updated_at":"2025-03-06T16:07:27.000Z","dependencies_parsed_at":"2025-03-06T17:21:40.420Z","dependency_job_id":"00ffb84b-4aff-443b-84fc-f64bc368f96f","html_url":"https://github.com/Magnus0969/Wikipedia-Web-Scraping","commit_stats":null,"previous_names":["magnus0969/wikipedia-web-scraping"],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Magnus0969%2FWikipedia-Web-Scraping","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Magnus0969%2FWikipedia-Web-Scraping/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Magnus0969%2FWikipedia-Web-Scraping/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Magnus0969%2FWikipedia-Web-Scraping/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/Magnus0969","download_url":"https://codeload.github.com/Magnus0969/Wikipedia-Web-Scraping/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":242473052,"owners_count":20134021,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["data-science","python","web-scraping","wikipedia-api","wikipedia-scraper"],"created_at":"2025-03-07T23:14:52.887Z","updated_at":"2026-04-18T22:04:36.783Z","avatar_url":"https://github.com/Magnus0969.png","language":"Jupyter Notebook","funding_links":[],"categories":[],"sub_categories":[],"readme":"# 🌐 Wikipedia Web Scraping\n\n## 📌 Overview\nThis project scrapes data from **Wikipedia** using **BeautifulSoup**, and **Requests**. The script extracts useful information from Wikipedia pages, processes the data, and stores it in structured formats for analysis.\n\n## 🛠 Technologies Used\n- **Python** 🐍\n- **BeautifulSoup** 🌐 (for parsing HTML)\n- **Requests** 📡 (for fetching Wikipedia pages)\n\n## 📈 Key Features\n- Scrapes Wikipedia pages for text, tables, and links.\n- Cleans and structures the extracted data.\n- Saves data in **Text** formats.\n- Implements request handling and rate-limiting to avoid blocking.\n\n## 🚀 Getting Started\n### 1️⃣ Clone the Repository\n```bash\ngit clone https://github.com/Magnus0969/Wikipedia-Web-Scraping.git\ncd Wikipedia-Web-Scraping\n```\n\n### 2️⃣ Install Dependencies\n```bash\npip install -r requirements.txt\n```\n\n### 3️⃣ Run the Scraper\nTo scrape a Wikipedia page:\n```bash\npython scrape_wikipedia.py \"https://en.wikipedia.org/wiki/Web_scraping\"\n```\n\n## 📂 Output\n- Extracted text is saved in `Satoshi Nakamoto.txt`.\n\n## 📝 Example Extracted Data\n**Sample Output from Wikipedia:**\n```\nSatoshi Nakamoto  is the name used by the presumed pseudonymous person or persons who developed bitcoin, authored the bitcoin white paper, and created and deployed bitcoin's original reference implementation. As part of the implementation, Nakamoto also devised the first blockchain database. Nakamoto was active in the development of bitcoin until December 2010.\n\nThere has been widespread speculation about Nakamoto's true identity, with various people posited as the person or persons behind the name. Though Nakamoto's name is Japanese, and inscribed as a man living in Japan, most of the speculation has involved software and cryptography experts in the United States or Europe.\n```\n\n## 📬 Contact\nFor any questions or collaborations, feel free to reach out on **[LinkedIn](https://www.linkedin.com/in/kmagadi/)**.\n\n---\n\u003cp align=\"center\"\u003eMade with ❤️ by Karthik B Magadi\u003c/p\u003e\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fmagnus0969%2Fwikipedia-web-scraping","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fmagnus0969%2Fwikipedia-web-scraping","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fmagnus0969%2Fwikipedia-web-scraping/lists"}