https://github.com/deejungx/wiki-bot

Web scraping implementation for fetching Text from Wikipedia Articles
https://github.com/deejungx/wiki-bot

beautifulsoup pyperclip python requests webscraping wikipedia

Last synced: about 1 month ago
JSON representation

Web scraping implementation for fetching Text from Wikipedia Articles

• Host: GitHub
• URL: https://github.com/deejungx/wiki-bot
• Owner: deejungx
• Created: 2020-06-22T03:04:53.000Z (over 4 years ago)
• Default Branch: master
• Last Pushed: 2020-06-22T03:55:47.000Z (over 4 years ago)
• Last Synced: 2024-11-03T06:41:46.180Z (3 months ago)
• Topics: beautifulsoup, pyperclip, python, requests, webscraping, wikipedia
• Language: Python
• Homepage: https://www.deejung.xyz/post/scraping-wikipedia-with-command-line-input/
• Size: 33.2 KB
• Stars: 0
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

        
# WikiBot

![Wikipedia Scraper](/images/wikiScraper.jpg)

This code is an implementation of web scraping for fetching texts from Wikipedia articles using command line input. To run the code, type the topic you want to search for as the first argument.

```bash

python wiki.py Nepal

```

## Requirements

- Python 3.7

## Setup

- Clone this repository

  ```

  git clone https://github.com/deejungx/wiki-bot.git

  ```

- Open the directory

  ```

  cd wiki-bot

  ```

- Install requests

  ```

  pip3 install requests

  ```

- Install BeautifulSoup

  ```

  pip3 install bs4

  ```

- Install pyperclip

  ```

  pip3 install pyperclip

  ```

# Disclaimer

While there aren't any established laws against the use of web scraping, there are guidelines and instructions for understanding proper use of such tools without any serious consequences.

Follow this link to read Wikipedia's instruction on the use of Web scraping on their platform: 

[Wikipedia Web scraping guideline](https://en.wikipedia.org/wiki/Web_scraping)