https://github.com/kabirnayeem99/islam_qa_scraper_go

IslamQA scraper written in Go.
https://github.com/kabirnayeem99/islam_qa_scraper_go

go-scraper go-scripts islamqa scraping

Last synced: about 1 month ago
JSON representation

IslamQA scraper written in Go.

• Host: GitHub
• URL: https://github.com/kabirnayeem99/islam_qa_scraper_go
• Owner: kabirnayeem99
• License: mit
• Created: 2023-07-27T14:35:32.000Z (over 1 year ago)
• Default Branch: main
• Last Pushed: 2023-07-27T14:46:02.000Z (over 1 year ago)
• Last Synced: 2024-11-07T00:35:55.421Z (3 months ago)
• Topics: go-scraper, go-scripts, islamqa, scraping
• Language: Go
• Homepage: https://islamqa.org/
• Size: 6.84 KB
• Stars: 0
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: readme.md
  • License: license

Awesome Lists containing this project

README

        
# IslamQA.org Scraper (GoLang)

A simple web scraper written in Go that extracts questions, links and answers from the islamqa.org website.

## Requirements

- Go (at least version 1.20)

- Colly (for web scraping)

## Installation

1. Make sure you have Go installed on your system.

2. Install the required package using the following command:

```{shell}

go get github.com/gocolly/colly/

```

## Usage

1. Clone this repository to your local machine.

2. Open the terminal and navigate to the project directory.

3. Run the scraper using the following command:

```{shell}

go run main.go

```

## Note

This scraper is provided for testing and educational purposes only. Please be respectful of the website's terms of service and robots.txt. Do not use this scraper for any unauthorized or unethical activities.

## License

This project is licensed under the [MIT License](license).