https://github.com/muhammedzohaib/churchangel-scraper

This Scrapy project scrapes data for 351,000 churches from https://www.churchangel.com at a rate of approximately 250 items per minute.
https://github.com/muhammedzohaib/churchangel-scraper

Last synced: about 6 hours ago
JSON representation

This Scrapy project scrapes data for 351,000 churches from https://www.churchangel.com at a rate of approximately 250 items per minute.

• Host: GitHub
• URL: https://github.com/muhammedzohaib/churchangel-scraper
• Owner: MuhammedZohaib
• Created: 2024-07-16T11:51:51.000Z (7 months ago)
• Default Branch: main
• Last Pushed: 2024-07-16T11:55:58.000Z (7 months ago)
• Last Synced: 2024-07-16T14:37:17.554Z (7 months ago)
• Language: Python
• Size: 111 KB
• Stars: 0
• Watchers: 2
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

        
# Church Scraper

This Scrapy project scrapes data for 351,000 churches from [churchangel.com](https://www.churchangel.com/) at a rate of approximately 250 items per minute.

## Installation

1. Clone the repository:

    ```sh

    git clone https://github.com/yourusername/church_scraper.git

    cd church_scraper

    ```

2. Install the required packages:

    ```sh

    pip install scrapy

    ```

## Usage

Run the spider:

```sh

scrapy crawl Church -O response.json

```

## Scraped Data

The spider collects the following information for each church:

- Title

- Category

- Telephone

- Description

- Website

- Link to the church's page

- Link to the church's category page