https://github.com/lablnet/pakweather_scraper

A multi-threaded Pakistan Weather crawler written in JavaScript
https://github.com/lablnet/pakweather_scraper

crawler data mit-license open-source pakistan scraping weather weather-channel

Last synced: 6 months ago
JSON representation

A multi-threaded Pakistan Weather crawler written in JavaScript

• Host: GitHub
• URL: https://github.com/lablnet/pakweather_scraper
• Owner: lablnet
• License: mit
• Created: 2022-08-14T08:34:24.000Z (over 3 years ago)
• Default Branch: main
• Last Pushed: 2025-08-20T00:21:55.000Z (6 months ago)
• Last Synced: 2025-08-20T01:09:18.468Z (6 months ago)
• Topics: crawler, data, mit-license, open-source, pakistan, scraping, weather, weather-channel
• Language: JavaScript
• Homepage: https://weather.lablnet.com/
• Size: 2.06 GB
• Stars: 10
• Watchers: 1
• Forks: 2
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • Contributing: CONTRIBUTING.md
  • License: LICENSE
  • Code of conduct: CODE_OF_CONDUCT.md

Awesome Lists containing this project

README

          
[![Pakistan Weather](https://github.com/lablnet/pakweather_scrapper/actions/workflows/weather.yaml/badge.svg)](https://github.com/lablnet/pakweather_scrapper/actions/workflows/weather.yaml)

# Overview

A multi-threaded **Pakistan** Weather crawler written in JavaScript learn more at : [https://lablnet.com/project/weather](https://lablnet.com/project/weather)

## Purpose

The sole purpose of this project is to extract weather data from the Weather Channel and store it in a database for further analysis.

## Requirements

* Node.js 18.x or above

## Installation

1. Clone the repository

2. Install dependencies using `npm install` or `pnpm install`

3. Copy `.env.example` to `.env` and update the values

4. Run the crawler using `node main.js weather.com`

	* The first argument is the website to crawl

	* You can add more crawlers; check the `main.js` file for more information

## Contributions

There is still a lot of work to be done, so feel free to contribute by opening a PR.

### Contributing Guide

[Contribution Guidelines](https://github.com/lablnet/pakweather_scraper/blob/main/CONTRIBUTING.md)

## LICENSE

* MIT

## Readme of Web

* [Web](./web/README.md)

### Python Version

* The script has been rewritten in Node.js to fix issues and update the structure. The Python version is available in the `python_script` folder but is no longer maintained.

* [Python](./python_script/README.md)