https://github.com/codegram01/worker-crawl

Cloudflare Worker Crawler, Microservice Crawler, crawl any web data
https://github.com/codegram01/worker-crawl

Last synced: about 1 year ago
JSON representation

Cloudflare Worker Crawler, Microservice Crawler, crawl any web data

• Host: GitHub
• URL: https://github.com/codegram01/worker-crawl
• Owner: codegram01
• Created: 2024-09-12T02:47:37.000Z (over 1 year ago)
• Default Branch: main
• Last Pushed: 2024-09-12T03:19:44.000Z (over 1 year ago)
• Last Synced: 2025-01-31T23:57:35.613Z (about 1 year ago)
• Language: JavaScript
• Homepage: https://youtu.be/KJrinhQtGls
• Size: 2.93 KB
• Stars: 0
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

          
# Cloudflare Worker Crawler

Microservice Crawler, crawl any web data

[Video when i create](https://youtu.be/KJrinhQtGls)

## Feature

Get title, description, meta, link of website

## Usage

Call API like this: 

```sh

curl https://crawl.wingram.org?crawlUrl=https://example.com

```

Return html data of website:

```sh

curl https://crawl.wingram.org?crawlUrl=https://example.com&text

```

## Install

- Create Cloudflare worker 

- Copy worker.js and paste in your worker 

## Contribute

- fork, update, merge, open issue is happy

- [Subscribe my Youtube](https://www.youtube.com/@WingramOrg)