An open API service indexing awesome lists of open source software.

https://github.com/jiusanzhou/pickup

[WIP] A tool for generating data and extraction rules from web.
https://github.com/jiusanzhou/pickup

zoe-lab

Last synced: about 1 year ago
JSON representation

[WIP] A tool for generating data and extraction rules from web.

Awesome Lists containing this project

README

          

## Pickup

**A tool for generating data and extraction rules from web.**

[![contributions welcome](https://img.shields.io/badge/contributions-welcome-brightgreen?logo=github)](README.md) [![Website](https://img.shields.io/website?url=https%3A%2F%2Fopencrawlers.org&logo=hoppscotch)](https://opencrawlers.org/) [![Tests](https://github.com/jiusanzhou/pickup/actions/workflows/tests.yml/badge.svg)](https://github.com/jiusanzhou/pickup/actions)

### Introduction

Pickup is a web-based tool for creating css/xpath rules and scraping data from the internet by clicking.

**Only tested in Chrome.**

### Features

- **Lightweight**: No need to install any things, including the browser plugins.
- **Flexible**: We supported `local development`, `server` and `service worker`.
- **Friendly**: A user friendly UI that help you to create your data adn rules fast.

### Modes compares

### Get Started

There is no any production-ready version released. The `local development` mode is the only way to use for now.

#### `Development` mode

1. Clone the source code in to your local path
2. Enter the project directory and run
```bash
yarn && yarn start
```
3. Waiting for prcessing finished, and open the development server,
most of `http://localhost:3000`

### `Service Worker` mode

*WIP*

### `Server` mode

*WIP*