Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

https://github.com/obetomuniz/tatooine

A powerful scraper for JavaScript Developers.
https://github.com/obetomuniz/tatooine

html javascript json nodejs scraper scraper-engine spa typescript xml

Last synced: 17 days ago
JSON representation

A powerful scraper for JavaScript Developers.

Host: GitHub
URL: https://github.com/obetomuniz/tatooine
Owner: obetomuniz
License: other
Created: 2016-07-20T20:48:37.000Z (over 8 years ago)
Default Branch: main
Last Pushed: 2023-05-17T04:14:59.000Z (over 1 year ago)
Last Synced: 2024-04-14T18:54:13.479Z (7 months ago)
Topics: html, javascript, json, nodejs, scraper, scraper-engine, spa, typescript, xml
Language: TypeScript
Homepage: https://npmjs.com/tatooine
Size: 1.76 MB
Stars: 88
Watchers: 4
Forks: 3
Open Issues: 9
Metadata Files:
- Readme: README.md
- License: LICENSE.md

Awesome Lists containing this project

README

        # tatooine: A powerful scraper for JavaScript Developers



## Installation

```ssh

$ npm install tatooine --save

```

## Demo

[![Try on Replit](https://camo.githubusercontent.com/56417b1780ddc0e04d7c9ce2e4041a437a25aeaa898473a75695723e88a9d043/68747470733a2f2f7265706c2d62616467652e6a616a6f6f73616d2e7265706c2e636f2f7472792e706e67)](https://replit.com/@obetomuniz/Tatooine-in-Action?v=1#index.js)

## How to use

```js

import { scrape } from "tatooine"

const data = await scrape({

  url: "https://betomuniz.com",

  engine: "html",

  options: {

    selectors: { title: { selector: "title" } },

  },

})

```

### Built-in Engines

- [HTML](https://github.com/obetomuniz/tatooine/tree/main/docs/engines/HTML.md) (e.g. Web Scraping)

- [SPA](https://github.com/obetomuniz/tatooine/tree/main/docs/engines/SPA.md) (e.g. Web Scraping for Single Page Applications)

- [JSON](https://github.com/obetomuniz/tatooine/tree/main/docs/engines/JSON.md) (e.g. Web Services, APIs, etc.)

- [XML](https://github.com/obetomuniz/tatooine/tree/main/docs/engines/XML.md) (e.g. RSS, APIs, etc.)

## Extended Features

- [Transformer Plugins](https://github.com/obetomuniz/tatooine/tree/main/docs/plugins/TRANSFORMER.md) - Create your own pre/post data processing flows.

- [Engine Plugins](https://github.com/obetomuniz/tatooine/tree/main/docs/plugins/ENGINE.md) - Create your own engine process using Tatooine runtime ecosystem.