An open API service indexing awesome lists of open source software.

https://github.com/jamezrin/distrowatch-parser

DistroWatch crawler for ranking data
https://github.com/jamezrin/distrowatch-parser

axios cheerio data-mining data-science distrowatch parsing ranking typescript

Last synced: about 1 year ago
JSON representation

DistroWatch crawler for ranking data

Awesome Lists containing this project

README

          

# DistroWatch Parser

**Take a look at [distrowatch-data](https://github.com/jamezrin/distrowatch-data) if you want a JSON file with up-to-date dumps generated by this tool (of all rankings)**

This package provides both a command and a library you can use to get rankings out of the website.

## Usage

```
npm install -g distrowatch-parser
distrowatch-parser --help
```

## How it works

Because DistroWatch does not provide an API for the ranking, this library does its thing by simply
requesting the page and parsing the result and then converting it to objects.

It uses typescript under the hood as well as axios (to make the requests) and cheerio (to parse the response)
as well as some other libraries.