https://github.com/princemaple/scraper

Elixir Scraper
https://github.com/princemaple/scraper

elixir elixir-scraper framework scraper

Last synced: 7 months ago
JSON representation

Elixir Scraper

• Host: GitHub
• URL: https://github.com/princemaple/scraper
• Owner: princemaple
• Created: 2018-01-18T10:27:08.000Z (about 8 years ago)
• Default Branch: master
• Last Pushed: 2023-06-05T06:44:27.000Z (almost 3 years ago)
• Last Synced: 2025-08-23T11:28:27.458Z (7 months ago)
• Topics: elixir, elixir-scraper, framework, scraper
• Language: Elixir
• Homepage: https://hex.pm/packages/scraper
• Size: 20.5 KB
• Stars: 2
• Watchers: 1
• Forks: 0
• Open Issues: 2
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

          
# Scraper

Elixir Scraper WIP

## TODO

- [x] concurrency limit

- [x] crawling depth limit

- [x] persistence adapters

- [x] custom link filter

- [x] custom data selector

- [ ] retry / put back

## Installation

The package can be installed

by adding `scraper` to your list of dependencies in `mix.exs`:

```elixir

def deps do

  [

    {:scraper, "~> 0.1.0"}

  ]

end

```