https://github.com/code-inside/sloader

Worker that loads and retrieves data from "slow" endpoints.
https://github.com/code-inside/sloader

crawler drop json yml

Last synced: about 7 hours ago
JSON representation

Worker that loads and retrieves data from "slow" endpoints.

• Host: GitHub
• URL: https://github.com/code-inside/sloader
• Owner: Code-Inside
• License: mit
• Created: 2014-12-21T16:24:09.000Z (almost 10 years ago)
• Default Branch: master
• Last Pushed: 2022-12-08T03:42:59.000Z (almost 2 years ago)
• Last Synced: 2024-11-15T16:37:18.789Z (1 day ago)
• Topics: crawler, drop, json, yml
• Language: C#
• Homepage: http://code-inside.github.io/Sloader/
• Size: 7.42 MB
• Stars: 4
• Watchers: 5
• Forks: 4
• Open Issues: 10
• Metadata Files:
  • Readme: ReadMe.md
  • Changelog: Changelog.md
  • License: LICENSE

Awesome Lists containing this project

README

        
[![Build status](https://ci.appveyor.com/api/projects/status/fn1yw7rei6gkj478?svg=true)](https://ci.appveyor.com/project/robertmuehsig/sloader)

# Idea & Goal

The goal of this library is to load data from "various" endpoints and store them in various "drops" in a structured way. 

The endpoint & drop configuration should very simple and developer focused.

To load data from those endpoints we have "Crawlers" and to store them we have "Drops".

## Learn more

Visit the __[documentation site](http://code-inside.github.io/Sloader/)__ for more information!