https://github.com/apache/incubator-stormcrawler

A scalable, mature and versatile web crawler based on Apache Storm
https://github.com/apache/incubator-stormcrawler

apache-storm crawler distributed java stormcrawler web-crawler

Last synced: about 2 months ago
JSON representation

A scalable, mature and versatile web crawler based on Apache Storm

• Host: GitHub
• URL: https://github.com/apache/incubator-stormcrawler
• Owner: apache
• License: apache-2.0
• Created: 2013-04-12T14:13:30.000Z (over 11 years ago)
• Default Branch: main
• Last Pushed: 2024-05-21T07:16:37.000Z (4 months ago)
• Last Synced: 2024-05-21T07:21:00.931Z (4 months ago)
• Topics: apache-storm, crawler, distributed, java, stormcrawler, web-crawler
• Language: HTML
• Homepage: https://stormcrawler.apache.org/
• Size: 6.58 MB
• Stars: 861
• Watchers: 71
• Forks: 256
• Open Issues: 33
• Metadata Files:
  • Readme: README.md
  • Contributing: CONTRIBUTING.md
  • License: LICENSE

Awesome Lists containing this project