https://github.com/english/crawler

Clojure web crawler
https://github.com/english/crawler

Last synced: 5 days ago
JSON representation

Clojure web crawler

• Host: GitHub
• URL: https://github.com/english/crawler
• Owner: english
• License: epl-1.0
• Created: 2014-08-30T23:34:03.000Z (over 10 years ago)
• Default Branch: master
• Last Pushed: 2015-01-01T16:00:58.000Z (about 10 years ago)
• Last Synced: 2025-01-20T01:21:22.331Z (10 days ago)
• Language: Clojure
• Homepage:
• Size: 867 KB
• Stars: 2
• Watchers: 3
• Forks: 1
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

        
# crawler

A web crawler used to produce a sitemap containing a list of crawled urls as well as a list of assets each page refers to.

## Usage

    $ lein uberjar

    $ java -jar crawler-0.1.0-standalone.jar [domain]