https://github.com/dustin/pfetch

A web service consumer.
https://github.com/dustin/pfetch

Last synced: about 2 months ago
JSON representation

A web service consumer.

• Host: GitHub
• URL: https://github.com/dustin/pfetch
• Owner: dustin
• Created: 2008-11-02T00:20:13.000Z (about 16 years ago)
• Default Branch: master
• Last Pushed: 2014-11-19T06:30:03.000Z (about 10 years ago)
• Last Synced: 2024-10-11T14:15:46.100Z (2 months ago)
• Language: Go
• Homepage: http://dustin.github.com/2008/12/26/pfetch.html
• Size: 201 KB
• Stars: 9
• Watchers: 4
• Forks: 2
• Open Issues: 0
• Metadata Files:
  • Readme: README.markdown

Awesome Lists containing this project

README

        
# pfetch - A Parallel Periodic URL Fetcher Utility

This is a really simple twisted app, but it solves a real problem I had, so

maybe it'll help you, too.

I've got a bunch of various URLs from which I pull down content regularly via

cron to do some processing.  Having a full-time process fetching all of them

without worrying about cron job overlaps, network timeouts slowing things down,

etc... is going to make my machine a lot happier.