https://github.com/mmcloughlin/keepaneyeon

Monitor URLs for changes
https://github.com/mmcloughlin/keepaneyeon

Last synced: 6 months ago
JSON representation

Monitor URLs for changes

• Host: GitHub
• URL: https://github.com/mmcloughlin/keepaneyeon
• Owner: mmcloughlin
• License: mit
• Created: 2015-05-23T22:17:05.000Z (over 10 years ago)
• Default Branch: master
• Last Pushed: 2021-03-25T21:56:30.000Z (over 4 years ago)
• Last Synced: 2025-04-05T14:47:28.337Z (6 months ago)
• Language: Python
• Size: 25.4 KB
• Stars: 8
• Watchers: 2
• Forks: 0
• Open Issues: 2
• Metadata Files:
  • Readme: README.rst
  • License: LICENSE

Awesome Lists containing this project

README

          
keepaneyeon

===========

|buildstatus| |coverage|

Monitor URLs for changes

Quick Start

-----------

``keepaneyeon`` is configured with YAML. The following configuration will

download the URLs ``http://httpbin.org/html`` and

``http://httpbin.org/bytes/128``. It will store the results in S3.

.. code:: yaml

  storage:

    - &aws !storage/s3

      access_key: <...>

      secret_access_key: <...>

      path: 's3://bucket/path'

  downloaders:

    - &http !downloader/http {}

  targets:

    - !target

      name: static

      downloader: *http

      url: 'http://httpbin.org/html'

      store: *aws

    - !target

      name: dynamic

      downloader: *http

      url: 'http://httpbin.org/bytes/128'

      store: *aws

If ``config.yaml`` contains the above configuration, you can execute the

download with::

  keepaneyeon config.yaml

.. |buildstatus| image:: https://img.shields.io/travis/mmcloughlin/keepaneyeon.svg

   :target: https://travis-ci.org/mmcloughlin/keepaneyeon

.. |coverage| image:: https://img.shields.io/coveralls/mmcloughlin/keepaneyeon.svg

   :target: https://coveralls.io/r/mmcloughlin/keepaneyeon