https://github.com/fx-kirin/periodical_requests_recorder

Periodically record http request result.
https://github.com/fx-kirin/periodical_requests_recorder

Last synced: about 1 month ago
JSON representation

Periodically record http request result.

• Host: GitHub
• URL: https://github.com/fx-kirin/periodical_requests_recorder
• Owner: fx-kirin
• License: mit
• Created: 2020-11-04T05:17:31.000Z (about 4 years ago)
• Default Branch: main
• Last Pushed: 2023-01-16T06:48:38.000Z (about 2 years ago)
• Last Synced: 2024-11-19T19:03:38.170Z (about 2 months ago)
• Language: Python
• Size: 19.5 KB
• Stars: 0
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

        
# periodical_requests_recorder

[![Latest PyPI version](https://img.shields.io/pypi/v/package_name.svg)](https://pypi.python.org/pypi/periodical_requests_recorder)

## Usage

```

periodical_recorder example.yaml

```

yaml data format example.

```yaml

gmail_address: [email protected]

gmail_oauth: "~/yagmail_secret.json"

tasks:

  - 

    name: "some_data"

    url: "https://example.com/somedata.csv"

    record_dir: "~/hist_data/"

    output_file_format: "{name}/{name}_%Y-%m-%d.csv"

    cron_expr: "0 * * * * * *"

    encoding: "ms932"

  - 

    name: "some_data_2"

    url: "https://www.google.com/"

    record_dir: "~/hist_data/"

    output_file_format: "{name}/{name}_%Y-%m-%d.txt"

    cron_expr: "@reboot"

    target_elements: 

      - 

        element: "#gws-output-pages-elements-homepage_additional_languages__als"

        index: 3

```

Request result will be stored in the `record_dir` with your `output_file_format`.

If you set up `yagmail`, error messages will be sent to your address.

`cron_expr` format is the same as [Crython](https://github.com/ahawker/crython).

## Installation

You can install this with pip.

### Requirements

## Compatibility

## Licence

## Authors

# periodical_requests_recorder was written by [fx-kirin]([email protected]).