https://github.com/snehankekre/foi-archive-bot

FOI Archive Bot archives Freedom of Information Requests from RightToKnow.org.au on the Wayback Machine
https://github.com/snehankekre/foi-archive-bot

archiveis civic-tech foia opengov wayback-machine

Last synced: 13 days ago
JSON representation

FOI Archive Bot archives Freedom of Information Requests from RightToKnow.org.au on the Wayback Machine

• Host: GitHub
• URL: https://github.com/snehankekre/foi-archive-bot
• Owner: snehankekre
• License: gpl-3.0
• Created: 2018-06-18T09:49:06.000Z (over 6 years ago)
• Default Branch: master
• Last Pushed: 2018-06-19T08:32:35.000Z (over 6 years ago)
• Last Synced: 2024-12-02T16:36:35.625Z (27 days ago)
• Topics: archiveis, civic-tech, foia, opengov, wayback-machine
• Language: Python
• Homepage:
• Size: 55.7 KB
• Stars: 1
• Watchers: 3
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

        
# Freedom of Information Request Archive Bot

The goal of this simple python script is to permanently archive Freedom of Information Requests from [Right to Know](https://righttoknow.org.au) on the Internet Archive's [Wayback Machine](https://archive.org/web/)

There is a lot to be added to the script, feel free to contribute! 👍

### Installation

⚠ Python v2.7 is required

You will need the following python packages installed: requests, archiveis, stem

```sh

pip install -r requirements.txt

```

### Usage

```

usage: FOI_Archive_Bot.py -s from_request -e to_request -r retries -l log_urls_to_file.txt

arguments:

  -h, --help            show this help message and exit

  -s from_request, --start from_request

                        FOI request number to start archiving from (default=1)

  -e to_request, --end to_request

                        FOI request number to stop archiving at (default=5000

  -r retries, --retries retries

                        set max number of retries when bot encounters a

                        connection error (default=3)

  -l log_urls_to_file, --log log_urls_to_file

                        log archived urls to a file

```

### Example output

![Archives FOI requests](https://i.imgur.com/qTtSbp0.png)

License

----

GNU GPLv3