https://github.com/bellingcat/auto-archiver

Automatically archive links to videos, images, and social media content from Google Sheets (and more).
https://github.com/bellingcat/auto-archiver

archive docker open-source-research python scraping service web-archiving

Last synced: 6 months ago
JSON representation

Automatically archive links to videos, images, and social media content from Google Sheets (and more).

• Host: GitHub
• URL: https://github.com/bellingcat/auto-archiver
• Owner: bellingcat
• License: mit
• Created: 2021-01-15T10:30:03.000Z (over 4 years ago)
• Default Branch: main
• Last Pushed: 2024-08-21T12:35:01.000Z (about 1 year ago)
• Last Synced: 2024-09-21T14:47:46.656Z (about 1 year ago)
• Topics: archive, docker, open-source-research, python, scraping, service, web-archiving
• Language: Python
• Homepage: https://pypi.org/project/auto-archiver/
• Size: 5.24 MB
• Stars: 545
• Watchers: 21
• Forks: 53
• Open Issues: 9
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

• awesome-rainmana - bellingcat/auto-archiver - Automatically archive links to videos, images, and social media content from Google Sheets (and more). (Python)
• awesome-repositories - bellingcat/auto-archiver - Automatically archive links to videos, images, and social media content from Google Sheets (and more). (Python)

README

          
Auto Archiver


[![Documentation Status](https://readthedocs.org/projects/auto-archiver/badge/?version=latest)](https://auto-archiver.readthedocs.io/en/latest/?badge=latest)

[![PyPI version](https://badge.fury.io/py/auto-archiver.svg)](https://badge.fury.io/py/auto-archiver)

[![Docker Image Version (latest by date)](https://img.shields.io/docker/v/bellingcat/auto-archiver?sort=semver&logo=docker&color=#69F0AE)](https://hub.docker.com/r/bellingcat/auto-archiver)

[![Core Test Status](https://github.com/bellingcat/auto-archiver/workflows/Core%20Tests/badge.svg)](https://github.com/bellingcat/auto-archiver/actions/workflows/tests-core.yaml)

Auto Archiver is a Python tool to automatically archive content on the web in a secure and verifiable way. It takes URLs from different sources (e.g. a CSV file, Google Sheets, command line etc.) and archives the content of each one. It can archive social media posts, videos, images and webpages. Content can be enriched, then saved either locally or remotely (S3 bucket, Google Drive). The status of the archiving process can be appended to a CSV report, or if using Google Sheets – back to the original sheet.



  

**[See the Auto Archiver documentation for more information.](https://auto-archiver.readthedocs.io/en/latest/)**




Read the [article about Auto Archiver on bellingcat.com](https://www.bellingcat.com/resources/2022/09/22/preserve-vital-online-content-with-bellingcats-auto-archiver-tool/).

## Installation

View the [Installation Guide](https://auto-archiver.readthedocs.io/en/latest/installation/installation.html) for full instructions

**Advanced:**

To get started quickly using Docker:

`docker pull bellingcat/auto-archiver && docker run -it --rm -v secrets:/app/secrets bellingcat/auto-archiver --config secrets/orchestration.yaml`

Or pip:

`pip install auto-archiver && auto-archiver --help`

## Contributing

We welcome contributions to the Auto Archiver project! See the [Contributing Guide](https://auto-archiver.readthedocs.io/en/latest/contributing.html) for how to get involved!