bellingcat Python script to automatically archive social media posts, videos, and images from a Google Sheets document.
 
 
 
 
 
 
Go to file
Patrick Robertson fbf51f61b9
Merge pull request #276 from bellingcat/actions_updates
Only run 'download' actions once core completes + re-add `ubuntu-latest` to matrix
2025-03-26 12:08:13 +00:00
.github Re-add 'ubuntu-latest' - now that we're rid of tsp_client 2025-03-26 15:29:36 +04:00
docs Add note that authentication only works for some modules 2025-03-24 18:28:35 +04:00
scripts Update node module versions 2025-03-24 18:28:30 +04:00
src/auto_archiver Small code tidy ups 2025-03-26 15:34:33 +04:00
tests Merge branch 'main' into timestamping_rewrite 2025-03-26 14:37:51 +04:00
.dockerignore
.gitignore Script to auto-generate a service account 2025-03-17 15:42:43 +00:00
.pre-commit-config.yaml
.pylintrc
.readthedocs.yaml
CONTRIBUTING.md
Dockerfile Bump browsertrix version 2025-03-24 17:39:44 +04:00
LICENSE
Makefile
README.md Add '-it' to the list of docker flags, so that docker gives a colour log output 2025-03-17 09:45:12 +00:00
docker-compose.yaml Cleanup docker-compose 2025-03-20 16:48:30 +04:00
poetry.lock Lock poetry file 2025-03-26 15:43:03 +04:00
pyproject.toml This force-pins cryptography to >44.0.1 to fix dependabot warning 2025-03-26 15:39:53 +04:00

README.md

Auto Archiver

PyPI version Docker Image Version (latest by date) Core Test Status Download Test Status

Auto Archiver is a Python tool to automatically archive content on the web in a secure and verifiable way. It takes URLs from different sources (e.g. a CSV file, Google Sheets, command line etc.) and archives the content of each one. It can archive social media posts, videos, images and webpages. Content can be enriched, then saved either locally or remotely (S3 bucket, Google Drive). The status of the archiving process can be appended to a CSV report, or if using Google Sheets – back to the original sheet.

Read the article about Auto Archiver on bellingcat.com.

Installation

View the Installation Guide for full instructions

Advanced:

To get started quickly using Docker:

docker pull bellingcat/auto-archiver && docker run -it --rm -v secrets:/app/secrets bellingcat/auto-archiver --config secrets/orchestration.yaml

Or pip:

pip install auto-archiver && auto-archiver --help

Contributing

We welcome contributions to the Auto Archiver project! See the Contributing Guide for how to get involved!