bellingcat Python script to automatically archive social media posts, videos, and images from a Google Sheets document.

Go to file

erinhmclark a577228465 Update generic_extractor.py for general/ youtube extraction.		2025-03-18 21:10:06 +00:00
.github/workflows	…
docs	Add info on building RTD versions + automated building of tagged versions	2025-03-17 12:52:04 +00:00
scripts	…
src/auto_archiver	Update generic_extractor.py for general/ youtube extraction.	2025-03-18 21:10:06 +00:00
tests	Tests for suitable URLs for tikwm	2025-03-18 10:04:03 +00:00
.dockerignore	…
.gitignore	…
.pre-commit-config.yaml	…
.pylintrc	…
.readthedocs.yaml	…
CONTRIBUTING.md	…
Dockerfile	…
LICENSE	…
Makefile	…
README.md	Add '-it' to the list of docker flags, so that docker gives a colour log output	2025-03-17 09:45:12 +00:00
docker-compose.yaml	…
poetry.lock	…
pyproject.toml	Version bump	2025-03-18 10:52:23 +00:00

README.md

Auto Archiver

Auto Archiver is a Python tool to automatically archive content on the web in a secure and verifiable way. It takes URLs from different sources (e.g. a CSV file, Google Sheets, command line etc.) and archives the content of each one. It can archive social media posts, videos, images and webpages. Content can be enriched, then saved either locally or remotely (S3 bucket, Google Drive). The status of the archiving process can be appended to a CSV report, or if using Google Sheets – back to the original sheet.

See the Auto Archiver documentation for more information.

Read the article about Auto Archiver on bellingcat.com.

Installation

View the Installation Guide for full instructions

Advanced:

To get started quickly using Docker:

docker pull bellingcat/auto-archiver && docker run -it --rm -v secrets:/app/secrets bellingcat/auto-archiver --config secrets/orchestration.yaml

Or pip:

pip install auto-archiver && auto-archiver --help

Contributing

We welcome contributions to the Auto Archiver project! See the Contributing Guide for how to get involved!