bellingcat Python script to automatically archive social media posts, videos, and images from a Google Sheets document.
 
 
 
 
 
 
Go to file
msramalho 37c6d97275
new auth wall check logic and escaped CSS selector in selenium
2025-07-05 18:30:31 +01:00
.github make python api tests work on gh when no env is set 2025-06-30 02:20:51 +01:00
docs updates docs to reflect new general approach extractor 2025-07-05 15:56:13 +01:00
scripts concludes logging standardization refactor 2025-06-26 17:20:04 +01:00
src/auto_archiver new auth wall check logic and escaped CSS selector in selenium 2025-07-05 18:30:31 +01:00
tests make python api tests work on gh when no env is set 2025-06-30 02:20:51 +01:00
.dockerignore
.gitignore
.pre-commit-config.yaml
.pylintrc
.readthedocs.yaml installs ffmpeg in readthedocs 2025-06-18 00:29:36 +01:00
CONTRIBUTING.md
Dockerfile browsertrix version bump 2025-06-17 19:22:20 +01:00
LICENSE
Makefile
README.md
docker-compose.yaml
poetry.lock updates dependencies 2025-07-05 16:03:47 +01:00
pyproject.toml closes #333 2025-06-30 01:52:22 +01:00

README.md

Auto Archiver

Documentation Status PyPI version Docker Image Version (latest by date) Core Test Status

Auto Archiver is a Python tool to automatically archive content on the web in a secure and verifiable way. It takes URLs from different sources (e.g. a CSV file, Google Sheets, command line etc.) and archives the content of each one. It can archive social media posts, videos, images and webpages. Content can be enriched, then saved either locally or remotely (S3 bucket, Google Drive). The status of the archiving process can be appended to a CSV report, or if using Google Sheets – back to the original sheet.

Read the article about Auto Archiver on bellingcat.com.

Installation

View the Installation Guide for full instructions

Advanced:

To get started quickly using Docker:

docker pull bellingcat/auto-archiver && docker run -it --rm -v secrets:/app/secrets bellingcat/auto-archiver --config secrets/orchestration.yaml

Or pip:

pip install auto-archiver && auto-archiver --help

Contributing

We welcome contributions to the Auto Archiver project! See the Contributing Guide for how to get involved!