bellingcat Python script to automatically archive social media posts, videos, and images from a Google Sheets document.
 
 
 
 
 
 
Go to file
erinhmclark c7c24fbaf2 Update style_guide.md to clarify pre-commit setup, add Docker commands to Makefile and merge ruff actions. 2025-03-13 20:26:29 +00:00
.github/workflows Update style_guide.md to clarify pre-commit setup, add Docker commands to Makefile and merge ruff actions. 2025-03-13 20:26:29 +00:00
docs Update style_guide.md to clarify pre-commit setup, add Docker commands to Makefile and merge ruff actions. 2025-03-13 20:26:29 +00:00
scripts Linting tests 2025-03-12 14:27:45 +00:00
src/auto_archiver Fix unused imports and include rule. 2025-03-13 13:55:31 +00:00
tests Remove autouse property of mock_sleep. 2025-03-13 15:23:35 +00:00
.dockerignore docker initial files 2022-10-31 17:10:55 +00:00
.gitignore Fix sorting of steps in the outputted file 2025-03-04 11:51:26 +00:00
.pre-commit-config.yaml Add documentation, pre-commit hook, more make commands and 2025-03-13 13:21:32 +00:00
.pylintrc Ignore pylint statements for manifest files 2025-01-21 17:59:52 +01:00
.readthedocs.yaml Overwrite settings_base file 2025-02-27 22:02:44 +00:00
CONTRIBUTING.md Fix links to docs 2025-02-12 11:41:54 +00:00
Dockerfile Remove geckodriver .tar file 2025-03-07 11:52:14 +00:00
LICENSE Add LICENSE 2021-06-24 16:14:32 +02:00
Makefile Update style_guide.md to clarify pre-commit setup, add Docker commands to Makefile and merge ruff actions. 2025-03-13 20:26:29 +00:00
README.md Adds new extractor for tiktok via unofficial API (#237) 2025-03-10 11:56:45 +00:00
docker-compose.yaml Add docker-compose for easy building and running of docker image in dev 2025-01-15 14:36:02 +01:00
poetry.lock Add documentation, pre-commit hook, more make commands and 2025-03-13 13:21:32 +00:00
pyproject.toml Fix unused imports and include rule. 2025-03-13 13:55:31 +00:00

README.md

Auto Archiver

PyPI version Docker Image Version (latest by date) Core Test Status Download Test Status

Auto Archiver is a Python tool to automatically archive content on the web in a secure and verifiable way. It takes URLs from different sources (e.g. a CSV file, Google Sheets, command line etc.) and archives the content of each one. It can archive social media posts, videos, images and webpages. Content can be enriched, then saved either locally or remotely (S3 bucket, Google Drive). The status of the archiving process can be appended to a CSV report, or if using Google Sheets – back to the original sheet.

Read the article about Auto Archiver on bellingcat.com.

Installation

View the Installation Guide for full instructions

Advanced:

To get started quickly using Docker:

docker pull bellingcat/auto-archiver && docker run --rm -v secrets:/app/secrets bellingcat/auto-archiver --config secrets/orchestration.yaml

Or pip:

pip install auto-archiver && auto-archiver --help

Contributing

We welcome contributions to the Auto Archiver project! See the Contributing Guide for how to get involved!