mirror
/
auto-archiver
kopia lustrzana https://github.com/bellingcat/auto-archiver
1
0
Forkuj 0
Kod Zgłoszenia Packages Projekty Wydania Wiki Aktywność
bellingcat Python script to automatically archive social media posts, videos, and images from a Google Sheets document.
1 309 Commity
7 Gałęzie
113 Tagi
22 MiB
Python 91.9%
TypeScript 4.1%
HTML 2.4%
Shell 1%
Makefile 0.3%
Pozostałe 0.3%
 
 
 
 
 
 
Go to file
msramalho f066111d49
removes geckodriver dependencies following screenshot enricher removal 		2025-06-04 14:09:13 +01:00
.github update runner os to matrix os. 2025-03-31 12:00:24 +01:00
docs removes geckodriver dependencies following screenshot enricher removal 2025-06-04 14:09:13 +01:00
scripts v1.0.1 dependency updates, generic extractor improvements (#307) 2025-06-02 20:57:12 +01:00
src/auto_archiver dropping screenshot enricher 2025-06-04 12:08:59 +01:00
tests adds test for antibot 2025-06-04 11:59:59 +01:00
.dockerignore
…
.gitignore experiments with seleniumbase 2025-04-28 11:08:00 +01:00
.pre-commit-config.yaml Fix pre-commit for ruff check 2025-03-14 13:40:57 +00:00
.pylintrc
…
.readthedocs.yaml Fix incorrect path in cp 2025-03-16 10:33:52 +00:00
CONTRIBUTING.md
…
Dockerfile removes geckodriver dependencies following screenshot enricher removal 2025-06-04 14:09:13 +01:00
LICENSE
…
Makefile Update style_guide.md to clarify pre-commit setup, add Docker commands to Makefile and merge ruff actions. 2025-03-13 20:26:29 +00:00
README.md update repo badges 2025-03-31 16:19:29 +01:00
docker-compose.yaml Cleanup docker-compose 2025-03-20 16:48:30 +04:00
poetry.lock dropping screenshot enricher 2025-06-04 12:08:59 +01:00
pyproject.toml dropping screenshot enricher 2025-06-04 12:08:59 +01:00

README.md

Auto Archiver

Documentation Status PyPI version Docker Image Version (latest by date) Core Test Status

Auto Archiver is a Python tool to automatically archive content on the web in a secure and verifiable way. It takes URLs from different sources (e.g. a CSV file, Google Sheets, command line etc.) and archives the content of each one. It can archive social media posts, videos, images and webpages. Content can be enriched, then saved either locally or remotely (S3 bucket, Google Drive). The status of the archiving process can be appended to a CSV report, or if using Google Sheets – back to the original sheet.

Read the article about Auto Archiver on bellingcat.com.

Installation

View the Installation Guide for full instructions

Advanced:

To get started quickly using Docker:

docker pull bellingcat/auto-archiver && docker run -it --rm -v secrets:/app/secrets bellingcat/auto-archiver --config secrets/orchestration.yaml

Or pip:

pip install auto-archiver && auto-archiver --help

Contributing

We welcome contributions to the Auto Archiver project! See the Contributing Guide for how to get involved!