mirror
/
auto-archiver
kopia lustrzana https://github.com/bellingcat/auto-archiver
1
0
Forkuj 0
Kod Zgłoszenia Packages Projekty Wydania Wiki Aktywność
bellingcat Python script to automatically archive social media posts, videos, and images from a Google Sheets document.
930 Commity
7 Gałęzie
113 Tagi
22 MiB
Python 91.9%
TypeScript 4.1%
HTML 2.4%
Shell 1%
Makefile 0.3%
Pozostałe 0.3%
 
 
 
 
 
 
Go to file
Patrick Robertson 061f29c885 How-to on updating config file to version 0.13+ 2025-02-20 11:46:57 +00:00
.github/workflows removes fixed oscrypto dependency, it blocked pypi publishing (#195) 2025-02-14 10:51:56 +00:00
docs How-to on updating config file to version 0.13+ 2025-02-20 11:46:57 +00:00
scripts Update modules for new core structure. 2025-01-30 08:42:23 +00:00
src/auto_archiver Better display name for wayback machine to emphasise it's typically used as an enricher 2025-02-20 11:46:57 +00:00
tests Implementation test with 2 x orchestrators with different configs 2025-02-20 11:18:28 +00:00
.dockerignore
…
.gitignore Use a script to auto-generate documentation for the core modules from the manifest file 2025-02-10 22:51:04 +00:00
.pylintrc Ignore pylint statements for manifest files 2025-01-21 17:59:52 +01:00
.readthedocs.yaml Readthedocs now requires all packages for running the pre-build scripts 2025-02-11 18:38:41 +00:00
CONTRIBUTING.md Fix links to docs 2025-02-12 11:41:54 +00:00
Dockerfile modifies base docker image to use browsertrix 1.4.2 (#182) 2025-01-24 13:59:29 +00:00
LICENSE
…
README.md Absolute paths in README for Github/PyPi/Dockerhub etc. 2025-02-20 11:18:28 +00:00
docker-compose.yaml
…
poetry.lock Updates tests to use pytest-mock. 2025-02-18 23:32:03 +00:00
pyproject.toml Merge pull request #210 from bellingcat/logger_fix 2025-02-19 15:11:42 +00:00

README.md

Auto Archiver

PyPI version Docker Image Version (latest by date) Core Test Status Download Test Status

Auto Archiver is a Python tool to automatically archive content on the web in a secure and verifiable way. It takes URLs from different sources (e.g. a CSV file, Google Sheets, command line etc.) and archives the content of each one. It can archive social media posts, videos, images and webpages. Content can enriched, then saved either locally or remotely (S3 bucket, Google Drive). The status of the archiving process can be appended to a CSV report, or if using Google Sheets – back to the original sheet.

Read the article about Auto Archiver on bellingcat.com.

Installation

View the Installation Guide for full instructions

To get started quickly using Docker:

docker pull bellingcat/auto-archiver && docker run

Or pip:

pip install auto-archiver && auto-archiver --help

Contributing

We welcome contributions to the Auto Archiver project! See the Contributing Guide for how to get involved!