mirror
/
auto-archiver
kopia lustrzana https://github.com/bellingcat/auto-archiver
1
0
Forkuj 0
Kod Zgłoszenia Packages Projekty Wydania Wiki Aktywność
1 156 Commity
13 Gałęzie
109 Tagi
19 MiB
Wykres commitów

1156 Commity (01516724d3dc7f6bb044e183672f906a4aa98eee)

Autor SHA1 Wiadomość Data
Patrick Robertson dba44b1ac1 Use WebDriverWait when waiting for elements in screenshot enricher 2025-03-07 12:07:54 +00:00
Patrick Robertson e756f1504f Remove geckodriver .tar file 2025-03-07 11:52:14 +00:00
Patrick Robertson 2c5e138263 Add a note on disabling the auto-update for yt-dlp 2025-03-07 11:44:24 +00:00
erinhmclark fb56aac15e Catch edge case to ensure iterator is reached in instagram_tbot_extractor.py 2025-03-07 11:24:25 +00:00
erinhmclark bdd35408ce Fix ref before assignment in orchestrator.py 2025-03-07 11:23:51 +00:00
Patrick Robertson 478f0b2171 Tidy-ups to auto-updating code 2025-03-07 09:59:18 +00:00
erinhmclark 32329c6b2c Update Google Sheet how to docs. 2025-03-07 00:11:43 +00:00
erinhmclark fa1e65f54c Fix instagram_extractor.py typo, add warning to docs, and add basic regex test. 2025-03-06 16:25:38 +00:00
erinhmclark b9c2f98f46 Update Atlos tests 2025-03-05 21:24:38 +00:00
erinhmclark 0f911543cd Atlos refactor 2025-03-05 13:49:11 +00:00
erinhmclark 6cb7afefdc Initial Atlos merge 2025-03-05 10:24:54 +00:00
Patrick Robertson 358884c5d1 Fix unit tests for yt-dlp update 2025-03-04 17:04:23 +00:00
Patrick Robertson be09aa927d Make 'STARTED' command INFO not warning 2025-03-04 16:51:17 +00:00
Patrick Robertson e6a578e60e Check for auto-archiver updates and present warning if there's a newer version available 2025-03-04 16:51:17 +00:00
Patrick Robertson 0eb112431b Auto-update yt-dlp based on generic_extractor.ytdlp_update_interval (default=5 days) 2025-03-04 16:43:46 +00:00
erinhmclark 22932645aa Merge remote-tracking branch 'origin/merge_modules' into merge_modules 2025-03-04 14:07:12 +00:00
erinhmclark d1c8d4ba0e Initial merge of Atlos Feeder and DB 2025-03-04 14:06:46 +00:00
erinhmclark d775e4612e Update gsheet_feeder references in tests. 2025-03-04 14:06:46 +00:00
erinhmclark 077b56c150 Merge GSheet Feeder and Database. 2025-03-04 14:05:19 +00:00
Patrick Robertson f54d6519a8 Fix sorting of steps in the outputted file 2025-03-04 11:51:26 +00:00
Patrick Robertson 07ee773a54 Better drag & drop + keep comments in file 2025-03-04 10:54:16 +00:00
erinhmclark a705a78632 Fix instagram_extractor.py typo in config value. 2025-03-03 21:06:09 +00:00
Patrick Robertson dcaf7639be Rename 'upgrading...' page to 'upgrading from...' because it's also valid for 0.13+ versions 2025-03-03 19:58:47 +00:00
Patrick Robertson 0b5a0fcb32 Better error logs if users have XXXX_archiver modules enabled in config 2025-03-03 19:57:09 +00:00
Patrick Robertson 1fe023cd70 Throw a nicer error if a user has an orchestration.yaml file in the old format (feeder: / archivers: / formatter: ) 2025-03-03 19:51:55 +00:00
Patrick Robertson a47e18ef9a Bump gecko driver to 0.36.0 2025-03-03 16:00:11 +00:00
Patrick Robertson 0dfab2d1bc Add some code to attempt to click the cookies banners on various websites 2025-03-03 15:55:04 +00:00
Patrick Robertson dea0a49600 Download correct gecko-driver for the platform + fix setting executable path when running in Docker 
Fixes #232
 2025-03-03 15:41:44 +00:00
Erin Clark 011ded2bde
Merge pull request #225 from bellingcat/small_issues 
## GSheets Columns updates
- Update the available columns in the Google Sheet Feeder and Database.
- Update the Sheet Template to reflect this.

## Other Fixes
- Ensure test file cleanup.
- Additional tests.
- Correctly mark download test.
- Small typos.
 2025-03-03 13:06:27 +00:00
Patrick Robertson a88a37d0a5 Hook in to RTD theme to set react theme 2025-03-03 11:56:23 +00:00
Patrick Robertson 9845804277 Fix up TODO plus add comments on integration into RTD page 2025-03-03 09:18:19 +00:00
Patrick Robertson cc14e5cb9f Remove extra html/head tag from page - now it's embedded in RTD 2025-03-03 09:06:40 +00:00
Patrick Robertson 6ba79049d9 Capitalize help text 2025-02-27 22:16:33 +00:00
Patrick Robertson 7620a671d1 Overwrite settings_base file 2025-02-27 22:02:44 +00:00
Patrick Robertson 54a2a19dd7 Also build auto-archiver 2025-02-27 21:56:36 +00:00
Patrick Robertson 3eb4ab41b8 Also generate the schema on each run 2025-02-27 21:38:55 +00:00
Patrick Robertson 65a9885d86 A few more manifest types 2025-02-27 21:33:04 +00:00
Patrick Robertson 4ee1e75aa2 Fix readthedocs config file 2025-02-27 21:24:34 +00:00
Patrick Robertson 1141c00e9a Remove unused files, set up for RTD 2025-02-27 21:23:38 +00:00
Patrick Robertson 15da907e81 Add a bit of typescripting 2025-02-27 15:58:30 +00:00
Patrick Robertson 2ec44f4170 Documentation on building the settings page 2025-02-27 15:42:37 +00:00
Patrick Robertson 1e92c03b1d Tweaks to settings page + more declarations in manifests 2025-02-27 15:21:11 +00:00
Patrick Robertson efe9fdf915 Tidy ups to config editor page 2025-02-27 13:02:50 +00:00
erinhmclark 4280791f07 Fix mocking in test_wayback_enricher.py. 2025-02-27 11:25:58 +00:00
Patrick Robertson f58f110436 Check at least 1 URL provided for new cli_feeder module rewrite 2025-02-26 17:59:13 +00:00
Patrick Robertson 70d89c71ce Fully-working settings page editor 2025-02-26 17:02:49 +00:00
Patrick Robertson bb961b131c Turn cli_feeder *back* into a module, it's better like this for settings etc, documentation etc. 2025-02-26 15:41:33 +00:00
Patrick Robertson e467fc90c2 Merge branch 'main' into settings_page 2025-02-26 15:32:07 +00:00
erinhmclark 8124bb831d Merge branch 'main' into small_issues 
# Conflicts:
#	src/auto_archiver/core/base_module.py
#	src/auto_archiver/utils/misc.py
 2025-02-26 13:19:49 +00:00
erinhmclark b2e654aef9 Remove context manager from test_pdq_hash_enricher.py 2025-02-26 12:57:33 +00:00