mirror
/
auto-archiver
kopia lustrzana https://github.com/bellingcat/auto-archiver
1
0
Forkuj 0
Kod Zgłoszenia Packages Projekty Wydania Wiki Aktywność
125 Commity
10 Gałęzie
110 Tagi
21 MiB
Wykres commitów

51 Commity (b3599dee718f157b39ef03308e78ad3598d33c13)

Autor SHA1 Wiadomość Data
Dave Mateer b3599dee71 working 2022-05-11 14:01:22 +01:00
Miguel Sozinho Ramalho bba510b8c2
Merge pull request #30 from djhmateer/logging 2022-05-09 15:59:49 +01:00
Miguel Sozinho Ramalho 6e8eccefd8
self-documenting info message 2022-05-09 15:59:35 +01:00
Miguel Sozinho Ramalho 05a3adfc36
Merge pull request #31 from djhmateer/firefox 2022-05-09 15:59:02 +01:00
Dave Mateer bb599f702d Reload firefox driver on every spreadsheet row 2022-05-09 12:16:18 +01:00
Dave Mateer f52d8cdef8 add back in d_dotenv() 2022-05-09 12:02:43 +01:00
Dave Mateer e3c0ae1d45 dotenv 2022-05-09 11:57:54 +01:00
Dave Mateer e18a9779db added log diretory and file creation 2022-05-09 11:55:10 +01:00
Dave Mateer 51f635ce50 get env variable FACEBOOK_COOKIE patch through from auto_archive 2022-05-09 11:44:25 +01:00
msramalho 3bdeec1d2f fix deprecation warning for selenium 2022-03-30 11:05:31 +02:00
Logan Williams 398f296789 Fix Selenium driver issues with telegram links 2022-03-18 11:10:27 +01:00
Logan Williams 538bb05395 Merge branch 'main' of github.com:bellingcat/auto-archiver into main 2022-03-18 09:53:29 +01:00
Logan Williams 050b04e31d Add flag for storage privacy 2022-03-18 09:53:21 +01:00
msramalho 0035603bfb telethon-poc 2022-03-15 18:45:53 +01:00
Logan Williams 0304860bce Don't check status for empty URL rows 2022-03-14 11:10:51 +01:00
msramalho f121c9dab7 enable tolower 2022-03-12 20:14:16 +01:00
msramalho 69483d432c adds logs 2022-03-12 20:04:08 +01:00
msramalho 486c3295b5 log 2022-03-12 19:54:10 +01:00
msramalho 6c5d6f521e implements fresh status retrieval if needed 2022-03-10 19:00:02 +01:00
msramalho 52333874c9 making column names configurable through the command line 2022-03-09 12:38:04 +01:00
msramalho ff874fe0d3 simplifies access to google sheets, single get_values 2022-03-09 12:17:51 +01:00
msramalho 544e7578a6 removes duplicate code 2022-03-09 11:46:14 +01:00
Logan Williams aa4b175dea Fix issue with timestamps being convereted to user format 2022-02-28 12:54:58 +01:00
Logan Williams c6b159905b Switch to headless Firefox 2022-02-28 11:45:32 +01:00
Logan Williams 6ebce974f0 WIP: Make timezones more consistent in UTC 2022-02-28 08:42:59 +01:00
Logan Williams 63a2847ac9 Add header argument; set up webdriver 2022-02-25 16:09:35 +01:00
msramalho 4bbbdcc7fd minor update 2022-02-23 18:30:06 +01:00
msramalho 214d52d36f improved tmp folder management 2022-02-23 16:43:42 +01:00
msramalho 3cafc444fc creates tmp folder if not exists 2022-02-23 16:32:38 +01:00
msramalho 1d62009c4f creates utils module and moves gworkseet there 2022-02-23 16:24:59 +01:00
msramalho 9550cd509e making code more resilient to exceptions 2022-02-23 13:57:11 +01:00
msramalho 644aa0811c todo 2022-02-23 09:57:44 +01:00
msramalho 374852e740 cleanup 2022-02-23 09:57:04 +01:00
msramalho 2d145802b5 extracted worksheet operations 2022-02-23 09:54:03 +01:00
msramalho e4603a9423 refactoring storage and bringing changes from origin 2022-02-22 16:03:35 +01:00
msramalho f3ce226665 split into multiple files MVP 2022-02-21 14:19:09 +01:00
Logan Williams 51d448f0cb Refactor archivers to make it easier to add support for new types of URLs 2022-02-20 10:36:53 +01:00
Logan Williams 7e2e9f999d Fix merge conflicts with get_key, remove os module as a function input 2021-10-21 10:01:05 +00:00
Logan Williams 0492eee65e Generate storage keys in reusable way 2021-10-21 09:55:50 +00:00
James Arnall b639a9b819 Minor refactoring to avoid redundant code 2021-09-08 14:20:23 -07:00
Logan Williams 2097e42df0 Dynamically adjust number of keyframes for contact sheet view. 2021-08-25 11:04:14 +00:00
Logan Williams e3b400ca4e Add Facebook cookie option 2021-08-24 11:17:29 +02:00
Logan Williams 4472389ae5 Remove case-sensitivity to column titles 2021-08-24 10:43:22 +02:00
Logan Williams af99f16f71 Use Internet Archive Save Now V2 API 2021-06-03 11:20:06 +02:00
Logan Williams 0b8f55de18 Check to see if Internet Archive request succeeded 2021-06-01 14:35:32 +02:00
Logan Williams 3e1e0e6a5f Add in progress status to Archive requests 2021-06-01 11:35:14 +02:00
Logan Williams 2540b54113 Allow redirects for Archive requets 2021-06-01 11:30:47 +02:00
Logan Williams cbfc054203 Use service_account.json 2021-06-01 11:05:13 +02:00
Logan Williams aaf75eb284 Add internet archive fallback 2021-06-01 11:00:40 +02:00
Logan Williams 866c4fa7fd Support (some) Telegram links 2021-05-03 14:16:09 +02:00