mirror
/
auto-archiver
kopia lustrzana https://github.com/bellingcat/auto-archiver
1
0
Forkuj 0
Kod Zgłoszenia Packages Projekty Wydania Wiki Aktywność
79 Commity
7 Gałęzie
113 Tagi
22 MiB
Wykres commitów

79 Commity (6e5e7212c273b0266e1f0717bdac80c689853090)

Autor SHA1 Wiadomość Data
msramalho 6e5e7212c2 fixes header offset 2022-03-12 19:56:00 +01:00
msramalho 486c3295b5 log 2022-03-12 19:54:10 +01:00
msramalho 6c5d6f521e implements fresh status retrieval if needed 2022-03-10 19:00:02 +01:00
msramalho 52333874c9 making column names configurable through the command line 2022-03-09 12:38:04 +01:00
msramalho 077c71f941 fixes index out fo range bug 2022-03-09 12:18:06 +01:00
msramalho ff874fe0d3 simplifies access to google sheets, single get_values 2022-03-09 12:17:51 +01:00
msramalho 544e7578a6 removes duplicate code 2022-03-09 11:46:14 +01:00
msramalho 59027ac477 simplification 2022-03-09 11:44:19 +01:00
msramalho 39ec190e56 adds README instructions for geckodriver 2022-03-09 11:44:05 +01:00
Logan Williams 82ca6792c4 Fix issue with extracting time from Telegram media posts 2022-03-02 14:45:36 +01:00
Logan Williams aa4b175dea Fix issue with timestamps being convereted to user format 2022-02-28 12:54:58 +01:00
Logan Williams c6b159905b Switch to headless Firefox 2022-02-28 11:45:32 +01:00
Logan Williams 6ebce974f0 WIP: Make timezones more consistent in UTC 2022-02-28 08:42:59 +01:00
Logan Williams 2d50703489 Generate archivers for Telegram posts with images; move generation to function in base_archiver 2022-02-28 08:41:45 +01:00
Logan Williams 63a2847ac9 Add header argument; set up webdriver 2022-02-25 16:09:35 +01:00
Logan Williams 09dc5b5b81 Fix issue with query parameters by using urllib 2022-02-25 15:29:56 +01:00
Logan Williams 6a62c5798c Add Twitter non-video archiver 2022-02-25 13:55:43 +01:00
Logan Williams 1eb17e4de5 Add hash and screenshot methods; switch to more recent ytdl fork 2022-02-25 13:54:40 +01:00
Logan Williams d76e3bc7ec
Merge pull request #13 from bellingcat/refactor-archivers 
WIP: Refactor archivers
 2022-02-25 08:05:22 +01:00
msramalho 8bce84082a minor updates 2022-02-23 18:32:40 +01:00
msramalho 4bbbdcc7fd minor update 2022-02-23 18:30:06 +01:00
msramalho 214d52d36f improved tmp folder management 2022-02-23 16:43:42 +01:00
msramalho 3cafc444fc creates tmp folder if not exists 2022-02-23 16:32:38 +01:00
msramalho 1d62009c4f creates utils module and moves gworkseet there 2022-02-23 16:24:59 +01:00
msramalho 2601313249 removed archivers.py 2022-02-23 16:13:09 +01:00
msramalho 3096725a2b Merge branch 'refactor-archivers' of https://github.com/bellingcat/auto-archiver into refactor-archivers 2022-02-23 16:12:47 +01:00
msramalho 9a264a7dfe cleanup and docs 2022-02-23 16:07:58 +01:00
msramalho 9550cd509e making code more resilient to exceptions 2022-02-23 13:57:11 +01:00
msramalho 644aa0811c todo 2022-02-23 09:57:44 +01:00
msramalho 374852e740 cleanup 2022-02-23 09:57:04 +01:00
msramalho 2d145802b5 extracted worksheet operations 2022-02-23 09:54:03 +01:00
msramalho e4603a9423 refactoring storage and bringing changes from origin 2022-02-22 16:03:35 +01:00
Logan Williams 07b5d357b4 Fix bugs in WaybackArchiver, follow redirects sometimes 2022-02-22 08:20:45 +01:00
msramalho f3ce226665 split into multiple files MVP 2022-02-21 14:19:09 +01:00
Logan Williams 009c0dd8ca Clean up dependencies 2022-02-20 11:06:47 +01:00
Logan Williams 51d448f0cb Refactor archivers to make it easier to add support for new types of URLs 2022-02-20 10:36:53 +01:00
Logan Williams b52380446f Merge branch 'jamesarnall-refactor-dry' into main 2021-10-21 10:01:11 +00:00
Logan Williams 7e2e9f999d Fix merge conflicts with get_key, remove os module as a function input 2021-10-21 10:01:05 +00:00
Logan Williams 0492eee65e Generate storage keys in reusable way 2021-10-21 09:55:50 +00:00
James Arnall b639a9b819 Minor refactoring to avoid redundant code 2021-09-08 14:20:23 -07:00
Logan Williams 2097e42df0 Dynamically adjust number of keyframes for contact sheet view. 2021-08-25 11:04:14 +00:00
Logan Williams e3b400ca4e Add Facebook cookie option 2021-08-24 11:17:29 +02:00
Logan Williams 4472389ae5 Remove case-sensitivity to column titles 2021-08-24 10:43:22 +02:00
Logan Williams 67e41b80ce
Add LICENSE 2021-06-24 16:14:32 +02:00
Logan Williams 194ff84e35
Merge pull request #9 from jamesarnall/gspreadconfig 
Changed instructions on creating credential files
 2021-06-12 19:04:24 +02:00
James Arnall 1e6b504c7a Changed instructions on creating credential files 
The original instructions specified putting the gspread credentials file in the default location, but the code looks for a file in another place. The README now reflects the code's behavior.
 2021-06-12 11:37:09 -05:00
Logan Williams 3aa2a083ba
Update README.md 2021-06-04 12:07:03 +02:00
Logan Williams af99f16f71 Use Internet Archive Save Now V2 API 2021-06-03 11:20:06 +02:00
Logan Williams 0b8f55de18 Check to see if Internet Archive request succeeded 2021-06-01 14:35:32 +02:00
Logan Williams 3e1e0e6a5f Add in progress status to Archive requests 2021-06-01 11:35:14 +02:00