mirror
/
auto-archiver
kopia lustrzana https://github.com/bellingcat/auto-archiver
1
0
Forkuj 0
Kod Zgłoszenia Packages Projekty Wydania Wiki Aktywność
1 419 Commity
11 Gałęzie
113 Tagi
22 MiB
Wykres commitów

1419 Commity (0db77c7e68a9c7ca7c671febc87ff56a78f1207c)

Autor SHA1 Wiadomość Data
msramalho 378b1a6d22
expand S3 objects content type for better preview results in non-latin languages 2025-06-04 11:53:41 +01:00
msramalho d130c1b3fa
WIP attempt at ytdlp impersonation 2025-06-04 11:53:18 +01:00
msramalho cbd189c97d
general cleanup 2025-06-04 11:53:01 +01:00
msramalho d2e8f1a512
introduces antibot step with seleniumbase 2025-06-04 11:20:46 +01:00
msramalho 488802b632
poetry update 2025-06-04 11:08:44 +01:00
Dave Mateer c772082f0e counter_screenshots to counter_warc_files in wacz_extractor so don't get error about add mulitple items with same id. 2025-06-03 12:34:41 +01:00
msramalho ee68f3efee
Merge remote-tracking branch 'origin/main' into feat/seleniumbase 2025-06-03 11:05:16 +01:00
dependabot[bot] efe2a1a8b6
Bump the actions group in /scripts/settings with 4 updates 
Bumps the actions group in /scripts/settings with 4 updates: [@mui/icons-material](https://github.com/mui/material-ui/tree/HEAD/packages/mui-icons-material), [@mui/material](https://github.com/mui/material-ui/tree/HEAD/packages/mui-material), [react](https://github.com/facebook/react/tree/HEAD/packages/react) and [react-dom](https://github.com/facebook/react/tree/HEAD/packages/react-dom).


Updates `@mui/icons-material` from 6.4.12 to 7.1.1
- [Release notes](https://github.com/mui/material-ui/releases)
- [Changelog](https://github.com/mui/material-ui/blob/master/CHANGELOG.md)
- [Commits](https://github.com/mui/material-ui/commits/v7.1.1/packages/mui-icons-material)

Updates `@mui/material` from 6.4.12 to 7.1.1
- [Release notes](https://github.com/mui/material-ui/releases)
- [Changelog](https://github.com/mui/material-ui/blob/master/CHANGELOG.md)
- [Commits](https://github.com/mui/material-ui/commits/v7.1.1/packages/mui-material)

Updates `react` from 19.0.0 to 19.1.0
- [Release notes](https://github.com/facebook/react/releases)
- [Changelog](https://github.com/facebook/react/blob/main/CHANGELOG.md)
- [Commits](https://github.com/facebook/react/commits/v19.1.0/packages/react)

Updates `react-dom` from 19.0.0 to 19.1.0
- [Release notes](https://github.com/facebook/react/releases)
- [Changelog](https://github.com/facebook/react/blob/main/CHANGELOG.md)
- [Commits](https://github.com/facebook/react/commits/v19.1.0/packages/react-dom)

---
updated-dependencies:
- dependency-name: "@mui/icons-material"
  dependency-version: 7.1.1
  dependency-type: direct:production
  update-type: version-update:semver-major
  dependency-group: actions
- dependency-name: "@mui/material"
  dependency-version: 7.1.1
  dependency-type: direct:production
  update-type: version-update:semver-major
  dependency-group: actions
- dependency-name: react
  dependency-version: 19.1.0
  dependency-type: direct:production
  update-type: version-update:semver-minor
  dependency-group: actions
- dependency-name: react-dom
  dependency-version: 19.1.0
  dependency-type: direct:production
  update-type: version-update:semver-minor
  dependency-group: actions
...

Signed-off-by: dependabot[bot] <support@github.com>
 2025-06-02 20:21:07 +00:00
Miguel Sozinho Ramalho 6735fa890b
v1.0.1 dependency updates, generic extractor improvements (#307) 
* wacz: allow exceptional cases where more than one resource image is available

* improves generic extractor edge-cases and yt-dlp updates

* REMOVES vk_extractor until further notice

* bumps browsertrix in docker image

* npm version bump on scripts/settings

* poetry updates

* Changed log level on gsheet_feeder_db started from warning to info (#301)

* closes 305 and further fixes finding local downloads from uncommon ytdlp extractors

* use ffmpeg -bitexact to reduce duplicate content storing

* formatting

* adds yt-dlp curl-cffi

* version bump

* linting

---------

Co-authored-by: Dave Mateer <davemateer@gmail.com>
 2025-06-02 20:57:12 +01:00
msramalho 69028588b3
linting 2025-06-02 20:04:34 +01:00
msramalho b351a33593
version bump 2025-06-02 20:03:48 +01:00
msramalho 87e1cdc102
adds yt-dlp curl-cffi 2025-06-02 20:02:35 +01:00
msramalho 4170c2011c
formatting 2025-06-02 19:33:55 +01:00
msramalho dd4e372703
use ffmpeg -bitexact to reduce duplicate content storing 2025-06-02 19:33:53 +01:00
msramalho b9f7927a3b
closes 305 and further fixes finding local downloads from uncommon ytdlp extractors 2025-06-02 19:14:09 +01:00
msramalho d99b7c9efe
Merge remote-tracking branch 'origin/main' into dev 2025-06-02 13:25:34 +01:00
Dave Mateer 48be13fb2a
catch for if self.comments are true but no actual comments in video (#303) 
* catch for if self.comments are true but no actual comments in video

* simplifies check code

---------

Co-authored-by: Miguel Sozinho Ramalho <19508417+msramalho@users.noreply.github.com>
 2025-06-02 13:02:19 +01:00
Dave Mateer 4aae5047f5
Changed log level on gsheet_feeder_db started from warning to info (#301) 2025-06-02 12:53:21 +01:00
msramalho 258e56aa26
poetry updates 2025-06-02 12:52:26 +01:00
msramalho 9ad6213efa
npm version bump on scripts/settings 2025-06-02 12:47:31 +01:00
msramalho 2f36e50e0b
bumps browsertrix in docker image 2025-06-02 12:06:14 +01:00
msramalho 2d7206f99d
REMOVES vk_extractor until further notice 2025-06-02 12:06:02 +01:00
msramalho ac24fd8f49
improves generic extractor edge-cases and yt-dlp updates 2025-06-02 12:03:51 +01:00
msramalho ee3e871dd8
wacz: allow exceptional cases where more than one resource image is available 2025-05-28 11:53:29 +01:00
msramalho e6fdef66df
improves instructions on docker setup with an example URL 2025-04-28 11:16:01 +01:00
msramalho 5cf640af8a
experiments with seleniumbase 2025-04-28 11:08:00 +01:00
Miguel Sozinho Ramalho 33cacd145f
Update tests-download.yaml 
to shift ownership of notifications
 2025-04-07 21:15:18 +01:00
Miguel Sozinho Ramalho 0f69b5fe0c
update repo badges 2025-03-31 16:19:29 +01:00
Erin Clark ad2e8397b2
Merge pull request #287 from bellingcat/fix/insta_tbot_empty 
Only return success for instagram_tbot_extractor.py with content.
 2025-03-31 14:31:46 +01:00
erinhmclark 144adaad5b Only return success for instagram_tbot_extractor.py with content. 2025-03-31 14:14:36 +01:00
Erin Clark c7c7eb00a1
Merge pull request #286 from bellingcat/version_comparison 
Small code fixes and GH Actions cache
 2025-03-31 12:40:42 +01:00
erinhmclark 7e4ba62918 Small code change 2025-03-31 12:05:39 +01:00
erinhmclark 9c2b506189 update runner os to matrix os. 2025-03-31 12:00:24 +01:00
erinhmclark 8940580638 Add poetry cache clear, and small code change 2025-03-31 11:41:26 +01:00
erinhmclark c2821d7c83 Fix poetry install deletion 2025-03-31 11:25:51 +01:00
erinhmclark a590647279 Small code tidy to trigger tests. 2025-03-31 11:23:49 +01:00
erinhmclark 1edfdae03e Update download tests to match cache process. 2025-03-31 11:17:40 +01:00
erinhmclark 6c7f6af4b4 Add cache action with key to OS, py version and lockfile hash, and install packages from source. 2025-03-31 11:11:56 +01:00
Erin Clark 8685b6bf13
Merge pull request #285 from bellingcat/fix-ubuntu-22 
[WIP] Change order of poetry install - in case this fixes core tests
 2025-03-28 15:38:03 +00:00
Patrick Robertson 0ce7f5a1b5 Disable caching 2025-03-28 18:40:02 +04:00
Patrick Robertson 85d3f2fa02 Revert changes 2025-03-28 18:36:11 +04:00
Patrick Robertson fd540bd03a Code change to trigger tests 2025-03-28 18:29:59 +04:00
Patrick Robertson 86f328515c Use cache key that includes os version 2025-03-28 18:29:52 +04:00
erinhmclark 68992025b0 Update version comparison. 2025-03-28 14:29:44 +00:00
Patrick Robertson 6544934825
Merge pull request #283 from bellingcat/1.0-release 
v1.0.0 release 🎉
 2025-03-28 18:06:59 +04:00
Patrick Robertson 197599b406
Merge pull request #284 from bellingcat/revert-downloads-test 
Revert downloads CI tests changes
 2025-03-28 18:06:49 +04:00
Erin Clark 96efdcbba1
Merge pull request #281 from bellingcat/add_inst_api_script 
Add InstagrAPI server script to be used with the Instagram API Extractor.
 2025-03-28 13:58:37 +00:00
Patrick Robertson 2ec494b4b9 Revert downloads CI tests changes 
It wasn't properly being triggered after the core tests. this reverts so that the download tests just run whatever
 2025-03-28 17:55:58 +04:00
Erin Clark 1d18399d70
Merge pull request #222 from bellingcat/feat/yt-dlp-pots 
yt-dlp proposed extractor_args and PO Token client.
 2025-03-28 13:54:27 +00:00
Patrick Robertson 3550a009e6
v1.0.0 release 🎉 2025-03-28 13:53:29 +00:00