62 Commity (dev)

Autor	SHA1	Wiadomość	Data
msramalho	cd6a2b6031	generic_extractor download tests adaptations	2025-06-11 20:05:35 +01:00
msramalho	d7a48e465b	fix copypasta	2025-06-11 18:04:49 +01:00
msramalho	f5be7a50c1	Testing Linkedin Dropin for Antibot	2025-06-11 16:52:03 +01:00
msramalho	69ddb72146	separate reddit tests	2025-06-11 11:27:11 +01:00
msramalho	1039e9631f	new reddit tests with .env.test	2025-06-11 11:22:23 +01:00
msramalho	8314833ae8	removes exclude_media_extensions option	2025-06-10 18:34:33 +01:00
msramalho	6bbc7fb47a	improves antibot flow and makes auth_wall detection optional	2025-06-10 16:29:07 +01:00
msramalho	6f02493ff1	adds clips extraction to VK, though generic_extractor should still be run for those	2025-06-08 14:36:55 +01:00
msramalho	d13a5ef003	adds tests in minor improvements	2025-06-07 19:58:18 +01:00
msramalho	2c6be4447f	linting	2025-06-04 14:17:38 +01:00
msramalho	22408e2a98	adds test for antibot	2025-06-04 11:59:59 +01:00
msramalho	cbd189c97d	general cleanup	2025-06-04 11:53:01 +01:00
Miguel Sozinho Ramalho	6735fa890b	v1.0.1 dependency updates, generic extractor improvements (#307) ... * wacz: allow exceptional cases where more than one resource image is available * improves generic extractor edge-cases and yt-dlp updates * REMOVES vk_extractor until further notice * bumps browsertrix in docker image * npm version bump on scripts/settings * poetry updates * Changed log level on gsheet_feeder_db started from warning to info (#301) * closes 305 and further fixes finding local downloads from uncommon ytdlp extractors * use ffmpeg -bitexact to reduce duplicate content storing * formatting * adds yt-dlp curl-cffi * version bump * linting --------- Co-authored-by: Dave Mateer <davemateer@gmail.com>	2025-06-02 20:57:12 +01:00
erinhmclark	144adaad5b	Only return success for instagram_tbot_extractor.py with content.	2025-03-31 14:14:36 +01:00
erinhmclark	c510c04643	Update config reference in test_generic_extractor.py	2025-03-28 13:43:46 +00:00
erinhmclark	0840b7283c	Format	2025-03-28 10:43:00 +00:00
erinhmclark	b5dc1854a2	Merge branch 'main' into feat/yt-dlp-pots	2025-03-28 10:42:24 +00:00
erinhmclark	efab0f9a91	Add test	2025-03-28 10:37:22 +00:00
Patrick Robertson	b7949a489f	Simplify telethon unit tests for CI (don't use TestExtractorBase - it causes loading issues)	2025-03-26 23:51:21 +04:00
Patrick Robertson	e06b0c0585	Skip checking if docker is running for tests + more graceful test for filename	2025-03-26 23:03:48 +04:00
Patrick Robertson	95ea9fb231	Telethon unit tests + tidyup	2025-03-26 22:53:27 +04:00
erinhmclark	040a864d5c	Merge branch 'refs/heads/main' into feat/yt-dlp-pots ... # Conflicts: # poetry.lock	2025-03-25 18:26:43 +00:00
erinhmclark	b4c33318c4	Merge branch 'main' into feat/yt-dlp-pots ... # Conflicts: # src/auto_archiver/modules/generic_extractor/__manifest__.py # tests/test_modules.py	2025-03-25 15:16:31 +00:00
Patrick Robertson	a9fe959ea1	Fix unit tests for latest yt-dlp ... (Yt-dlp title is now truncated)	2025-03-24 17:48:15 +04:00
Patrick Robertson	0a5ba3385e	Fix small bug in twitter dropin ... - previously the 'content' was being set to a json dump of the tweet, it should be set to full_text	2025-03-20 18:55:22 +04:00
erinhmclark	ba9d67e4bb	Merge branch 'main' into feat/yt-dlp-pots	2025-03-18 20:10:38 +00:00
erinhmclark	c4e63ebd8c	Add conditional check to setup bgutils token generation script. ... TODO: Update tests	2025-03-18 14:54:57 +00:00
Patrick Robertson	89e387030d	Tests for suitable URLs for tikwm	2025-03-18 10:04:03 +00:00
Patrick Robertson	59b910ec30	Merge main	2025-03-17 10:05:11 +00:00
erinhmclark	72f48f0147	Fix merge conflicts.	2025-03-14 12:11:24 +00:00
erinhmclark	846474a4e2	Merge branch 'main' into linting_etc	2025-03-14 10:50:13 +00:00
Patrick Robertson	2e25e59fa6	Fix unit tests - make caplog checks more robust, having added a new logger/debug call	2025-03-13 16:07:49 +00:00
Patrick Robertson	10ceb7aa15	Move tikwm extractor into a droping for the generic extractor	2025-03-13 15:59:42 +00:00
erinhmclark	0bef78b0b4	Remove autouse property of mock_sleep.	2025-03-13 15:23:35 +00:00
erinhmclark	16012df30b	Revert exception check in test.	2025-03-13 13:57:04 +00:00
erinhmclark	8673bc5979	Fix unused imports and include rule.	2025-03-13 13:55:31 +00:00
erinhmclark	e76551ba22	Add documentation, pre-commit hook, more make commands and	2025-03-13 13:21:32 +00:00
erinhmclark	753c3c6214	Linting tests	2025-03-12 14:27:45 +00:00
erinhmclark	441f341139	Merge branch 'main' into linting_etc ... # Conflicts: # src/auto_archiver/core/consts.py # src/auto_archiver/core/orchestrator.py # src/auto_archiver/core/storage.py # src/auto_archiver/modules/local_storage/local_storage.py # src/auto_archiver/modules/s3_storage/s3_storage.py # tests/storages/test_S3_storage.py # tests/storages/test_local_storage.py # tests/storages/test_storage_base.py	2025-03-11 10:39:47 +00:00
erinhmclark	85abe1837a	Ruff format with defaults.	2025-03-10 18:44:54 +00:00
Miguel Sozinho Ramalho	58bd38e292	Adds new extractor for tiktok via unofficial API (#237) ... * minor update to defaults in api_db * readme typo * adds and tests new tikwm tiktok downloader * addresses PR comments	2025-03-10 11:56:45 +00:00
erinhmclark	fa1e65f54c	Fix instagram_extractor.py typo, add warning to docs, and add basic regex test.	2025-03-06 16:25:38 +00:00
erinhmclark	a705a78632	Fix instagram_extractor.py typo in config value.	2025-03-03 21:06:09 +00:00
erinhmclark	8124bb831d	Merge branch 'main' into small_issues ... # Conflicts: # src/auto_archiver/core/base_module.py # src/auto_archiver/utils/misc.py	2025-02-26 13:19:49 +00:00
erinhmclark	73b434aafc	Tests for test_vk_extractor.py.	2025-02-25 14:08:28 +00:00
Patrick Robertson	f8e846d59a	Create facebook dropin - working for images + text. CAVEAT: only gets the first ~100 chars of the post at the moment	2025-02-25 11:44:35 +00:00
Patrick Robertson	7dde8d609d	Merge main	2025-02-20 10:29:57 +00:00
erinhmclark	47a634fc63	Add WACZ, Wayback and local storage tests.	2025-02-19 13:14:08 +00:00
Patrick Robertson	222a94563f	WIP: Docs tidyups+add howto on logging and authentication ... (Authentication is WIP)	2025-02-19 10:37:04 +00:00
erinhmclark	f0fd9bf445	Updates tests to use pytest-mock.	2025-02-18 23:32:03 +00:00