dgtlmoon
61be7f68db
Requests fetcher - Remove old screenshot when watch was in a different fetcher type ( #3097 )
2025-04-09 10:01:20 +02:00
dgtlmoon
78b7aee512
Groups - Including "Extract text", "Text to ignore", "Trigger text" and "Text that should not be present" filters
2025-04-04 11:16:12 +02:00
dgtlmoon
54b7c070f7
UI - Conditions - Offer some information about what the filter/condition/trigger saw ( #3062 )
2025-03-27 10:29:11 +01:00
dgtlmoon
7e7d5dc383
New major functionality CONDITIONS - Compare values, check numbers within range, etc
2025-03-17 19:20:24 +01:00
dgtlmoon
f7e9846c9b
CVE-2024-56509 - Stricter file protocol checking pre-check ( Improper Input Validation Leading to LFR/Path Traversal when fetching file:.. )
2024-12-27 09:26:28 +01:00
dgtlmoon
49bc982c69
CVE-2024-51998 - file:/ path traversal access should not be allowed to access a file without ALLOW_FILE_URI set
2024-11-07 18:45:19 +01:00
dgtlmoon
f08a1185aa
Price tracker - fix for sites that supply an empty additional price ( #2758 )
2024-11-01 10:56:27 +01:00
dgtlmoon
26d3a23e05
CVE-2024-51483 - Fix for limiting access to file:// via source:file:///tmp/file.txt when using webdriver/playwright
2024-10-31 22:49:31 +01:00
Christopher Charbonneau Wells
e8b82c47ca
#2502 - Add jinja2 template handling to request body and headers ( #2740 )
2024-10-28 15:46:05 +01:00
dgtlmoon
c1dd681643
Filters - "Block change detection when text exists" should not trigger a change when the original text returns
2024-10-14 12:57:02 +02:00
dgtlmoon
5bb47e47db
Remove same checksum skip check - saved a little CPU but added a lot of complexity ( #2700 )
2024-10-11 17:28:42 +02:00
dgtlmoon
a278fa22f2
Restock multiprice improvements ( #2698 )
2024-10-11 11:43:35 +02:00
dgtlmoon
c1c8de3104
Fixing proxy checker ( #2696 )
2024-10-11 00:19:19 +02:00
dgtlmoon
5a768d7db3
UTF-8 handling fixes, Improvements to whitespace filtering ( #2691 )
2024-10-10 14:59:39 +02:00
dgtlmoon
f38429ec93
Testing - Tidyup ( #2693 )
2024-10-10 12:45:23 +02:00
dgtlmoon
783926962d
Filters & Text - Preview refactor/improvements ( #2689 )
2024-10-09 09:17:32 +02:00
dgtlmoon
2842ffb205
Restock - Use the scraped 'Not in stock' product status over the metadata version (many website lie in the metadata) ( #2684 )
2024-10-07 20:10:35 +02:00
dgtlmoon
f255165571
Code - Small improvements in logging
2024-10-07 16:01:55 +02:00
dgtlmoon
00458b95c4
UI - Improvements to live preview of Filters text
...
"Ignore text" is now "Remove text", it works the same but it removes the text instead of ignoring it, which is the same thing, but makes the code simpler
2024-10-05 16:32:28 +02:00
dgtlmoon
5b34aece96
UI - Live preview - misc improvements (Adding test, fixes to filters) ( #2663 )
2024-09-30 13:54:35 +02:00
dgtlmoon
1b625dc18a
UI - "Filters & Triggers" - Live preview of text filters (Preview the output of the filters section in realtime) ( #2612 )
2024-09-28 10:40:47 +02:00
dgtlmoon
367afc81e9
Reversing subprocess execution - saved a little memory but used a LOT more CPU ( #2659 )
2024-09-27 21:36:02 +02:00
dgtlmoon
e173954cdd
Restock monitor - Only try to process restock information (like scraping for "out of stock" keywords) if the page was actually rendered correctly. ( #2645 )
2024-09-20 09:19:57 +02:00
dgtlmoon
e830fb2320
Text filters - Adding filters "Trim whitespace" and "Remove duplicate lines"
2024-09-18 15:45:44 +02:00
Felipe Tuffani
8ecfd17973
Restock/Price detection - Fix duplicated prices with different data type on single page product #2636 ( #2638 )
2024-09-17 11:22:54 +02:00
dgtlmoon
19f3851c9d
Memory management improvements - LXML and other libraries can leak allocation, wrap in a sub-process ( #2626 )
2024-09-11 16:20:49 +02:00
dgtlmoon
55fe2abf42
Restock/Price detection - Better catching of errors when parsing metadata documents for restock/price check ( #2602 )
2024-09-01 13:07:06 +02:00
dgtlmoon
932cf15e1e
Price and restock scraping - small price fix scraper ( #2575 )
2024-08-19 15:47:19 +02:00
dgtlmoon
8a35d62e02
Handle zero-byte/empty content responses with "`[ ] Empty pages are a change`" option, the same as when the HTML doesnt render any useful text ( #2530 )
2024-07-29 13:27:59 +02:00
dgtlmoon
44e7e142f8
Restock/Price detection - Improving text information snapshot value
2024-07-18 13:28:54 +02:00
dgtlmoon
fe704e05a3
Restock - Tweaking storage of "original price"
2024-07-18 13:15:56 +02:00
dgtlmoon
321426dea2
Ability to use restock and price amounts in notifications as tokens (for example {{restock.price}} ) ( #2503 )
2024-07-17 20:27:47 +02:00
dgtlmoon
bde27c8a8f
Restock & Price detection - Ability to set up a tag/group that applies to all watches with price + restock limits
2024-07-16 17:23:39 +02:00
dgtlmoon
6f2186b442
UI - Restock/price following text cleanups
2024-07-14 07:50:52 +02:00
dgtlmoon
cf0ff26275
UI - Extract <title> as title should work on all processors ( #2490 )
2024-07-12 19:42:18 +02:00
dgtlmoon
cffb6d748c
Restock & Price monitor - Huge refactor, set upper and lower price alert limits, set % change, follow the prices and restock amounts directly in the watch-overview list
2024-07-12 17:09:42 +02:00
dgtlmoon
f07ff9b55e
UI - Visual Selector should still update when elements were not found ( #2476 )
2024-07-09 15:35:19 +02:00
dgtlmoon
343e359b39
Now saving last two HTML snapshots for future reference, refactor, dont write screenshots and xpath to disk when no change detected (saves disk IO) ( #2431 )
2024-06-23 09:19:32 +02:00
Hritik Vijay
ffd160ce0e
Filters - Implement jqraw: filter (use this to output nicer JSON format when selecting/filtering by JSON) ( #2430 )
2024-06-21 13:31:03 +02:00
dgtlmoon
c6ee6687b5
Fetching/Requests - Fixing user agent header overrides per-watch of global settings ( #2409 )
2024-06-13 10:50:46 +02:00
dgtlmoon
f49eb4567f
Ability to set default User-Agent for either fetching types directly in the UI ( #2375 )
2024-05-20 15:11:15 +02:00
dgtlmoon
9449c59fbb
Code - Getting ready for newer python versions - packing our own strtobool ( #2291 )
2024-04-03 16:17:15 +02:00
Constantin Hong
52c895b2e8
text_json_diff/fix: Keep an order of filter and remove duplicated filters. 2 ( #2178 )
2024-02-21 11:46:23 +01:00
dgtlmoon
904ef84f82
Build fix - Pinning package versions and Custom browser endpoints should not have a proxy set ( #2204 )
2024-02-20 22:11:17 +01:00
dgtlmoon
ccb42bcb12
Fetching pages - Custom browser endpoints should not have default proxy info added
2024-02-12 19:05:10 +01:00
dgtlmoon
823a0c99f4
Code - Split content fetcher code up (playwright, puppeteer and requests), fix puppeteer direct chrome support ( #2169 )
2024-02-11 00:09:12 +01:00
dgtlmoon
616c0b3f65
New text filter - Sort text alphabetically filter ( #2153 )
2024-02-02 11:36:58 +01:00
dgtlmoon
c90b27823a
Filtering - include_filters in group and watch settings should not duplicate ( #2151 #1845 )
2024-02-02 09:30:01 +01:00
dgtlmoon
fe3cf5ffd2
Logging - Adding extra debug logging to change detection ( #2136 )
2024-01-29 11:21:21 +01:00
dgtlmoon
399cdf0fbf
Logging loguru output tweaks ( #2112 )
2024-01-16 11:27:47 +01:00