dgtlmoon
bae1a89b75
Notifications - Default notification format (for new installs) now "HTML color" ( #2843 )
2024-12-16 14:55:10 +01:00
dgtlmoon
e49711f449
Notification - `HTML Color` format notification colors should be same as UI, `{{diff_full}}` token should also get HTML colors ( #2842 #2554 )
2024-12-16 14:46:39 +01:00
dgtlmoon
a3a3ab0622
Notifcations - Adding "HTML Color" notification format option ( #2837 )
2024-12-13 11:21:39 +01:00
dgtlmoon
7421e0f95e
New functionality - Time (weekday + time) scheduler / duration ( #2802 )
2024-12-03 12:45:28 +01:00
dgtlmoon
6084b0f23d
VisualSelector - Use 'deflate' for storing elements.json, 90% file size reduction ( #2794 )
2024-11-19 17:28:21 +01:00
dgtlmoon
d297850539
Security - Fix test
2024-11-07 20:10:02 +01:00
dgtlmoon
751239250f
Security check - improve test
2024-11-07 19:41:48 +01:00
dgtlmoon
49bc982c69
CVE-2024-51998 - file:/ path traversal access should not be allowed to access a file without ALLOW_FILE_URI set
2024-11-07 18:45:19 +01:00
dgtlmoon
33c83230a6
Backups - Backups now operate in the background, provide a nice UI to access/download previous backups ( #2755 )
2024-10-31 10:34:59 +01:00
dgtlmoon
87510becb5
Filters - Process all CSS and XPath 'subtract' selectors in a single pass to prevent index shifting and reference loss during DOM manipulation. ( #2754 )
2024-10-30 12:00:53 +01:00
dgtlmoon
563c196396
Notification post:// get:// etc - Fixing URL encoding of headers so that '+' in URL is correctly parsed as ' ' (and other url-encodings) ( #2745 )
2024-10-28 16:59:49 +01:00
Christopher Charbonneau Wells
e8b82c47ca
#2502 - Add jinja2 template handling to request body and headers ( #2740 )
2024-10-28 15:46:05 +01:00
dgtlmoon
1543edca24
"Send test notification" in "Restock" mode was not working correclty when restock tokens "{{restock.price}}" were in the notification body ( #2737 )
2024-10-24 19:46:45 +02:00
dgtlmoon
82e0b99b07
#2727 Notifications - Fix "send test notification" on empty list, includes test ( #2731 )
2024-10-21 11:35:37 +02:00
dgtlmoon
c1dd681643
Filters - "Block change detection when text exists" should not trigger a change when the original text returns
2024-10-14 12:57:02 +02:00
dgtlmoon
a278fa22f2
Restock multiprice improvements ( #2698 )
2024-10-11 11:43:35 +02:00
dgtlmoon
d39530b261
Test - Simple test for live preview
2024-10-11 11:07:12 +02:00
dgtlmoon
d4b4355ff5
Adding test for proxy checker/scanner ( #2697 )
2024-10-11 09:52:55 +02:00
dgtlmoon
c1c8de3104
Fixing proxy checker ( #2696 )
2024-10-11 00:19:19 +02:00
dgtlmoon
5a768d7db3
UTF-8 handling fixes, Improvements to whitespace filtering ( #2691 )
2024-10-10 14:59:39 +02:00
dgtlmoon
f38429ec93
Testing - Tidyup ( #2693 )
2024-10-10 12:45:23 +02:00
dgtlmoon
00458b95c4
UI - Improvements to live preview of Filters text
...
"Ignore text" is now "Remove text", it works the same but it removes the text instead of ignoring it, which is the same thing, but makes the code simpler
2024-10-05 16:32:28 +02:00
dgtlmoon
5b34aece96
UI - Live preview - misc improvements (Adding test, fixes to filters) ( #2663 )
2024-09-30 13:54:35 +02:00
dgtlmoon
1b625dc18a
UI - "Filters & Triggers" - Live preview of text filters (Preview the output of the filters section in realtime) ( #2612 )
2024-09-28 10:40:47 +02:00
dgtlmoon
ddfbef6db3
[test] Use local data instead of reaching out to changedetection when testing ( #2660 )
2024-09-27 20:30:19 +02:00
dgtlmoon
e830fb2320
Text filters - Adding filters "Trim whitespace" and "Remove duplicate lines"
2024-09-18 15:45:44 +02:00
Michael McMillan
dc936a2e8a
Filters - Add support for also removing HTML elements using XPath selectors ( #2632 )
2024-09-17 22:43:04 +02:00
dgtlmoon
543cb205d2
Testing - Fixing Restock test #2641
2024-09-17 18:29:12 +02:00
dgtlmoon
273adfa0a4
Testing - Fix false filter missing check alerts
2024-09-17 16:55:04 +02:00
dgtlmoon
e16814e40b
Testing - locale fix for test ( #2623 )
2024-09-11 11:31:07 +02:00
dgtlmoon
337fcab3f1
Testing/Code - Improving test reliability ( #2617 )
2024-09-09 16:50:00 +02:00
dgtlmoon
eaccd6026c
UI - Hiding noisy info under 'show advanced help' button ( #2609 )
2024-09-06 14:33:06 +02:00
dgtlmoon
371f85d544
Watch 'Download last snapshot' link/button should give last, not first snapshot ( #2576 )
2024-08-19 17:20:30 +02:00
dgtlmoon
8a35d62e02
Handle zero-byte/empty content responses with "`[ ] Empty pages are a change`" option, the same as when the HTML doesnt render any useful text ( #2530 )
2024-07-29 13:27:59 +02:00
dgtlmoon
71c9b1273c
Adding test for #1995 UTF-8 encoding in POST request body and post:// notifications ( #2525 )
2024-07-27 19:47:03 +02:00
Kenny Root
d23a301826
Use #!/usr/bin/env to support virtualenv ( #2518 )
2024-07-25 14:39:01 +02:00
dgtlmoon
8acdcdd861
UI - Adding "Download latest HTML snapshot" from Edit Watch > Stats page for easier debugging ( #2513 )
2024-07-21 18:17:34 +02:00
dgtlmoon
8aae7dfae0
UI - Fixing up 'test notification' bug from main settings and tag settings pages #2510 ( #2511 )
2024-07-19 13:51:15 +02:00
dgtlmoon
e756e0af5e
Fixing file:// file pickup - for change detection of local files ( #2505 )
2024-07-18 13:05:27 +02:00
dgtlmoon
321426dea2
Ability to use restock and price amounts in notifications as tokens (for example {{restock.price}} ) ( #2503 )
2024-07-17 20:27:47 +02:00
dgtlmoon
bde27c8a8f
Restock & Price detection - Ability to set up a tag/group that applies to all watches with price + restock limits
2024-07-16 17:23:39 +02:00
dgtlmoon
cffb6d748c
Restock & Price monitor - Huge refactor, set upper and lower price alert limits, set % change, follow the prices and restock amounts directly in the watch-overview list
2024-07-12 17:09:42 +02:00
dgtlmoon
99b0935b42
Product checks - Just a basic string check is far more efficient for suggestion price/restock check plugin ( #2488 )
2024-07-12 14:46:36 +02:00
dgtlmoon
8f3a6a42bc
Testing - Adding simple memory usage test ( #2483 )
2024-07-11 15:03:42 +02:00
dgtlmoon
a1d04bb37f
Snapshot count from history was not updated in watch after using [clear history] ( #2459 )
2024-07-05 11:09:31 +02:00
dgtlmoon
faeed78ffb
UI - Fixing preview/diff "ignore text" highlight button (refactor, didnt work in "preview" mode) ( #2455 )
2024-07-03 19:26:33 +02:00
dgtlmoon
343e359b39
Now saving last two HTML snapshots for future reference, refactor, dont write screenshots and xpath to disk when no change detected (saves disk IO) ( #2431 )
2024-06-23 09:19:32 +02:00
Hritik Vijay
ffd160ce0e
Filters - Implement jqraw: filter (use this to output nicer JSON format when selecting/filtering by JSON) ( #2430 )
2024-06-21 13:31:03 +02:00
dgtlmoon
c9af9b6374
Filter failure/not found notification threshold - Counter should be reset when editing a watch, clear watch errors on 'save' ( #2413 )
2024-06-17 11:42:41 +02:00
dependabot[bot]
5e65fb606b
Bump dnspython from 2.3.0 to 2.6.1 ( #2306 )
2024-06-17 10:23:50 +02:00
dgtlmoon
434a1b242e
Improve testing for Python 3.10, 3.11 and 3.12
2024-06-17 09:46:54 +02:00
dgtlmoon
c6ee6687b5
Fetching/Requests - Fixing user agent header overrides per-watch of global settings ( #2409 )
2024-06-13 10:50:46 +02:00
dgtlmoon
de48892243
Code - improving unique key fix for history database handler ( #2402 )
...
* improving unique key fix
* also bump timestamp along 1 sec
2024-06-06 22:59:04 +02:00
dgtlmoon
6aded50aca
UI - 'Mark all viewed' button should not show when all viewed ( #2399 )
2024-06-05 11:46:04 +02:00
dgtlmoon
b8e279a025
Fixing build test - Adding small delay ( #2397 )
2024-06-04 13:56:35 +02:00
dgtlmoon
f49eb4567f
Ability to set default User-Agent for either fetching types directly in the UI ( #2375 )
2024-05-20 15:11:15 +02:00
dgtlmoon
a8959be348
Testing - Fixing JSON test
2024-05-20 14:14:40 +02:00
dgtlmoon
e4504fee49
Browser Steps - Fixing "goto site" step #2330 #2337 ( #2364 )
2024-05-15 10:49:30 +02:00
dgtlmoon
8d1fb96d18
UI - Refactor of the Recheck Time Settings, Added "Use default recheck time" checkbox and refactor/simplify system handling ( #2362 )
2024-05-14 13:51:03 +02:00
dgtlmoon
c0f000b1d1
Merge pull request from GHSA-pwgc-w4x9-gw67
...
* Auto-escape was not enabled GHSA-pwgc-w4x9-gw67
* Auto-escape was not enabled because the filenames were not something jinja2 enables it for.
2024-05-02 11:46:31 +02:00
dgtlmoon
bd6eda696c
Merge pull request from GHSA-4r7v-whpg-8rx3
...
* CVE-2024-32651 - Security fix - Server Side Template Injection in Jinja2 allows Remote Command Execution
* use ImmutableSandboxedEnvironment also in validation
2024-04-25 22:06:09 +02:00
dgtlmoon
74707909f1
Bug fix for newer lxml module - module 'lxml.etree' has no attribute '_ElementStringResult' - reimplement _ElementStringResult ( #2313 #2312 )
2024-04-17 19:55:45 +02:00
dgtlmoon
f9954f93f3
UI - Adding UI notice if watch has group options set ( #2311 #2307 )
2024-04-16 18:48:51 +02:00
dgtlmoon
387ce32e6f
Restock detection - Improving test for restock IN STOCK -> OUT OF STOCK ( #2219 )
2024-02-28 10:05:52 +01:00
dgtlmoon
14e632bc19
Custom headers fix in Browser Steps and Playwright/Puppeteer fetchers ( #2197 )
2024-02-26 18:02:45 +01:00
Constantin Hong
52c895b2e8
text_json_diff/fix: Keep an order of filter and remove duplicated filters. 2 ( #2178 )
2024-02-21 11:46:23 +01:00
dgtlmoon
823a0c99f4
Code - Split content fetcher code up (playwright, puppeteer and requests), fix puppeteer direct chrome support ( #2169 )
2024-02-11 00:09:12 +01:00
dgtlmoon
c5a4e0aaa3
Fetching - Prefer to use SockPuppetBrowser ( #2163 )
2024-02-07 20:58:21 +01:00
dgtlmoon
616c0b3f65
New text filter - Sort text alphabetically filter ( #2153 )
2024-02-02 11:36:58 +01:00
dgtlmoon
7d96b4ba83
Fetching - Always record `server` software reply headers (will be used in the future) ( #2143 )
2024-01-31 16:15:43 +01:00
dgtlmoon
fca40e4d5b
Testing - General test workflow improvements ( #2144 )
2024-01-31 15:10:44 +01:00
dgtlmoon
9510345e01
Test - tidy up backup test ( #2117 )
2024-01-17 22:35:29 +01:00
Constantin Hong
4be0fafa93
Support Loguru as a logger ( #2036 )
2024-01-16 09:48:16 +01:00
dgtlmoon
c3d825f38c
Test - Adding extra test for HTML output in emails ( #2103 )
2024-01-14 17:47:54 +01:00
dgtlmoon
65428655b8
Notifications - When any in a list of notifications fails, the others should still work ( #2106 )
2024-01-12 12:25:21 +01:00
dgtlmoon
8e207ba438
API - Ability to add/import bulk list of watches as a line-feed separated list ( #2021 )
2023-12-01 18:38:49 +01:00
dgtlmoon
f0823126c8
Notifications - Fixing support for headers in custom post://, posts:// notifications, ability to include HTTP headers when making custom notifications ( #2018 )
2023-12-01 18:05:19 +01:00
dgtlmoon
bbc18d8e80
API - Make sure the watch "is viewed" attribute is correctly represented in the API output ( #2009 )
2023-11-28 11:42:08 +01:00
dgtlmoon
8fd57280b7
Testing - Improve PDF text change detection tests ( #1992 )
2023-11-20 15:18:46 +01:00
dgtlmoon
0285d00f13
UI - Clicking the "[Diff]" link should take you to the difference starting at the relative time to when you last viewed the difference page ( #1989 )
2023-11-17 17:21:26 +01:00
dgtlmoon
f7f98945a2
Visual Selector - xPath handling misc fixes ( #1976 )
2023-11-13 21:23:43 +01:00
Constantin Hong
26931e0167
feature: Support XPath2.0 to 3.1 ( #1774 )
2023-11-13 16:42:21 +01:00
dgtlmoon
5229094e44
New functionanlity - Selectable browser / ability to add extra browser connections (good for using "scraping browsers"/ etc) ( #1943 )
2023-11-13 16:39:11 +01:00
dgtlmoon
c8dcc072c8
Code refactor for fetchers ( #1941 )
2023-11-13 10:42:56 +01:00
dgtlmoon
99246d3e6d
Visual Selector - Small fix, Improving elements fetcher reliability ( #1947 )
2023-11-09 19:13:18 +01:00
Jai Gupta
d3c8386874
Import - Improved Wachete Excel XLS import support for "dynamic wachet" (sets correct state of using chrome browser or not) column ( #1934 )
2023-11-06 12:50:27 +01:00
dgtlmoon
47103d7f3d
Refactor Excel / wachete import, extend tests ( #1931 )
2023-11-03 15:43:57 +01:00
dgtlmoon
03c671bfff
Build - Upgrading pip packages ( #1915 )
2023-11-01 18:47:12 +01:00
dgtlmoon
e209d9fba0
Ability to Import from Wachete XLSX (or any XLSX) - Wachete alternative made easy ( #1921 )
2023-11-01 15:36:49 +01:00
dgtlmoon
6a589e14f3
BrowserSteps - Wrong text taken from browser steps ( #1911 )
2023-10-28 20:19:51 +02:00
dgtlmoon
e1860549dc
Fetching - Browser Step enabled watches should also identify 404/non-200 status situations ( #1907 )
2023-10-28 14:37:42 +02:00
dgtlmoon
9765d56a23
Text Filters - "Extract Text" filter was not being error checked properly when using a RegEx ( #1902 )
2023-10-26 20:19:59 +02:00
dgtlmoon
7220afab0a
RSS fetch - RSS field <title> was not rendering as text correctly, added workaround #1879
2023-10-19 16:42:05 +02:00
dgtlmoon
f707c914b6
RSS Fetching - Handle CDATA (commented out text) in RSS correctly, generally handle RSS better ( #1866 )
2023-10-17 18:34:19 +02:00
dgtlmoon
c0b49d3be9
Testing - Improve xPath tests ( #1863 )
2023-10-16 16:48:47 +02:00
dgtlmoon
da421fe110
UI - Ability to select between any difference date ( from / to ) and minor UI cleanup for differences page ( #1855 )
2023-10-11 16:25:36 +02:00
dgtlmoon
7debccca73
Fetching - Clarifying how fetchers work with SOCKS5 proxies
2023-10-09 16:57:30 +02:00
dgtlmoon
ceac8c21e4
LD JSON Price followers - Handle incorrectly created LD-JSON price structures better ( #1837 )
2023-10-04 15:57:55 +02:00
dgtlmoon
2b948c15c1
Backend - Regular expression / string filtering refactor for Python 3.11 and deprecation warnings since Python 3.6 ( #1786 )
2023-10-03 17:44:27 +02:00
dgtlmoon
e30b17b8bc
UI + Fetching - Be more helpful when a filter contains no text, suggest ways to deal with images in filters ( #1819 )
2023-09-26 13:59:59 +02:00