dgtlmoon
33c83230a6
Backups - Backups now operate in the background, provide a nice UI to access/download previous backups ( #2755 )
2024-10-31 10:34:59 +01:00
dgtlmoon
5bb47e47db
Remove same checksum skip check - saved a little CPU but added a lot of complexity ( #2700 )
2024-10-11 17:28:42 +02:00
dgtlmoon
c1c8de3104
Fixing proxy checker ( #2696 )
2024-10-11 00:19:19 +02:00
dgtlmoon
5a768d7db3
UTF-8 handling fixes, Improvements to whitespace filtering ( #2691 )
2024-10-10 14:59:39 +02:00
Michael McMillan
dc936a2e8a
Filters - Add support for also removing HTML elements using XPath selectors ( #2632 )
2024-09-17 22:43:04 +02:00
Dawid Wróbel
a5ff1cd1d7
browser_steps: add "click element containing text if exists" ( #2629 )
2024-09-17 18:30:54 +02:00
dgtlmoon
eaccd6026c
UI - Hiding noisy info under 'show advanced help' button ( #2609 )
2024-09-06 14:33:06 +02:00
Mike Splain
bf0d410d32
Browser Steps UI - Interactive UI wasn't sending headers but was when the check ran ( #2551 )
2024-08-19 10:21:05 +02:00
Kenny Root
d23a301826
Use #!/usr/bin/env to support virtualenv ( #2518 )
2024-07-25 14:39:01 +02:00
dgtlmoon
321426dea2
Ability to use restock and price amounts in notifications as tokens (for example {{restock.price}} ) ( #2503 )
2024-07-17 20:27:47 +02:00
dgtlmoon
bde27c8a8f
Restock & Price detection - Ability to set up a tag/group that applies to all watches with price + restock limits
2024-07-16 17:23:39 +02:00
dgtlmoon
cffb6d748c
Restock & Price monitor - Huge refactor, set upper and lower price alert limits, set % change, follow the prices and restock amounts directly in the watch-overview list
2024-07-12 17:09:42 +02:00
dgtlmoon
ed38012c6e
Code - Fixing deprecation warning ( #2477 )
2024-07-09 17:38:17 +02:00
dgtlmoon
343e359b39
Now saving last two HTML snapshots for future reference, refactor, dont write screenshots and xpath to disk when no change detected (saves disk IO) ( #2431 )
2024-06-23 09:19:32 +02:00
Hritik Vijay
ffd160ce0e
Filters - Implement jqraw: filter (use this to output nicer JSON format when selecting/filtering by JSON) ( #2430 )
2024-06-21 13:31:03 +02:00
dgtlmoon
cc147be76e
Prefer pythons built in "importlib" over pkg_resources+setuptools ( #2424 )
2024-06-18 09:08:48 +02:00
dgtlmoon
e4504fee49
Browser Steps - Fixing "goto site" step #2330 #2337 ( #2364 )
2024-05-15 10:49:30 +02:00
dgtlmoon
c0f000b1d1
Merge pull request from GHSA-pwgc-w4x9-gw67
...
* Auto-escape was not enabled GHSA-pwgc-w4x9-gw67
* Auto-escape was not enabled because the filenames were not something jinja2 enables it for.
2024-05-02 11:46:31 +02:00
dgtlmoon
bd6eda696c
Merge pull request from GHSA-4r7v-whpg-8rx3
...
* CVE-2024-32651 - Security fix - Server Side Template Injection in Jinja2 allows Remote Command Execution
* use ImmutableSandboxedEnvironment also in validation
2024-04-25 22:06:09 +02:00
dgtlmoon
db59bf73e1
"Send Test Notification" - In "Group" settings form it should not fallback to the system wide notifications when sending a test if nothing is set.
2024-04-03 17:10:13 +02:00
dgtlmoon
9449c59fbb
Code - Getting ready for newer python versions - packing our own strtobool ( #2291 )
2024-04-03 16:17:15 +02:00
dgtlmoon
56b365df40
UI - Improvements to tag/groups page, show number of watches under each group, link group name to list ( #2290 )
2024-04-03 16:01:24 +02:00
dgtlmoon
14e632bc19
Custom headers fix in Browser Steps and Playwright/Puppeteer fetchers ( #2197 )
2024-02-26 18:02:45 +01:00
dgtlmoon
af747e6e3f
UI - Sorted alphabetical tag list and list of tags in groups setting ( #2205 )
2024-02-21 10:03:09 +01:00
dgtlmoon
823a0c99f4
Code - Split content fetcher code up (playwright, puppeteer and requests), fix puppeteer direct chrome support ( #2169 )
2024-02-11 00:09:12 +01:00
dgtlmoon
c5a4e0aaa3
Fetching - Prefer to use SockPuppetBrowser ( #2163 )
2024-02-07 20:58:21 +01:00
dgtlmoon
593660e2f6
Fix for switching to price-data-follower mode (when page has JSON price data), only needs to be queued once. Re #1565
2024-01-31 22:39:24 +01:00
Constantin Hong
4be0fafa93
Support Loguru as a logger ( #2036 )
2024-01-16 09:48:16 +01:00
dgtlmoon
8be0029260
Browser Steps - Fixing "'Response' object is not subscriptable" where quotes were used in connection URL - Quote wrapped URL for browserstep url was breaking the connection #1627 #1823 #2099 ( #2100 )
2024-01-11 10:12:00 +01:00
dgtlmoon
d115b2c858
UI - [Send test notification] - Refactor to use all tokens like a real watch and Notification Body+Title from UI value ( #2079 )
2024-01-04 17:02:31 +01:00
dgtlmoon
98f56736c1
Improve handling of SIGTERM shutdown in containers, remove unnecessary multi-process handler for pip installs, tidy up modules ( #2014 )
2023-12-01 17:31:09 +01:00
dgtlmoon
7fdae82e46
Browser Steps - Adding validation for "Click X,Y" step
2023-11-28 12:36:15 +01:00
dgtlmoon
d8ee5472f1
Update playwright fetcher library and API calls
2023-11-28 11:20:06 +01:00
Constantin Hong
26931e0167
feature: Support XPath2.0 to 3.1 ( #1774 )
2023-11-13 16:42:21 +01:00
dgtlmoon
c8dcc072c8
Code refactor for fetchers ( #1941 )
2023-11-13 10:42:56 +01:00
dgtlmoon
349111eb35
Fetching/BrowserSteps - Going to a page was using slightly logic to the main way - make them use the same methods ( #1890 )
2023-10-26 20:19:22 +02:00
dgtlmoon
1709e8f936
UI - BrowserSteps - Show the screenshot of an error if it happened on a step, highlight which step had the error to make it easier to find out why the step didnt work, minor fixes to timeouts( #1883 )
2023-10-21 09:41:51 +02:00
dgtlmoon
c52eb512e8
UI - Proxy Scanner tool should also understand when a filter is empty or contains only an image
2023-09-26 14:29:42 +02:00
dgtlmoon
ed4bafae63
UI - "Test notification" button in "Group Tag" settings page was broken due to missing variable #1753
2023-08-31 13:29:38 +02:00
dgtlmoon
661f7fe32c
Proxy scan improvements - handle custom proxies, dont restart when a scan is already running ( #1689 )
2023-07-11 16:48:50 +02:00
dgtlmoon
aaceb4ebad
Scan/Recheck proxies - Report filter not found as "OK" but with warning
2023-07-11 10:44:21 +02:00
dgtlmoon
1987e109e8
New feature - Helper button to trigger a scan/access test of all proxies for a particular watch ( #1685 )
2023-07-10 16:08:45 +02:00
dgtlmoon
5f150c4f03
Bug - Fix watch clone ( #1647 )
2023-06-27 17:05:32 +02:00
dgtlmoon
52f2c00308
UI/Functionality - Ability to manage/apply filters and notifications across tags/groups
2023-06-19 23:29:13 +02:00
dgtlmoon
dd87912c88
BrowserSteps - Support for float seconds (0.5 etc)
2023-05-15 10:35:25 +02:00
dgtlmoon
463b2d0449
BrowserSteps - adding setup check
2023-05-12 15:41:00 +02:00
dgtlmoon
e4f6d54ae2
BrowserSteps - Refactored to re-use playwright context which should solve some errors
2023-05-12 15:38:55 +02:00
dgtlmoon
cf3f3e4497
BrowserSteps - BrowserSteps was not always following proxy information
2023-05-07 13:15:29 +02:00
dgtlmoon
ba76c2a280
BrowserSteps - remove minor delay
2023-05-07 13:15:20 +02:00
dgtlmoon
c454cbb808
BrowserSteps - Adding `Goto URL` step
2023-03-12 17:22:56 +01:00
dgtlmoon
e9e586205a
Browser Steps - Adding "Wait for text" and "Wait for text in element" Re #1427
2023-02-22 20:10:21 +01:00
dgtlmoon
0ed897c50f
New setting to allow passwordless access to your 'diff' page - perfect for sharing your diff page securely, refactored login code ( #1357 )
2023-01-29 22:36:55 +01:00
dgtlmoon
b76148a0f4
Fetcher - CPU usage - Skip processing if the previous checksum and the just fetched one was the same ( #925 )
2022-12-14 15:08:34 +01:00
dgtlmoon
93cc30437f
Playwright+BrowserSteps - Fetch changes - Fetch simply after page starts rendering + delay seconds, disable service workers
2022-12-14 12:16:04 +01:00
dgtlmoon
14da0646a7
Price follower - Dont scan for ldjson data when 'no' was clicked on the suggestion ( #1207 )
2022-12-08 22:35:37 +01:00
dgtlmoon
b58fd995b5
Automatically offer to track LD+JSON product price data ( #1204 )
2022-12-08 19:28:20 +01:00
dgtlmoon
64caeea491
BrowserSteps - Cleanup interface on shutdown
2022-12-01 23:28:20 +01:00
dgtlmoon
3838bff397
BrowserSteps - More work on cleaner shutdowns of browser session
2022-12-01 23:08:28 +01:00
dgtlmoon
55ea983bda
BrowserSteps - Forcefully shutdown playwright to prevent any race-conditions waiting for it to shutdown
2022-12-01 19:32:05 +01:00
dgtlmoon
b4d79839bf
BrowserSteps - Make the UI require an extra step so it doesnt slow down the experience when clicking through the tabs ( #1175 )
2022-11-30 19:40:15 +01:00
dgtlmoon
0b8c3add34
BrowserSteps - Use correct mimetype for screenshot update
2022-11-29 14:07:53 +01:00
dgtlmoon
51d57f0963
BrowserSteps - Faster screenshot updates and enable gzip compression for all content replies in the UI ( #1171 )
2022-11-29 13:55:53 +01:00
dgtlmoon
6d932149e3
BrowserSteps - Add 'Execute JS' step
2022-11-29 09:09:26 +01:00
dgtlmoon
2c764e8f84
BrowserSteps - Also try to find clickable div/spans
2022-11-29 08:46:11 +01:00
dgtlmoon
69756f20f2
VisualSelector & BrowserSteps - Scraper improvements, remove duplicate code
2022-11-25 10:45:38 +01:00
dgtlmoon
5b530ff61c
Configurable "Browser Steps" when Playwright/Chrome is configured (enter text, scroll, wait for text, click button etc) ( #478 )
2022-11-24 20:53:01 +01:00