mirror
/
changedetection.io
kopia lustrzana https://github.com/dgtlmoon/changedetection.io
1
0
Forkuj 0
Kod Zgłoszenia Packages Projekty Wydania Wiki Aktywność
1 758 Commity
456 Gałęzie
176 Tagi
17 MiB
Wykres commitów

307 Commity (ffde79ecacf4e9f31e8c926b22027af76753d4c8)

Autor SHA1 Wiadomość Data
dgtlmoon f7bb8a0afa UI - favicon callback no longer needed 2022-12-07 12:14:36 +01:00
dgtlmoon 65db4d68e3
Dark mode - HTML template tidy up (#1197) 2022-12-06 23:50:49 +01:00
dgtlmoon fc94c57d7f
Extract text as CSV - Extra validation (#1192) 2022-12-05 16:36:00 +01:00
dgtlmoon 2345b6b558
New feature - Simple extract data by regex from all historical watch text into CSV (#1191) 2022-12-05 14:48:03 +01:00
dgtlmoon 77409eeb3a UI - Dark Mode (#1187) 2022-12-04 16:39:25 +01:00
dgtlmoon 51d57f0963
BrowserSteps - Faster screenshot updates and enable gzip compression for all content replies in the UI (#1171) 2022-11-29 13:55:53 +01:00
dgtlmoon 5b530ff61c
Configurable "Browser Steps" when Playwright/Chrome is configured (enter text, scroll, wait for text, click button etc) (#478) 2022-11-24 20:53:01 +01:00
dgtlmoon 463747d3b7 0.39.22.1 2022-11-22 18:09:25 +01:00
dgtlmoon 943704cd04 0.39.22 2022-11-20 16:29:16 +01:00
dgtlmoon 35d44c8277
Notification screenshot option should only be available to webdriver/playwright watches, screenshot sent as JPEG to save bandwidth, Simplify the logic around screenshot, (#1140) 2022-11-20 14:40:41 +01:00
dgtlmoon ab28f20eba
Make link to notification debug log easier to find (#1130) 2022-11-16 09:17:57 +01:00
dgtlmoon 359fc48fb4
Filters can now accept a list/multiple filters (#1064) #623 2022-11-03 12:13:54 +01:00
dgtlmoon d0efeb9770 0.39.21.1 2022-11-02 23:48:10 +01:00
dgtlmoon defc7a340e 0.39.21 2022-11-02 15:12:33 +01:00
dgtlmoon c197c062e1
Disable version check when pytest is running (#1084) 2022-11-01 18:26:29 +01:00
dgtlmoon 77b59809ca
Removing unused code (#1070) 2022-10-28 18:36:07 +02:00
dgtlmoon 72834a42fd
Backups and Snapshots - Data directory now fully portable, (all paths are relative) , refactored backup zip export creation 2022-10-27 12:35:26 +02:00
dgtlmoon 5d40e16c73
API - Adding basic system info/system state API (#1051) 2022-10-23 19:15:11 +02:00
dgtlmoon 4cbcc59461 0.39.20.4 2022-10-17 18:36:47 +02:00
dgtlmoon 4be0260381
Better cross platform file handling in diff and preview (#1034) 2022-10-17 18:36:22 +02:00
dgtlmoon 957a3c1c16 0.39.20.3 2022-10-17 17:43:35 +02:00
dgtlmoon 85897e0bf9
Windows - diff file handling improvements (#1031) 2022-10-17 17:40:28 +02:00
dgtlmoon 1b077abd93 0.39.20.2 2022-10-12 09:53:59 +02:00
dgtlmoon 32ea1a8721
Windows - JQ - Make library optional so it doesnt break Windows pip installs (#1009) 2022-10-12 09:53:16 +02:00
dgtlmoon 8fb146f3e4 0.39.20.1 2022-10-09 23:05:35 +02:00
dgtlmoon 17d37fb626 0.39.20 2022-10-09 16:13:32 +02:00
dgtlmoon d4715e2bc8
Tidy up proxies.json logic, adding tests (#955) 2022-09-19 13:14:35 +02:00
dgtlmoon 77fdf59ae3 Improve Proxy minimum time debug output 2022-09-15 17:17:07 +02:00
dgtlmoon 0e194aa4b4 Default proxy settings fixes 2022-09-15 16:58:23 +02:00
dgtlmoon 2ba55bb477
Use proxies.json instead of proxies.txt - see wiki Proxies section (#945) 2022-09-15 15:25:23 +02:00
dgtlmoon 22638399c1 0.39.19.1 2022-09-11 09:23:43 +02:00
dgtlmoon 26e2f21a80 Watch list & notification - Adding extra list batch operations for Mute, Unmute, Reset-to-default 2022-09-10 15:29:39 +02:00
dgtlmoon 434c5813b9 0.39.19 2022-09-08 20:16:35 +02:00
dgtlmoon 0c111bd9ae
Further notification settings refinement (#910) 2022-09-08 09:10:04 +02:00
dgtlmoon 6168cd2899
Code maintenance - Removing old function (#875) 2022-08-31 15:23:10 +02:00
dgtlmoon 67d2441334 0.39.18 2022-08-19 11:37:26 +02:00
dgtlmoon e2a6865932
UI feature - Basic checkbox/group operations (#861) 2022-08-18 14:48:21 +02:00
dgtlmoon f04adb7202
Bug fix - automatically queued watch checks weren't always being processed sequentially 2022-08-18 13:41:28 +02:00
dgtlmoon 269e3bb7c5
Column sorting (#838) 2022-08-16 10:45:36 +02:00
dgtlmoon 1c08d9f150
Remove 'last-changed' from url-watches.json and always calculate from history index (#835) 2022-08-15 21:14:18 +02:00
dgtlmoon 9942107016
Massive improvements to error handling - show separate output for non HTTP 200 status replies 2022-08-15 18:56:53 +02:00
dgtlmoon 4026575b0b 0.39.17.2 2022-08-05 15:53:09 +02:00
dgtlmoon 6f072b42e8
Security update - Password could be unset from settings form unexpectedly (#808) 2022-08-05 00:05:43 +02:00
dgtlmoon f0f2fe94ce
Handle SIGTERM for cleaner shutdowns (#737) 2022-08-02 10:21:25 +02:00
dgtlmoon 26f5c56ba4
Remove [save & preview] button, the preview is not updated live so it can lead to confusion (#801) 2022-08-01 14:47:00 +02:00
dgtlmoon a1c3107cd6
Feature - priority queue - edited and added watches should get checked before automatically queued watches (#799) 2022-07-31 15:35:35 +02:00
dgtlmoon 8fef3ff4ab
[preview current] cleanup code and add test 2022-07-30 20:11:56 +02:00
dgtlmoon baa25c9f9e
Feature - mute notifications (#791) 2022-07-29 21:09:55 +02:00
dgtlmoon cf3a1ee3e3 0.39.17.1 2022-07-29 10:13:29 +02:00
dgtlmoon 3c9d2ded38 0.39.17 2022-07-28 13:07:51 +02:00
dgtlmoon 5bd9eaf99d
UI Feature - Add watch in "paused" state, saving then unpauses (#779) 2022-07-28 12:13:26 +02:00
dgtlmoon 2f636553a9 Bug fix: RSS Feed should also announce utf-8 charset 2022-07-10 18:50:21 +02:00
dgtlmoon 15569f9592 0.39.16 2022-07-05 16:14:57 +02:00
dgtlmoon 5f9e475fe0
Fix notification apprise application name to changedetection.io #731 2022-06-30 23:11:03 +02:00
dgtlmoon 6553980cd5
Playwright - Use HTTP Request Headers override (Cookie, etc) 2022-06-25 23:42:48 +02:00
jtagcat 7c12c47204
lang: prefer 'clear (snap) history' to 'scrub' (#721) 2022-06-25 13:43:57 +02:00
dgtlmoon dbd9b470d7
Minor diff page improvements - list should be sorted 'newest first' and no need to include the current version to compare against (#716) 2022-06-23 10:16:05 +02:00
dgtlmoon 83555a9991
bug fix: `last_changed` was being set on the first fetch, should only be set on the change after the first fetch #705 2022-06-23 09:41:55 +02:00
dgtlmoon fba2b1a39d Notifications regression bug in 0.39.15 - only sent the first notification URL 2022-06-15 17:05:03 +02:00
dgtlmoon 2ba00d2e1d
Notifications log - log what was sent after applying all cleanups 2022-06-14 17:01:13 +02:00
dgtlmoon a07ca4b136
Re #580 - New functionality - Random "jitter" delay to requests (#681) 2022-06-13 12:41:53 +02:00
dgtlmoon ba8cf2c8cf 0.39.15 2022-06-12 14:05:34 +02:00
dgtlmoon 3106b6688e Watch overview list - adding spinner to make it easier to see whats currently being 'Checked' 2022-06-12 12:52:17 +02:00
dgtlmoon 2c83845dac
Preview section - add helpful check 2022-06-12 11:10:06 +02:00
dgtlmoon ead610151f
Notification log - also log normal requests and make the log easier to find 2022-06-11 23:07:09 +02:00
dgtlmoon 327cc4af34 Use correct RSS CDATA handling (#662) 2022-06-08 18:40:01 +02:00
dgtlmoon 6008ff516e
Improve logging (#671) 2022-06-08 18:32:41 +02:00
dgtlmoon cdcf4b353f
New [scrub] button when editing a watch - scrub single watch history (#672) 2022-06-08 18:32:25 +02:00
dgtlmoon c113d5fb24 Screenshot handling on the diff/preview section refactor (#630) 2022-06-07 19:22:42 +02:00
dgtlmoon 62f14df3cb
Fixing RSS feed HTML content formatting (#662) 2022-06-06 10:24:39 +02:00
dgtlmoon 7929aeddfc
'Mark all viewed' button was missing in this version, added test also. (#652) 2022-06-02 10:01:03 +02:00
dgtlmoon aa3c8a9370
Move history data to a textfile, improves memory handling (#638) 2022-05-31 23:43:50 +02:00
dgtlmoon eef56e52c6 Adding new Visual Selector for choosing the area of the webpage to monitor - playwright/browserless only (#566) 2022-05-23 23:44:51 +02:00
dgtlmoon 8e3195f394 0.39.14 2022-05-23 14:40:26 +02:00
dgtlmoon 07e279b38d
API Interface (#617) 2022-05-20 16:27:51 +02:00
dgtlmoon 70b3493866
Proxy settings on watch should have a "[ ] default" option (#610) 2022-05-18 13:59:54 +02:00
dgtlmoon 67c833d2bc
Re #214 - configurable wait extra seconds for webdriver requests before extracting text (#606) 2022-05-17 18:35:33 +02:00
dgtlmoon 034507f14f
Fixing Pip install problem - Update MANIFEST to include model/ subdir, improving imports (#593) 2022-05-10 22:45:08 +02:00
dgtlmoon 0e385b1c22 0.39.13 2022-05-10 17:24:38 +02:00
dgtlmoon f28c260576
Distill.io JSON export file importer (#592) 2022-05-10 17:15:41 +02:00
dgtlmoon 18f0b63b7d
Ability to specify a list of proxies to choose from, always using the first one by default, See wiki (#591) 2022-05-08 20:35:36 +02:00
dgtlmoon 1d4474f5a3
Simplify scrub operation (simply cleans all) (#575) 2022-05-02 21:10:23 +02:00
dgtlmoon c0d0424e7e
Data storage bug fix #569 2022-04-29 18:26:15 +02:00
dgtlmoon 06517bfd22
Ability to 'Share' a watch by a generated link, this will include all filters and triggers - see Wiki (#563) 2022-04-26 10:52:08 +02:00
dgtlmoon 9e708810d1
Seconds/minutes/hours/days between checks form field upgrade from 'minutes' only (#512) 2022-04-24 16:56:32 +02:00
dgtlmoon e4eaa0c817
Shows which items are already in the queue, disables adding to the queue if already in the recheck queue (#552) 2022-04-21 12:52:45 +02:00
dgtlmoon 2a9fb12451
Import speed improvements, and adding an import URL batch size of 5,000 to stop accidental CPU overload (#549) 2022-04-19 23:15:32 +02:00
dgtlmoon 8f062bfec9
Refactor form handling (#548) 2022-04-19 21:43:07 +02:00
dgtlmoon 380c512cc2
Adding support for change detection of HTML source-code via "source:https://website.com" prefix (#540) 2022-04-12 17:36:29 +02:00
dgtlmoon 615fe9290a 0.39.12 2022-04-09 14:16:30 +02:00
dgtlmoon 9809af142d
Option to render links as [Some Text ](/link), adds the ability to change-detect on hyperlink changes 2022-04-09 10:35:14 +02:00
dgtlmoon 34c83f0e7c
[Add email] button in notification settings with a prefix set from NOTIFICATION_MAIL_BUTTON_PREFIX env variable when defined. (#528) 2022-04-07 18:18:23 +02:00
dgtlmoon 63e91a3d66 Skip processing a watch into the RSS feed if there's not enough data to examine (fixes Internal Server Error when accessing the RSS feed) (#521) 2022-04-05 20:31:31 +02:00
dgtlmoon 3034d047c2
Introduce an AJAX button for sending test notifications instead of the checkbox (#519) 2022-04-05 18:04:26 +02:00
dgtlmoon 2620818ba7 Make text tab always available at default 2022-04-02 14:55:40 +02:00
dgtlmoon 9fe4f95990
When fetching a snapshot via Chrome, make the most recent screenshot available on the Diff and Preview pages (#516) 2022-04-02 14:49:32 +02:00
dgtlmoon 8f40f19328
RSS feed CDATA should contain difference output 2022-03-30 10:51:10 +02:00
dgtlmoon 1d060225e1 0.39.11 2022-03-23 09:42:51 +01:00
dgtlmoon 7e0f0d0fd8
Microsoft Windows installation fixes (#492) 2022-03-22 23:08:08 +01:00
dgtlmoon 942c3f021f
Allow changedetector to ignore status codes as a per-site setting (#479) (#485) 
Co-authored-by: Ara Hayrabedian <ara.hayrabedian@gmail.com>
 2022-03-21 23:03:54 +01:00
dgtlmoon 5483f5d694
Security update - Use CSRF token protection for forms, make "remove password" use HTTP Post (#484) 2022-03-21 22:54:27 +01:00
dgtlmoon c25294ca57 0.39.10 2022-03-12 17:28:30 +01:00
Tim Loderhose d4359c2e67
Add filter to remove elements by CSS rule from HTML before change detection is run (#445) 2022-03-12 13:29:30 +01:00
dgtlmoon a709122874
Handle the case where the visitor is already logged-in and tries to login again (#447) 2022-03-06 18:19:05 +01:00
dgtlmoon 3be1f4ea44
Set authentication cookie path relative to X-Forwarded-Prefix when running via reverse proxy subdirectory (#446) 2022-03-04 11:23:32 +01:00
dgtlmoon 96664ffb10
Better text/plain detection and refactor tests (#443) 2022-03-01 17:50:15 +01:00
dgtlmoon 615fa2c5b2
Tweak support tabs and text (#440) 2022-02-28 22:39:32 +01:00
dgtlmoon fd45fcce2f
Include link to changedetection.io hosted option (#439) 2022-02-28 15:47:59 +01:00
dgtlmoon 75ca7ec504
Improved CPU usage around the loop responsible for what sites needs to be checked 2022-02-28 15:08:51 +01:00
dgtlmoon 883aa968fd 0.39.9 2022-02-24 17:02:50 +01:00
dgtlmoon 3240ed2339
Minor reliability upgrade for large datasets - retry deepcopy (#436) 2022-02-24 16:58:51 +01:00
dgtlmoon a51c555964 Fix small issue in highlight trigger/ignore preview page with setting the background colours, add test 2022-02-23 12:30:36 +01:00
dgtlmoon 014fda9058
Ability to visualise trigger and filter rules against the current snapshot on the preview page 2022-02-23 10:49:25 +01:00
dgtlmoon d4f4ab306a
Dont allow redirect on login, it's safer and more reliable this way (#414) 2022-02-08 21:12:44 +01:00
dgtlmoon 8d2e240a2a When using Env. FETCH_WORKERS or WEBDRIVER_DELAY_BEFORE_CONTENT_READY , it should be type int 2022-02-08 20:01:24 +01:00
dgtlmoon d7ed479ca2 0.39.8 2022-02-08 18:56:10 +01:00
dgtlmoon f25cdf0a67
Number of fetching workers can be overriden by Env "FETCH_WORKERS" (#413) 2022-02-08 18:27:56 +01:00
dgtlmoon eb3dca3805 Language fix "watches are rechecking." it actually puts them into an internal queue "watches are QUEUED for rechecking" 2022-02-08 13:00:18 +01:00
dgtlmoon 22ef9afb93
Refactor tests for notification error log handler (#404) 2022-02-04 20:54:20 +01:00
dgtlmoon abaec224f6
Notification error log handler (#403) 
* Add a notifications debug/error log interface (Link available under the notification URLs list)
 2022-02-04 19:29:39 +01:00
dgtlmoon 73101a47e7
Ability to use a generated salted password in deployments as env var SALTED_PASS (#397) 
* Ability to use a generated salted password in deployments as env var SALTED_PASS
 2022-01-29 19:36:44 +01:00
Tim Loderhose 4887180671
Add option for tags on import (#377) 
* Add option for tags on import and backup
 2022-01-25 18:46:05 +01:00
dgtlmoon bbc2875ef3 0.39.7 2022-01-15 23:21:06 +01:00
dgtlmoon a896493797
Simple HTTP auth (#372) 
HTTP Basic Auth form validation
 2022-01-15 22:52:39 +01:00
Unpublished bd8f389a65
Add API endpoint for current snapshot (#359) 2022-01-08 16:38:42 +01:00
dgtlmoon 07c60a6acc Merge branch 'master' of github.com:dgtlmoon/changedetection.io 2022-01-05 19:13:42 +01:00
dgtlmoon 7916faf58b 0.39.6 2022-01-05 19:13:36 +01:00
dgtlmoon febb2bbf0d
Heroku tweaks (backup download) (#356) 
* use absolute path, just incase the data-dir is set relative
 2022-01-05 19:12:13 +01:00
dgtlmoon b33105d576 Re #348 - Add test for backup, use proper datastore path 2022-01-03 20:16:21 +01:00
dgtlmoon b5c1fce136
Re #133 Option for ignoring whitespacing (#345) 
* Global setting option to ignore whitespace when detecting a change
 2022-01-02 22:28:34 +01:00
dgtlmoon 0439acacbe
Adding global ignore text (#339) 2022-01-01 14:53:08 +01:00
dgtlmoon a37a5038d8 Fix broken RSS link fields 2021-12-30 00:04:38 +01:00
dgtlmoon f1933b786c RSS Link links you back to the difference UI/JS page, RSS Description is the page you're watching, and RSS Title is the page you're watching 2021-12-29 23:57:30 +01:00
Simon Caron dfcae4ee64
Extend Request Parameters to add Body & Method (#325) 2021-12-29 23:18:29 +01:00
dgtlmoon 43c9cb8b0c 0.39.5 2021-12-27 23:46:29 +01:00
dgtlmoon 9815fc2526
RSS allow access via token (#310) 
Allow access via a token
* New RSS URL
* Redirect the old RSS feed URL
* fix tests
 2021-12-16 00:05:01 +01:00
dgtlmoon 35d0c74454
Re #308 - Adding test and including settings in clone operation (#309) 2021-12-15 19:54:30 +01:00
dgtlmoon 5a10acfd09
Send diff in notifications (#296) 2021-12-10 12:08:51 +01:00
dgtlmoon 9235eae608 Scrub dates: Fix date regex limit handler parsing 2021-12-10 00:09:42 +01:00
dgtlmoon 7f8c0fb2fa
Check that a notification URL is set when sending the test notification (#300) 2021-12-08 12:23:48 +01:00
Tristan Hill 489eedf34e
Flask 2 (#299) 
Co-authored-by: Tristan Hill <t+git@eaux.uk>
 2021-12-07 23:23:23 +01:00
dgtlmoon 3956b3fd68
Re #269 - Show current/correct BASE_URL information (#271) 
* Re #269 - Show current/correct BASE_URL information
 2021-12-04 15:23:23 +01:00
ghjklw ecba130fdb
Enable Markdown and HTML notifications. (#288) 
This change enable defining the notification body as HTML or Markdown. This can be very
useful to have more user-friendly notifications such as:
* applying a heading style to the `{watch_title}` to make it stand out
* creating clickable links using the `{watch_url}`, `{preview_url}` and `{diff_url}`.

Changes
=======
* Add a `notification_format` to the notification settings, defaults to plain text.
* Use the `body_format` parameter of Apprise's `notify` method.

Co-authored-by: Malo Jaffré <malo.jaffre@dunnhumby.com>
 2021-12-04 14:41:48 +01:00
dgtlmoon ff6dc842c0 0.39.4 release 2021-12-02 22:54:38 +01:00
dgtlmoon 4659993ecf
Re #286 - Solving lost data/corrupted data - Tweak timing and try to write to a temp file first (#292) 
* Re #286 - Tweak timing and try to write to a temp file first, Increase logging and format info message better.
 2021-12-02 22:48:44 +01:00
dgtlmoon c55bf418c5 0.39.3 release 2021-10-28 11:32:33 +02:00
dgtlmoon 4bbb7d99b6 Re #264 - fixing clone watch operation 2021-10-28 11:29:59 +02:00
dgtlmoon 2dc43bdfd3 version 0.39.2 2021-10-05 18:21:40 +02:00
dgtlmoon 95e39aa727
Configurable BASE_URL (#228) 
Re #152 ability to over-ride env var BASE_URL, with UI+tests
 2021-10-05 18:15:36 +02:00
dgtlmoon cd7df86f54
Re #242 - app was treating notification field defaults as the field value (#244) 2021-10-05 14:33:57 +02:00
dgtlmoon ca0ab50c5e
Re #239 - Individual GUID for watch+changeevent (#241) 
* Re #239 - Individual GUID for watch+changeevent
 2021-10-04 08:34:10 +02:00
dgtlmoon fe59ac4986
Re #232 - Use a copy of the datastore incase it changes while we iterate through it (#234) 2021-09-23 18:27:16 +02:00
dgtlmoon 25476bfcb2
Setting for Extract <title> as title option on individual watches (#229) 
* Extract <title> as title option on individual items
 2021-09-19 22:57:15 +02:00
dgtlmoon 7618081e83 v0.39.1 2021-09-17 18:40:16 +02:00
dgtlmoon b903280cd0
Re #185 - [feature] Custom notifications templates per watch (#226) 
* Re #185 - [feature] Custom text templates for the notification per monitored entry as override.
Bonus points: Adding validation for apprise URLs
 2021-09-17 18:37:26 +02:00
Matthias Langhard 05f7e123ed
Adds 'Create Copy' feature to clone a watch (#184) 2021-08-26 22:10:17 +02:00
dgtlmoon a11b6daa2e
Installation via pip (#186) 
Builder for https://pypi.org/project/changedetection.io/
 2021-08-16 15:24:37 +02:00