Wykres commitów

154 Commity (site-osm-baustelle)

Autor SHA1 Wiadomość Data
Hartmut Holzgraefe 8ca8bd1d79 copy logo settings to rendering job config 2022-10-23 14:57:22 +00:00
Hartmut Holzgraefe 1e178395f0 whitespace only 2022-09-08 19:40:01 +00:00
Hartmut Holzgraefe 43126ea003 add indexer choice 2022-09-08 19:39:52 +00:00
Hartmut Holzgraefe e05711be43 add support for multiple render queues (Issue #91)
* maprenderingjob model now has a "queue" name column,
  defaulting to "default"
* methods dealing with the rendering queue now all either
  use the jobs queue column value if already available
  or have an additional optional "queue_name" parameter
  with default value "default"
* a systemd template service file was added to be able to start
  individual per-queue render services
* the progress bar in the map request detail view was finally
  fixed to show actual position-in-queue progress
2022-08-16 15:52:43 +00:00
Hartmut Holzgraefe faa5051395 exclude submitter IP and email from exception emals for privacy 2022-04-06 09:44:36 +02:00
Hartmut Holzgraefe 65118b15aa improve results directory purging to prevent stalls
so far when hitting the results directory threshold only few,
often just one, results were purged which basically triggered
another purge on the very next request rather often

as purge processing takes quite some time with large result
directories (somehting that needs solving, too, at a later time)
being near the threshold size could lead to substantial stalls
between individual render requests being processed

now purging will remove more results at a time, bringing the
directory size down to 90% of the threshold size whenever the
threshold is exceeded, and actual purge runs happen less often
2022-03-27 13:14:24 +02:00
Hartmut Holzgraefe 9e1a180ff1 properly encode non-ASCII mail contents (Issue #77) 2022-03-27 13:08:16 +02:00
Hartmut Holzgraefe ebdb9964a8 add extra result state for "out of memory" exceptions 2022-03-19 13:50:46 +01:00
Hartmut Holzgraefe 3542fcd251 fix exception email notification formatting (part of issue #76 ) 2022-03-16 11:23:43 +01:00
Hartmut Holzgraefe 3418f0f13f pass actual exception to traceback code correctly ( part of issue #76 ) 2022-03-16 11:12:17 +01:00
Hartmut Holzgraefe 58c46ab776 prevent exception on trying to send error notifications to admins
see also https://stackoverflow.com/a/53385409
2022-03-16 10:43:27 +01:00
Hartmut Holzgraefe 419ba3ea40 Merge branch 'site-osm-baustelle' of github.com:hholzgra/maposmatic into site-osm-baustelle 2021-12-27 18:27:23 +01:00
Hartmut Holzgraefe d060a758ea check number of generated files, report success only if at leat one 2021-12-26 17:32:37 +00:00
Hartmut Holzgraefe fe72e6ecc0 refactor (and fix) old map purge code 2021-09-20 20:00:38 +02:00
Hartmut Holzgraefe 416a2a2463 fix some collaterals of m2m field rename 2021-09-18 15:50:16 +00:00
Hartmut Holzgraefe dcfec04bb5 change render result dir structure to include dated subdirs
by creating year/month/day subdir structure the number of files
per directory gets limited, and manual cleanup by date -- if needed --
becomes more simple
2021-09-12 11:44:59 +00:00
Hartmut Holzgraefe 10856835e7 transation base update 2021-06-13 14:37:15 +02:00
Hartmut Holzgraefe 0f5a0179fd merge 2020-11-02 12:47:53 +01:00
Hartmut Holzgraefe c6130c6994 only run cleanup when it really makes sense, not every 10 seconds 2020-11-01 11:23:10 +00:00
Hartmut Holzgraefe 5f5090f1b6 use proper Django templates for notification emails 2020-10-14 21:05:08 +00:00
Hartmut Holzgraefe 5965b5aeb0 add Sender: header to outgoing emails
for now contains the same address as From:
some mail servers seem to require having a Sender: header
as part of their spam detection rules
2020-10-08 12:48:41 +02:00
Hartmut Holzgraefe ea871a789c fix notification mail issues 2020-10-06 18:06:55 +02:00
Hartmut Holzgraefe 752eaad6ef Merge branch 'site-osm-baustelle' of https://github.com/hholzgra/maposmatic into site-osm-baustelle 2020-02-19 00:41:33 +01:00
Hartmut Holzgraefe dd764a2c76 remove alpha channel befor converting to JPEG 2020-02-18 18:43:32 +00:00
Hartmut Holzgraefe af4783510b add multiple file upload capability (issue #41 - work in progress)
(previous commit was incomplete ...)

this change adds the most basic steps needed to allow multi file uploads,
there are still some rough edges to fix, but basically things work ...
2020-02-16 11:39:29 +00:00
Hartmut Holzgraefe 636a73803c close django database connections before forking render jobs 2020-02-15 17:04:43 +00:00
Hartmut Holzgraefe 8cfe461e7a purge files in small batches only, don't let deletion stall rendering for long 2020-02-09 13:26:27 +01:00
Hartmut Holzgraefe 81dfc610cf do not fail completely on failure to generate map thumbnail 2019-08-22 10:43:35 +02:00
Hartmut Holzgraefe 7268ea9943 make cleanup part of the main loop
using django models from different threads doesn't seem to work
out well, so we just check whether we've hit the result storage
threshold after each render job
2019-08-11 22:15:49 +00:00
Hartmut Holzgraefe e2ba92f014 switched to self hosted Weblate for translations, which has good github integration
so the Transifex related sync scripts are no longer needed
2019-04-12 18:05:38 +02:00
Hartmut Holzgraefe 65656f6be0 consistently use LOG for logger 2019-04-07 21:43:19 +00:00
Hartmut Holzgraefe 37f563d121 preserve original request URL (work in progress) 2018-12-26 22:17:12 +00:00
Hartmut Holzgraefe 30a63c88e7 newer Ubuntu versions of the ImageMagic package disable parsing
of PDF, PS, and some other file formats for security reasons

do not fail completely if no preview thumbnail can be extracted
from the actual PDF result file
2018-11-25 10:13:45 +00:00
Hartmut Holzgraefe 6e1d5f7508 do not fail completely if ppmquant step fails 2018-10-06 09:55:40 +02:00
Hartmut Holzgraefe 917136d540 use local places database instead of nominatim for city search 2018-09-23 20:17:42 +00:00
Hartmut Holzgraefe 160d667ed3 translation helper script 2018-09-19 22:26:13 +00:00
Hartmut Holzgraefe 318c425511 add api support for POI "Umgebungsplan" files 2018-09-09 20:57:13 +00:00
Hartmut Holzgraefe 5c425cd317 we know that we create very large images, so remove size limits 2018-04-29 13:18:29 +02:00
Hartmut Holzgraefe 94cd56d56d Started porting to Django 1.11
(as part of moving to Ubuntu 18.04 'bionic' as default platform)
2018-04-04 06:55:47 +00:00
Hartmut Holzgraefe 9bd7ab6241 pass umap file to ocitiesmap renderer 2018-02-18 19:54:21 +00:00
Hartmut Holzgraefe e29fe2b081 code for gpx track bbox handling no longer neededx 2018-02-10 13:46:31 +00:00
Hartmut Holzgraefe 4d0b8fa987 used wrong file name component, screwing up uploads with non-ascii file names 2017-10-05 22:02:53 +00:00
Hartmut Holzgraefe 3ee5d563cb some more python3 port fixes 2017-09-20 22:57:39 +00:00
Hartmut Holzgraefe 97565af601 python3 porting modifications 2017-09-17 19:58:58 +00:00
Hartmut Holzgraefe 7f25c8f896 Merge branch 'site-osm-baustelle' of https://github.com/hholzgra/maposmatic into site-osm-baustelle 2017-07-16 22:02:35 +02:00
Hartmut Holzgraefe 101742b08b generate color reduced smaller size 8bit PNG using pngquant 2017-07-16 19:56:17 +00:00
Hartmut Holzgraefe 7cc9c5193f mail template typo fix 2017-07-16 17:12:45 +02:00
Hartmut Holzgraefe a66157f218 also send notification to submitter on timeout failures 2017-07-16 13:55:07 +00:00
Hartmut Holzgraefe 313c48b7bc notify submitter of rendering failuers, too 2017-07-16 11:45:44 +00:00
Hartmut Holzgraefe 538750b8f3 send email to requesting user on success 2017-07-16 11:33:52 +00:00