Wykres commitów

213 Commity (master)

Autor SHA1 Wiadomość Data
Piero Toffanin 6ae2cca1f6 Memory-aware multipart uploads 2020-11-02 12:53:50 -05:00
Piero Toffanin b2f7a19e1f Faster S3 uploads, progress reporting 2020-11-02 12:13:30 -05:00
Piero Toffanin 74ca12240f Fix domain type parsing #128 2020-09-22 16:37:39 -04:00
Piero Toffanin f92899639b Merge branch 'master' of https://github.com/OpenDroneMap/NodeODM into python3 2020-09-17 12:00:36 -04:00
Bibek Joshi 2ee189612d
Added the IAM role authentication for the s3 access 2020-09-17 16:36:00 +05:30
Bibek Joshi aa2347ef3b
Added the correct value from config file 2020-09-17 00:09:01 +05:30
Bibek Joshi f7abea2f9b
Added the support to read the s3 acl value from the config file 2020-09-17 00:07:14 +05:30
Piero Toffanin be98fe4d92 Merged 7unzip branch 2020-09-10 14:07:11 -04:00
Piero Toffanin 32ff066096 Fix max_images logic 2020-09-10 13:17:59 -04:00
Piero Toffanin 8439a04fd4 Use unzip if available 2020-09-10 12:55:22 -04:00
Piero Toffanin 802d72a48b Faster unzipping with 7z 2020-09-10 12:24:08 -04:00
Piero Toffanin 89584ee50b Updated docs, remove download/orthophoto.tif endpoint, migration guide 2020-09-09 14:42:55 -04:00
Piero Toffanin aeb31f6ecd Delete previous directory if already exists during task init 2020-08-26 15:54:32 -04:00
Piero Toffanin 7043eafe99
Error throw fix 2020-08-26 15:13:00 -04:00
Piero Toffanin b84a14101a Fixes 2020-08-03 15:15:46 -04:00
Piero Toffanin eb377c7fcc Deal with Python2 warnings for parsing ODM options 2020-08-03 15:07:20 -04:00
John Mason e98aed7216 Support s3ForcePathStyle AWS config option
Adds the following ways to configure S3 to use path style instead of
subdomains.

* argument `--s3_force_path_style`
* config file option `s3ForcePathStyle`

Ref: https://docs.aws.amazon.com/AWSJavaScriptSDK/latest/AWS/Config.html#s3ForcePathStyle-property
2020-06-03 06:47:30 -04:00
Piero Toffanin ebb76f7fdc Include report folder 2020-05-15 14:41:54 -04:00
Piero Toffanin 6459f10e45 Remove file sanitization 2020-04-04 12:22:48 -04:00
Piero Toffanin f9c264aa04 Fix 7zip compression 2020-02-05 11:23:08 -05:00
Piero Toffanin 7cc53bda85 Fix archiver import 2020-02-04 14:36:10 -05:00
Piero Toffanin 0d61a82129 Optional output capture in task runner 2020-01-21 17:07:13 -05:00
Piero Toffanin dccc51f7da Implemented /task/list 2020-01-19 16:37:54 -05:00
Piero Toffanin f695c7b44e Use 7zip for compression 2020-01-19 15:21:54 -05:00
Piero Toffanin 346031307e Allow multiple files with same name 2020-01-19 13:55:00 -05:00
Piero Toffanin 4a0adcd883 Allow /task/new/init to be called multiple times with same set-uuid 2019-10-14 12:25:19 -04:00
Piero Toffanin 938b13f21f Bug fix 2019-10-14 11:13:52 -04:00
Piero Toffanin fd677e8048 Track dateCreated, fixes 2019-10-01 23:43:49 -04:00
Piero Toffanin ced6a83cba Remove seed.zip after extraction 2019-10-01 23:07:15 -04:00
Piero Toffanin f539638cfa Do not build MBTiles, timeout fixes 2019-10-01 22:59:00 -04:00
Piero Toffanin e206fc7dba Added timeout option 2019-10-01 22:52:48 -04:00
Piero Toffanin 2f54e12470 clone, keep process env vars 2019-07-15 15:02:59 -04:00
Piero Toffanin 27ed79a5a3 Forgot env, added HOME envvar to service to make entwine happy 2019-07-15 14:47:28 -04:00
Piero Toffanin 947b8b046e Add LD_LIBRARY_PATH to spawn command 2019-07-15 14:36:39 -04:00
Piero Toffanin c379ed861f Add support for json option type 2019-06-25 14:09:37 -04:00
Piero Toffanin b59fb316bc Export cameras.json 2019-06-25 13:21:15 -04:00
Piero Toffanin 53191c2aa3 Set progress to zero on restart 2019-06-19 09:48:45 -04:00
Piero Toffanin 9bcbe07d99 Add entwine pointcloud to output 2019-06-08 17:23:49 -04:00
Piero Toffanin 3909c0a677 dateCreated hot init extension 2019-06-04 10:18:58 -04:00
Piero Toffanin 434b84bf7c --test_seconds option 2019-05-28 09:26:17 -04:00
Piero Toffanin 2a5d73ae2d Fixed --testSkipOrthophotos 2019-05-26 10:56:16 -04:00
Piero Toffanin c43a723037 Expose --end-with 2019-05-20 10:39:34 -04:00
Piero Toffanin 52156b18de Progress simplified to global progress only, drop stages reporting 2019-05-19 16:58:45 -04:00
Piero Toffanin 3ef22efb2c Fixes 2019-05-17 19:33:29 -04:00
Piero Toffanin 1a4048402f Stage update code, API docs update 2019-05-17 19:24:47 -04:00
Piero Toffanin c574e2b83d Progress receiver class, stages information 2019-05-17 14:03:17 -04:00
Piero Toffanin cbd629dfcb Added opensfm dir for test data, removed console log 2019-05-08 16:34:50 -04:00
Piero Toffanin 3080080602 Readded --end-with 2019-05-08 14:26:58 -04:00
Piero Toffanin 250ba43506 seed file support, updated docs 2019-05-05 13:39:39 -04:00
Piero Toffanin 39b8926824 outputs field support for new tasks 2019-05-05 12:35:50 -04:00
Piero Toffanin d2cc745e30 Allow dash in filenames 2019-04-10 11:13:47 -04:00
Piero Toffanin 7f8802e448 Hide project name from options 2019-03-08 11:26:12 -05:00
Piero Toffanin cbf5e40027 More strict sanitization (remove spaces, special characters) 2019-03-08 10:36:20 -05:00
Piero Toffanin 6526010112 Fix premature deletion of long run tasks 2019-02-13 15:10:38 -05:00
Piero Toffanin 1ec908e9d6 Added ability to test task fails 2019-02-13 14:03:28 -05:00
Piero Toffanin 06fef5549b Sanitization 2019-02-01 16:20:03 -05:00
Piero Toffanin a489a95d6e Bug fixes, parallel uploads working 2019-02-01 13:04:09 -05:00
Piero Toffanin 5be741bef2 Started rewriting UI, added dropzone, tweaks, drop uploads test mode 2019-01-31 17:16:37 -05:00
Piero Toffanin 5c78f8c506 Chunked API draft working 2019-01-31 13:33:50 -05:00
Piero Toffanin 9fb1097e87 more refactoring, changed gpc --> gcp 2019-01-31 09:45:29 -05:00
Piero Toffanin c7a7423079 Started refactoring to accomodate chunked upload API 2019-01-30 15:56:09 -05:00
Piero Toffanin e87eabe9e3 Better help text parsing 2019-01-10 10:07:32 -05:00
Piero Toffanin 423ee155a5 More explicit paths for odm_orthophoto output inclusion, removed odm_meshing 2019-01-04 11:46:01 -05:00
Piero Toffanin cdf175f16c Added skippostprocess parameter, converted tabs to spaces in files 2019-01-04 11:36:14 -05:00
Piero Toffanin bb66d2852f Spaces --> tabs 2018-12-27 23:25:20 -05:00
Piero Toffanin 133994bb91 Set archiver zlib level to 1 2018-12-27 23:23:09 -05:00
Piero Toffanin cfd3677e07 Halved multipart upload size to S3 2018-12-19 11:39:01 -05:00
Piero Toffanin 2d7944c18b max-concurrency param bug fix 2018-12-15 12:58:28 -05:00
Piero Toffanin 5965d2eff9 1 = true, 0 = false boolean values for options 2018-12-15 11:27:42 -05:00
Piero Toffanin 4339eedfc8 Added retries to S3 uploads, UI improvement 2018-12-05 10:16:23 -05:00
Piero Toffanin 688e853ae4 Reduced parallel uploads to 1 2018-12-04 15:48:58 -05:00
Piero Toffanin bcbec55c03 Added s3_upload_everything flag 2018-12-03 21:46:49 -05:00
Piero Toffanin 2b76079bbd Added set-uuid parameter in headers for /task/new 2018-12-02 14:44:37 -05:00
Piero Toffanin 2fe8c523ec Increase parallel uploads to S3 2018-11-30 09:05:29 -05:00
Piero Toffanin 1a274d55f7 Added configuration to set a max-concurrency cap 2018-11-28 16:27:03 -05:00
Piero Toffanin c9d82e13bd Token handling, better S3 test uploads 2018-11-27 16:51:47 -05:00
Piero Toffanin dfc776eaf7 Webhook body changes 2018-11-24 14:07:21 -05:00
Piero Toffanin 5dd99884e7 Refactoring, remove images.json from download API, updated hook callback with images database 2018-11-24 14:03:15 -05:00
Piero Toffanin 354bb9c591 images.json download path, URL changes 2018-11-24 13:34:53 -05:00
Piero Toffanin a1f4981788 Add images.json in results 2018-11-24 13:14:10 -05:00
Piero Toffanin 4788bfde4f Webhook improvements 2018-11-23 14:48:22 -05:00
Piero Toffanin 2e9e7e9f42 S3 upload support 2018-11-23 13:19:52 -05:00
Piero Toffanin 4ad169a052 S3 configs, S3 module 2018-11-21 22:22:37 -05:00
Piero Toffanin b75e86183f maxImages limit, expose odmVersion 2018-11-09 11:09:19 -05:00
Piero Toffanin 4a797251f4 Added CPU, RAM info in /info, updated API version, docs 2018-06-27 17:27:38 -04:00
Piero Toffanin bcdbc51f48 Cannot read property pid of undefined during tests fix 2018-06-25 13:26:17 -04:00
Piero Toffanin bf210e5f11 Added SimpleTokenAuth, NoTokenRequiredAuth for token authentication, API definition change 2018-06-25 11:40:57 -04:00
Piero Toffanin 472eb84619 Support for domain validation on integer 2018-05-16 14:09:19 -05:00
Piero Toffanin cfc42cf80b one more trim() 2018-04-08 13:00:23 -04:00
Piero Toffanin f576858f0f Better output handling 2018-04-08 12:53:42 -04:00
Piero Toffanin 0c7ef7852f Expose --rerun-from instead of --rerun 2018-01-23 11:23:45 -05:00
Piero Toffanin afb7469c75 Added ability to change task options during restart 2018-01-23 11:04:28 -05:00
Piero Toffanin 4bf8346d1e Converted spaces to tabs 2018-01-23 10:00:33 -05:00
Piero Toffanin ac26c16ca6 Make sure enum values always contain the default value 2018-01-23 09:58:44 -05:00
Piero Toffanin 0cf514ee1a Exposed rerun parameter 2018-01-18 10:54:09 -05:00
Piero Toffanin d07e8e5e42 Added tree-kill 2017-09-15 05:22:10 -04:00
Piero Toffanin 01e2fdf472 Replaced run.py with run.sh 2017-09-14 14:34:19 -04:00
Piero Toffanin 3586a31f90 File path archive fix 2017-07-12 09:47:21 -04:00
Piero Toffanin 7dc78379d9 Added DEM derivatives generation 2017-06-30 15:17:44 -04:00
Piero Toffanin bfc90c9cec Fixed test mode fault 2017-05-21 13:29:59 -04:00