Andrew Gaul
d2f4f30012
s3proxy 1.6.2 release
2019-07-03 10:26:05 -07:00
Andrew Gaul
83664acd89
Rebase onto latest s3-tests
2019-07-02 15:00:24 -07:00
Andrew Gaul
7b1c46fb65
Include KeyCount in List V2 responses
...
Found via s3-tests.
2019-07-02 14:56:18 -07:00
Andrew Gaul
30b8677831
Remove another useless debug message
2019-07-02 00:19:38 -07:00
Timur Alperovich
e37300dd3f
UploadPartCopy: Fail if improper source range.
...
S3Proxy should check the format of the x-amz-copy-source-range value
when handling an UploadPartCopy request. The patch changes the behavior
to return an InvalidArgument error along with the matching error
description to AWS S3. To match the error format, the S3Exception class
is modified to return the actual error message, rather than the String
version of the error code.
Corresponding tests will be added to ceph/s3-tests.
Fixes : #304
2019-06-24 16:03:47 -07:00
Andrew Gaul
1966efc269
Remove useless debug messages
2019-06-22 09:46:28 -07:00
Andrew Gaul
7d7ee0d794
Do not depend on a specific distribution
...
Trusty is at end of life and S3Proxy should not depend on much
specific from its environment.
2019-06-09 22:03:34 -07:00
Andrew Gaul
bba3950f35
Remove sudo: false
...
Travis deprecated this:
https://blog.travis-ci.com/2018-11-19-required-linux-infrastructure-migration
2019-06-09 18:55:53 -07:00
Andrew Gaul
93edbfea85
Upgrade to Jetty 9.2.28.v20190418
2019-06-07 04:36:30 -07:00
Andrew Gaul
34c043d222
Upgrade to modernizer-maven-plugin 1.8.0
...
Release notes:
https://github.com/gaul/modernizer-maven-plugin/releases/tag/modernizer-maven-plugin-1.8.0
https://github.com/gaul/modernizer-maven-plugin/releases/tag/modernizer-maven-plugin-1.7.1
2019-05-28 17:11:44 +09:00
Andrew Gaul
620723ee8e
Rebase onto latest s3-tests
...
This moves many tests to boto3 and required manually re-adding
fails_on_s3proxy attributes to many functions.
2019-05-22 16:41:41 +09:00
Andrew Gaul
85975e76ce
Add more logging in top-level exception handler
...
References #262 .
2019-05-21 21:22:34 +09:00
Andrew Gaul
af840a4ae0
Add bucket policies to limitations
...
References #301 .
2019-05-21 11:45:04 +09:00
Andrew Gaul
85d33596f6
Emit request ID in headers as well as XML
...
Found via s3-tests.
2019-05-20 13:18:21 +09:00
Andrew Gaul
f635763af7
Emit PreconditionFailed on HTTP 412
...
Found via s3-tests.
2019-05-20 12:57:09 +09:00
Andrew Gaul
b9e0714b2d
Limit signed URL duration
...
Found via s3-tests.
2019-05-20 12:56:59 +09:00
Andrew Gaul
8c9bfe5ea5
Emit MalformedXML for empty complete MPU
...
Found via s3-tests.
2019-05-20 12:29:11 +09:00
Andrew Gaul
2480d0b01f
Only emit delimiter if non-empty
...
Found via s3-tests.
2019-05-20 12:19:07 +09:00
Andrew Gaul
32fe8d0343
Emit MalformedXML with empty multi delete objects
...
Cannot test in s3-tests since the boto client prevents this.
Fixes #300 .
2019-05-20 10:27:22 +09:00
Andrew Gaul
5bc6931439
Skip s3-tests appendobject tests
...
This is a non-standard Ceph extension.
2019-05-20 09:51:27 +09:00
Andrew Gaul
913d3df765
Emit InvalidRange with over-long range requests
...
Found via s3-tests.
2019-05-20 09:31:08 +09:00
Andrew Gaul
f45d6e7fce
Prefer HTTPS links where possible
2019-05-20 09:30:27 +09:00
Andrew Gaul
c8d8126b3f
Add simple handler for GetBucketPolicy
...
Fixes #301 .
2019-05-10 19:19:56 +07:00
Andrew Gaul
21ea62ec93
Only append elements when non-empty
...
Cleans up error responses.
2019-05-10 19:16:51 +07:00
Andrew Gaul
6389e45670
Allow overriding maximum signed request time skew
2019-04-30 10:44:55 +09:00
Maciej
c88072b8ef
Do not eagerly initialize BlobStore
...
This prevents OpenStack blobstores from matching regions incorrectly, basing on a value of the endpoint variable. OVH has different URLs for each storage endpoint, which does not match the auth endpoint.
2019-03-06 23:26:43 +09:00
Andrew Gaul
52fcf4a868
Override Exception.getMessage instead of toString
...
This can help some logging tools. Found via error-prone 2.3.3.
2019-02-24 21:34:28 +09:00
Andrew Gaul
4f81c17e11
Factor out AWS HTTP constants
...
Mirrors Guava HttpHeaders.
2019-02-17 17:24:43 +09:00
Andrew Gaul
25e7bbd5b4
Fix copy part if-none-match and if-modified-since
2019-02-16 12:58:20 +09:00
Andrew Gaul
3fed3941f1
Add partial support for list objects v2
...
Not supporting fetch-owner until jclouds adds support for this.
Several applications like AWS CLI now require this RPC. Fixes #168 .
2019-02-13 09:57:47 -08:00
Andrew Gaul
4698a2a913
Bump to 1.6.2-SNAPSHOT
2019-02-06 16:54:15 -08:00
Andrew Gaul
be0ffa2452
S3Proxy 1.6.1 release
2019-02-06 16:49:55 -08:00
Andrew Gaul
8223f443c7
Fix NullBlobStore multipart upload
...
Complete multipart upload lists the parts to get their sizes but the
NullBlobStore reported 8 bytes for the physical size instead of the
logical size embedded with the part. There is no readable space to
store the logical size so we create a companion single-part object for
every part.
2019-02-06 16:35:19 -08:00
Andrew Gaul
c07adfc1a9
Periodically emit newlines during complete MPU
...
CompleteMultipartUpload can take a long time so some S3
implementations emit newlines while the response is pending.
Fixes #292 . Reference:
https://docs.aws.amazon.com/AmazonS3/latest/API/mpUploadComplete.html
2019-02-06 15:13:41 -08:00
Andrew Gaul
8a4ff5a80c
Upgrade to jclouds 2.1.2
...
Release notes:
https://jclouds.apache.org/releasenotes/2.1.2/
2019-02-06 14:06:33 -08:00
Andrew Gaul
43a45e36b6
Fix error prone 2.3.2 warnings
2019-02-05 15:33:46 -08:00
Andrew Gaul
66ed9fe6ef
Upgrade to maven-javadoc-plugin 3.0.1
...
Notably this fixes issues with newer versions of Java. Release notes:
https://mail-archives.apache.org/mod_mbox/maven-announce/201712.mbox/%3Cop.zaufhhzukdkhrr%40desktop-2khsk44.mshome.net%3E
https://mail-archives.apache.org/mod_mbox/maven-announce/201805.mbox/%3Cop.zjqrfkbukdkhrr%40desktop-2khsk44%3E
2019-02-05 15:18:47 -08:00
Andrew Gaul
fbead8e47c
Increase surefire heap size
...
Prevents out of memory errors with many concurrent tests.
2019-02-05 15:13:38 -08:00
Andrew Gaul
204324b1fb
Increase Azure maximum single part upload size
...
Enabled by Azure API version 2017-04-17 and jclouds 2.1.1. Also tweak
Azure multipart comments.
2019-02-05 10:16:37 -08:00
Andrew Gaul
c6b4839d2b
Allow glacier storage tier during PUT object
...
Amazon now allows this:
https://docs.aws.amazon.com/AmazonS3/latest/API/RESTObjectPUT.html
2019-02-04 18:28:22 -08:00
Andrew Gaul
ede70db7b7
Upgrade to jclouds 2.1.2-SNAPSHOT
...
Notably this fixes listing inside a directory on Docker. Fixes #279 .
2019-01-04 11:43:25 -08:00
Falk Reimann
e3277a4c1f
Basic CORS support
...
This commit adds a globally configurable CORS support. Note that this differs from AWS per-bucket support.
2018-12-22 07:19:50 +09:00
Andrew Gaul
3ba59d7370
Allow overriding S3PROXY_PORT
2018-11-15 16:43:34 -08:00
Andrew Gaul
78c9d54ea6
Always kill s3proxy on exit
...
Previously this only happened on success due to errexit.
2018-11-15 16:43:14 -08:00
Andrew Gaul
d45f2978c6
Skip cors tests
2018-11-15 16:42:56 -08:00
Andrew Gaul
ff33294afc
Rebase s3-tests
2018-11-15 16:36:46 -08:00
Falk Reimann
5377efef2a
Keystone v3 support with properties
2018-11-14 12:49:26 -08:00
Andrew Gaul
e7070762b4
Upgrade to modernizer-maven-plugin 1.7.0
...
Release notes:
https://github.com/gaul/modernizer-maven-plugin/releases/tag/modernizer-maven-plugin-1.7.0
2018-11-10 09:17:25 -08:00
Andrew Gaul
204d47bec5
Upgrade to SpotBugs 3.1.8
...
Changelog:
https://github.com/spotbugs/spotbugs/blob/release-3.1/CHANGELOG.md#318---2018-10-16
2018-11-04 13:08:22 -08:00
Andrew Gaul
d811e44c39
Add jaxb-api as a dependency
...
This allows Java 9 to run S3Proxy. Java 9 removed javax.xml which
previous Java versions included so adding the explicit dependency
allows both versions to work. References #270 . References #280 .
2018-11-04 12:48:31 -08:00