mirror
/
s3proxy
kopia lustrzana https://github.com/gaul/s3proxy
1
0
Forkuj 0
Kod Zgłoszenia Packages Projekty Wydania Wiki Aktywność
218 Commity
10 Gałęzie
23 Tagi
3,4 MiB
Wykres commitów

159 Commity (3b9f58e540cfc91738f83b73a304cbe89583404d)

Autor SHA1 Wiadomość Data
Andrew Gaul a3043c1e6f Suppress serialization warning 2015-03-25 17:03:57 -07:00
Ka-Hing Cheung 4450c6aebb add a way to lookup blobstore with a callback 
remove the old map based lookup
 2015-03-25 16:59:02 -07:00
Ka-Hing Cheung 4ca219470e reordered blobstore parameter 2015-03-25 16:59:02 -07:00
Ka-Hing Cheung 87bed283cb Allow multiple account providers 
This allows different backend blobstores to be configured at
runtime, based on the request access key. As a result different
frontend auth can also be used. Currently this can only be done
programmatically and not through properties config file.
 2015-03-24 13:23:50 -07:00
Andrew Gaul b036318ec6 Update copyright year to 2015 2015-03-21 23:51:24 -07:00
Andrew Gaul 02c1e8f77f Move main from S3Proxy to Main class 2015-03-21 23:51:23 -07:00
Andrew Gaul 103f949627 Centralize ContainerNotFoundException handling 2015-03-18 19:26:25 -07:00
Andrew Gaul 81a5024bd3 Include jclouds properties in overrides 2015-03-18 19:21:31 -07:00
Andrew Gaul 6b5f9fd7f3 Remove unused s3Context 
This test uses AmazonS3Client instead of jclouds client.
 2015-03-17 23:55:48 -07:00
Andrew Gaul 58800de7bf Expect AWSResponseException 2015-03-17 22:57:27 -07:00
Andrew Gaul 70a7a6ecf6 Upgrade to Modernizer Maven Plugin 1.3.0 
Changelog:

https://github.com/andrewgaul/modernizer-maven-plugin/releases/tag/modernizer-maven-plugin-1.3.0
 2015-03-17 17:46:25 -07:00
Andrew Gaul 209f3e60e4 Narrow exception handling scope 2015-03-13 18:58:27 -07:00
Andrew Gaul 27900bf4de Allow setting object ACL during PUT 
References #44.
 2015-03-12 17:42:40 -07:00
Andrew Gaul 2b29bcd588 Disable AWS SDK SSL verification 2015-03-12 17:38:51 -07:00
Andrew Gaul 5f117c15a6 Add SeparatorWrap check 
This ensures that chained method calls have the dot operator at the
beginning of the line.
 2015-03-12 17:22:55 -07:00
Andrew Gaul 7dbdc4faf8 Handle default private ACL 
References:

http://docs.aws.amazon.com/AmazonS3/latest/API/RESTBucketPUTacl.html
http://docs.aws.amazon.com/AmazonS3/latest/API/RESTObjectPUTacl.html
 2015-03-06 18:02:00 -08:00
Andrew Gaul abe6b9ddf1 Automatically use MPU for Azure when needed 
All providers except for Azure support at least S3's 5 GB single-part
upload limit.  The previous configuration knob was suboptimal since it
used multi-part upload for small blobs.
 2015-03-06 17:28:20 -08:00
Timur Alperovich 1d7af6acae Add a test for failure when using v4 signatures. 
Adds a unit test with the Amazon Java SDK for failures when submitting
v4-signed requests. We use the Amazon Java SDK while waiting for the
issues JCLOUDS-480 to be resolved (implementing v4 signatures).
 2015-03-05 23:37:25 -08:00
Andrew Gaul c2724b4399 Introduce S3Exception 
This elides some boilerplate and ensures that we consistently handle
errors.
 2015-03-04 12:49:09 -08:00
Andrew Gaul 7e0c817660 Add NotImplemented error code 2015-03-04 10:38:57 -08:00
Andrew Gaul cbac36efdd Avoid unnecessary String concatenation 2015-03-03 16:50:38 -08:00
Ka-Hing Cheung 335e735c5b provide reason for access denied 2015-03-03 12:47:33 -08:00
Andrew Gaul 71d3a67b95 Explicitly add Content-Length 
Previously InitiateMultipartUpload used the incorrect length.  Found
with s3fs integration tests.  References #2.
 2015-03-02 17:00:41 -08:00
Andrew Gaul e90074afc0 Add helper to emit Owner stanza 2015-03-02 16:08:09 -08:00
Andrew Gaul 0337a4e4bc Handle zero-length multi-part upload 2015-03-02 16:08:09 -08:00
Andrew Gaul b0b1f4e9fa Emulate multipart upload with single-part uploads 
This approach requires three times as many operations as the optimal
approach.  Implementing this correctly requires exposing the
underlying multipart operations in jclouds.  Most s3-tests pass but
test_list_multipart_upload still fails:

References #2.
 2015-03-02 14:37:16 -08:00
Andrew Gaul 11c93a43a8 Use correct content length during copy 
Previously replacing the metadata would zero out the object contents.
 2015-03-02 14:01:00 -08:00
Andrew Gaul a65221091f Use maven-assembly-plugin instead of Maven Shade 
This works around MSHADE-183 which prevents use with Maven 3.2.5 and
has caused recent Travis CI failures.  Fixes #38.
 2015-02-22 23:22:05 -08:00
Andrew Gaul 52118ced78 Add support to set and get canned object ACLs 
Currently only support private and public-read access.
 2015-02-22 18:48:08 -08:00
Andrew Gaul c8e4279853 Propagate Exception if not HttpResponseException 2015-02-20 17:22:47 -08:00
Andrew Gaul 613da2f3ec Use builder to create S3Proxy 
Also hoist sanity checks out of main.
 2015-02-20 11:01:37 -08:00
Andrew Gaul 2e82478f0e Prefer static imports for Preconditions 2015-02-20 10:50:37 -08:00
Timur Alperovich 51e7f3c22a Expose the Jetty state in the S3Proxy interface. 
The commit adds a getState() method, which exposes the Jetty state
to the caller. This is useful to check whether the server is running
or is in some other state.
 2015-02-18 16:13:45 -08:00
Andrew Gaul b85ab17316 Correct typo 2015-02-18 11:34:28 -08:00
Andrew Gaul 7e61856db1 Support native multi-object delete 2015-02-15 01:07:10 -08:00
Andrew Gaul 9a261a62b0 Add support to set and get canned container ACLs 
Currently only support private and public-read access.
 2015-02-13 15:43:58 -08:00
Andrew Gaul 4ebbce7956 Run unknown parameter test 
JCLOUDS-258 allows use of MPU with the generic S3 provider.
 2015-02-12 18:08:29 -08:00
Andrew Gaul 074c36baab Add test harness to execute s3-tests 
Also add Travis configuration.
 2015-01-22 17:14:45 -08:00
Andrew Gaul 23f8e772da Upgrade to jclouds 2.0.0-SNAPSHOT 
This release allows larger than 2 GB single-part blobs and supports
object metadata with the filesystem provider on Linux and Windows.  It
also includes support for object size in container lists.  Fixes #1.
Fixes #6.
 2015-01-22 14:03:18 -08:00
Andrew Gaul fb0f321303 Improve CommonPrefixes support 
References #5.
 2015-01-22 13:30:28 -08:00
Andrew Gaul 7815a79548 Emit NotImplemented with unknown parameters 
This ensures that requests like multi-part upload and version
operations emit the intended responses.
 2015-01-19 20:06:58 -08:00
Andrew Gaul bae51b500a Reduce exception handling scope 2015-01-16 15:56:08 -08:00
Andrew Gaul e1c7b22b7d Handle NoSuchBucket during copy object 2015-01-16 15:14:53 -08:00
Andrew Gaul d81ee81a86 Handle null from HttpResponseException.getResponse 2015-01-15 18:36:14 -08:00
Andrew Gaul 05b63365bf Emit bogus CreationDate when not present 2015-01-15 18:23:22 -08:00
Andrew Gaul 7dff664c17 Add prefix to CommonPrefixes 
Addresses s3cmd tests failures.
 2015-01-14 12:24:23 -08:00
Andrew Gaul 5b5e9877b9 Improve support for x-amz-metadata-directive 
Replace content metadata in addition to user metadata.  Addresses
s3cmd tests failures.
 2015-01-13 23:32:46 -08:00
Andrew Gaul a6133a60a6 Honor force multipart in emulated copy object 2015-01-13 23:28:09 -08:00
Andrew Gaul 86665450ca URI decode copy source path 
Fixes s3cmd tests failures seen with Unicode object names.  Follow on
to b91b8e25d7.
 2015-01-13 18:44:59 -08:00
Andrew Gaul e3c49331ac Emit UTF-8 in object listing and multi-delete 
Fixes s3cmd tests failures seen with Unicode object names.
 2015-01-13 17:50:47 -08:00