mirror
/
s3proxy
kopia lustrzana https://github.com/gaul/s3proxy
1
0
Forkuj 0
Kod Zgłoszenia Packages Projekty Wydania Wiki Aktywność
371 Commity
10 Gałęzie
23 Tagi
3,4 MiB
Wykres commitów

371 Commity (d8c73bc86d30e885e743eb7afcd41cf0b9e9497b)

Autor SHA1 Wiadomość Data
Derrek Leute d8c73bc86d URL encode blob names when client requests it 
This allows support for characters which XML 1.0 cannot represent and
improves compatibility with newer versions of the AWS CLI.
Fixes #104.
 2015-12-14 17:10:45 -08:00
Andrew Gaul 23cff3a61d Do not require credentials for local blobstores 2015-12-14 16:01:35 -08:00
Andrew Gaul 9e033c677f Require credentials for aws-v2 authentication 2015-12-14 15:48:19 -08:00
Andrew Gaul 9af1d14dcc Provide content length to AmazonS3.putObject 
Prevents warnings of the form:

WARNING: No content length specified for stream data.  Stream contents
will be buffered in memory and could result in out of memory errors.
 2015-12-14 00:31:19 -08:00
Andrew Gaul 177d9b7566 Handle possibly-null HttpResponse 2015-12-13 23:43:22 -08:00
Andrew Gaul fa215ecb8a Factor out calls to get blobStoreType 2015-12-13 22:58:35 -08:00
Andrew Gaul e237ee9ebb Disable ETag checking for Google Cloud Storage 
Google Cloud Storage ETag is opaque and not an MD5 hash.
 2015-12-12 20:40:26 -08:00
Andrew Gaul c45dde3cbe Skip testMaximumMultipartUpload with large sizes 2015-12-12 13:00:48 +08:00
Andrew Gaul 0581c747bd Add missing @Override annotation 
Found via error-prone.
 2015-12-12 11:24:59 +08:00
Andrew Gaul 33fac374a6 Use container public-read for Azure test 
Azure does not support blob-level ACLs.
 2015-12-12 11:24:58 +08:00
Andrew Gaul eccf6d1b1f Disable ETag checking for Azure 
Azure ETag is opaque and not an MD5 hash.  References #96.
 2015-12-12 11:24:58 +08:00
Andrew Gaul 445fdc54ac Add s3proxydocker to references 
Fixes #103.
 2015-12-11 07:31:12 +08:00
Andrew Gaul cb3855736e Add swift3 to references 2015-12-09 15:51:21 +08:00
Rita Zhang a5221f5f8e Upload two parts in testBigMultipartUpload 2015-12-03 16:31:42 +08:00
Andrew Gaul ed29debdf9 Upgrade to aws-java-sdk-s3 1.10.38 
This addresses an issue with the SDK providing an incorrect
Content-Type when uploading a multipart part.  Fixes #80.
 2015-12-02 22:24:47 +08:00
Andrew Gaul 01c43c9f1b Assert expected content length 
This makes some errors more obvious than comparing the content data.
 2015-12-02 22:18:28 +08:00
Andrew Gaul 4a4d2f7e6a Update pom.xml description 2015-11-30 13:30:09 +07:00
Andrew Gaul 9210cd679e Map IllegalArgumentException to HTTP 400 2015-11-20 22:31:06 -08:00
Andrew Gaul 67839acef1 Map UnsupportedOperationException to HTTP 501 2015-11-20 22:09:24 -08:00
Andrew Gaul 22ed1c542c Map KeyNotFoundException to NoSuchKey 
Unfortunately jclouds inconsistently throws ContainerNotFoundException
and KeyNotFoundException.
 2015-11-20 22:09:24 -08:00
Andrew Gaul bc2b18ee2b Add support for conditional get 
Fixes #77.
 2015-11-19 18:34:56 -08:00
Rita Zhang 71e2d61377 Allow anonymous access mode to use private buckets 
Fixes #94.
 2015-11-16 21:20:22 -08:00
Andrew Gaul 702de46f50 Add compatibility notes 2015-11-16 17:45:50 -08:00
Andrew Gaul e56e6732e2 Simplify usage and add curl example 
Link to wiki for more complicated examples.
 2015-11-16 17:03:31 -08:00
Andrew Gaul 80d5a58a9f Add AWS signature V4 to limitations 2015-11-15 10:43:51 -08:00
Andrew Gaul d6ec0d0f69 Update s3-tests to include POST upload tests 2015-11-14 23:24:58 -08:00
Andrew Gaul 2207dfbd21 Basic support for POST uploads 
This commit lacks support for policies.  References #73.
 2015-11-14 23:22:05 -08:00
Andrew Gaul 1797992e02 Do not emit response body for HEAD requests 2015-11-11 16:03:42 -08:00
Andrew Gaul 10f2e930a4 Rewrite summary and rework features 
Users should assume these features work; instead document the
limitations.
 2015-11-10 17:23:01 -08:00
Andrew Gaul a85e1783ac Add S3 ninja to references 2015-11-10 16:53:48 -08:00
Andrew Gaul b9907a841c Upgrade to error-prone 2.0.5 
Release notes:

https://groups.google.com/d/msg/error-prone-announce/vHvZx2MOpvg/xwYSH3i6AQAJ
 2015-10-28 13:38:54 -07:00
Andrew Gaul 0b4c81f445 Update s3-tests to include multipart copy tests 2015-10-27 10:29:51 -07:00
Andrew Gaul 22d57b1f18 Remove redundant private modifier from enum 2015-10-26 13:11:14 -07:00
Andrew Gaul a7d1a465d7 Upgrade to Maven Checkstyle Plugin 2.17 
Release notes:

https://mail-archives.apache.org/mod_mbox/maven-announce/201510.mbox/%3C5623FB9C.1080506%40apache.org%3E
 2015-10-26 11:56:29 -07:00
Andrew Gaul 3bb00f4336 Upgrade to Maven Assembly Plugin 2.6 
Release notes:

https://mail-archives.apache.org/mod_mbox/maven-announce/201510.mbox/%3CCALhtWkfv3Eh8zeqydR1XuaTksMWeUVdj39UbB6y1fXzWz9VVvA%40mail.gmail.com%3E
 2015-10-26 11:55:58 -07:00
Andrew Gaul acc38e3c2a Upgrade to Maven Surefire Plugin 2.19 
Release notes:

https://mail-archives.apache.org/mod_mbox/maven-announce/201510.mbox/%3CCAKuVzBRpxiVrO8RFCPsEiPn%2BJEKKgO-fDz2G01q%2B5j5dz5RzAA%40mail.gmail.com%3E
 2015-10-26 11:54:24 -07:00
Andrew Gaul 732ef5d260 Correct RandomByteSource.read return value 
Previously read returned a value between -128 and 127.  -1 indicates
end of stream, causing issues for callers.  Instead return values
between 0 and 255 as intended.
 2015-10-24 20:53:11 -07:00
Andrew Gaul 50a3024362 Work around incorrect Content-Type 
References #80.
 2015-10-20 22:17:56 -07:00
Alex Hall b7e98d1ce3 Test uploading large parts in multipart upload 
This commit exposes a AWS Java SDK bug.  References #80.
 2015-10-20 22:17:56 -07:00
Andrew Gaul d4f20646b4 Add test for 10,000 part MPU 
References #80.
 2015-10-20 14:44:17 -07:00
Andrew Gaul 97d467a698 Enforce no part number during complete MPU 
References #80.
 2015-10-20 14:41:42 -07:00
Andrew Gaul b1e96f4c2f Upgrade to modernizer-maven-plugin 1.4.0 
Release notes:

https://github.com/andrewgaul/modernizer-maven-plugin/releases/tag/modernizer-maven-plugin-1.4.0
 2015-10-15 20:21:02 -07:00
Andrew Gaul 274bf8a32e Handle listing a public-read container 
Also handle checking existence.
 2015-10-15 20:14:41 -07:00
Andrew Gaul 0faa68ccfc Honor jclouds.region with Swift blobstores 
jclouds has inconsistent support for regions due to provider
differences.  AWS providers a single global namespace while Swift
scopes per-endpoint.  Tested with Rackspace Cloud Files in HKG and ORD
regions.  Fixes #81.
 2015-10-14 13:08:29 -07:00
Andrew Gaul 618c35054c Do not check authorization when in anonymous mode 2015-10-11 11:09:04 -07:00
Andrew Gaul cad436fb95 Do not set Content-MD5 during copy part 
The previously used MD5 covered the entire object, not just the range
request.  Uncovered by ceph/s3-tests#75.
 2015-09-02 11:31:46 -07:00
Andrew Gaul 1d8dfea9c7 Use args4j for argument parsing 2015-09-01 11:12:34 -07:00
Nate Rosenblum f40693f214 Terminate on s3proxy start failure 
E.g. when bind(2) fails.
 2015-08-22 16:28:02 -07:00
Andrew Gaul 095d9aa94d Check anonymous access configuration first 
Previously, when configured for anonymous access and a client tried to
authenticate, S3Proxy would create a signature with a non-existent
credential.  Instead check anonymous access configuration first to
avoid a NullPointerException.
 2015-08-05 17:14:10 -07:00
Andrew Gaul 3b4d1b285b Add issue links to limitations 2015-08-02 17:12:39 -07:00