mirror
/
s3proxy
kopia lustrzana https://github.com/gaul/s3proxy
1
0
Forkuj 0
Kod Zgłoszenia Packages Projekty Wydania Wiki Aktywność
358 Commity
10 Gałęzie
23 Tagi
3,4 MiB
Wykres commitów

358 Commity (a5221f5f8e51c639c958dfca5fa9799b572d1803)

Autor SHA1 Wiadomość Data
Rita Zhang a5221f5f8e Upload two parts in testBigMultipartUpload 2015-12-03 16:31:42 +08:00
Andrew Gaul ed29debdf9 Upgrade to aws-java-sdk-s3 1.10.38 
This addresses an issue with the SDK providing an incorrect
Content-Type when uploading a multipart part.  Fixes #80.
 2015-12-02 22:24:47 +08:00
Andrew Gaul 01c43c9f1b Assert expected content length 
This makes some errors more obvious than comparing the content data.
 2015-12-02 22:18:28 +08:00
Andrew Gaul 4a4d2f7e6a Update pom.xml description 2015-11-30 13:30:09 +07:00
Andrew Gaul 9210cd679e Map IllegalArgumentException to HTTP 400 2015-11-20 22:31:06 -08:00
Andrew Gaul 67839acef1 Map UnsupportedOperationException to HTTP 501 2015-11-20 22:09:24 -08:00
Andrew Gaul 22ed1c542c Map KeyNotFoundException to NoSuchKey 
Unfortunately jclouds inconsistently throws ContainerNotFoundException
and KeyNotFoundException.
 2015-11-20 22:09:24 -08:00
Andrew Gaul bc2b18ee2b Add support for conditional get 
Fixes #77.
 2015-11-19 18:34:56 -08:00
Rita Zhang 71e2d61377 Allow anonymous access mode to use private buckets 
Fixes #94.
 2015-11-16 21:20:22 -08:00
Andrew Gaul 702de46f50 Add compatibility notes 2015-11-16 17:45:50 -08:00
Andrew Gaul e56e6732e2 Simplify usage and add curl example 
Link to wiki for more complicated examples.
 2015-11-16 17:03:31 -08:00
Andrew Gaul 80d5a58a9f Add AWS signature V4 to limitations 2015-11-15 10:43:51 -08:00
Andrew Gaul d6ec0d0f69 Update s3-tests to include POST upload tests 2015-11-14 23:24:58 -08:00
Andrew Gaul 2207dfbd21 Basic support for POST uploads 
This commit lacks support for policies.  References #73.
 2015-11-14 23:22:05 -08:00
Andrew Gaul 1797992e02 Do not emit response body for HEAD requests 2015-11-11 16:03:42 -08:00
Andrew Gaul 10f2e930a4 Rewrite summary and rework features 
Users should assume these features work; instead document the
limitations.
 2015-11-10 17:23:01 -08:00
Andrew Gaul a85e1783ac Add S3 ninja to references 2015-11-10 16:53:48 -08:00
Andrew Gaul b9907a841c Upgrade to error-prone 2.0.5 
Release notes:

https://groups.google.com/d/msg/error-prone-announce/vHvZx2MOpvg/xwYSH3i6AQAJ
 2015-10-28 13:38:54 -07:00
Andrew Gaul 0b4c81f445 Update s3-tests to include multipart copy tests 2015-10-27 10:29:51 -07:00
Andrew Gaul 22d57b1f18 Remove redundant private modifier from enum 2015-10-26 13:11:14 -07:00
Andrew Gaul a7d1a465d7 Upgrade to Maven Checkstyle Plugin 2.17 
Release notes:

https://mail-archives.apache.org/mod_mbox/maven-announce/201510.mbox/%3C5623FB9C.1080506%40apache.org%3E
 2015-10-26 11:56:29 -07:00
Andrew Gaul 3bb00f4336 Upgrade to Maven Assembly Plugin 2.6 
Release notes:

https://mail-archives.apache.org/mod_mbox/maven-announce/201510.mbox/%3CCALhtWkfv3Eh8zeqydR1XuaTksMWeUVdj39UbB6y1fXzWz9VVvA%40mail.gmail.com%3E
 2015-10-26 11:55:58 -07:00
Andrew Gaul acc38e3c2a Upgrade to Maven Surefire Plugin 2.19 
Release notes:

https://mail-archives.apache.org/mod_mbox/maven-announce/201510.mbox/%3CCAKuVzBRpxiVrO8RFCPsEiPn%2BJEKKgO-fDz2G01q%2B5j5dz5RzAA%40mail.gmail.com%3E
 2015-10-26 11:54:24 -07:00
Andrew Gaul 732ef5d260 Correct RandomByteSource.read return value 
Previously read returned a value between -128 and 127.  -1 indicates
end of stream, causing issues for callers.  Instead return values
between 0 and 255 as intended.
 2015-10-24 20:53:11 -07:00
Andrew Gaul 50a3024362 Work around incorrect Content-Type 
References #80.
 2015-10-20 22:17:56 -07:00
Alex Hall b7e98d1ce3 Test uploading large parts in multipart upload 
This commit exposes a AWS Java SDK bug.  References #80.
 2015-10-20 22:17:56 -07:00
Andrew Gaul d4f20646b4 Add test for 10,000 part MPU 
References #80.
 2015-10-20 14:44:17 -07:00
Andrew Gaul 97d467a698 Enforce no part number during complete MPU 
References #80.
 2015-10-20 14:41:42 -07:00
Andrew Gaul b1e96f4c2f Upgrade to modernizer-maven-plugin 1.4.0 
Release notes:

https://github.com/andrewgaul/modernizer-maven-plugin/releases/tag/modernizer-maven-plugin-1.4.0
 2015-10-15 20:21:02 -07:00
Andrew Gaul 274bf8a32e Handle listing a public-read container 
Also handle checking existence.
 2015-10-15 20:14:41 -07:00
Andrew Gaul 0faa68ccfc Honor jclouds.region with Swift blobstores 
jclouds has inconsistent support for regions due to provider
differences.  AWS providers a single global namespace while Swift
scopes per-endpoint.  Tested with Rackspace Cloud Files in HKG and ORD
regions.  Fixes #81.
 2015-10-14 13:08:29 -07:00
Andrew Gaul 618c35054c Do not check authorization when in anonymous mode 2015-10-11 11:09:04 -07:00
Andrew Gaul cad436fb95 Do not set Content-MD5 during copy part 
The previously used MD5 covered the entire object, not just the range
request.  Uncovered by ceph/s3-tests#75.
 2015-09-02 11:31:46 -07:00
Andrew Gaul 1d8dfea9c7 Use args4j for argument parsing 2015-09-01 11:12:34 -07:00
Nate Rosenblum f40693f214 Terminate on s3proxy start failure 
E.g. when bind(2) fails.
 2015-08-22 16:28:02 -07:00
Andrew Gaul 095d9aa94d Check anonymous access configuration first 
Previously, when configured for anonymous access and a client tried to
authenticate, S3Proxy would create a signature with a non-existent
credential.  Instead check anonymous access configuration first to
avoid a NullPointerException.
 2015-08-05 17:14:10 -07:00
Andrew Gaul 3b4d1b285b Add issue links to limitations 2015-08-02 17:12:39 -07:00
Andrew Gaul 0daa04a3ed Emit NotImplemented for unknown x-amz headers 2015-07-30 21:49:44 -07:00
Andrew Gaul b85dc31d48 Call HttpServletRequest.getWriter 
This avoids explicit wrapping with OutputStreamWriter.
 2015-07-30 21:00:54 -07:00
Andrew Gaul cc5f1e259f Issue BlobStore calls before opening Writer 
This allows Jetty to propagate errors from the calls correctly.
Follow on to dba252bb99.
 2015-07-30 20:50:48 -07:00
Andrew Gaul 96a6d188a3 Set Content-MD5 during emulated copy part 
Dead store found with FindBugs.  References #56.
 2015-07-30 20:32:03 -07:00
Andrew Gaul 2709d3faa4 Upgrade to error-prone 2.0.4 
Release notes:

https://groups.google.com/forum/#!topic/error-prone-announce/syl8dKP_Aow
https://groups.google.com/forum/#!topic/error-prone-announce/iZI0yixYDms
https://groups.google.com/forum/#!topic/error-prone-announce/v7aBgfhH-u8
https://groups.google.com/forum/#!topic/error-prone-announce/-f6Cv6jKvig
 2015-07-30 15:57:02 -07:00
Andrew Gaul cdbe139234 Remove munging of Google Cloud Storage ETag 
Clients need the original value for conditional GETs.
 2015-07-30 14:29:23 -07:00
Andrew Gaul 8e5fecaa91 Emulate multipart copy 
Fixes #56.
 2015-07-30 14:19:09 -07:00
Andrew Gaul 81c3fe9fc7 Consistently compared unquoted ETags 
Also use the ETag from listing parts which resolves an issue with
Swift multipart upload due to use of quoted ETags in the client S3
request and unquoted in underlying Swift request.
 2015-07-30 14:01:43 -07:00
Andrew Gaul 4684c1efe0 Do not test Content-Language with Swift 
Swift does not support this header.
 2015-07-29 16:59:18 -07:00
Andrew Gaul dba252bb99 Call completeMultipartUpload before opening writer 
This allows Jetty to propagate errors from completeMultipartUpload
correctly.
 2015-07-29 16:22:18 -07:00
Andrew Gaul 50871a55ec Partially emulate arbitrary markers with GCS 
S3 supports arbitrary keys for the marker while GCS only supports its
opaque marker.  Emulate the common case for GCS by mapping the last
key from a listing to the corresponding previously returned marker.
 2015-07-28 15:49:32 -07:00
Andrew Gaul 19aa01c090 Partially emulate arbitrary markers with Azure 
S3 supports arbitrary keys for the marker while Azure only supports
its opaque marker.  Emulate the common case for Azure by mapping the
last key from a listing to the corresponding previously returned
marker.
 2015-07-28 05:15:07 -07:00
Andrew Gaul f94d1834c9 Add test for multipart copy 
S3Proxy does not yet support this so we expect NotImplemented.
References #56.
 2015-07-25 13:04:05 -07:00