mirror
/
s3proxy
kopia lustrzana https://github.com/gaul/s3proxy
1
0
Forkuj 0
Kod Zgłoszenia Packages Projekty Wydania Wiki Aktywność
1 024 Commity
11 Gałęzie
22 Tagi
2,4 MiB
Wykres commitów

596 Commity (master)

Autor SHA1 Wiadomość Data
Andrew Gaul ec12ae0fe5 Plug leak in handleCompleteMultipartUpload 
In jclouds 2.6.0 BlobStore.getBlob returns an InputStream instead of a
ByteSource for the filesystem.  Previously the call site leaked the
former since it only consumed the BlobMetadata.  Instead call
BlobStore.blobMedata which does not include the payload.
Fixes JCLOUDS-1626.
 2024-03-03 13:13:08 +09:00
Andrew Gaul 90d6abc7fb Reapply "Upgrade to jclouds 2.6.0-SNAPSHOT" 
This reverts commit e1e1a9e0fd.
References #473.
 2024-02-25 17:42:15 +09:00
Andrew Gaul bf879d653e Set Jetty legacy URI compliance 
This resolves an issue with, "Ambiguous URI empty segment" in s3fs
integration test_time_mountpoint.
 2024-02-25 16:04:06 +09:00
momez 435eb37bf8 Remove tests that expect signature failure on OPTIONS preflight 
References #411.
 2024-02-07 13:16:53 +09:00
momez 6bb0250103 Do not perform signature check for OPTIONS verb 
Fixes #411.
 2024-02-07 13:09:06 +09:00
ali-firat.kilic 8165be6b17 Increase max non chunked request size to 128 MB 2024-01-12 08:19:34 +09:00
Andrew Gaul a7aa9a63ac Re-enable Checkstyle 
Also disable UnnecessaryParentheses due to false positive.
 2023-12-26 17:40:31 +09:00
Andrew Gaul 4aeff5fb28 Address Checkstyle LineLength violations 2023-12-26 17:38:59 +09:00
Andrew Gaul a732dca4c2 Add jakarta to Checkstyle ImportOrder 2023-12-26 13:51:54 +09:00
Andrew Gaul 1dac9ccd12 Address Checkstyle violations 2023-12-26 13:47:18 +09:00
Andrew Gaul e5fb3619df Remove unneeded UnsupportedEncodingException 2023-12-26 13:29:40 +09:00
jixinchi 2a44bcd709
commonPrefixes is only for delimiter request; check size and tier null 2023-11-13 22:38:13 +09:00
Lars Hagen 2281c74150 treat null and empty string equally for endpoint properties 
This improves the usability of the docker image, as it defaults
to empty strings for both properties. With this fix, the docker image
will work when only one of the endpoints are set.
 2023-10-24 20:45:37 +09:00
jixinchi 60f8366d33
Add DELETE and HEAD methods for CORS and CORS headers for all responses 2023-10-18 11:34:50 +09:00
Raul Sampedro 916af55366 add some test for regex midd 2023-10-03 20:53:45 +09:00
Raul Sampedro 5682b10c71 add regex middleware 2023-10-03 20:53:45 +09:00
Shane St Savage d52ceb134b Support S3PROXY_READ_ONLY_BLOBSTORE Docker env var 2023-09-27 22:18:26 +09:00
Andrew Gaul e1e1a9e0fd Revert "Upgrade to jclouds 2.6.0-SNAPSHOT" 
This reverts commit 222f4796b1.
References #473.
 2023-09-26 20:39:28 +09:00
Steve b134e81406
Add Access-Control-Allow-Credentials header 
Fixes #415
 2023-09-26 20:38:22 +09:00
Lars Hagen ff347352bf
Clear system property for credentials for file paths 
jclouds will override the passed in credentials if the system property is present
 2023-09-26 20:37:04 +09:00
Andrew Gaul 4706b1760f Log headers at trace instead of debug 2023-08-28 20:57:47 -07:00
Lars Hagen a4cf4dcd1f fix issues reported by modernizer 2.6.0 2023-08-17 23:08:38 +09:00
Lars Hagen b6fce1432d make sure all errors are logged at debug level 2023-08-17 17:21:02 +09:00
Szymon Draszkiewicz cf4db284a6 fixed marker being saved under wrong key in marker cache 2023-07-10 21:24:01 +09:00
Andrew Gaul 99c1486fd3 Add and ignore x-amz-api-version 
Fixes #497.
 2023-05-16 21:35:11 +09:00
Yann Defretin d42e42c3f0 Set default non chunked request size value 2023-04-22 16:22:19 +09:00
Yann Defretin bc607d6cf9 Configure Secure Endpoint with environment variable 2023-04-22 16:22:19 +09:00
Yann Defretin 52d942d3f7 Configure Keystore through environment variables 2023-04-19 12:42:56 +09:00
Srujan Deshpande 2f941aa990 Add S3PROXY_JAVA_OPTS environment variable 2023-03-18 03:56:00 +09:00
Andrew Gaul 222f4796b1 Upgrade to jclouds 2.6.0-SNAPSHOT 
Shuffle some test teardown methods to satisfy newer testng.
References #473.
 2023-01-28 22:34:22 +09:00
Andrew Gaul b72a6fea9e Remove unneeded AliasBlobStore directory methods 
These are not needed and generate deprecation warnings.
 2022-12-26 12:24:28 +09:00
Andrew Gaul 81e885422f Suppress spurious md5 deprecation warnings 2022-12-26 12:21:04 +09:00
Andrew Gaul 0245de405c Address error-prone warnings 2022-08-20 19:29:41 +09:00
Andrew Gaul bbbacaa442 Require Java 11 
Jetty 11 requires this.  Also address some Modernizer issues.
References #422.
 2022-08-08 21:24:58 +09:00
Andrew Gaul d375011388 Upgrade to Jetty 11.0.11 
Jetty 9 is EOL.  This requires Java 11 and updating some Java EE
imports.  Fixes #422.
 2022-08-08 21:17:40 +09:00
Thiago da Silva 00894152cd Allow setting of v4-max-non-chunked-request-size in Docker container 2022-07-20 13:35:50 +09:00
Christoph Kreutzer 1d450fa221 Docker entrypoint: authentication for Azure Blob 
When using the s3proxy as a proxy for S3 -> Azure Blob Storage, one needs to set the authentication parameters. When running in a container, these can be exposed via environment variables, but are currently not passed through to the jclouds config.
 2022-06-21 14:54:19 +09:00
xavier.gourmandin1 2e17734dc1 fix: #412 fix NPE when creating S3ProxyExtention or S3ProxyRule with Auth type = NONE 2022-04-01 21:16:09 +09:00
Florin Peter 217308abd7
Support for transparent encryption 
Co-authored-by: Florin Peter <Florin-Alexandru.Peter@t-systems.com>
 2022-03-26 22:05:08 +09:00
Xavier Gourmandin 05a39cf745
Support for Junit 5 Extension mechanism 
Fixes #288
 2022-03-02 23:36:11 +09:00
Liam 5aec5c132c Support configurable base directory for S3Proxy 2022-02-10 09:55:19 +09:00
Liam 0c3d81feb2 Make S3Proxy compatible with ExAws by checking for parameter presence 2022-02-10 09:54:24 +09:00
Andrew Gaul 2e61c38626 Configure Jetty to use legacy compliance 
This prevents changing header value cases which previously caused S3
signature mismatches.  Fixes #392.
References eclipse/jetty.project#7168.
 2022-01-22 19:41:04 +09:00
Tamas Cservenak 2839107c6f UT for #392 
This UT reproduces issue #392:
attempts a plain simple putObject without
any "trickery", and fails with SignatureDoesNotMatch.

The trick is, to use such Content-Type header that
is cached by Jetty, as it seems all the UTs are using
content types that are not quite common, hence Jetty
cache is not pre-populated with those.
 2022-01-22 19:41:04 +09:00
Tamas Cservenak 075ff7f126 Update build 
In general update the ancient build plugins
around.

Changes:
* bring all maven plugins to latest versions
* update checkstyle (as pre 8.41 is not supported anymore)
* update checkstyle rules
* make checkstyle plugin not fail the build (as there are issues)
* fix maven-shade-plugin warnings about dupe resource
* fix modernizer issue as it fails the build
* make build reproducible

Added comment about parent POM: the currently used parent is
10 years old, moreover, if you look in Maven Central,
the GA is unmaintained (last release was in 2014). Better introduce
own parent POM, or just copy whatever needed into this POM
(related to staging) and stop using the ancient POM.
 2022-01-22 19:07:24 +09:00
Andrew Gaul db2cc2a0ff Cache replaceAll regex when normalizing headers 2021-11-01 19:00:28 +09:00
Andrew Gaul cb3845c1ab Reduce allocations in buildCanonicalHeaders 2021-10-31 21:09:48 +09:00
Andrew Gaul b6c2dc9b9c Re-use XmlMapper instances 
These can be expensive to create:

https://stackoverflow.com/a/57671444
 2021-10-31 19:31:55 +09:00
Timur Alperovich 512c926b6e Fix anonymous bucket listing bug 
If the bucket locator is used with anonymous access, listing a container
results in a null-pointer exception, as there are no blobstores in the
locator. In that case, we should use the globLocator structure and
return the first available blobstore.
 2021-10-26 13:15:02 +09:00
Timur Alperovich a2e9e22719 Fix a bug in blobstore locator 
558efb7b29 introduced a bug where if anonymous access is
configured, the bucket locator hits a null pointer exception. There is
an additional bug where if an incorrect identity is used with the
blobstore locator (as in, the request identity does not match the
configured bucket's blobstore identity), another null pointer exception
can be triggered.

The patch creates a new GlobBlobStoreLocator class and adds tests to it,
as it is difficult to test Main.java directly. The blobstore locator
logic is also reworked to fix the above bugs.
 2021-10-24 18:20:25 +09:00