mirror
/
s3proxy
kopia lustrzana https://github.com/gaul/s3proxy
1
0
Forkuj 0
Kod Zgłoszenia Packages Projekty Wydania Wiki Aktywność
1 243 Commity
10 Gałęzie
27 Tagi
5,8 MiB
Wykres commitów

1243 Commity (f0c2eaee901de1d72c6fa1a85cb34678ed1da79a)

Autor SHA1 Wiadomość Data
Andrew Gaul 138abbd033 Add creation and last modified times to getBlob 
Found via s3-tests.  References #697.
 2024-11-23 14:36:52 -08:00
Andrew Gaul 8842c8ded2 Support container and blob access control 
Found via s3-tests.  References #697.
 2024-11-23 14:17:00 -08:00
Andrew Gaul db3911c878 Prohibit object operations on non-existent containers 
Found via s3-tests.  References #697.
 2024-11-23 13:01:59 -08:00
Andrew Gaul 88961539bc Bump to 2.5.0-SNAPSHOT 2024-11-22 22:29:16 -08:00
Andrew Gaul 53a20f0f77 S3Proxy 2.4.0 release 2024-11-22 22:20:40 -08:00
Andrew Gaul d9e85205a0 Add NIO.2 BlobStore 
This will enable multiple backends, e.g., jimfs (in-memory),
filesystem, and possibly stranger things like Hadoop.  Currently only
configured to use jimfs.  Fixes #697.
 2024-11-23 14:08:50 +09:00
David Herman 73df2b6f1a Allow to use Azure managed identities for azureblob-sdk backend 2024-11-23 03:19:54 +09:00
Andrew Gaul 0ea6dbf438 Upgrade to Jetty 11.0.24 
Release notes:
https://github.com/jetty/jetty.project/releases/tag/jetty-11.0.24

Fixes #723.
 2024-11-22 09:13:43 -08:00
zhaoshihao cbd6c264f2 fix handleCompleteMultipartUpload bug 2024-11-22 16:54:26 +09:00
Andrew Gaul b2c4665641 Allow copyBlob lastModified to be null 
This matches getBlob and other call sites.
 2024-11-19 12:00:26 -08:00
Andrew Gaul 48c04eca6a Handle non-existent blob in UserMetadataReplacer 
Fixes #720.
 2024-11-18 10:37:36 -08:00
Andrew Gaul a3125c4ee3 Add test for getting a range 2024-11-15 21:56:21 -08:00
Andrew Gaul fb31431702 Allow overriding s3proxy.conf for s3-tests 2024-11-11 15:34:00 -08:00
Andrew Gaul 783b1f1d37 Clarify state of azureblob-sdk 
References #606.
 2024-11-11 13:42:12 -08:00
Andrew Gaul 2e66fb2efc Handle deleting missing container in azureblob-sdk 
References #606.
 2024-11-11 12:59:07 -08:00
Andrew Gaul 9e2c40a1df Consolidate azureblob-sdk error handling 
References #606.
 2024-11-11 12:36:45 -08:00
Andrew Gaul d8350b57cd Update s3-tests with azureblob tags 2024-11-10 22:00:59 -08:00
Andrew Gaul 5272c79083 Handle missing container in more places 
References #606.
 2024-11-10 12:49:29 -08:00
Andrew Gaul b02ce67c5a Handle invalid MD5 hashes 
References #606.
 2024-11-10 10:46:32 -08:00
Andrew Gaul 2e05eee061 Handle invalid container names 
References #606.
 2024-11-10 10:46:32 -08:00
Andrew Gaul 354ef589cf Add test for replacing a multi-part upload 
References #468.
 2024-11-09 17:28:33 -08:00
Andrew Gaul 5da1178df3 Add support for getBlob ranges in azureblob-sdk 
References #606.
 2024-11-07 23:42:40 -08:00
Andrew Gaul d4e20acb6d Run Maven tests against azureblob-sdk in CI 
References #700.
 2024-11-08 14:49:06 +09:00
Andrew Gaul 07613b9fba Use marker when listing blobs in azureblob-sdk 
References #606.
 2024-11-07 21:16:22 -08:00
Andrew Gaul 5332a9dce7 Ignore part checksums in CompleteMultipartUpload 
The intent of these are to correlate with the headers from previous
UploadPart requests.  S3Proxy ignores these elements for now since
none of the storage backends support them.  References #656.
 2024-11-04 19:23:32 -08:00
dependabot[bot] 00989c68da Bump org.junit.jupiter:junit-jupiter from 5.11.1 to 5.11.3 
Bumps [org.junit.jupiter:junit-jupiter](https://github.com/junit-team/junit5) from 5.11.1 to 5.11.3.
- [Release notes](https://github.com/junit-team/junit5/releases)
- [Commits](https://github.com/junit-team/junit5/compare/r5.11.1...r5.11.3)

---
updated-dependencies:
- dependency-name: org.junit.jupiter:junit-jupiter
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
 2024-11-02 07:36:58 +09:00
dependabot[bot] 8408e3545e Bump com.google.auto.service:auto-service from 1.0-rc3 to 1.1.1 
Bumps [com.google.auto.service:auto-service](https://github.com/google/auto) from 1.0-rc3 to 1.1.1.
- [Release notes](https://github.com/google/auto/releases)
- [Commits](https://github.com/google/auto/commits/auto-service-1.1.1)

---
updated-dependencies:
- dependency-name: com.google.auto.service:auto-service
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
 2024-11-02 07:36:47 +09:00
dependabot[bot] fe784afe97 Bump com.fasterxml.jackson.dataformat:jackson-dataformat-xml 
Bumps [com.fasterxml.jackson.dataformat:jackson-dataformat-xml](https://github.com/FasterXML/jackson-dataformat-xml) from 2.18.0 to 2.18.1.
- [Commits](https://github.com/FasterXML/jackson-dataformat-xml/compare/jackson-dataformat-xml-2.18.0...jackson-dataformat-xml-2.18.1)

---
updated-dependencies:
- dependency-name: com.fasterxml.jackson.dataformat:jackson-dataformat-xml
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
 2024-11-02 07:36:35 +09:00
dependabot[bot] 013565a968 Bump ch.qos.logback:logback-classic from 1.5.8 to 1.5.12 
Bumps [ch.qos.logback:logback-classic](https://github.com/qos-ch/logback) from 1.5.8 to 1.5.12.
- [Commits](https://github.com/qos-ch/logback/compare/v_1.5.8...v_1.5.12)

---
updated-dependencies:
- dependency-name: ch.qos.logback:logback-classic
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
 2024-11-02 07:36:17 +09:00
Andrew Gaul 544a863f96 Ignore x-amz-te: append-md5 request header 
This header requests that the server add a trailing MD5 checksum to
the response body.  However, if the X-Amz-Transfer-Encoding:
append-md5 response header is missing then the AWS Java SDK v2 will
ignore its absence.  So ignoring the request header works for now.
Fixes #414.
 2024-10-31 19:01:49 -07:00
Andrew Gaul aea6fd71b6 Bump copyright year 2024-10-30 15:50:01 -07:00
Andrew Gaul 5d960b3eed Add middleware to replace user metadata 
This is useful when keys and values must conform to some subset of
values, e.g., Azure's C# identifiers.  Fixes #466.
 2024-10-31 06:43:05 +09:00
Andrew Gaul 18d2f0ef9f Include Content-MD5 in azureblob-sdk putBlob 
References #606.  Fixes #576.
 2024-10-30 14:27:46 -07:00
Andrew Gaul c40237dfd0 Add Last-Modified to azureblob-sdk getBlob 
Also ETag and creation date.  References #606.
 2024-10-29 21:55:07 -07:00
Andrew Gaul c2106fae21 Split s3-tests tags per-line for readability 2024-10-29 16:39:07 -07:00
Andrew Gaul d6e9c5bbb8 Update s3-tests submodule for multipart tags 
References #700.
 2024-10-29 13:25:27 -07:00
Andrew Gaul e23e9ac99c Emit 501 for initiateMultipartUpload in azureblob-sdk 
The SDK lacks a method to upload a part with a non-repeatable payload.
References #708.
 2024-10-29 13:04:53 -07:00
Andrew Gaul 6610b14ea5 Disable retries for azureblob-sdk 
It is better to let the client retry.
 2024-10-29 00:09:32 -07:00
Andrew Gaul 8ebf6ce84e Handle non-empty delete container in azureblob-sdk 
Found via s3-tests.  References #606.
 2024-10-28 16:26:17 -07:00
Andrew Gaul ff8e12e631 Handle missing buckets and keys in azureblob-sdk 
Found via s3-tests.  References #606.
 2024-10-28 15:30:34 -07:00
Andrew Gaul 1120591674 Remove unused imports 
Follows on to 49e468ab68.
 2024-10-28 13:15:36 -07:00
Andrew Gaul c36ae275bb Skip failing azureblob-sdk multipart tests 
References #700.  References #708.
 2024-10-28 13:01:16 -07:00
Andrew Gaul 49e468ab68 Avoid type duplication with type inference 
Replaced via:

find -name \*.java | xargs sed -i 's/^\( *\)\([^ ].*\) \([^ ]*\) = new \2/\1var \3 = new \2/'
 2024-10-27 21:58:43 -07:00
Andrew Gaul 38cf4a9239 Translate Azure errors in AzureBlobStore 
This addresses a layering violation and may make AzureBlobStore more
useful to non-S3Proxy users.  References #606.
 2024-10-27 21:17:55 -07:00
Andrew Gaul 513283859a Fix Checkstyle violations 2024-10-27 19:43:52 -07:00
Andrew Gaul 38d2881d59 Support condition get object in azureblob-sdk 
References #606.
 2024-10-27 19:39:31 -07:00
Andrew Gaul c28f7dba47 Add workarounds for azureblob-sdk tests 
References #606.
 2024-10-27 17:57:00 -07:00
Andrew Gaul 8311d11456 Skip copy blob tests on Azurite 
References #606.
 2024-10-27 17:56:54 -07:00
Andrew Gaul fc7a135cb4 Implement copyBlob for azureblob-sdk 
References #606.
 2024-10-27 17:35:50 -07:00
Andrew Gaul 8b22505d5d Disable retries for AwsSdkTest 
This prevents long test run-times for unexpected HTTP 500 errors.
 2024-10-27 15:46:05 -07:00