mirror
/
s3proxy
kopia lustrzana https://github.com/gaul/s3proxy
1
0
Forkuj 0
Kod Zgłoszenia Packages Projekty Wydania Wiki Aktywność
1 153 Commity
9 Gałęzie
27 Tagi
5,9 MiB
Wykres commitów

1153 Commity (0ba15eaab8e8d67b4eef990d4b244d04572a68c5)

Autor SHA1 Wiadomość Data
Andrew Gaul 0ba15eaab8 Bump to 2.5.0-SNAPSHOT 2024-11-23 18:39:50 -08:00
Andrew Gaul e4a3f06703 S3Proxy 2.4.1 release 2024-11-23 18:34:31 -08:00
Andrew Gaul 662bb2c9ef Run s3-tests against transient-nio2 
References #697.
 2024-11-23 18:12:57 -08:00
Andrew Gaul 8b751f789b Skip s3-tests which fail on transient-nio2 
References #697.
 2024-11-23 18:08:59 -08:00
Andrew Gaul 7ac4146b14 Handle conditional get in transient-nio2 
Found by s3-tests.  References #697.
 2024-11-23 18:06:17 -08:00
Andrew Gaul 6b63abb6b6 Enforce correct MD5 hash in transient-nio2 putBlob 
Found via s3-tests.  References #697.
 2024-11-23 17:40:27 -08:00
Andrew Gaul fc0f31fc01 Handle list marker after last key in transient-nio2 
Found by s3-tests.  References #697.
 2024-11-23 17:22:47 -08:00
Andrew Gaul e598a835ee Treat empty delimiter as if it is not specified 
Found by s3-tests.  References #697.
 2024-11-23 17:19:42 -08:00
Andrew Gaul b0e119a99f Support list markers in transient-nio2 
References #697.
 2024-11-23 17:04:27 -08:00
Andrew Gaul e05343d986 Add ETag and Tier to getBlob and list 
Found via s3-tests.  References #697.
 2024-11-23 14:44:41 -08:00
Andrew Gaul 138abbd033 Add creation and last modified times to getBlob 
Found via s3-tests.  References #697.
 2024-11-23 14:36:52 -08:00
Andrew Gaul 8842c8ded2 Support container and blob access control 
Found via s3-tests.  References #697.
 2024-11-23 14:17:00 -08:00
Andrew Gaul db3911c878 Prohibit object operations on non-existent containers 
Found via s3-tests.  References #697.
 2024-11-23 13:01:59 -08:00
Andrew Gaul 88961539bc Bump to 2.5.0-SNAPSHOT 2024-11-22 22:29:16 -08:00
Andrew Gaul 53a20f0f77 S3Proxy 2.4.0 release 2024-11-22 22:20:40 -08:00
Andrew Gaul d9e85205a0 Add NIO.2 BlobStore 
This will enable multiple backends, e.g., jimfs (in-memory),
filesystem, and possibly stranger things like Hadoop.  Currently only
configured to use jimfs.  Fixes #697.
 2024-11-23 14:08:50 +09:00
David Herman 73df2b6f1a Allow to use Azure managed identities for azureblob-sdk backend 2024-11-23 03:19:54 +09:00
Andrew Gaul 0ea6dbf438 Upgrade to Jetty 11.0.24 
Release notes:
https://github.com/jetty/jetty.project/releases/tag/jetty-11.0.24

Fixes #723.
 2024-11-22 09:13:43 -08:00
zhaoshihao cbd6c264f2 fix handleCompleteMultipartUpload bug 2024-11-22 16:54:26 +09:00
Andrew Gaul b2c4665641 Allow copyBlob lastModified to be null 
This matches getBlob and other call sites.
 2024-11-19 12:00:26 -08:00
Andrew Gaul 48c04eca6a Handle non-existent blob in UserMetadataReplacer 
Fixes #720.
 2024-11-18 10:37:36 -08:00
Andrew Gaul a3125c4ee3 Add test for getting a range 2024-11-15 21:56:21 -08:00
Andrew Gaul fb31431702 Allow overriding s3proxy.conf for s3-tests 2024-11-11 15:34:00 -08:00
Andrew Gaul 783b1f1d37 Clarify state of azureblob-sdk 
References #606.
 2024-11-11 13:42:12 -08:00
Andrew Gaul 2e66fb2efc Handle deleting missing container in azureblob-sdk 
References #606.
 2024-11-11 12:59:07 -08:00
Andrew Gaul 9e2c40a1df Consolidate azureblob-sdk error handling 
References #606.
 2024-11-11 12:36:45 -08:00
Andrew Gaul d8350b57cd Update s3-tests with azureblob tags 2024-11-10 22:00:59 -08:00
Andrew Gaul 5272c79083 Handle missing container in more places 
References #606.
 2024-11-10 12:49:29 -08:00
Andrew Gaul b02ce67c5a Handle invalid MD5 hashes 
References #606.
 2024-11-10 10:46:32 -08:00
Andrew Gaul 2e05eee061 Handle invalid container names 
References #606.
 2024-11-10 10:46:32 -08:00
Andrew Gaul 354ef589cf Add test for replacing a multi-part upload 
References #468.
 2024-11-09 17:28:33 -08:00
Andrew Gaul 5da1178df3 Add support for getBlob ranges in azureblob-sdk 
References #606.
 2024-11-07 23:42:40 -08:00
Andrew Gaul d4e20acb6d Run Maven tests against azureblob-sdk in CI 
References #700.
 2024-11-08 14:49:06 +09:00
Andrew Gaul 07613b9fba Use marker when listing blobs in azureblob-sdk 
References #606.
 2024-11-07 21:16:22 -08:00
Andrew Gaul 5332a9dce7 Ignore part checksums in CompleteMultipartUpload 
The intent of these are to correlate with the headers from previous
UploadPart requests.  S3Proxy ignores these elements for now since
none of the storage backends support them.  References #656.
 2024-11-04 19:23:32 -08:00
dependabot[bot] 00989c68da Bump org.junit.jupiter:junit-jupiter from 5.11.1 to 5.11.3 
Bumps [org.junit.jupiter:junit-jupiter](https://github.com/junit-team/junit5) from 5.11.1 to 5.11.3.
- [Release notes](https://github.com/junit-team/junit5/releases)
- [Commits](https://github.com/junit-team/junit5/compare/r5.11.1...r5.11.3)

---
updated-dependencies:
- dependency-name: org.junit.jupiter:junit-jupiter
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
 2024-11-02 07:36:58 +09:00
dependabot[bot] 8408e3545e Bump com.google.auto.service:auto-service from 1.0-rc3 to 1.1.1 
Bumps [com.google.auto.service:auto-service](https://github.com/google/auto) from 1.0-rc3 to 1.1.1.
- [Release notes](https://github.com/google/auto/releases)
- [Commits](https://github.com/google/auto/commits/auto-service-1.1.1)

---
updated-dependencies:
- dependency-name: com.google.auto.service:auto-service
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
 2024-11-02 07:36:47 +09:00
dependabot[bot] fe784afe97 Bump com.fasterxml.jackson.dataformat:jackson-dataformat-xml 
Bumps [com.fasterxml.jackson.dataformat:jackson-dataformat-xml](https://github.com/FasterXML/jackson-dataformat-xml) from 2.18.0 to 2.18.1.
- [Commits](https://github.com/FasterXML/jackson-dataformat-xml/compare/jackson-dataformat-xml-2.18.0...jackson-dataformat-xml-2.18.1)

---
updated-dependencies:
- dependency-name: com.fasterxml.jackson.dataformat:jackson-dataformat-xml
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
 2024-11-02 07:36:35 +09:00
dependabot[bot] 013565a968 Bump ch.qos.logback:logback-classic from 1.5.8 to 1.5.12 
Bumps [ch.qos.logback:logback-classic](https://github.com/qos-ch/logback) from 1.5.8 to 1.5.12.
- [Commits](https://github.com/qos-ch/logback/compare/v_1.5.8...v_1.5.12)

---
updated-dependencies:
- dependency-name: ch.qos.logback:logback-classic
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
 2024-11-02 07:36:17 +09:00
Andrew Gaul 544a863f96 Ignore x-amz-te: append-md5 request header 
This header requests that the server add a trailing MD5 checksum to
the response body.  However, if the X-Amz-Transfer-Encoding:
append-md5 response header is missing then the AWS Java SDK v2 will
ignore its absence.  So ignoring the request header works for now.
Fixes #414.
 2024-10-31 19:01:49 -07:00
Andrew Gaul aea6fd71b6 Bump copyright year 2024-10-30 15:50:01 -07:00
Andrew Gaul 5d960b3eed Add middleware to replace user metadata 
This is useful when keys and values must conform to some subset of
values, e.g., Azure's C# identifiers.  Fixes #466.
 2024-10-31 06:43:05 +09:00
Andrew Gaul 18d2f0ef9f Include Content-MD5 in azureblob-sdk putBlob 
References #606.  Fixes #576.
 2024-10-30 14:27:46 -07:00
Andrew Gaul c40237dfd0 Add Last-Modified to azureblob-sdk getBlob 
Also ETag and creation date.  References #606.
 2024-10-29 21:55:07 -07:00
Andrew Gaul c2106fae21 Split s3-tests tags per-line for readability 2024-10-29 16:39:07 -07:00
Andrew Gaul d6e9c5bbb8 Update s3-tests submodule for multipart tags 
References #700.
 2024-10-29 13:25:27 -07:00
Andrew Gaul e23e9ac99c Emit 501 for initiateMultipartUpload in azureblob-sdk 
The SDK lacks a method to upload a part with a non-repeatable payload.
References #708.
 2024-10-29 13:04:53 -07:00
Andrew Gaul 6610b14ea5 Disable retries for azureblob-sdk 
It is better to let the client retry.
 2024-10-29 00:09:32 -07:00
Andrew Gaul 8ebf6ce84e Handle non-empty delete container in azureblob-sdk 
Found via s3-tests.  References #606.
 2024-10-28 16:26:17 -07:00
Andrew Gaul ff8e12e631 Handle missing buckets and keys in azureblob-sdk 
Found via s3-tests.  References #606.
 2024-10-28 15:30:34 -07:00