mirror
/
s3proxy
kopia lustrzana https://github.com/gaul/s3proxy
1
0
Forkuj 0
Kod Zgłoszenia Packages Projekty Wydania Wiki Aktywność
S3Proxy implements the S3 API and proxies requests
24 Commity
9 Gałęzie
28 Tagi
6,2 MiB
Java 99.3%
Shell 0.5%
Dockerfile 0.2%
 
 
 
Go to file
Andrew Gaul 17b3d6c0ba Emit HTTP status code inside handler methods 
Also remove bogus HTTP 500 internal errors which were sent after the
response body.
 		2014-08-01 22:20:26 -07:00
src Emit HTTP status code inside handler methods 2014-08-01 22:20:26 -07:00
.gitignore Initial commit of S3Proxy 2014-07-27 13:32:04 -07:00
LICENSE Initial commit of S3Proxy 2014-07-27 13:32:04 -07:00
README.md Implement AWS Authorization 2014-07-30 00:18:03 -07:00
pom.xml Initial commit of S3Proxy 2014-07-27 13:32:04 -07:00

README.md

S3Proxy

S3Proxy allows applications using the S3 API to interface with a variety of object stores, e.g., EMC Atmos, Microsoft Azure, OpenStack Swift. It runs a local HTTP server which translates S3 operations into provider-specific operations. S3Proxy also allows developers to test against S3 without the cost or latency associated with using AWS by using the local file system.

Features

  • create, remove, list containers
  • put, get, remove, list blobs (up to 2 GB in size)
  • store and retrieve user metadata

Supported object stores:

  • atmos
  • aws-s3
  • azureblob
  • cloudfiles-uk and cloudfiles-us
  • filesystem (on-disk storage)
  • hpcloud-objectstorage
  • s3
  • swift and swift-keystone
  • transient (in-memory storage)

Installation

S3Proxy requires Java 7 to run. Presently there is no binary release but Bintray will host releases in the future.

One can build the project by running mvn package which produces a binary at target/s3proxy.

Examples

Linux and Mac OS users can run S3Proxy either via the executable jar or by explicitly invoking java:

s3proxy --properties s3proxy.conf
java -jar s3proxy --properties s3proxy.conf

Windows users must explicitly invoke java.

Configuration

Users can configure S3Proxy via a properties file. An example:

jclouds.provider=transient
jclouds.identity=identity
jclouds.credential=credential
# endpoint is optional for some providers
#jclouds.endpoint=http://127.0.0.1:8081
jclouds.filesystem.basedir=/tmp/blobstore

s3proxy.endpoint=http://127.0.0.1:8080
# authorization must be aws-v2 or none
s3proxy.authorization=aws-v2
s3proxy.identity=identity
s3proxy.credential=credential

Users can also set a variety of Java and jclouds properties.

Limitations

S3Proxy does not support:

  • single-part uploads larger than 2 GB (upstream issue)
  • multi-part uploads
  • bucket ACLs
  • server-side copy
  • URL signing
  • metadata with filesystem provider (upstream issue)
  • listening on HTTPS

References

jclouds provides object store support for S3Proxy. Ceph s3-tests help maintain and improve compatibility with the S3 API.

License

Copyright (C) 2014 Andrew Gaul

Licensed under the Apache License, Version 2.0