MyFavMirrors/minio
1
0
Fork 0
mirror of https://github.com/minio/minio.git synced 2024-12-25 22:55:54 -05:00
Code Issues Packages Projects Releases Wiki Activity
4,479 Commits 4 Branches 506 Tags 189 MiB
45463b1d6b
Commit Graph

38 Commits

Author SHA1 Message Date
Harshavardhana
099b5293a9 Move gateway unsupported functions into a common struct. (#5009) 
This is done to avoid repeated declaration of not-implemented
functions for each gateway. It also avoids a possible bug in go
https://github.com/golang/go/issues/18468 which is triggered on
our multiple PRs already.
 2017-10-09 16:41:35 -07:00
Bala FA
88938340b3 remove all dead codes (#5019) 
Fixes #5012
 2017-10-05 12:25:45 -07:00
Bala FA
60cc6184d2 azure: handle list objects properly (#4953) 
When removing `minio.sys.tmp` prefixed entries and objects/prefixes is
empty, populate till we get all valid entries.
 2017-09-29 12:08:23 -07:00
Aditya Manthramurthy
b5dc4b5873 Fix CopyObject with metadata for GCS Gateway (#4971) 2017-09-26 11:04:42 -07:00
Bala FA
70fec0a53f azure: add stateless gateway support (#4874) 
Previously init multipart upload stores metadata of an object which is
used for complete multipart.  This patch makes azure gateway to store
metadata information of init multipart object in azure in the name of
'minio.sys.tmp/multipart/v1/<UPLOAD-ID>/meta.json' and uses this
information on complete multipart.
 2017-09-19 16:08:08 -07:00
Andreas Auernhammer
79ba4d3f33 refactor ObjectLayer PutObject and PutObjectPart (#4925) 
This change refactor the ObjectLayer PutObject and PutObjectPart
functions. Instead of passing an io.Reader and a size to PUT operations
ObejectLayer expects an HashReader.
A HashReader verifies the MD5 sum (and SHA256 sum if required) of the object.
This change updates all all PutObject(Part) calls and removes unnecessary code
in all ObjectLayer implementations.

Fixes #4923
 2017-09-19 12:40:27 -07:00
Andreas Auernhammer
b10fa507b2 set http transport config for gateway (#4765) 
This change sets the http config for the minio client used by the
minio server in gateway mode.

Fixes #4765
 2017-08-08 16:23:52 -07:00
Krishna Srinivas
eb787d8613 gateway-gcs: remove files older than 2 weeks in minio.sys.temp (#4599). 
Rename ##minio## to {minio}.
 2017-07-20 15:36:48 -07:00
Harshavardhana
bc73a1a1cb gcs: Save partNumber as part of backend format. (#4666) 
Fixes #4637
 2017-07-13 23:20:16 -07:00
Harshavardhana
ce7af3aae1 gcs: Fix writer/reader go-routine leaks and code re-use (#4651) 
This PR serves to fix following things in GCS gateway.

- fixes leaks in object reader and writer, not getting closed
  under certain situations. This led to go-routine leaks.

- apparent confusing issue in case of complete multipart upload,
  where it is currently possible for an entirely different
  object name to concatenate parts of a different object name
  if you happen to know the upload-id and parts of the object.
  This is a very rare scenario but it is possible.

- succint usage of certain parts of code base and re-use.
 2017-07-11 09:25:19 -07:00
Nitish Tiwari
e91e9e8a38 GCS ListObjectV2 honours continuationToken (#4608) 2017-06-29 11:19:55 -07:00
Bala FA
53e7fdc847 create subcomposed objects if total parts are > 32 (#4593) 2017-06-27 22:27:05 -07:00
A. Elleuch
eaa41e4086 gcs: Check if the given project id argument exists (#4583) 
Using GCS resource manager API, check if the provided
project id is already created and associated to the current
user account.
 2017-06-23 22:10:29 -07:00
Krishna Srinivas
0a6e9a1834 gateway-gcs: cleanup minio.sys.temp before deleting the bucket (#4582) 
fixes #4560
fixes #4569
 2017-06-23 17:57:25 -07:00
Nitish Tiwari
15b65a8342 Added AnonListObjectsV2 support to GCS (#4584) 2017-06-23 17:35:45 -07:00
Krishna Srinivas
13ab8e17e2 gateway-gcs: use minio.sys.temp/multipart/v1 as url base (#4562) 2017-06-21 10:27:44 -07:00
Krishna Srinivas
3928c1e14c gateway/gcs: Change in multipart backend format (#4455) 2017-06-17 16:00:41 -07:00
Harshavardhana
f99f218999 Add support for reading and saving config on Gateway. (#4463) 
This is also a first step towards supporting bucket
notification for gateway.
 2017-06-16 16:01:41 -07:00
Krishnan Parthasarathi
4fb5fc72d7 GCS gateway allows apps to supply their own marker (#4495) 
Most s3 compatible apps use object keys returned in listing as
marker. This change allows this behaviour with gateway-gcs too.
 2017-06-16 15:02:07 -07:00
Remco Verhoef
d86973dcca Allow bucket creation in different regions, closes #4287 and #4241 
* I needed to remove the region check from PutBucketHandler
 2017-06-16 15:02:07 -07:00
Krishnan Parthasarathi
8085ba4494 Filter out internal object prefix during listing (#4435) 
We use ZZZZ-Minio/ prefix internally in our GCS gateway which should be
filtered out in the response to ListObjects.
 2017-06-16 15:02:07 -07:00
poornas
9bd0eb1a9e Set default ETag value if vendor returns empty md5 string (#4409) 
The ETag is constructed from md5 atttribute of object attributes
returned by the vendor's Composer. The md5 attribute comes back
as nil for large uploads. Instead the CRC32C should be used.

Refer to https://cloud.google.com/storage/docs/hashes-etags

Fixes #4397
 2017-06-16 15:02:07 -07:00
Anis Elleuch
e4e0abfc05 fix: Check project id before starting gateway (#4412) 2017-06-16 15:02:07 -07:00
Krishna Srinivas
2aa76e7407 Change md5Sum to etag (#4399) 2017-06-16 14:58:49 -07:00
Remco Verhoef
0dab038858 Cleanup and update the PR with the master branch. 2017-06-16 14:55:32 -07:00
Remco Verhoef
a76556ec1b Map only default region us-east-1 to gcs us region 2017-06-16 14:54:37 -07:00
Harshavardhana
91c7bb65c5 gateway/gcs: send proper error responses for Get/SetBucket policies. (#4338) 
Fixes #4323
 2017-06-16 14:54:37 -07:00
Anis Elleuch
5d602034ea gateway: Use default params when no args provided (#4315) 
For S3 & Azure, use default parameters when no arguments (endpoint) are
provided. This also avoids a crash.
 2017-06-16 14:54:37 -07:00
Remco Verhoef
9c50a9f567 Fix ListObjectParts to list properly all parts - closes #4322 2017-06-16 14:54:37 -07:00
Remco Verhoef
52122c0309 Fix uploadIDMarker handling. 2017-06-16 14:54:37 -07:00
Remco Verhoef
3b9d313c87 Fix issue with AbortMultipartUpload, closes #4322 2017-06-16 14:54:37 -07:00
Remco Verhoef
bfff251e2a Fix issue with UNSIGNED payloads. 
Additionally also fixes escaping slashes in
temporary multipart names
 2017-06-16 14:54:37 -07:00
Remco Verhoef
52b500cce9 Verify multipart etag during complete, closes #4288 2017-06-16 14:54:37 -07:00
Remco Verhoef
c63cdca11f Support iterating through ListObjectParts using NextPartNumberMarker, closes #4284 2017-06-16 14:54:37 -07:00
Remco Verhoef
4430085981 Add region to gcs gateway example 2017-06-16 14:54:37 -07:00
Remco Verhoef
5c78415b31 Verify md5 content hash, closes #4285 2017-06-16 14:54:37 -07:00
Remco Verhoef
bd67117756 Use maxKeys for iterator 2017-06-16 14:54:37 -07:00
Remco Verhoef
f3e5e9fb29 Support marker, closes #4286 2017-06-16 14:54:37 -07:00