Nitish Tiwari
e91e9e8a38
GCS ListObjectV2 honours continuationToken ( #4608 )
2017-06-29 11:19:55 -07:00
Bala FA
53e7fdc847
create subcomposed objects if total parts are > 32 ( #4593 )
2017-06-27 22:27:05 -07:00
Aditya Manthramurthy
1af331c05c
Remove unnecessary newline at beginning of server output ( #4600 )
2017-06-27 19:46:58 -07:00
ebozduman
0e5b9c7fe4
Adds 'gcs not ready for production' msg ( #4604 )
2017-06-27 19:44:47 -07:00
A. Elleuch
c88dca984d
web: Encode path in presigned GET urls ( #4596 )
...
When the browser asks for a GET presigned url, this latter is not
encoded and can be confusing when the user copies-pastes it somewhere,
especially when the path contains a space.
2017-06-25 18:39:14 -07:00
Harshavardhana
1054f9cbf0
fix: Remove adverb from erasure coded startup message. ( #4594 )
2017-06-25 18:38:55 -07:00
Nitish Tiwari
7bd1f44491
Add support for helm package info in useragent ( #4592 )
2017-06-24 13:17:28 -07:00
A. Elleuch
eaa41e4086
gcs: Check if the given project id argument exists ( #4583 )
...
Using GCS resource manager API, check if the provided
project id is already created and associated to the current
user account.
2017-06-23 22:10:29 -07:00
Krishna Srinivas
6b70f429ed
gateway/azure: Parse error responses for anonymous requests ( #4543 )
...
fixes #4481
2017-06-23 22:07:46 -07:00
Krishna Srinivas
0a6e9a1834
gateway-gcs: cleanup minio.sys.temp before deleting the bucket ( #4582 )
...
fixes #4560
fixes #4569
2017-06-23 17:57:25 -07:00
Nitish Tiwari
15b65a8342
Added AnonListObjectsV2 support to GCS ( #4584 )
2017-06-23 17:35:45 -07:00
Harshavardhana
8b7df7da37
api: No need to set x-amz-bucket-region if region is empty. ( #4586 )
2017-06-23 16:05:40 -07:00
Krishnan Parthasarathi
237c8af5ef
Improve GCS gateway example instruction ( #4587 )
2017-06-23 13:13:26 -07:00
Krishna Srinivas
ff036c171f
gateway-gcs: double quotes should be striped from ETag ( #4590 )
2017-06-23 12:19:10 -07:00
Harshavardhana
a3b085300d
gcs: Add missing AnonListObjectsV2
2017-06-22 12:09:13 -07:00
Harshavardhana
b90cefdb88
Merge remote-tracking branch 'origin/feature-gcs'
2017-06-22 11:52:12 -07:00
Frank Wessels
46897b1100
Name return values to prevent the need (and unnecessary code bloat) ( #4576 )
...
This is done to explicitly instantiate objects for every return statement.
2017-06-21 19:53:09 -07:00
Harshavardhana
cec8b238f3
sign: StreamingSign should use region from client. ( #4577 )
...
This is a fix to make streaming signature to behave
the same as regular signature and presigned signature.
Fixes https://github.com/minio/minio-go/issues/718
2017-06-21 11:30:34 -07:00
Krishna Srinivas
13ab8e17e2
gateway-gcs: use minio.sys.temp/multipart/v1 as url base ( #4562 )
2017-06-21 10:27:44 -07:00
Krishnan Parthasarathi
146bc3e638
Add MINIO_REGION to server help message ( #4558 )
...
* Add e.g for setting MINIO_REGION env variable
* Add MINIO_REGION to region table
2017-06-20 15:02:18 -07:00
Harshavardhana
0543d45fb3
fix: OwnerID in response should be 64 character in length. ( #4554 )
...
Rather than sending a custom "minio" string, we can
change this to `sha256('arn:aws:iam::minio:user/admin')`.
Fixes #4553
2017-06-20 15:01:13 -07:00
Krishnan Parthasarathi
fe426944ea
Fix GCS help message ( #4570 )
2017-06-20 14:25:16 -07:00
Aditya Manthramurthy
c1a6ca0c33
Fix spelling of function name to startLockMaintenance
( #4561 )
2017-06-20 12:10:02 -07:00
Harshavardhana
5a78266821
gateway/gcs: Complete minio browser support for gcs. ( #4552 )
...
Fixes #4460
2017-06-19 19:45:13 -07:00
Krishna Srinivas
3928c1e14c
gateway/gcs: Change in multipart backend format ( #4455 )
2017-06-17 16:00:41 -07:00
Harshavardhana
a86c2e2ce1
xl/fs: Return InvalidPart{} error for part ETag mismatch. ( #4541 )
...
Fixes #4539
2017-06-17 11:20:39 -07:00
Harshavardhana
e99244be02
xl: prepare storage should Abort properly. ( #4542 )
...
Current state-machine didn't honor a situation
which can arise when there is a combination of
- formatted
- unformatted
- corrupted
disks - this combination invariably goes into a
mode where all servers are waiting perpetually
forever thinking we will get quorum in future.
At this point there is a distant possibility of
ever getting a quorum since we don't even have
quorum number of disks offline.
We should exit and print a proper message per disk
to indicate what went wrong and what was detected
by the server.
Refer #4477
2017-06-17 11:20:12 -07:00
Nitish Tiwari
58833711e0
Added ListObjectsV2 and ListObjectsV2 Anon support to Gateway S3 and Azure. ( #4547 )
2017-06-16 22:17:00 -07:00
Harshavardhana
f99f218999
Add support for reading and saving config on Gateway. ( #4463 )
...
This is also a first step towards supporting bucket
notification for gateway.
2017-06-16 16:01:41 -07:00
Krishnan Parthasarathi
4fb5fc72d7
GCS gateway allows apps to supply their own marker ( #4495 )
...
Most s3 compatible apps use object keys returned in listing as
marker. This change allows this behaviour with gateway-gcs too.
2017-06-16 15:02:07 -07:00
Remco Verhoef
d86973dcca
Allow bucket creation in different regions, closes #4287 and #4241
...
* I needed to remove the region check from PutBucketHandler
2017-06-16 15:02:07 -07:00
Krishnan Parthasarathi
8085ba4494
Filter out internal object prefix during listing ( #4435 )
...
We use ZZZZ-Minio/ prefix internally in our GCS gateway which should be
filtered out in the response to ListObjects.
2017-06-16 15:02:07 -07:00
poornas
9bd0eb1a9e
Set default ETag value if vendor returns empty md5 string ( #4409 )
...
The ETag is constructed from md5 atttribute of object attributes
returned by the vendor's Composer. The md5 attribute comes back
as nil for large uploads. Instead the CRC32C should be used.
Refer to https://cloud.google.com/storage/docs/hashes-etags
Fixes #4397
2017-06-16 15:02:07 -07:00
Anis Elleuch
e4e0abfc05
fix: Check project id before starting gateway ( #4412 )
2017-06-16 15:02:07 -07:00
poornas
12b2fc894b
Remove profile option for gcs from gateway help message ( #4421 )
2017-06-16 15:01:34 -07:00
Krishna Srinivas
2aa76e7407
Change md5Sum to etag ( #4399 )
2017-06-16 14:58:49 -07:00
Remco Verhoef
0dab038858
Cleanup and update the PR with the master branch.
2017-06-16 14:55:32 -07:00
Remco Verhoef
a76556ec1b
Map only default region us-east-1 to gcs us region
2017-06-16 14:54:37 -07:00
Harshavardhana
91c7bb65c5
gateway/gcs: send proper error responses for Get/SetBucket policies. ( #4338 )
...
Fixes #4323
2017-06-16 14:54:37 -07:00
Anis Elleuch
5d602034ea
gateway: Use default params when no args provided ( #4315 )
...
For S3 & Azure, use default parameters when no arguments (endpoint) are
provided. This also avoids a crash.
2017-06-16 14:54:37 -07:00
Nitish Tiwari
b829ec4a6b
Fixes https://github.com/minio/minio/issues/4320 ( #4332 )
...
- Add description for error ErrBucketAlreadyExists
2017-06-16 14:54:37 -07:00
Remco Verhoef
9c50a9f567
Fix ListObjectParts to list properly all parts - closes #4322
2017-06-16 14:54:37 -07:00
Remco Verhoef
52122c0309
Fix uploadIDMarker handling.
2017-06-16 14:54:37 -07:00
Remco Verhoef
3b9d313c87
Fix issue with AbortMultipartUpload, closes #4322
2017-06-16 14:54:37 -07:00
Remco Verhoef
bfff251e2a
Fix issue with UNSIGNED payloads.
...
Additionally also fixes escaping slashes in
temporary multipart names
2017-06-16 14:54:37 -07:00
Remco Verhoef
52b500cce9
Verify multipart etag during complete, closes #4288
2017-06-16 14:54:37 -07:00
Remco Verhoef
c63cdca11f
Support iterating through ListObjectParts using NextPartNumberMarker, closes #4284
2017-06-16 14:54:37 -07:00
Remco Verhoef
4430085981
Add region to gcs gateway example
2017-06-16 14:54:37 -07:00
Remco Verhoef
5c78415b31
Verify md5 content hash, closes #4285
2017-06-16 14:54:37 -07:00
Remco Verhoef
bd67117756
Use maxKeys for iterator
2017-06-16 14:54:37 -07:00