Nitish Tiwari
58833711e0
Added ListObjectsV2 and ListObjectsV2 Anon support to Gateway S3 and Azure. ( #4547 )
2017-06-16 22:17:00 -07:00
Harshavardhana
f99f218999
Add support for reading and saving config on Gateway. ( #4463 )
...
This is also a first step towards supporting bucket
notification for gateway.
2017-06-16 16:01:41 -07:00
Krishnan Parthasarathi
4fb5fc72d7
GCS gateway allows apps to supply their own marker ( #4495 )
...
Most s3 compatible apps use object keys returned in listing as
marker. This change allows this behaviour with gateway-gcs too.
2017-06-16 15:02:07 -07:00
Remco Verhoef
d86973dcca
Allow bucket creation in different regions, closes #4287 and #4241
...
* I needed to remove the region check from PutBucketHandler
2017-06-16 15:02:07 -07:00
Krishnan Parthasarathi
8085ba4494
Filter out internal object prefix during listing ( #4435 )
...
We use ZZZZ-Minio/ prefix internally in our GCS gateway which should be
filtered out in the response to ListObjects.
2017-06-16 15:02:07 -07:00
poornas
9bd0eb1a9e
Set default ETag value if vendor returns empty md5 string ( #4409 )
...
The ETag is constructed from md5 atttribute of object attributes
returned by the vendor's Composer. The md5 attribute comes back
as nil for large uploads. Instead the CRC32C should be used.
Refer to https://cloud.google.com/storage/docs/hashes-etags
Fixes #4397
2017-06-16 15:02:07 -07:00
Anis Elleuch
e4e0abfc05
fix: Check project id before starting gateway ( #4412 )
2017-06-16 15:02:07 -07:00
poornas
12b2fc894b
Remove profile option for gcs from gateway help message ( #4421 )
2017-06-16 15:01:34 -07:00
Krishna Srinivas
2aa76e7407
Change md5Sum to etag ( #4399 )
2017-06-16 14:58:49 -07:00
Remco Verhoef
0dab038858
Cleanup and update the PR with the master branch.
2017-06-16 14:55:32 -07:00
Remco Verhoef
a76556ec1b
Map only default region us-east-1 to gcs us region
2017-06-16 14:54:37 -07:00
Harshavardhana
91c7bb65c5
gateway/gcs: send proper error responses for Get/SetBucket policies. ( #4338 )
...
Fixes #4323
2017-06-16 14:54:37 -07:00
Anis Elleuch
5d602034ea
gateway: Use default params when no args provided ( #4315 )
...
For S3 & Azure, use default parameters when no arguments (endpoint) are
provided. This also avoids a crash.
2017-06-16 14:54:37 -07:00
Nitish Tiwari
b829ec4a6b
Fixes https://github.com/minio/minio/issues/4320 ( #4332 )
...
- Add description for error ErrBucketAlreadyExists
2017-06-16 14:54:37 -07:00
Remco Verhoef
9c50a9f567
Fix ListObjectParts to list properly all parts - closes #4322
2017-06-16 14:54:37 -07:00
Remco Verhoef
52122c0309
Fix uploadIDMarker handling.
2017-06-16 14:54:37 -07:00
Remco Verhoef
3b9d313c87
Fix issue with AbortMultipartUpload, closes #4322
2017-06-16 14:54:37 -07:00
Remco Verhoef
bfff251e2a
Fix issue with UNSIGNED payloads.
...
Additionally also fixes escaping slashes in
temporary multipart names
2017-06-16 14:54:37 -07:00
Remco Verhoef
52b500cce9
Verify multipart etag during complete, closes #4288
2017-06-16 14:54:37 -07:00
Remco Verhoef
c63cdca11f
Support iterating through ListObjectParts using NextPartNumberMarker, closes #4284
2017-06-16 14:54:37 -07:00
Remco Verhoef
4430085981
Add region to gcs gateway example
2017-06-16 14:54:37 -07:00
Remco Verhoef
5c78415b31
Verify md5 content hash, closes #4285
2017-06-16 14:54:37 -07:00
Remco Verhoef
bd67117756
Use maxKeys for iterator
2017-06-16 14:54:37 -07:00
Remco Verhoef
f3e5e9fb29
Support marker, closes #4286
2017-06-16 14:54:37 -07:00
Remco Verhoef
2de1921fe8
Use MINIO_REGION environment variable for region configuration, closes #4287
2017-06-16 14:54:37 -07:00
Remco Verhoef
dd7e47f264
Add access and secret key to example, needed to access Minio Gateway
2017-06-16 14:54:37 -07:00
Remco Verhoef
fe9d826bef
Implement bucket policies
2017-06-16 14:53:36 -07:00
Remco Verhoef
6dbc5aba09
Return correct error when PutObject fails
2017-06-16 14:53:36 -07:00
Remco Verhoef
de5374f74c
Map S3 regions to Google (multi)regions
2017-06-16 14:53:36 -07:00
Remco Verhoef
bf55591c64
Make every backend responsible for parsing its own arguments, fixes #4293
2017-06-16 14:53:36 -07:00
Remco Verhoef
2d814e340f
Return BucketAlreadyExists when bucket exists with another user
2017-06-16 14:53:36 -07:00
Remco Verhoef
0a8cf1a6b0
Allow bucket creation in different regions, closes #4287 and #4241
...
* I needed to remove the region check from PutBucketHandler
2017-06-16 14:53:36 -07:00
Remco Verhoef
07949f68d8
Translate gcs errors to S3 compatible errors, fixes #4278
2017-06-16 14:53:36 -07:00
Remco Verhoef
909a89647b
Use default endpoint when not supplied
2017-06-16 14:53:36 -07:00
Remco Verhoef
6508da5fde
Add usage for GCS gateway, closes #4280
2017-06-16 14:53:36 -07:00
Remco Verhoef
3379f005a5
Initial implementation of Google Cloud Storage
2017-06-16 14:47:02 -07:00
Remco Verhoef
4be609eb82
Added AllAccessDisabled error
2017-06-16 14:47:02 -07:00
Remco Verhoef
dd5b975001
Add comment, gateway should validate object name
2017-06-16 14:47:02 -07:00
Remco Verhoef
9ac3538141
Move anonymous error to object translation from Azure specific to gateway
2017-06-16 14:47:02 -07:00
Remco
ace4f9fd15
Implement gateway support Google Cloud Storage
2017-06-16 14:47:02 -07:00
Nitish Tiwari
b283a2c21f
Bump docs references to latest Minio release RELEASE.2017-06-13T19-01-01Z ( #4546 )
2017-06-15 14:20:36 -07:00
Anand Babu (AB) Periasamy
ed37bf3703
Reduce macOS instructions
2017-06-14 23:26:33 -07:00
Rushan
d0f18dc1b5
browser: Use custom input number step-up/down function ( #4524 )
2017-06-14 17:34:11 -07:00
splinter98
8293f546af
Add support for MQTT server as a notification target ( #4474 )
...
This implementation is similar to AMQP notifications:
* Notifications are published on a single topic as a JSON feed
* Topic is configurable, as is the QoS. Uses the paho.mqtt.golang
library for the mqtt connection, and supports connections over tcp
and websockets, with optional secure tls support.
* Additionally the minio server configuration has been bumped up
so mqtt configuration can be added.
* Configuration migration code is added with tests.
MQTT is an ISO standard M2M/IoT messaging protocol and was
originally designed for applications for limited bandwidth
networks. Today it's use is growing in the IoT space.
2017-06-14 17:27:49 -07:00
Anis Elleuch
af8071c86a
xl: Fix rare freeze after many disk/network errors ( #4438 )
...
xl.storageDisks is sometimes passed to some low-level XL functions. Some disks in
xl.storageDisks are set to nil when they encounter some errors. This means all
elements in xl.storageDisks will be nil after some time which lead to an unusable XL.
2017-06-14 17:14:27 -07:00
Daniel Lind
dce76d9307
Fix xl.diskWithAllParts to proper checksum algorithm ( #4509 )
2017-06-14 17:13:02 -07:00
Harshavardhana
11c4223f2c
Add docker release files. ( #4473 )
...
We used to release by building directly on the docker
hub auto build process, which is sufficient for edge
but it is not a good idea to do it for stable releases.
Do not build docker release binaries again, but instead
use the released binaries themselves which are signed
and validated.
2017-06-14 02:08:35 -07:00
Nitish Tiwari
26903da8c2
Add steps to remove Minio volumes in the swarm ( #4536 )
2017-06-13 16:10:11 -07:00
Harshavardhana
353f2d3a6e
fs: Hold format.json
readLock ref to avoid GC. ( #4532 )
...
Looks like if we follow pattern such as
```
_ = rlk
```
Go can potentially kick in GC and close the fd when
the reference is lost, only speculation is that
the cause here is `SetFinalizer` which is set on
`os.close()` internally in `os` stdlib.
This is unexpected and unsual endeavour for Go, but
we have to make sure the reference is never lost
and always dies with the server.
Fixes #4530
2017-06-13 08:29:07 -07:00
Nitish Tiwari
c8947af227
Update Kubernetes-yaml deployment example and Helm deployment doc with Minio image update steps ( #4515 )
2017-06-13 01:37:14 -07:00