8ceb2a93fd
fix: peer replication bandwidth monitoring in distributed setup ( #10652 )
2020-10-12 09:04:55 -07:00
c2f16ee846
Add basic bandwidth monitoring for replication. ( #10501 )
...
This change tracks bandwidth for a bucket and object
- [x] Add Admin API
- [x] Add Peer API
- [x] Add BW throttling
- [x] Admin APIs to set replication limit
- [x] Admin APIs for fetch bandwidth
2020-10-09 20:36:00 -07:00
a0d0645128
remove safeMode behavior in startup ( #10645 )
...
In almost all scenarios MinIO now is
mostly ready for all sub-systems
independently, safe-mode is not useful
anymore and do not serve its original
intended purpose.
allow server to be fully functional
even with config partially configured,
this is to cater for availability of actual
I/O v/s manually fixing the server.
In k8s like environments it will never make
sense to take pod into safe-mode state,
because there is no real access to perform
any remote operation on them.
2020-10-09 09:59:52 -07:00
907a171edd
Generalize error messages for remote targets ( #10638 )
...
This is to allow remote targets to be generalized
for replication/ILM transition
Also adding a field in BucketTarget to identify
a remote target with a label.
2020-10-08 10:54:11 -07:00
effe131090
fix: allow read unlocks to be defensive about split brains ( #10637 )
2020-10-07 09:15:01 -07:00
dbbed6f7f0
update minio-go dependency ( #10634 )
2020-10-06 08:37:09 -07:00
7fbfdceba3
Fix replication slowness ( #10632 )
...
- Increase channel buffer length
- Avoid blocking wait on replicaCh
2020-10-05 14:45:42 -07:00
e6ab4db6b8
Fix minimum replication workers started ( #10560 )
...
This PR also fixes GetReplicationConfiguration permission
in web-handlers.go to use bucket as resource
2020-09-24 12:25:41 -07:00
4c54ed8748
Close replica channel only once ( #10542 )
...
Also enforce s3:GetReplicationConfiguration permission check as a
bucket level resource.
2020-09-22 12:47:24 -07:00
17e17da00d
add parallel workers to perform replication in parallel ( #10525 )
...
set the concurrency for replication be to runtime.NumCPU()/2
2020-09-21 13:43:29 -07:00
d616d8a857
serialize replication and feed it through task model ( #10500 )
...
this allows for eventually controlling the concurrency
of replication and overally control of throughput
2020-09-16 16:04:55 -07:00
02c1a08a5b
fix: make sure to lock CopyObject for in-place updates ( #10492 )
2020-09-15 20:44:48 -07:00
79e21601b0
fix: web handlers to enforce replication ( #10249 )
...
This PR also preserves source ETag for replication
2020-08-12 17:32:24 -07:00
adcaa6f9de
fix: Change ListBucketTargets handler ( #10217 )
...
to list all targets across a tenant.
Also fixing some validations.
2020-08-06 17:10:21 -07:00
121164db56
fix: relax some replication validations ( #10210 )
...
Also inherit storage class from source object
if replication configuration does not have a storage
class specified for destination bucket.
2020-08-05 20:01:20 -07:00
88daaef76b
Validate object lock when setting replication config. ( #10200 )
...
Check if object lock is enabled on
destination bucket while setting replication
configuration on a object lock enabled bucket.
2020-08-04 23:02:27 -07:00
a8dd7b3eda
Refactor replication target management. ( #10154 )
...
Generalize replication target management so
that remote targets for a bucket can be
managed with ARNs. `mc admin bucket remote`
command will be used to manage targets.
2020-07-30 19:55:22 -07:00
b46ab7e921
Rename replication target handler ( #10142 )
...
Rename replication target handler to a generic bucket target handler
2020-07-28 11:50:47 -07:00
b9be841fd2
Add missing validation for replication API conditions ( #10114 )
2020-07-22 17:39:40 -07:00
c43da3005a
Add support for server side bucket replication ( #9882 )
2020-07-21 17:49:56 -07:00
Ritesh H Shukla
Harshavardhana
Poorna Krishnamoorthy