Minio Trusted
9cdf490bc5
Update yaml files to latest version RELEASE.2023-12-07T04-16-00Z
2023-12-07 06:28:15 +00:00
Shireesh Anjal
7350a29fec
Capture percentage of cpu load and memory used ( #18596 )
...
By default the cpu load is the cumulative of all cores. Capture the
percentage load (load * 100 / cpu-count)
Also capture the percentage memory used (used * 100 / total)
2023-12-06 13:19:59 -08:00
Minio Trusted
e99a597899
Update yaml files to latest version RELEASE.2023-12-06T09-09-22Z
2023-12-06 10:16:37 +00:00
Harshavardhana
73dde66dbe
stick to go1.19 go.mod ( #18600 )
2023-12-06 01:09:22 -08:00
Harshavardhana
e98172d72d
avoid hot-tier SLA to be tied to warm-tier SLA ( #18581 )
...
it is okay if the warm-tier cannot keep up, we should continue
to take I/O at hot-tier, only fail hot-tier or block it when
we are disk full.
Bonus: add metrics counter for these missed tasks, we will
know for sure if one of the node is lagging behind or is
losing too many tasks during transitioning.
2023-12-02 13:02:12 -08:00
Minio Trusted
f2d063e7b9
Update yaml files to latest version RELEASE.2023-12-02T10-51-33Z
2023-12-02 11:14:35 +00:00
jiuker
34187e047d
feat: support elasticsearch notification endpoint compression codec ( #18562 )
2023-11-30 00:25:03 -08:00
Shubhendu
ce62980d4e
Fixed transition rules getting overwritten while healing ( #18542 )
...
While healing the latest changes of expiry rules across sites
if target had pre existing transition rules, they were getting
overwritten as cloned latest expiry rules from remote site were
getting written as is. Fixed the same and added test cases as
well.
Signed-off-by: Shubhendu Ram Tripathi <shubhendu@minio.io>
2023-11-28 10:38:35 -08:00
Harshavardhana
fba883839d
feat: bring new HDD related performance enhancements ( #18239 )
...
Optionally allows customers to enable
- Enable an external cache to catch GET/HEAD responses
- Enable skipping disks that are slow to respond in GET/HEAD
when we have already achieved a quorum
2023-11-22 13:46:17 -08:00
Shubhendu
58306a9d34
Replicate Expiry ILM configs while site replication ( #18130 )
...
Signed-off-by: Shubhendu Ram Tripathi <shubhendu@minio.io>
2023-11-21 09:48:06 -08:00
Harshavardhana
a4cfb5e1ed
return errors if dataDir is missing during HeadObject() ( #18477 )
...
Bonus: allow replication to attempt Deletes/Puts when
the remote returns quorum errors of some kind, this is
to ensure that MinIO can rewrite the namespace with the
latest version that exists on the source.
2023-11-20 21:33:47 -08:00
Minio Trusted
8bedb419a9
Update yaml files to latest version RELEASE.2023-11-20T22-40-07Z
2023-11-21 00:54:16 +00:00
Shubhendu
317b40ef90
Fixed broken docs link ( #18486 )
...
Signed-off-by: Shubhendu Ram Tripathi <shubhendu@minio.io>
2023-11-20 12:04:49 -08:00
Shubhendu
e938ece492
Added guidelines for setting prometheus alerts ( #18479 )
...
Signed-off-by: Shubhendu Ram Tripathi <shubhendu@minio.io>
2023-11-19 10:16:08 -08:00
Shubhendu
e4b619ce1a
Added graph for Erasure Set Tolerance value ( #18472 )
...
Signed-off-by: Shubhendu Ram Tripathi <shubhendu@minio.io>
2023-11-17 10:38:15 -08:00
Minio Trusted
343dd2f491
Update yaml files to latest version RELEASE.2023-11-15T20-43-25Z
2023-11-16 01:32:11 +00:00
Minio Trusted
4598827dcb
Update yaml files to latest version RELEASE.2023-11-11T08-14-41Z
2023-11-11 18:01:27 +00:00
Minio Trusted
0924b34a17
Update yaml files to latest version RELEASE.2023-11-06T22-26-08Z
2023-11-08 08:04:46 +00:00
Harshavardhana
3c2e1a87e2
fix: support dropping privileges with arbitrary users ( #18386 )
...
fixes #18380
2023-11-03 14:18:18 -07:00
vicmunoz
da95a2d13f
fix: object versions metric help ( #18388 )
2023-11-03 11:43:52 -07:00
Minio Trusted
8953f88780
Update yaml files to latest version RELEASE.2023-11-01T18-37-25Z
2023-11-01 21:57:51 +00:00
Minio Trusted
ad44fe8d3e
Update yaml files to latest version RELEASE.2023-11-01T01-57-10Z
2023-11-01 10:39:41 +00:00
Shubhendu
ef67c39910
Added graphs for KMS metrics ( #18321 )
...
Signed-off-by: Shubhendu Ram Tripathi <shubhendu@minio.io>
2023-10-30 03:20:53 -07:00
Minio Trusted
99c1a642a4
Update yaml files to latest version RELEASE.2023-10-25T06-33-25Z
2023-10-25 07:52:49 +00:00
Harshavardhana
c0f2f84285
avoid racy replicationCount checks ( #18311 )
...
resync status may not be upto-date by
the time the resync is over due to how
the timer is triggered.
diff is sufficient to know if replication
happened or not.
2023-10-24 15:30:42 -07:00
Minio Trusted
01b3fb91e5
Update yaml files to latest version RELEASE.2023-10-24T04-42-36Z
2023-10-24 05:05:12 +00:00
Minio Trusted
a0ae1489e5
Update yaml files to latest version RELEASE.2023-10-16T04-13-43Z
2023-10-16 05:58:49 +00:00
Minio Trusted
a2312028b9
Update yaml files to latest version RELEASE.2023-10-14T05-17-22Z
2023-10-14 06:27:13 +00:00
Poorna
78f1f69d57
fix site replication resync status ( #18245 )
...
To persist status changes on disk upon completion.
Adds new tests to handle this functionality.
2023-10-13 22:17:22 -07:00
Harshavardhana
e1e33077e8
fix: tests and resync replication status ( #18244 )
2023-10-13 17:03:34 -07:00
dependabot[bot]
9476d212bc
build(deps): bump golang.org/x/net from 0.14.0 to 0.17.0 in /docs/debugging/s3-verify ( #18218 )
...
build(deps): bump golang.org/x/net in /docs/debugging/s3-verify
Bumps [golang.org/x/net](https://github.com/golang/net ) from 0.14.0 to 0.17.0.
- [Commits](https://github.com/golang/net/compare/v0.14.0...v0.17.0 )
---
updated-dependencies:
- dependency-name: golang.org/x/net
dependency-type: indirect
...
Signed-off-by: dependabot[bot] <support@github.com>
2023-10-12 00:39:12 -07:00
jiuker
000928d34e
fix: should call func globalOSMetrics.time(s)() when updateOSMetrics ( #18209 )
2023-10-12 00:08:13 -07:00
Minio Trusted
efb03e19e6
Update yaml files to latest version RELEASE.2023-10-07T15-07-38Z
2023-10-08 07:09:45 +00:00
Shireesh Anjal
6d20ec3bea
Add support for resource metrics ( #18057 )
...
Add a new endpoint for "resource" metrics `/v2/metrics/resource`
This should return system metrics related to drives, network, CPU and
memory. Except for drives, other metrics should have corresponding "avg"
and "max" values also.
Reuse the real-time feature to capture the required data,
introducing CPU and memory metrics in it.
Collect the data every minute and keep updating the average and max values
accordingly, returning the latest values when the API is called.
2023-09-30 13:40:20 -07:00
Minio Trusted
b3cd893f93
Update yaml files to latest version RELEASE.2023-09-30T07-02-29Z
2023-09-30 07:51:58 +00:00
Minio Trusted
f29522269d
Update yaml files to latest version RELEASE.2023-09-27T15-22-50Z
2023-09-28 17:49:57 +00:00
Minio Trusted
8a672e70a7
Update yaml files to latest version RELEASE.2023-09-23T03-47-50Z
2023-09-25 01:55:31 +00:00
Minio Trusted
6a096e7dc7
Update yaml files to latest version RELEASE.2023-09-20T22-49-55Z
2023-09-21 00:42:16 +00:00
Harshavardhana
9081346c40
fix: more regressions listing policy mappings ( #18060 )
...
also relax ListServiceAccounts() returning error if
no service accounts exist.
2023-09-19 15:23:18 -07:00
Anis Eleuch
c5279ec630
fix: building reorder-disks under darwin ( #18053 )
...
Also build debugging tools only in tests or with a specific target
2023-09-19 03:19:26 -07:00
Harshavardhana
8c4561b8da
add all missing go.mod for debugging tools ( #18049 )
2023-09-18 13:47:03 -07:00
Harshavardhana
fa6d082bfd
reduce all major allocations in replication path ( #18032 )
...
- remove targetClient for passing around via replicationObjectInfo{}
- remove cloing to object info unnecessarily
- remove objectInfo from replicationObjectInfo{} (only require necessary fields)
2023-09-16 02:28:06 -07:00
Minio Trusted
9fab91852a
Update yaml files to latest version RELEASE.2023-09-16T01-01-47Z
2023-09-16 07:38:18 +00:00
Harshavardhana
822cbd4b43
add couple of missing things from #18027
2023-09-13 23:26:48 -07:00
Ravind Kumar
3c19a9308d
DOCS-987: Reorganizing list.md for better RST compatibility ( #18027 )
2023-09-13 23:23:37 -07:00
Anis Eleuch
41de53996b
heal: calculate the number of workers based on NRRequests ( #17945 )
2023-09-11 14:48:54 -07:00
Minio Trusted
fba0924b1d
Update yaml files to latest version RELEASE.2023-09-07T02-05-02Z
2023-09-07 23:10:40 +00:00
Minio Trusted
19f70dbfbf
Update yaml files to latest version RELEASE.2023-09-04T19-57-37Z
2023-09-04 21:20:49 +00:00
Aditya Manthramurthy
1c99fb106c
Update to minio/pkg/v2 ( #17967 )
2023-09-04 12:57:37 -07:00
Minio Trusted
ea93643e6a
Update yaml files to latest version RELEASE.2023-08-31T15-31-16Z
2023-09-01 00:15:57 +00:00
Shubhendu
e47e625f73
Added replication graphs for site replication metrics ( #17951 )
...
This dashboard graphs the metrics when site replication is enabled
across MinIO instances.
Signed-off-by: Shubhendu Ram Tripathi <shubhendu@minio.io>
2023-08-31 08:31:16 -07:00
Shubhendu
0ce9e00ffa
Added node scanner and node drives graphs ( #17949 )
...
Signed-off-by: Shubhendu Ram Tripathi <shubhendu@minio.io>
2023-08-30 14:01:51 -07:00
Shubhendu
c778c381b5
Added new bucket replication graphs ( #17947 )
...
This PR adds new bucket replication graphs for better and granular
monitoring of bucket replication. Also arranged all replication graphs
together.
Signed-off-by: Shubhendu Ram Tripathi <shubhendu@minio.io>
2023-08-30 11:57:41 -07:00
Poorna
b48bbe08b2
Add additional info for replication metrics API ( #17293 )
...
to track the replication transfer rate across different nodes,
number of active workers in use and in-queue stats to get
an idea of the current workload.
This PR also adds replication metrics to the site replication
status API. For site replication, prometheus metrics are
no longer at the bucket level - but at the cluster level.
Add prometheus metric to track credential errors since uptime
2023-08-30 01:00:59 -07:00
Minio Trusted
cce90cb2b7
Update yaml files to latest version RELEASE.2023-08-29T23-07-35Z
2023-08-30 02:17:56 +00:00
Andrea Longo
6f0ed2a091
Add equivalent mc ilm rule commands for some JSON rule examples ( #17923 )
2023-08-26 00:33:25 -07:00
Minio Trusted
a2f0771fd3
Update yaml files to latest version RELEASE.2023-08-23T10-07-06Z
2023-08-23 23:17:59 +00:00
Shubhendu
c3c8441a1d
Corrected the count of buckets and objects graphs ( #17883 )
...
In distributed setup with a load balancer, randmoly any server
would report the metrics `minio_cluster_bucket_total` and
`minio_cluster_usage_object_total` and while graphing it, we should
take max of reported values.
Signed-off-by: Shubhendu Ram Tripathi <shubhendu@minio.io>
2023-08-21 09:04:38 -07:00
Harshavardhana
bc7c0d8624
if object is a delete marker it must skip tags filter in ILM ( #17861 )
2023-08-18 09:36:23 -07:00
Minio Trusted
065fd094d1
Update yaml files to latest version RELEASE.2023-08-16T20-17-30Z
2023-08-16 21:22:41 +00:00
Harshavardhana
8a9b886011
update grafana dashboard with disk -> drive rename ( #17857 )
2023-08-15 16:04:20 -07:00
Harshavardhana
c4ca0a5a57
add two more drive metrics when metrics is available ( #17854 )
2023-08-15 10:55:47 -07:00
Minio Trusted
0e93681589
Update yaml files to latest version RELEASE.2023-08-09T23-30-22Z
2023-08-10 00:09:18 +00:00
Shubhendu
b6b6d6e8d8
Removed replication dashboard ( #17815 )
...
As all replication metrics are moved at bucket level, all replication
graphs as well are added under minio-bucket.json. Removing the independent
replication dashboard.
Signed-off-by: Shubhendu Ram Tripathi <shubhendu@minio.io>
2023-08-08 08:13:45 -07:00
Minio Trusted
3bc34ffd94
Update yaml files to latest version RELEASE.2023-08-04T17-40-21Z
2023-08-04 19:12:46 +00:00
Harshavardhana
cb089dcb52
error out by default beyond 10000 versions per object ( #17803 )
...
```
You've exceeded the limit on the number of versions you can create on this object
```
2023-08-04 10:40:21 -07:00
Poorna
311380f8cb
replication resync: fix queueing ( #17775 )
...
Assign resync of all versions of object to the same worker to avoid locking
contention. Fixes parallel resync implementation in #16707
2023-08-01 11:51:15 -07:00
Harshavardhana
73edd5b8fd
introduce 'mc admin config set alias/ api odirect=on' ( #17753 )
...
change disable_odirect=off -> odirect=on to make it
easier to understand, instead of making it double
negative.
2023-07-31 00:12:53 -07:00
Harshavardhana
114fab4c70
export cluster health as prometheus metrics ( #17741 )
2023-07-28 01:16:53 -07:00
Shubhendu
e1731d9403
Added bucket specific grafana dashboard ( #17727 )
...
Signed-off-by: Shubhendu Ram Tripathi <shubhendu@minio.io>
2023-07-26 15:10:11 -07:00
Harshavardhana
e1094dde08
update MinIO replication dashboard with latest metrics
2023-07-21 17:30:04 -07:00
Minio Trusted
4894c67196
Update yaml files to latest version RELEASE.2023-07-21T21-12-44Z
2023-07-21 22:28:35 +00:00
Doom And Love
d004c45386
grafana-dashboard: Update scrape_jobs variable to be single select ( #17696 )
...
Set `includeAll` and `mult` to be false since this dashboard only works with a single value being selected
2023-07-21 14:12:44 -07:00
Krishnan Parthasarathi
9eeee92d36
Add deletemarker_total metric ( #17689 )
2023-07-20 07:52:32 -07:00
Harshavardhana
c0a5bdaed9
update grafana dashboard JSON with the new metrics ( #17683 )
2023-07-19 08:16:04 -07:00
Harshavardhana
6426b74770
move bucket centric metrics to /minio/v2/metrics/bucket handlers ( #17663 )
...
users/customers do not have a reasonable number of buckets anymore,
this is why we must avoid overpopulating cluster endpoints, instead
move the bucket monitoring to a separate endpoint.
some of it's a breaking change here for a couple of metrics, but
it is imperative that we do it to improve the responsiveness of
our Prometheus cluster endpoint.
Bonus: Added new cluster metrics for usage, objects and histograms
2023-07-18 22:25:12 -07:00
Minio Trusted
73a056999c
Update yaml files to latest version RELEASE.2023-07-18T17-49-40Z
2023-07-18 21:44:57 +00:00
guangwu
f80b6926d3
chore: fix minor issues reported via staticcheck ( #17639 )
2023-07-12 20:33:11 -07:00
Minio Trusted
f6040dffaf
Update yaml files to latest version RELEASE.2023-07-11T21-29-34Z
2023-07-11 23:25:30 +00:00
Harshavardhana
dfd7cca0d2
fix: allow cancel of decom only when its in progress ( #17607 )
2023-07-10 07:55:38 -07:00
Minio Trusted
6335a48a53
Update yaml files to latest version RELEASE.2023-07-07T07-13-57Z
2023-07-07 07:53:18 +00:00
Harshavardhana
8af0773baf
remove deprecated Content-Security-Policy ( #17580 )
...
https://developer.mozilla.org/en-US/docs/Web/HTTP/Headers/Content-Security-Policy/block-all-mixed-content
2023-07-06 09:18:38 -07:00
Minio Trusted
2fcb75d86d
Update yaml files to latest version RELEASE.2023-06-29T05-12-28Z
2023-06-29 06:37:32 +00:00
Harshavardhana
aae6846413
feat: allow expiration of all versions via ILM Expiration action ( #17521 )
...
Following extension allows users to specify immediate purge of
all versions as soon as the latest version of this object has
expired.
```
<LifecycleConfiguration>
<Rule>
<ID>ClassADocRule</ID>
<Filter>
<Prefix>classA/</Prefix>
</Filter>
<Status>Enabled</Status>
<Expiration>
<Days>3650</Days>
<ExpiredObjectAllVersions>true</ExpiredObjectAllVersions>
</Expiration>
</Rule>
...
```
2023-06-28 22:12:28 -07:00
Harshavardhana
1818764840
fix: bug in passing Versioned field set for getHealReplicationInfo() ( #17498 )
...
Bonus: rejects prefix deletes on object-locked buckets earlier
2023-06-27 09:45:50 -07:00
Harshavardhana
2a82c15bf1
update all our deps ( #17497 )
2023-06-26 15:36:56 -07:00
Minio Trusted
fcbed41cc3
Update yaml files to latest version RELEASE.2023-06-23T20-26-00Z
2023-06-24 07:25:49 +00:00
Klaus Post
15daa2e74a
tooling: Add xlmeta --combine switch that will combine inline data ( #17488 )
...
Will combine or write partial data of each version found in the inspect data.
Example:
```
> xl-meta -export -combine inspect-data.1228fb52.zip
(... metadata json...)
}
Attempting to combine version "994f1113-da94-4be1-8551-9dbc54b204bc".
Read shard 1 Data shards 9 Parity 4 (994f1113-da94-4be1-8551-9dbc54b204bc/shard-01-of-13.data)
Read shard 2 Data shards 9 Parity 4 (994f1113-da94-4be1-8551-9dbc54b204bc/shard-02-of-13.data)
Read shard 3 Data shards 9 Parity 4 (994f1113-da94-4be1-8551-9dbc54b204bc/shard-03-of-13.data)
Read shard 4 Data shards 9 Parity 4 (994f1113-da94-4be1-8551-9dbc54b204bc/shard-04-of-13.data)
Read shard 6 Data shards 9 Parity 4 (994f1113-da94-4be1-8551-9dbc54b204bc/shard-06-of-13.data)
Read shard 7 Data shards 9 Parity 4 (994f1113-da94-4be1-8551-9dbc54b204bc/shard-07-of-13.data)
Read shard 8 Data shards 8 Parity 5 (994f1113-da94-4be1-8551-9dbc54b204bc/shard-08-of-13.data)
Read shard 9 Data shards 8 Parity 5 (994f1113-da94-4be1-8551-9dbc54b204bc/shard-09-of-13.data)
Read shard 10 Data shards 8 Parity 5 (994f1113-da94-4be1-8551-9dbc54b204bc/shard-10-of-13.data)
Read shard 11 Data shards 8 Parity 5 (994f1113-da94-4be1-8551-9dbc54b204bc/shard-11-of-13.data)
Read shard 13 Data shards 8 Parity 5 (994f1113-da94-4be1-8551-9dbc54b204bc/shard-13-of-13.data)
Attempting to reconstruct using parity sets:
* Setup: Data shards: 9 - Parity blocks: 6
Have 6 complete remapped data shards and 6 complete parity shards. Could NOT reconstruct: too few shards given
* Setup: Data shards: 8 - Parity blocks: 5
Have 5 complete remapped data shards and 5 complete parity shards. Could reconstruct completely
0 bytes missing. Truncating 0 from the end.
Wrote output to 994f1113-da94-4be1-8551-9dbc54b204bc.complete
```
So far only inline data, but no real reason that external data can't also be included with some handling of blocks.
Supports only unencrypted data.
2023-06-22 12:41:24 -07:00
Harshavardhana
7605d07bb2
add support for bucket level request count per API ( #17468 )
...
New metrics added to calculate API request count
per bucket, per API. Captures errors, including
4xx, 5xx HTTP status codes separately.
2023-06-21 09:41:59 -07:00
Minio Trusted
bbb7ae156c
Update yaml files to latest version RELEASE.2023-06-19T19-52-50Z
2023-06-19 22:53:03 +00:00
Harshavardhana
f9b8d1c699
fix: sio-error test to fail if commands fail ( #17466 )
2023-06-19 12:52:50 -07:00
Minio Trusted
142a5b0dcd
Update yaml files to latest version RELEASE.2023-06-16T02-41-06Z
2023-06-16 05:36:19 +00:00
Anis Eleuch
8c33fdf5f4
s3-check-md5: Add --modified-since flag to skip some objects ( #17410 )
2023-06-15 12:44:09 -07:00
Harshavardhana
ad4e511026
do not save plain-text ETag when encryption is requested ( #17427 )
...
fixes an issue under bucket replication could cause
ETags for replicated SSE-S3 single part PUT objects,
to fail as we would attempt a decryption while listing,
or stat() operation.
2023-06-15 12:43:26 -07:00
Minio Trusted
91987d6f7a
Update yaml files to latest version RELEASE.2023-06-09T07-32-12Z
2023-06-10 05:38:08 +00:00
Anis Eleuch
f9e07d6143
goroutines parser: Add --less flag to filter goroutines ( #17339 )
2023-06-04 14:20:46 -07:00
Minio Trusted
a485b923bf
Update yaml files to latest version RELEASE.2023-06-02T23-17-26Z
2023-06-03 05:07:30 +00:00
Klaus Post
669acbb032
Fix Test LDAP for automatic site replication ( #17305 )
2023-05-29 08:13:58 -07:00
Minio Trusted
086d8f036e
Update yaml files to latest version RELEASE.2023-05-27T05-56-19Z
2023-05-28 06:53:17 +00:00
Anis Eleuch
563f667e30
reorder-disks: Fix UID to UUID and add better error messages ( #17292 )
2023-05-26 15:03:31 -07:00
Aditya Manthramurthy
65cba212e8
Remove older policy attach behavior for LDAP ( #17240 )
2023-05-26 06:31:24 -07:00
Harshavardhana
4a425cbac1
cleanup scripts and apply shfmt ( #17284 )
2023-05-25 22:07:25 -07:00
Harshavardhana
d0a0eb9738
support fan-out objects via PostUpload() ( #17233 )
2023-05-24 22:51:07 -07:00
jiuker
e94e6adf91
fix: return proper error if OIDC Discoverydoc fails to respond ( #17242 )
2023-05-19 02:13:33 -07:00
Minio Trusted
b784e458cb
Update yaml files to latest version RELEASE.2023-05-18T00-05-36Z
2023-05-18 17:56:05 +00:00
Anis Eleuch
07927e032a
Add a script to filter goroutines waiting for a given number of minutes ( #17204 )
2023-05-16 08:05:49 -07:00
Poorna
e07c2ab868
Use hash.NewLimitReader for internal multipart calls ( #17191 )
2023-05-12 11:19:08 -07:00
Harshavardhana
824c55b3a4
fix: few typos and wordings in minio-limits.md
2023-05-05 20:04:52 -07:00
Minio Trusted
2f44dac14f
Update yaml files to latest version RELEASE.2023-05-04T21-44-30Z
2023-05-05 06:21:31 +00:00
Harshavardhana
1d0211d395
allow deletes on directory objects to perform permanent deletes ( #17132 )
2023-05-04 14:43:52 -07:00
Harshavardhana
b53376a3a4
change directory objects to never create new versions ( #17109 )
2023-05-02 16:09:33 -07:00
Minio Trusted
701b89f377
Update yaml files to latest version RELEASE.2023-04-28T18-11-17Z
2023-04-28 18:48:25 +00:00
Anis Eleuch
46d45a6923
grafana: Add TCP dial errors panel ( #17101 )
2023-04-28 11:11:17 -07:00
Anis Eleuch
2448a9e047
grafana: Remove minio_s3_requests_errors_total metric ( #17094 )
2023-04-27 10:55:30 -07:00
Jiffs Maverick
61101d82d9
Rename inodes metric in grafana dashboards ( #17030 )
2023-04-21 11:07:30 -07:00
Minio Trusted
cebb948da2
Update yaml files to latest version RELEASE.2023-04-20T17-56-55Z
2023-04-21 08:00:05 +00:00
Harshavardhana
dd9ed85e22
implement support for FTP/SFTP server ( #16952 )
2023-04-15 07:34:02 -07:00
Minio Trusted
f1ab9df2ee
Update yaml files to latest version RELEASE.2023-04-13T03-08-07Z
2023-04-13 07:28:46 +00:00
Minio Trusted
2c85b84cbc
Update yaml files to latest version RELEASE.2023-04-07T05-28-58Z
2023-04-07 06:07:27 +00:00
Andrea Longo
0499e1c4b0
Remove ~ from Object Lambda curl example ( #16966 )
2023-04-04 12:15:28 -07:00
Allan Roger Reid
27d0d22e5d
docs: Specify correct port in docker-compose README.md ( #16939 )
2023-03-31 12:20:56 -07:00
Minio Trusted
58c129f94a
Update yaml files to latest version RELEASE.2023-03-24T21-41-23Z
2023-03-24 23:03:23 +00:00
Minio Trusted
4bc52897b2
Update yaml files to latest version RELEASE.2023-03-22T06-36-24Z
2023-03-22 21:16:15 +00:00
Harshavardhana
fb1492f531
check for quorum errors for DeleteBucket() ( #16859 )
2023-03-20 23:38:06 -07:00
Minio Trusted
d14ead7bec
Update yaml files to latest version RELEASE.2023-03-20T20-16-18Z
2023-03-21 01:07:32 +00:00
Poorna
d1e775313d
support decommissioning of tiered objects ( #16751 )
2023-03-16 07:48:05 -07:00
Anis Eleuch
a65df1e67b
debug: new tool to reorder local erasure disks ( #16816 )
2023-03-15 13:53:17 -07:00
Minio Trusted
c2f9cc5824
Update yaml files to latest version RELEASE.2023-03-13T19-46-17Z
2023-03-13 22:11:07 +00:00
Minio Trusted
9800760cb3
Update yaml files to latest version RELEASE.2023-03-09T23-16-13Z
2023-03-10 00:59:46 +00:00
Harshavardhana
901887e6bf
feat: add lambda transformation functions target ( #16507 )
2023-03-07 08:12:41 -08:00
Aditya Manthramurthy
47dfa62384
Update LDAP doc for new policy attach|detach cmds ( #16723 )
2023-02-27 21:04:27 -08:00
Minio Trusted
3a3265cf88
Update yaml files to latest version RELEASE.2023-02-27T18-10-45Z
2023-02-28 00:30:32 +00:00
Aditya Manthramurthy
3f81cd1b22
Update OpenID doc with info on redirection params ( #16704 )
2023-02-24 12:13:00 -08:00
Minio Trusted
2bbf380262
Update yaml files to latest version RELEASE.2023-02-22T18-23-45Z
2023-02-22 21:50:11 +00:00
Minio Trusted
7f2c90a0ed
Update yaml files to latest version RELEASE.2023-02-17T17-52-43Z
2023-02-17 19:07:39 +00:00
Minio Trusted
bf749eec61
Update yaml files to latest version RELEASE.2023-02-10T18-48-39Z
2023-02-10 20:55:45 +00:00
k0i
6b41f941b6
fix: README.md in docs/config ( #16564 )
2023-02-10 03:02:11 -08:00
Minio Trusted
1141187bf2
Update yaml files to latest version RELEASE.2023-02-09T05-16-53Z
2023-02-09 06:21:34 +00:00
Harshavardhana
c97f50e274
replication syncs happen in 60sec intervals ( #16571 )
2023-02-08 08:23:26 -08:00
Harshavardhana
14cf8f1b22
upgrade deps for minio/pkg v1.6.1 to include groups conditions ( #16538 )
2023-02-06 09:27:29 -08:00
Harshavardhana
e47a31f9fc
fix: object size distribution in metrics for all objects ( #16539 )
2023-02-04 21:10:10 -08:00
Minio Trusted
a24037bfec
Update yaml files to latest version RELEASE.2023-01-31T02-24-19Z
2023-01-31 07:49:15 +00:00
Jan Zhanal
8fa80874a6
doc: LDAP/AD - nested groups ( #16483 )
2023-01-26 22:17:59 +05:30
Minio Trusted
1bf1fafc86
Update yaml files to latest version RELEASE.2023-01-25T00-19-54Z
2023-01-25 02:09:27 +00:00
Harshavardhana
e64b9f6751
fix: disallow SSE-C encrypted objects on replicated buckets ( #16467 )
2023-01-24 15:46:33 -08:00
Harshavardhana
3683673fb0
add missing gorilla/mux migration, update credits ( #16461 )
2023-01-23 08:46:37 -08:00
Anis Elleuch
e73894fa50
grafana: Show one metric for the total data growth ( #16449 )
2023-01-20 09:39:28 -08:00
Minio Trusted
3fa7218c44
Update yaml files to latest version RELEASE.2023-01-20T02-05-44Z
2023-01-20 08:11:58 +00:00
Minio Trusted
5c1a4ba5f9
Update yaml files to latest version RELEASE.2023-01-18T04-36-38Z
2023-01-18 07:46:44 +00:00
Minio Trusted
d33c527e39
Update yaml files to latest version RELEASE.2023-01-12T02-06-16Z
2023-01-12 07:27:07 +00:00
Minio Trusted
52b88b52f0
Update yaml files to latest version RELEASE.2023-01-06T18-11-18Z
2023-01-08 07:51:31 +00:00
Poorna
b29e159604
docs: Update replication setup commands ( #16361 )
2023-01-04 13:39:37 -08:00
Harshavardhana
b197623ed2
remove unnecessary kernel-tuning docs ( #16354 )
2023-01-04 01:33:40 -08:00
Harshavardhana
14d29b77ae
update replication tests with latest 'mc' ( #16348 )
2023-01-03 22:54:39 -08:00
Minio Trusted
72394a8319
Update yaml files to latest version RELEASE.2023-01-02T09-40-09Z
2023-01-03 10:16:34 +00:00
Anis Elleuch
b8943fdf19
doc: Update prometheus metrics list ( #16329 )
2022-12-29 15:08:22 -08:00
Harshavardhana
2937711390
fix: DeleteObject() API with versionId under replication ( #16325 )
2022-12-28 22:48:33 -08:00
Aditya Manthramurthy
9e6cc847f8
Add HTTP2 config option for policy plugin ( #16225 )
2022-12-13 14:28:48 -08:00
Minio Trusted
76905b7a67
Update yaml files to latest version RELEASE.2022-12-12T19-27-27Z
2022-12-13 01:10:31 +00:00
Aditya Manthramurthy
a469e6768d
Add LDAP DNS SRV record lookup support ( #16201 )
2022-12-12 11:27:27 -08:00
Harshavardhana
b03dd1af17
remove hard limit for number of buckets ( #16194 )
2022-12-08 12:24:03 -08:00
Klaus Post
3eb2d086b2
Replace filepathx with fork ( #16192 )
2022-12-08 10:42:44 -08:00
Minio Trusted
9f71369b67
Update yaml files to latest version RELEASE.2022-12-07T00-56-37Z
2022-12-07 01:30:51 +00:00
Aditya Manthramurthy
a30cfdd88f
Bump up madmin-go to v2 ( #16162 )
2022-12-06 13:46:50 -08:00
Harshavardhana
a9f5b58a01
fix: update the JSON keys for latest 'mc' release ( #16171 )
2022-12-05 10:28:22 -08:00
Minio Trusted
d6351879f3
Update yaml files to latest version RELEASE.2022-12-02T19-19-22Z
2022-12-02 20:15:36 +00:00
Harshavardhana
71133105d7
re-order the top-level config keys for priority ( #16150 )
2022-12-01 07:50:08 -08:00
Minio Trusted
76943ac05e
Update yaml files to latest version RELEASE.2022-11-29T23-40-49Z
2022-11-30 21:13:07 +00:00
Aditya Manthramurthy
87cbd41265
feat: Allow at most one claim based OpenID IDP ( #16145 )
2022-11-29 15:40:49 -08:00
Minio Trusted
53cbc020b9
Update yaml files to latest version RELEASE.2022-11-26T22-43-32Z
2022-11-27 04:08:35 +00:00
Minio Trusted
3661aaf8a1
Update yaml files to latest version RELEASE.2022-11-17T23-20-09Z
2022-11-18 08:51:38 +00:00
Minio Trusted
6dc7109a9f
Update yaml files to latest version RELEASE.2022-11-11T03-44-20Z
2022-11-11 04:57:16 +00:00
Minio Trusted
4fe9cbb973
Update yaml files to latest version RELEASE.2022-11-10T18-20-21Z
2022-11-10 19:36:54 +00:00
yanggang
52769e1e71
remove io/util for advanced golang ( #16011 )
2022-11-08 07:58:02 -08:00
Minio Trusted
808739867c
Update yaml files to latest version RELEASE.2022-11-08T05-27-07Z
2022-11-08 05:59:18 +00:00
Anis Elleuch
7e73fc2870
Implement inspect data API v2 ( #15474 )
...
Co-authored-by: Klaus Post <klauspost@gmail.com>
2022-11-02 13:36:38 -07:00
Minio Trusted
0303cd8625
Update yaml files to latest version RELEASE.2022-10-29T06-21-33Z
2022-10-29 09:29:37 +00:00
Poorna
dc92bb4646
xl-meta: update metadata version ( #15958 )
2022-10-28 02:48:43 -07:00
Harshavardhana
23b329b9df
remove gateway completely ( #15929 )
2022-10-24 17:44:15 -07:00
Minio Trusted
630dabf4b9
Update yaml files to latest version RELEASE.2022-10-24T18-35-07Z
2022-10-24 19:29:30 +00:00
Minio Trusted
c921dc75c7
Update yaml files to latest version RELEASE.2022-10-21T22-37-48Z
2022-10-22 00:04:37 +00:00
Klaus Post
86d543d0f6
Check for s3zip content offset ( #15924 )
2022-10-21 15:37:48 -07:00
Minio Trusted
bd77f1df4c
Update yaml files to latest version RELEASE.2022-10-20T00-55-09Z
2022-10-20 06:38:33 +00:00
Minio Trusted
196fab6834
Update yaml files to latest version RELEASE.2022-10-15T19-57-03Z
2022-10-15 23:20:56 +00:00
Minio Trusted
0c8dd8046a
Update yaml files to latest version RELEASE.2022-10-08T20-11-00Z
2022-10-09 19:44:19 +00:00
Harshavardhana
2a13cc28f2
feat: implement support batch replication ( #15554 )
2022-10-05 23:00:43 -07:00
Minio Trusted
4d761fda81
Update yaml files to latest version RELEASE.2022-10-05T14-58-27Z
2022-10-05 22:50:50 +00:00
Minio Trusted
dc6733dacc
Update yaml files to latest version RELEASE.2022-10-02T19-29-29Z
2022-10-03 02:29:56 +00:00
Daryl White
d44f3526dc
Update links to documentation site ( #15750 )
2022-09-28 21:28:45 -07:00
Minio Trusted
1480340830
Update yaml files to latest version RELEASE.2022-09-25T15-44-53Z
2022-09-26 04:54:15 +00:00
Minio Trusted
334f1ed45a
Update yaml files to latest version RELEASE.2022-09-22T18-57-27Z
2022-09-23 06:01:11 +00:00
Klaus Post
ff12080ff5
Remove deprecated io/ioutil ( #15707 )
2022-09-19 11:05:16 -07:00
Minio Trusted
98874c3baf
Update yaml files to latest version RELEASE.2022-09-17T00-09-45Z
2022-09-17 08:07:32 +00:00
Ashish Kumar Sinha
fb8d512f58
update docs to add cycle in scanner ( #15686 )
2022-09-13 22:46:02 -07:00
Harshavardhana
b579163802
limit number of buckets to 500k ( #15668 )
...
500k is a reasonable limit for any single MinIO
cluster deployment, in future we may increase this
value.
However for now we are going to keep this limit.
2022-09-09 03:06:34 -07:00
Minio Trusted
87f0c8e7e8
Update yaml files to latest version RELEASE.2022-09-07T22-25-02Z
2022-09-08 00:44:12 +00:00
Minio Trusted
240164560f
Update yaml files to latest version RELEASE.2022-09-01T23-53-36Z
2022-09-02 01:52:19 +00:00
Minio Trusted
cd18599e7b
Update yaml files to latest version RELEASE.2022-08-26T19-53-15Z
2022-08-29 00:10:22 +00:00
Minio Trusted
1fd72d5aea
Update yaml files to latest version RELEASE.2022-08-25T07-17-05Z
2022-08-25 07:47:18 +00:00
Anis Elleuch
b737c83a66
Ensure that only one node performs site replication healing ( #15584 )
...
When a node finds a change in the other replication cluster and applies
to itself will already notify other peers. No need for all nodes in a
given cluster to do site replication healing, only one node is
sufficient.
2022-08-24 13:46:09 -07:00
Minio Trusted
2c48f6a02b
Update yaml files to latest version RELEASE.2022-08-22T23-53-06Z
2022-08-23 05:45:31 +00:00
Klaus Frank
a2e037f0ec
doc: certgen typo in parameter name ( #15555 )
...
"-ca" is not a valid parameter remove it.
2022-08-19 10:48:34 -07:00
Harshavardhana
d350b666ff
feat: add idempotent delete marker support ( #15521 )
...
The bottom line is delete markers are a nuisance,
most applications are not version aware and this
has simply complicated the version management.
AWS S3 gave an unnecessary complication overhead
for customers, they need to now manage these
markers by applying ILM settings and clean
them up on a regular basis.
To make matters worse all these delete markers
get replicated as well in a replicated setup,
requiring two ILM settings on each site.
This PR is an attempt to address this inferior
implementation by deviating MinIO towards an
idempotent delete marker implementation i.e
MinIO will never create any more than single
consecutive delete markers.
This significantly reduces operational overhead
by making versioning more useful for real data.
This is an S3 spec deviation for pragmatic reasons.
2022-08-18 16:41:59 -07:00
Minio Trusted
fa9b361a3d
Update yaml files to latest version RELEASE.2022-08-13T21-54-44Z
2022-08-14 05:33:08 +00:00
Minio Trusted
c5b3666089
Update yaml files to latest version RELEASE.2022-08-11T04-37-28Z
2022-08-11 22:36:34 +00:00
Minio Trusted
6a6c772ff2
Update yaml files to latest version RELEASE.2022-08-08T18-34-09Z
2022-08-08 21:30:40 +00:00
Minio Trusted
fcd4b3ba9b
Update yaml files to latest version RELEASE.2022-08-05T23-27-09Z
2022-08-06 00:08:21 +00:00
ebozduman
b57e7321e7
Replaces 'disk'=>'drive' visible to end user ( #15464 )
2022-08-04 16:10:08 -07:00
Minio Trusted
e956369c4e
Update yaml files to latest version RELEASE.2022-08-02T23-59-16Z
2022-08-03 01:45:42 +00:00
Harshavardhana
fd349103e8
fix: allow P-384/P-512 constant time implementation ( #15445 )
...
since go1.18.x P-384/P-512 are now constant time
implementations, enable them.
2022-08-01 09:27:16 -07:00
Minio Trusted
6b4cb35f4f
Update yaml files to latest version RELEASE.2022-07-30T05-21-40Z
2022-07-30 05:50:06 +00:00
Minio Trusted
824d52a82b
Update yaml files to latest version RELEASE.2022-07-29T19-40-48Z
2022-07-29 22:06:57 +00:00
Minio Trusted
067ebab9d8
update object-locking docs and word them appropriately
2022-07-29 12:40:48 -07:00
Harshavardhana
5e763b71dc
use logger.LogOnce to reduce printing disconnection logs ( #15408 )
...
fixes #15334
- re-use net/url parsed value for http.Request{}
- remove gosimple, structcheck and unusued due to https://github.com/golangci/golangci-lint/issues/2649
- unwrapErrs upto leafErr to ensure that we store exactly the correct errors
2022-07-27 09:44:59 -07:00
Minio Trusted
bfc70bc74e
Update yaml files to latest version RELEASE.2022-07-26T00-53-03Z
2022-07-26 06:56:37 +00:00
Poorna
426c902b87
site replication: fix healing of bucket deletes. ( #15377 )
...
This PR changes the handling of bucket deletes for site
replicated setups to hold on to deleted bucket state until
it syncs to all the clusters participating in site replication.
2022-07-25 17:51:32 -07:00
Minio Trusted
e465c3587b
Update yaml files to latest version RELEASE.2022-07-24T17-09-31Z
2022-07-24 17:37:58 +00:00
Minio Trusted
f802d2ba83
Update yaml files to latest version RELEASE.2022-07-24T01-54-52Z
2022-07-24 02:31:24 +00:00
MohammadReza
f4d5c861f3
update grafana dashboard ( #15357 )
2022-07-21 15:17:44 -07:00
Minio Trusted
e7eb94de6b
Update yaml files to latest version RELEASE.2022-07-17T15-43-14Z
2022-07-17 22:06:11 +00:00
Harshavardhana
b6eb8dff64
Add decommission compression+encryption enabled tests ( #15322 )
...
update compression environment variables to follow
the expected sub-system style, however support fallback
mode.
2022-07-17 08:43:14 -07:00
Harshavardhana
7da9e3a6f8
support encrypted/compressed objects properly during decommission ( #15320 )
...
fixes #15314
2022-07-16 19:35:24 -07:00
Minio Trusted
4aecd8d039
Update yaml files to latest version RELEASE.2022-07-15T03-44-22Z
2022-07-15 06:05:11 +00:00
Poorna
7e32a17742
fix: site replication healing of missing buckets ( #15298 )
...
fixes a regression from #15186
- Adding tests to cover healing of buckets.
- Also dereference quota in SiteReplicationStatus only when non-nil
2022-07-14 14:27:47 -07:00
Minio Trusted
688215e787
Update yaml files to latest version RELEASE.2022-07-13T23-29-44Z
2022-07-14 00:11:19 +00:00
daniel-bogusz95
00e235a1ee
fix grammatic errors and minor rewrites ( #15264 )
...
Thank you @djwfyi for the help
2022-07-11 07:59:49 -07:00
Minio Trusted
cf9e3069f2
Update yaml files to latest version RELEASE.2022-07-08T00-05-23Z
2022-07-08 00:44:43 +00:00
Minio Trusted
c1901f4e12
Update yaml files to latest version RELEASE.2022-07-06T20-29-49Z
2022-07-07 00:24:36 +00:00
Harshavardhana
9d80ff5a05
fix: decommission delete markers for non-current objects ( #15225 )
...
versioned buckets were not creating the delete markers
present in the versioned stack of an object, this essentially
would stop decommission to succeed.
This PR fixes creating such delete markers properly during
a decommissioning process, adds tests as well.
2022-07-05 07:37:24 -07:00
Minio Trusted
39b3941892
Update yaml files to latest version RELEASE.2022-07-04T21-02-54Z
2022-07-04 21:51:54 +00:00
Harshavardhana
b311abed31
decom IAM, Bucket metadata properly ( #15220 )
...
Current code incorrectly passed the
config asset object name while decommissioning,
make sure that we pass the right object name
to be hashed on the newer set of pools.
This PR fixes situations after a successful
decommission, the users and policies might go
missing due to wrong hashed set.
2022-07-04 14:02:54 -07:00
Poorna
0ea5c9d8e8
site healing: Skip stale iam asset updates from peer. ( #15203 )
...
Allow healing to apply IAM change only when peer
gave the most recent update.
2022-07-01 13:19:13 -07:00
Minio Trusted
a01a39b153
Update yaml files to latest version RELEASE.2022-06-30T20-58-09Z
2022-07-01 00:44:04 +00:00
Poorna
7cc9286e0f
site healing: Skip stale bucket metadata updates from peer ( #15186 )
...
Allow healing to apply bucket metadata change only when peer
gave the most recent update.
2022-06-28 18:09:20 -07:00
Harshavardhana
9c605ad153
allow support for parity '0', '1' enabling support for 2,3 drive setups ( #15171 )
...
allows for further granular setups
- 2 drives (1 parity, 1 data)
- 3 drives (1 parity, 2 data)
Bonus: allows '0' parity as well.
2022-06-27 20:22:18 -07:00
Minio Trusted
2075501d86
Update yaml files to latest version RELEASE.2022-06-25T15-50-16Z
2022-06-26 16:09:28 +00:00
Anis Elleuch
f3bec41eb9
s3-verify: Add a flag to exclude younger than a certain age ( #15142 )
...
--minimum-object-age 1h can help exclude objects that are newly
uploaded but not replicated yet
2022-06-22 08:12:47 -07:00
Anis Elleuch
95b51c48be
s3-verify: Fix endpoint and missing comparaison ( #15129 )
...
- Fix a typo where target s3 client uses the source endpoint
- Fix a missing necessary comparison: if source name is lexically lower than target name
2022-06-21 05:35:41 -07:00
Minio Trusted
17ab8145b5
Update yaml files to latest version RELEASE.2022-06-20T23-13-45Z
2022-06-21 00:16:07 +00:00
Harshavardhana
e83e947ca3
debug/s3-verify: simplify the tool to use lower memory footprint ( #15110 )
2022-06-20 10:45:35 -07:00
daniel-bogusz95
ce6c23a360
docs: some grammatical, typo fixes
...
includes #15104 , #15105 , #15106 , #15107
2022-06-19 15:35:51 -07:00
Minio Trusted
1e1d9acb1b
Update yaml files to latest version RELEASE.2022-06-17T02-00-35Z
2022-06-17 02:56:57 +00:00
Harshavardhana
8082d1fed6
add bucket level S3 received/sent bytes ( #15084 )
...
adds bucket level metrics for bytes received and sent bytes on all S3 API calls.
2022-06-14 15:14:24 -07:00
Minio Trusted
f34b2ef90b
update dashboard Data Usage Growth as time series
2022-06-13 22:05:36 -07:00
George Costea
ce894665a8
examples: support configuration of a session policy file ( #15078 )
2022-06-13 15:36:58 -07:00
Anis Elleuch
e9efee0e64
debug: Close object after check ( #15077 )
2022-06-13 07:21:04 -07:00
Minio Trusted
4b3e7aee0b
Update yaml files to latest version RELEASE.2022-06-11T19-55-32Z
2022-06-11 21:04:23 +00:00
Harshavardhana
7413045f0e
fix: add missing minio_s3_requests_total ( #15070 )
...
PR #15052 caused a regression, add the missing metrics back.
Bonus:
- internode information should be only for distributed setups
- update the dashboard to include 4xx and 5xx error panels.
2022-06-11 00:50:31 -07:00
Harshavardhana
d76c508566
debug: verify diff on latest objects on source and target buckets ( #15069 )
2022-06-10 16:56:51 -07:00
Minio Trusted
8fb46de5e4
Update yaml files to latest version RELEASE.2022-06-10T16-59-15Z
2022-06-10 20:12:04 +00:00