a566bcf613
treat 0-byte objects to honor same quorum as delete marker ( #17633 )
...
on unversioned buckets its possible that 0-byte objects
might lose quorum on flaky systems, allow them to be same
as DELETE markers. Since practically speak they have no
content.
2023-07-11 21:53:49 -07:00
f6040dffaf
Update yaml files to latest version RELEASE.2023-07-11T21-29-34Z
2023-07-11 23:25:30 +00:00
9885a0a6af
Fix hasSpaceFor in SNSD setup ( #17630 )
...
If drive is offline or filled we divide by 0.
Fixes #17629
Bonus: Reject when any valid disk exceeds minimum inode threshold.
2023-07-11 14:29:34 -07:00
f64d62b01d
Fix style of logOnceIf calls w/unique identifiers ( #17631 )
2023-07-11 13:17:45 -07:00
82075e8e3a
use strconv variants to improve on performance per 'op' ( #17626 )
...
```
BenchmarkItoa
BenchmarkItoa-8 673628088 1.946 ns/op 0 B/op 0 allocs/op
BenchmarkFormatInt
BenchmarkFormatInt-8 592919769 2.012 ns/op 0 B/op 0 allocs/op
BenchmarkSprint
BenchmarkSprint-8 26149144 49.06 ns/op 2 B/op 1 allocs/op
BenchmarkSprintBool
BenchmarkSprintBool-8 26440180 45.92 ns/op 4 B/op 1 allocs/op
BenchmarkFormatBool
BenchmarkFormatBool-8 1000000000 0.2558 ns/op 0 B/op 0 allocs/op
```
2023-07-11 07:46:58 -07:00
5b7c83341b
move per bucket metrics to peer location ( #17627 )
2023-07-11 07:46:24 -07:00
8522905d97
update helm linting workflow
2023-07-10 20:11:51 -07:00
524ed7ccd0
update go.mod pointing to wrong repo
2023-07-10 20:10:39 -07:00
fb49aead9b
replication: add validation API ( #17520 )
...
To check if replication is set up properly on a bucket.
2023-07-10 20:09:20 -07:00
85f5700e4e
fix: missing audit logger call for some admin APIs ( #17623 )
2023-07-10 16:59:44 -07:00
43b3c093ef
Fix: set request id in trace context properly ( #17622 )
2023-07-10 15:40:44 -07:00
bd6842d917
Further print log messages once per error ( #17618 )
2023-07-10 07:59:57 -07:00
e8c98c3246
Avoid extra GetObjectInfo call in DeleteObject API ( #17599 )
...
Optimize DeleteObject API to avoid extra
GetObjectInfo call on the replicating side.
For receiving side, it is just a regular
DeleteObject call.
Bonus: Fix a corner case where version purged is
absent on target (either due to replication not yet
complete or target version already deleted in a
one-way replication or when replication was disabled).
In such cases, mark version purge complete.
2023-07-10 07:57:56 -07:00
dfd7cca0d2
fix: allow cancel of decom only when its in progress ( #17607 )
2023-07-10 07:55:38 -07:00
af3d99e35f
helm release v5.0.13
...
Signed-off-by: Harshavardhana <harsha@minio.io>
2023-07-09 00:13:05 -07:00
f6186965c3
honor DeleteAllVersions in list(), head() calls ( #17604 )
2023-07-08 15:42:10 -07:00
90c2129f44
Add helm chart linting to CI workflow ( #17606 )
2023-07-08 15:41:12 -07:00
69e131ee69
Fix helm templating syntax in post-job ( #17605 )
2023-07-08 12:18:31 -07:00
28a01f0320
update missing license header in files ( #17603 )
2023-07-08 10:42:05 -07:00
6d0bc5ab1e
prometheus: Fix internode stats ( #17594 )
...
Internode calculation was done inside S3 handlers, fix it by moving it
to internode handlers.
Remove admin stats since it is not used.
2023-07-08 07:35:11 -07:00
7af78af1f0
fix: set request ID in tracing context key ( #17602 )
...
Since `addCustomerHeaders` middleware was after the `httpTracer`
middleware, the request ID was not set in the http tracing context. By
reordering these middleware functions, the request ID header becomes
available. We also avoid setting the tracing context key again in
`newContext`.
Bonus: All middleware functions are renamed with a "Middleware" suffix
to avoid confusion with http Handler functions.
2023-07-08 07:31:42 -07:00
45a717a142
Avoid per request URL parsing ( #17593 )
...
Every request does a `url.Parse(c.url.String())` to clone a URL.
The host will also be static, so we rewrite that on creation.
2023-07-07 22:07:30 -07:00
cb1ec0a0d9
fix: helm templating syntax in post-job ( #17600 )
2023-07-07 22:06:40 -07:00
abb1f22057
Revert "change ttfb_distribution metrics to histogramMetric ( #17115 )"
...
This reverts commit 9112ca4e29
2023-07-07 13:57:37 -07:00
73efe436a5
update helm v5.0.12
...
Signed-off-by: Harshavardhana <harsha@minio.io>
2023-07-07 09:44:16 -07:00
f41edb23e2
add variadic delays in peer notification retries ( #17592 )
...
just adds more `jitter` in our retries to avoid
burst flooding for peer calls.
2023-07-07 07:47:38 -07:00
6335a48a53
Update yaml files to latest version RELEASE.2023-07-07T07-13-57Z
2023-07-07 07:53:18 +00:00
e20aab25ec
Check for progress before we reach the limit ( #17552 )
2023-07-07 00:13:57 -07:00
66bea3942a
CI/CD to stop one node per pool in the two pools mint test ( #17518 )
...
This is to make sure that all S3 ops work when there is enough quorum
2023-07-07 00:10:13 -07:00
08acd9c43d
update all our deps ( #17590 )
2023-07-06 21:47:46 -07:00
ff5988f4e0
Reduce allocations ( #17584 )
...
* Reduce allocations
* Add stringsHasPrefixFold which can compare string prefixes, while ignoring case and not allocating.
* Reuse all msgp.Readers
* Reuse metadata buffers when not reading data.
* Make type safe. Make buffer 4K instead of 8.
* Unslice
2023-07-06 16:02:08 -07:00
1bf23374a3
do not need to gzip 'mc' in our container ( #17586 )
...
fixes #17581
2023-07-06 15:13:17 -07:00
899b429094
Update Console to v0.32.0 ( #17587 )
...
Signed-off-by: Benjamin Perez <benjamin@bexsoft.net>
2023-07-06 15:13:07 -07:00
c47ff44f5e
fix: disable site network test if site replication is disabled ( #17579 )
2023-07-06 09:19:14 -07:00
8af0773baf
remove deprecated Content-Security-Policy ( #17580 )
...
https://developer.mozilla.org/en-US/docs/Web/HTTP/Headers/Content-Security-Policy/block-all-mixed-content
2023-07-06 09:18:38 -07:00
37cbd114de
Updated console to v0.31.0 ( #17578 )
2023-07-06 00:37:56 -07:00
2dbb1cff4a
feat: support perf site replication ( #17477 )
2023-07-05 22:28:26 -07:00
6efcf9c982
Do lockless last minute latency metrics ( #17576 )
...
Collect metrics in one second and accumulate lockless before sending upstream.
2023-07-05 10:40:45 -07:00
0bc34952eb
fix: under FanOut API avoid repeated md5sum calculation ( #17572 )
...
md5sum calculation has a high CPU overhead, avoid calculating
it repeatedly for similar fanOut calls.
To fix following CPU profiler result
```
(pprof) top10
Showing nodes accounting for 678.68s, 84.67% of 801.54s total
Dropped 1072 nodes (cum <= 4.01s)
Showing top 10 nodes out of 156
flat flat% sum% cum cum%
332.54s 41.49% 41.49% 332.54s 41.49% runtime/internal/syscall.Syscall6
228.39s 28.49% 69.98% 228.39s 28.49% crypto/md5.block
48.07s 6.00% 75.98% 48.07s 6.00% runtime.memmove
28.91s 3.61% 79.59% 28.91s 3.61% github.com/minio/highwayhash.updateAVX2
8.25s 1.03% 80.61% 8.25s 1.03% runtime.futex
8.25s 1.03% 81.64% 10.81s 1.35% runtime.step
6.99s 0.87% 82.52% 22.35s 2.79% runtime.pcvalue
6.67s 0.83% 83.35% 38.90s 4.85% runtime.mallocgc
5.77s 0.72% 84.07% 32.61s 4.07% runtime.gentraceback
4.84s 0.6% 84.67% 10.49s 1.31% runtime.lock2
```
2023-07-05 03:16:05 -07:00
f6b48ed02a
fix: create user without policy that is required ( #17554 )
...
fixes #17492
2023-07-04 07:39:29 -07:00
e37c4efc6e
fix: upon DNS refresh() failure use previous values ( #17561 )
...
DNS refresh() in-case of MinIO can safely re-use
the previous values on bare-metal setups, since
bare-metal arrangements do not change DNS in any
manner commonly.
This PR simplifies that, we only ever need DNS caching
on bare-metal setups.
- On containerized setups do not enable DNS
caching at all, as it may have adverse effects on
the overall effectiveness of k8s DNS systems.
k8s DNS systems are dynamic and expect applications
to avoid managing DNS caching themselves, instead
provide a cleaner container native caching
implementations that must be used.
- update IsDocker() detection, including podman runtime
- move to minio/dnscache fork for a simpler package
2023-07-03 12:30:51 -07:00
22f5bc643c
fix: honor older scanner settings only if newer has not changed ( #17564 )
2023-07-03 12:28:36 -07:00
15fd5ce2fa
fix: A typo in per pool make/delete bucket errs calculation ( #17553 )
2023-07-03 09:47:40 -07:00
7f782983ca
fix: for FTP server driver allow implicit trust of TLS ( #17541 )
...
fixes #17535
2023-06-30 08:04:13 -07:00
9d628346eb
fix: service account list for root user ( #17547 )
...
Fixes https://github.com/minio/minio/issues/17545
2023-06-30 08:02:12 -07:00
bde533a9c7
fix: OpenID config initialization ( #17544 )
...
This is due to a regression in the handling of the enable key in OpenID
configuration.
2023-06-29 23:38:26 -07:00
2fcb75d86d
Update yaml files to latest version RELEASE.2023-06-29T05-12-28Z
2023-06-29 06:37:32 +00:00
aae6846413
feat: allow expiration of all versions via ILM Expiration action ( #17521 )
...
Following extension allows users to specify immediate purge of
all versions as soon as the latest version of this object has
expired.
```
<LifecycleConfiguration>
<Rule>
<ID>ClassADocRule</ID>
<Filter>
<Prefix>classA/</Prefix>
</Filter>
<Status>Enabled</Status>
<Expiration>
<Days>3650</Days>
<ExpiredObjectAllVersions>true</ExpiredObjectAllVersions>
</Expiration>
</Rule>
...
```
2023-06-28 22:12:28 -07:00
5317a0b755
fix: support LDAP settings properly in ftp/sftp ( #17536 )
...
Bonus this PR enhances and supports creating
buckets via ftp `mkdir`
fixes #17526
2023-06-28 13:15:21 -07:00
73de721a63
fix: handle copyObjectPart encryption properly ( #17530 )
...
- look for requested encryption while compressing
not just via HTTP Headers, but also via multipart
metadata
- look for SSE-S3 etag decryption not just via HTTP
Headers, but also via multipart metadata
fixes #17519
2023-06-28 09:43:50 -07:00
Harshavardhana
Minio Trusted
Klaus Post
Kaan Kabalak
Poorna
Aditya Manthramurthy
Ian Martin
yaohwu
Anis Eleuch
Ian Martin
Alex
jiuker