3faef829c5
expect full quorum for writing 'format.json' everywhere ( #15362 )
2022-07-21 18:04:17 -07:00
7560fb6f9a
save IAM export assets relative at a folder prefix ( #15355 )
2022-07-21 17:51:33 -07:00
2fddcc6a11
upgrade mqtt library to v1.4.1 ( #15366 )
...
mainly to address some connect()/reconnect() packet
exhaustion issues, that were found in some deployments.
2022-07-21 17:49:28 -07:00
69bf39f42e
fix: make complete multipart uploads faster encrypted/compressed backends ( #15375 )
...
- Only fetch the parts we need and abort as soon as one is missing.
- Only fetch the number of parts requested by "ListObjectParts".
2022-07-21 16:47:58 -07:00
f4d5c861f3
update grafana dashboard ( #15357 )
2022-07-21 15:17:44 -07:00
564a0afae1
Revert "tests: Add context cancelation ( #15374 )"
...
This reverts commit 1e332f0eb1
2022-07-21 13:58:56 -07:00
1e332f0eb1
tests: Add context cancelation ( #15374 )
...
A huge number of goroutines would build up from various monitors
When creating test filesystems provide a context so they can shut down when no longer needed.
2022-07-21 11:52:18 -07:00
cab8d3d568
feat: add API to return list of objects waiting to be replicated ( #15091 )
2022-07-21 11:05:44 -07:00
be8c4cb24a
fix: support multiple validateAdminReq actions ( #15372 )
...
handle multiple validateAdminReq actions and remove duplicate error responses.
2022-07-21 10:26:59 -07:00
65166e4ce4
fix: readQuorum calculation when defaultParityCount is 0 ( #15363 )
...
when parity is '0' the readQuorum must be equal
to the number of data disks.
2022-07-21 07:25:54 -07:00
8249cd4406
fix: allow payload verification error to be returned ( #15364 )
...
without reading the reader the error is ignored
by the custom unmarshaller written by ObjectLegalHold
data structure.
2022-07-21 01:24:03 -07:00
c6ecaf68ed
update CREDITS with latest dependencies
2022-07-21 00:49:38 -07:00
d3f89fa6e3
remove unnecessary logs in IAM store ( #15356 )
2022-07-20 08:19:12 -07:00
ce8397f7d9
use partInfo only for intermediate part.x.meta ( #15353 )
2022-07-19 18:56:24 -07:00
cae9aeca00
fix: reused field crash in PartIndices ( #15351 )
...
`PartIndices` may be set if xlMetaV2Version is reused.
Clear before unmarshaling and add sanity check when reading.
2022-07-19 16:49:46 -07:00
f939d1c183
Independent Multipart Uploads ( #15346 )
...
Do completely independent multipart uploads.
In distributed mode, a lock was held to merge each multipart
upload as it was added. This lock was highly contested and
retries are expensive (timewise) in distributed mode.
Instead, each part adds its metadata information uniquely.
This eliminates the per object lock required for each to merge.
The metadata is read back and merged by "CompleteMultipartUpload"
without locks when constructing final object.
Co-authored-by: Harshavardhana <harsha@minio.io>
2022-07-19 08:35:29 -07:00
242d06274a
kms: add `context.Context` to KMS API calls ( #15327 )
...
This commit adds a `context.Context` to the
the KMS `{Stat, CreateKey, GenerateKey}` API
calls.
The context will be used to terminate external calls
as soon as the client requests gets canceled.
A follow-up PR will add a `context.Context` to
the remaining `DecryptKey` API call.
Signed-off-by: Andreas Auernhammer <hi@aead.dev>
2022-07-18 18:54:27 -07:00
957e3ed729
export IAM: include site replicator svcacct ( #15339 )
2022-07-18 17:38:53 -07:00
ed02ee4ef4
fix: issue when a Helm create user job returns more than once ( #15321 )
2022-07-18 12:09:44 -07:00
ba9691a0ad
Console v0.19.1 ( #15338 )
...
Signed-off-by: Daniel Valdivia <18384552+dvaldivia@users.noreply.github.com>
2022-07-18 11:45:20 -07:00
e7eb94de6b
Update yaml files to latest version RELEASE.2022-07-17T15-43-14Z
2022-07-17 22:06:11 +00:00
b6eb8dff64
Add decommission compression+encryption enabled tests ( #15322 )
...
update compression environment variables to follow
the expected sub-system style, however support fallback
mode.
2022-07-17 08:43:14 -07:00
7da9e3a6f8
support encrypted/compressed objects properly during decommission ( #15320 )
...
fixes #15314
2022-07-16 19:35:24 -07:00
876970baea
Exclude upload-ids with incomplete part upload in multipart listing ( #15318 )
...
Uploading a part object can leave an inconsistent state inside
.minio.sys/multipart where data are uploaded but xl.meta is not
committed yet.
Do not list upload-ids that have this state in the multipart listing.
2022-07-16 13:25:58 -07:00
e68e76e143
fix: data race, which caused tests execution to fail ( #15313 )
2022-07-16 07:57:55 -07:00
2bc7ca2d34
helm: add annotations for ServiceMonitor ( #15020 )
2022-07-16 01:04:27 -07:00
e94eb9af10
update helm v4.0.5
...
Signed-off-by: Minio Trusted <trusted@minio.io>
2022-07-15 23:42:56 -07:00
3018b21ab8
fix: failure to createUser used by make-user-job helm chart ( #15293 )
2022-07-15 23:22:21 -07:00
0b605c3383
Allow topologySpreadConstraints configuration ( #14684 )
...
The default replica value is 16 (right now) which can lead to massive
resource consumption on one node in smaller clusters. The idea for this
addition is to allow users to specify how the pods (replicas) are being
spread across the cluster. It gives more control over this Helm Release
in smaller clusters where most worker nodes have taints.
As this Kubernetes feature exists since Kubernetes 1.19 and is only
useful for a replica count > 1, this was taken into account.
2022-07-15 21:05:38 -07:00
e7ac1ea54c
allow decommission to continue when healing ( #15312 )
...
Bonus:
- heal buckets in-case during startup the new
pools have bucket missing.
2022-07-15 21:03:23 -07:00
5ac6d91525
support 'admin update' for hotfix versions ( #15308 )
...
hotfixed versions are rejected as invalid,
allow `mc admin update` from hotfix repos.
2022-07-15 16:00:34 -07:00
1cd6713e24
copy query values before update to preserve the expected keys ( #15310 )
...
in success_action_redirect we were missing required
query params as per S3 spec - updated tests.
2022-07-15 15:04:48 -07:00
785b429737
add reconnect duration allows for verifying disconnect intervals ( #15306 )
2022-07-15 14:41:24 -07:00
4aecd8d039
Update yaml files to latest version RELEASE.2022-07-15T03-44-22Z
2022-07-15 06:05:11 +00:00
1b339ea062
allow force delete on decom pool ( #15302 )
...
Bonus:
- skip suspended pool from being
considered for multipart uploads
- add more context for decomErrors()
2022-07-14 20:44:22 -07:00
236ef03dbd
fix: skip objects expired via lifecycle rules during decommission ( #15300 )
2022-07-14 16:47:09 -07:00
53cc561048
Default DeleteReplication rule status if unspecified. ( #15301 )
...
Since this is a MinIO specific extension in the replication config,
default this to Disabled to allow other sdks to be used to configure
replication rules.
Co-authored-by: Poorna Krishnamoorthy <poorna@minio.io>
2022-07-14 16:27:09 -07:00
bb4b143f3b
helm: Add missing TLS config for service monitor ( #15228 )
2022-07-14 14:29:08 -07:00
3af41cd37d
helm: enable using different ports for minioAPIPort and minioConsolePort ( #15259 )
2022-07-14 14:28:34 -07:00
7e32a17742
fix: site replication healing of missing buckets ( #15298 )
...
fixes a regression from #15186
- Adding tests to cover healing of buckets.
- Also dereference quota in SiteReplicationStatus only when non-nil
2022-07-14 14:27:47 -07:00
6c265534a4
Updating minio-go to fix channel close bug ( #15297 )
2022-07-14 14:26:48 -07:00
1d42133d44
listing: Expire object versions past expiry ( #15287 )
...
We skip object versions which are past their ILM expiry. This change schedules
them for expiry while at it.
2022-07-14 07:21:26 -07:00
df911c9b9e
correct `RefreshCall` & `UnlockCall` of `DefaultTimeouts` ( #15288 )
2022-07-14 07:20:48 -07:00
a6f40dd574
update helm to v4.0.4
2022-07-13 21:44:23 -07:00
688215e787
Update yaml files to latest version RELEASE.2022-07-13T23-29-44Z
2022-07-14 00:11:19 +00:00
1cfa2e04bc
Add a github workflow test for root disk detection ( #15267 )
...
Use losetup to create fake disks, start a MinIO cluster, umount
one disk, and fails if the mount point directory will have format.json
recreated. It should fail because the mount point directory will belong
to the root disk after unmount.
2022-07-13 16:29:44 -07:00
b4f6901903
resync: Avoid concurrent access/write on map ( #15286 )
...
fixes a crash
```
fatal error: concurrent map iteration and map write
minio[19309]: goroutine 18640 [running]:
minio[19309]: runtime.throw({0x27a3399?, 0x1785?})
minio[19309]: runtime/panic.go:992 +0x71 fp=0xc0062f1c80 sp=0xc0062f1c50 pc=0x438671
minio[19309]: runtime.mapiternext(0xc0062f1e90?)
minio[19309]: runtime/map.go:871 +0x4eb fp=0xc0062f1cf0 sp=0xc0062f1c80 pc=0x41002b
minio[19309]: github.com/minio/minio/cmd.(*ReplicationPool).periodicResyncMetaSave(0xc0056c00c0, {0x4d06a48, 0xc0005b2480}, {0x4d22fc0, 0xc0015ea0
```
2022-07-13 16:29:10 -07:00
0149382cdc
Add padding to compressed+encrypted files ( #15282 )
...
Add up to 256 bytes of padding for compressed+encrypted files.
This will obscure the obvious cases of extremely compressible content
and leave a similar output size for a very wide variety of inputs.
This does *not* mean the compression ratio doesn't leak information
about the content, but the outcome space is much smaller,
so often *less* information is leaked.
2022-07-13 07:52:15 -07:00
697c9973a7
Upgrade compression package ( #15284 )
...
Includes mitigation for CVE-2022-30631 (Go should still be updated)
Remove functions now available upstream.
2022-07-13 07:48:14 -07:00
788fd3df81
preserve incoming query params in success_action_redirect ( #15280 )
...
fixes #15274
2022-07-13 07:46:44 -07:00
jiuker
Poorna
Harshavardhana
Klaus Post
MohammadReza
Minio Trusted
Andreas Auernhammer
Jeff Haynie
Daniel Valdivia
Anis Elleuch
LHHDZ
Mathieu Parent
Jon Kartago Lamida
Steven Kriegler
Alexander Overvoorde
chel-ou
Cesar Celis Hernandez
Krishnan Parthasarathi