95c65f4e8f
do not panic on rebalance during server restarts ( #19563 )
...
This PR makes a feasible approach to handle all the scenarios
that we must face to avoid returning "panic."
Instead, we must return "errServerNotInitialized" when a
bucketMetadataSys.Get() is called, allowing the caller to
retry their operation and wait.
Bonus fix the way data-usage-cache stores the object.
Instead of storing usage-cache.bin with the bucket as
`.minio.sys/buckets`, the `buckets` must be relative
to the bucket `.minio.sys` as part of the object name.
Otherwise, there is no way to decommission entries at
`.minio.sys/buckets` and their final erasure set positions.
A bucket must never have a `/` in it. Adds code to read()
from existing data-usage.bin upon upgrade.
2024-04-22 10:49:30 -07:00
9d63bb1b41
Added new API errors for LDAP ( #19415 )
...
* change internal errors to named errors
* Change names
2024-04-05 22:26:02 -07:00
95bf4a57b6
logging: Add subsystem to log API ( #19002 )
...
Create new code paths for multiple subsystems in the code. This will
make maintaing this easier later.
Also introduce bugLogIf() for errors that should not happen in the first
place.
2024-04-04 05:04:40 -07:00
53aa8f5650
use typos instead of codespell ( #19088 )
2024-02-21 22:26:06 -08:00
134db72bb7
fix: reject service account access key same as root credentials ( #19055 )
2024-02-14 10:37:12 -08:00
4d94609c44
FIx unexpected behavior when creating service account ( #19036 )
2024-02-13 02:31:43 -08:00
e3fbac9e24
do not have to use the same distributionAlgo as first pool ( #19031 )
...
when we expand via pools, there is no reason to stick
with the same distributionAlgo as the rest. Since the
algo only makes sense with-in a pool not across pools.
This allows for newer pools to use newer codepaths to
avoid legacy file lookups when they have a pre-existing
deployment from 2019, they can expand their new pool
to be of a newer distribution format, allowing the
pool to be more performant.
2024-02-11 23:21:56 -08:00
53997ecc79
avoid excessive logging for objects that do not exist ( #19030 )
...
in replicated setups, that have proxying enabled for
replicated buckets.
2024-02-11 14:21:08 -08:00
997ba3a574
introduce reader deadlines for net.Conn ( #19023 )
...
Bonus: set "retry-after" header for AWS SDKs if possible to honor them.
2024-02-09 13:25:16 -08:00
dd2542e96c
add codespell action ( #18818 )
...
Original work here, #18474 , refixed and updated.
2024-01-17 23:03:17 -08:00
9b8ba97f9f
feat: add support for GetObjectAttributes API ( #18732 )
2024-01-05 10:43:06 -08:00
0a284a1a10
fix: SR: Add more info when IAM config differs ( #18302 )
...
Provide details on what IAM info mismatched when the validation fails
2023-10-23 21:16:40 -07:00
5b8599e52d
Do not log invalid tag errors ( #18200 )
...
Eliminate logging on invalid tags:
```
API: PutObjectTagging(bucket=aws-sdk-go-test-aupmzek4341ee2, object=sgehiqp24fwt4hafffmtwzkrqnq325)
Time: 07:40:33 UTC 10/10/2023
DeploymentID: f122cbfa-42b1-428f-9002-39c644cace71
RequestID: 178CAF0DE0A67480
RemoteHost: 127.0.0.1
Host: 127.0.0.1:9001
UserAgent: aws-sdk-go/1.44.257 (go1.21.0; linux; amd64)
Error: Tags cannot be more than 10 (*tags.errTag)
5: internal\logger\logger.go:259:logger.LogIf()
4: cmd\api-errors.go:2350:cmd.toAPIErrorCode()
3: cmd\api-errors.go:2375:cmd.toAPIError()
2: cmd\object-handlers.go:2912:cmd.objectAPIHandlers.PutObjectTaggingHandler()
1: net\http\server.go:2136:http.HandlerFunc.ServeHTTP()
API: PutObjectTagging(bucket=aws-sdk-go-test-aupmzek4341ee2, object=sgehiqp24fwt4hafffmtwzkrqnq325)
Time: 07:40:33 UTC 10/10/2023
DeploymentID: f122cbfa-42b1-428f-9002-39c644cace71
RequestID: 178CAF0DE0BEA514
RemoteHost: 127.0.0.1
Host: 127.0.0.1:9001
UserAgent: aws-sdk-go/1.44.257 (go1.21.0; linux; amd64)
Error: Cannot provide multiple Tags with the same key (*tags.errTag)
5: internal\logger\logger.go:259:logger.LogIf()
4: cmd\api-errors.go:2350:cmd.toAPIErrorCode()
3: cmd\api-errors.go:2375:cmd.toAPIError()
2: cmd\object-handlers.go:2912:cmd.objectAPIHandlers.PutObjectTaggingHandler()
1: net\http\server.go:2136:http.HandlerFunc.ServeHTTP()
API: PutObjectTagging(bucket=aws-sdk-go-test-aupmzek4341ee2, object=sgehiqp24fwt4hafffmtwzkrqnq325)
Time: 07:40:33 UTC 10/10/2023
DeploymentID: f122cbfa-42b1-428f-9002-39c644cace71
RequestID: 178CAF0DE0E78970
RemoteHost: 127.0.0.1
Host: 127.0.0.1:9001
UserAgent: aws-sdk-go/1.44.257 (go1.21.0; linux; amd64)
Error: The TagKey you have provided is invalid (*tags.errTag)
5: internal\logger\logger.go:259:logger.LogIf()
4: cmd\api-errors.go:2350:cmd.toAPIErrorCode()
3: cmd\api-errors.go:2375:cmd.toAPIError()
2: cmd\object-handlers.go:2912:cmd.objectAPIHandlers.PutObjectTaggingHandler()
1: net\http\server.go:2136:http.HandlerFunc.ServeHTTP()
API: PutObjectTagging(bucket=aws-sdk-go-test-aupmzek4341ee2, object=sgehiqp24fwt4hafffmtwzkrqnq325)
Time: 07:40:33 UTC 10/10/2023
DeploymentID: f122cbfa-42b1-428f-9002-39c644cace71
RequestID: 178CAF0DE1002AE8
RemoteHost: 127.0.0.1
Host: 127.0.0.1:9001
UserAgent: aws-sdk-go/1.44.257 (go1.21.0; linux; amd64)
Error: The TagValue you have provided is invalid (*tags.errTag)
5: internal\logger\logger.go:259:logger.LogIf()
4: cmd\api-errors.go:2350:cmd.toAPIErrorCode()
3: cmd\api-errors.go:2375:cmd.toAPIError()
2: cmd\object-handlers.go:2912:cmd.objectAPIHandlers.PutObjectTaggingHandler()
1: net\http\server.go:2136:http.HandlerFunc.ServeHTTP()
```
2023-10-10 08:35:03 -07:00
21e8e071d7
Improve ListObject Compatibility ( #18099 )
...
Do not error out when a provided marker is before or after the prefix, but instead just ignore it if before and return an empty list when after.
Fixes #18093
2023-09-25 08:13:08 -07:00
1c99fb106c
Update to minio/pkg/v2 ( #17967 )
2023-09-04 12:57:37 -07:00
cb089dcb52
error out by default beyond 10000 versions per object ( #17803 )
...
```
You've exceeded the limit on the number of versions you can create on this object
```
2023-08-04 10:40:21 -07:00
6624f970c0
Fix spelling of 'already' across repository ( #17703 )
2023-07-21 08:45:08 -07:00
fb49aead9b
replication: add validation API ( #17520 )
...
To check if replication is set up properly on a bucket.
2023-07-10 20:09:20 -07:00
7605d07bb2
add support for bucket level request count per API ( #17468 )
...
New metrics added to calculate API request count
per bucket, per API. Captures errors, including
4xx, 5xx HTTP status codes separately.
2023-06-21 09:41:59 -07:00
5a1612fe32
Bump up madmin-go and pkg deps ( #17469 )
2023-06-19 17:53:08 -07:00
1443b5927a
allow quorum fileInfo to pick same parityBlocks ( #17454 )
...
Bonus: allow replication to proceed for 503 errors such as
with error code SlowDownRead
2023-06-18 18:20:15 -07:00
f32efd5429
more compliance related fixes ( #17408 )
...
- lifecycle must return InvalidArgument for rule errors
- do not return `null` versionId in HTTP header
- reject mixed SSE uploads with correct error message
2023-06-13 13:52:33 -07:00
26a0803388
various compliance related fixes ( #17401 )
...
- getObjectTagging to be allowed for anonymous policies
- return correct errors for invalid retention period
- return sorted list of tags for an object
- putObjectTagging must return 200 OK not 204 OK
- return 409 ErrObjectLockConfigurationNotAllowed for existing buckets
2023-06-12 13:22:07 -07:00
43468f4d47
return InvalidRequest when no parts are provided ( #17395 )
2023-06-10 21:59:51 -07:00
65cba212e8
Remove older policy attach behavior for LDAP ( #17240 )
2023-05-26 06:31:24 -07:00
54c5c88fe6
Add number of offline disks in quorum errors ( #16822 )
2023-05-25 09:39:06 -07:00
62df731006
Add updatedAt for GetBucketLifecycleConfig ( #17271 )
2023-05-24 22:52:39 -07:00
ef2fc0f99e
fix: reduce using memory and temporary files. ( #17206 )
2023-05-15 14:08:54 -07:00
ef7177ebbd
disallow bucket replication setup with site replication ( #17189 )
2023-05-11 15:48:40 -07:00
76913a9fd5
Signed trailers for signature v4 ( #16484 )
2023-05-05 19:53:12 -07:00
8a81e317d6
verify maxPartID in object options helpers ( #17015 )
2023-04-18 22:34:30 -07:00
46f9049fb4
simplify error responses for KMS ( #16793 )
2023-03-16 11:59:42 -07:00
58266c9e2c
Add enable flag for LDAP IDP config ( #16805 )
2023-03-16 11:58:59 -07:00
901887e6bf
feat: add lambda transformation functions target ( #16507 )
2023-03-07 08:12:41 -08:00
0a17acdb34
return error if policy changes on disabled groups ( #16766 )
2023-03-06 10:46:24 -08:00
714283fae2
cleanup ignored static analysis ( #16767 )
2023-03-06 08:56:10 -08:00
ae029191a3
liveness returns "busy" if queued requests > available capacity ( #16719 )
2023-02-27 08:34:52 -08:00
b49b39e99d
fix: errNoSuchPolicy should use errors.Is ( #16656 )
2023-02-25 00:01:37 -08:00
94c6cb1323
tests: Add test for S3 API error codes ( #16705 )
2023-02-25 08:06:29 +05:30
8bfe972bab
Set meaningful message from minio with env variable KMS_SECRET_KEY ( #16584 )
2023-02-22 07:13:01 +05:30
c33a237067
fix: under site replication disallow remote target modification ( #16628 )
2023-02-15 20:22:13 -08:00
37134e42d4
ignore io.EOF, io.ErrUnexpectedEOF on xl.meta reads in WalkDir() ( #16625 )
2023-02-15 07:12:48 -08:00
e64b9f6751
fix: disallow SSE-C encrypted objects on replicated buckets ( #16467 )
2023-01-24 15:46:33 -08:00
6423e4c767
Remove site replication config if it succeeded locally ( #16279 )
2022-12-22 01:31:20 -08:00
709eb283d9
Add endpoints for managing IAM policies ( #15897 )
...
Co-authored-by: Taran <taran@minio.io>
Co-authored-by: ¨taran-p¨ <¨taran@minio.io¨>
Co-authored-by: Aditya Manthramurthy <donatello@users.noreply.github.com>
2022-12-13 12:13:23 -08:00
e06127566d
Add IAM API to attach/detach policies for LDAP ( #16182 )
2022-12-09 13:08:33 -08:00
b03dd1af17
remove hard limit for number of buckets ( #16194 )
2022-12-08 12:24:03 -08:00
a30cfdd88f
Bump up madmin-go to v2 ( #16162 )
2022-12-06 13:46:50 -08:00
44735be38e
s3: Return correct error when Version is invalid in policy document ( #16178 )
2022-12-06 08:07:24 -08:00
a713aee3d5
Run staticcheck on CI ( #16170 )
2022-12-05 11:18:50 -08:00
Harshavardhana
Taran Pelkey
Anis Eleuch
Taran Pelkey
Sveinn
Aditya Manthramurthy
Klaus Post
Kaan Kabalak
Poorna
Krishnan Parthasarathi
jiuker
ferhat elmas
Allan Roger Reid
Taran Pelkey