2007dd26ae
ilm: Expire if object past expected expiry date ( #19230 )
...
When an object qualifies for both tiering and expiration rules and is
past its expiration date, it should be expired without requiring to tier
it, even when tiering event occurs before expiration.
2024-03-08 22:41:22 -08:00
51f62a8da3
Port ListBuckets to websockets layer & some cleanup ( #19199 )
2024-03-08 11:08:18 -08:00
c26b8d4eb8
Set expected expiry date for ExpiredObjectAllVersions ( #19210 )
2024-03-05 22:28:57 -08:00
95032e4710
ilm: Select an object when all AND tags are satisfied ( #19134 )
...
Currently, if one object tag matches with one lifecycle tag filter, ILM
will select it, however, this is wrong. All the Tag filters in the
lifecycle document should be satisfied.
2024-02-26 16:01:20 -08:00
53aa8f5650
use typos instead of codespell ( #19088 )
2024-02-21 22:26:06 -08:00
56887f3208
Add DeleteAll with expiry days non zero value only ( #19095 )
...
Signed-off-by: Shubhendu Ram Tripathi <shubhendu@minio.io>
2024-02-21 12:28:34 -08:00
e06168596f
Convert more peer <--> peer REST calls ( #19004 )
...
* Convert more peer <--> peer REST calls
* Clean up in general.
* Add JSON wrapper.
* Add slice wrapper.
* Add option to make handler return nil error if no connection is given, `IgnoreNilConn`.
Converts the following:
```
+ HandlerGetMetrics
+ HandlerGetResourceMetrics
+ HandlerGetMemInfo
+ HandlerGetProcInfo
+ HandlerGetOSInfo
+ HandlerGetPartitions
+ HandlerGetNetInfo
+ HandlerGetCPUs
+ HandlerServerInfo
+ HandlerGetSysConfig
+ HandlerGetSysServices
+ HandlerGetSysErrors
+ HandlerGetAllBucketStats
+ HandlerGetBucketStats
+ HandlerGetSRMetrics
+ HandlerGetPeerMetrics
+ HandlerGetMetacacheListing
+ HandlerUpdateMetacacheListing
+ HandlerGetPeerBucketMetrics
+ HandlerStorageInfo
+ HandlerGetLocks
+ HandlerBackgroundHealStatus
+ HandlerGetLastDayTierStats
+ HandlerSignalService
+ HandlerGetBandwidth
```
2024-02-19 14:54:46 -08:00
980fb5e2ab
Enable expired-object-all-versions ( #18954 )
...
Signed-off-by: Shubhendu Ram Tripathi <shubhendu@minio.io>
2024-02-06 13:36:22 -08:00
dd2542e96c
add codespell action ( #18818 )
...
Original work here, #18474 , refixed and updated.
2024-01-17 23:03:17 -08:00
a93214ea63
ilm: ObjectSizeLessThan and ObjectSizeGreaterThan ( #18500 )
2023-11-22 13:42:39 -08:00
58306a9d34
Replicate Expiry ILM configs while site replication ( #18130 )
...
Signed-off-by: Shubhendu Ram Tripathi <shubhendu@minio.io>
2023-11-21 09:48:06 -08:00
8cd80fec8c
Add unit test for lifecycle.FilterRules ( #18284 )
2023-10-19 21:33:28 -07:00
557df666fd
Don't skip rules with ExpiredObjectDeleteMarker ( #18256 )
2023-10-16 22:46:46 -07:00
5b114b43f7
refactor bandwidth throttling for replication target ( #17980 )
...
This refactor is to allow using the bandwidth throttling
for other purposes.
2023-09-05 20:21:59 -07:00
1c99fb106c
Update to minio/pkg/v2 ( #17967 )
2023-09-04 12:57:37 -07:00
bc7c0d8624
if object is a delete marker it must skip tags filter in ILM ( #17861 )
2023-08-18 09:36:23 -07:00
406ea4f281
Fix distributed listing not able to resume ( #17855 )
...
Two fields in lifecycles made GOB encoding consistently fail with `gob: type lifecycle.Prefix has no exported fields`.
This meant that in distributed systems listings would never be able to continue and would restart on every call.
Fix issues and be sure to log these errors at least once per bucket. We may see some connectivity errors here, but we shouldn't hide them.
2023-08-15 07:45:25 -07:00
f6186965c3
honor DeleteAllVersions in list(), head() calls ( #17604 )
2023-07-08 15:42:10 -07:00
aae6846413
feat: allow expiration of all versions via ILM Expiration action ( #17521 )
...
Following extension allows users to specify immediate purge of
all versions as soon as the latest version of this object has
expired.
```
<LifecycleConfiguration>
<Rule>
<ID>ClassADocRule</ID>
<Filter>
<Prefix>classA/</Prefix>
</Filter>
<Status>Enabled</Status>
<Expiration>
<Days>3650</Days>
<ExpiredObjectAllVersions>true</ExpiredObjectAllVersions>
</Expiration>
</Rule>
...
```
2023-06-28 22:12:28 -07:00
f32efd5429
more compliance related fixes ( #17408 )
...
- lifecycle must return InvalidArgument for rule errors
- do not return `null` versionId in HTTP header
- reject mixed SSE uploads with correct error message
2023-06-13 13:52:33 -07:00
8030e12ba5
fix: expMovingAvg is too small when startTime is zero ( #17346 )
2023-06-03 13:41:51 -07:00
fc03be7891
simplify bucket metadata lookups for versioning/object locking ( #17253 )
2023-05-22 12:05:14 -07:00
0ec722bc54
Add tags to NewerNoncurrentVersions audit event ( #17110 )
2023-05-02 12:56:33 -07:00
8fd07bcd51
simplify sort.Sort by using sort.Slice ( #17066 )
2023-04-24 13:28:18 -07:00
e96c88e914
fix: DeleteBucketThrottle must delete ARN ( #17034 )
2023-04-15 02:14:26 -07:00
b984bf8d1a
allow expiration of all versions during Listing() ( #16757 )
2023-03-09 15:15:30 -08:00
714283fae2
cleanup ignored static analysis ( #16767 )
2023-03-06 08:56:10 -08:00
1b02e046c2
Fix bandwidth monitoring to be per remote target ( #16360 )
2023-01-19 18:52:16 +05:30
3db658e51e
use correct xml package for custom MarshalXML() ( #16421 )
2023-01-17 05:08:33 +05:30
2fc182d8e6
fix: iso8601TimeFormat padding issue for certain nanoseconds ( #16207 )
2022-12-12 10:28:30 -08:00
a30cfdd88f
Bump up madmin-go to v2 ( #16162 )
2022-12-06 13:46:50 -08:00
6eef9b4a23
lifecycle: simplify Eval and HasActiveRules ( #16036 )
2022-11-10 07:17:45 -08:00
7ba281728f
ilm: fix x-amz-expiration header evaluation ( #16029 )
2022-11-09 04:20:34 -08:00
d765b89a63
improve validation for replication resync API ( #15964 )
2022-10-28 23:21:33 -07:00
23b329b9df
remove gateway completely ( #15929 )
2022-10-24 17:44:15 -07:00
ac85c2af76
lifecycle: refactor rules filtering and tagging support ( #15914 )
2022-10-21 10:46:53 -07:00
59e33b3b21
validate setBucketTarget properly as per BucketExists() call ( #15860 )
2022-10-13 17:46:49 -07:00
3c4ef4338f
marshal retention XML in expected format ( #15821 )
2022-10-08 13:11:00 -07:00
6d6a731d6d
Handle overlapping and conflicting ILM rules ( #15812 )
2022-10-07 14:36:23 -07:00
b6b26dba87
fix: GetObjectRetention to parse in ISO8601 time format ( #15809 )
2022-10-06 13:53:56 -07:00
41b633f5ea
support tagging based policy conditions ( #15763 )
2022-09-28 11:25:46 -07:00
5fd5ddea23
relax retention date validation on replication target ( #15752 )
2022-09-23 21:19:03 -07:00
6f56ba80b3
lifecycle: Assign unique id to rules with empty id ( #15731 )
2022-09-22 10:51:54 -07:00
6b9fd256e1
Persist in-memory replication stats to disk ( #15594 )
...
to avoid relying on scanner-calculated replication metrics.
This will improve the accuracy of the replication stats reported.
This PR also adds on to #15556 by handing replication
traffic that could not be queued by available workers to the
MRF queue so that entries in `PENDING` status are healed faster.
2022-09-12 12:40:02 -07:00
d4e0f13bb3
chore: remove duplicate word in comments ( #15607 )
...
Signed-off-by: Abirdcfly <fp544037857@gmail.com>
Signed-off-by: Abirdcfly <fp544037857@gmail.com>
2022-08-30 08:26:43 -07:00
433b6fa8fe
upgrade golang-lint to the latest ( #15600 )
2022-08-26 12:52:29 -07:00
48640b1de2
fix: trim arn:aws:kms from incoming SSE aws-kms-key-id ( #15540 )
2022-08-16 11:28:30 -07:00
8249cd4406
fix: allow payload verification error to be returned ( #15364 )
...
without reading the reader the error is ignored
by the custom unmarshaller written by ObjectLegalHold
data structure.
2022-07-21 01:24:03 -07:00
53cc561048
Default DeleteReplication rule status if unspecified. ( #15301 )
...
Since this is a MinIO specific extension in the replication config,
default this to Disabled to allow other sdks to be used to configure
replication rules.
Co-authored-by: Poorna Krishnamoorthy <poorna@minio.io>
2022-07-14 16:27:09 -07:00
0149382cdc
Add padding to compressed+encrypted files ( #15282 )
...
Add up to 256 bytes of padding for compressed+encrypted files.
This will obscure the obvious cases of extremely compressible content
and leave a similar output size for a very wide variety of inputs.
This does *not* mean the compression ratio doesn't leak information
about the content, but the outcome space is much smaller,
so often *less* information is leaked.
2022-07-13 07:52:15 -07:00
Krishnan Parthasarathi
Klaus Post
Anis Eleuch
Harshavardhana
Shubhendu
Aditya Manthramurthy
jiuker
ferhat elmas
Poorna
Abirdcfly