Minio Trusted
d14ead7bec
Update yaml files to latest version RELEASE.2023-03-20T20-16-18Z
2023-03-21 01:07:32 +00:00
Poorna
d1e775313d
support decommissioning of tiered objects ( #16751 )
2023-03-16 07:48:05 -07:00
Anis Eleuch
a65df1e67b
debug: new tool to reorder local erasure disks ( #16816 )
2023-03-15 13:53:17 -07:00
Minio Trusted
c2f9cc5824
Update yaml files to latest version RELEASE.2023-03-13T19-46-17Z
2023-03-13 22:11:07 +00:00
Minio Trusted
9800760cb3
Update yaml files to latest version RELEASE.2023-03-09T23-16-13Z
2023-03-10 00:59:46 +00:00
Harshavardhana
901887e6bf
feat: add lambda transformation functions target ( #16507 )
2023-03-07 08:12:41 -08:00
Aditya Manthramurthy
47dfa62384
Update LDAP doc for new policy attach|detach cmds ( #16723 )
2023-02-27 21:04:27 -08:00
Minio Trusted
3a3265cf88
Update yaml files to latest version RELEASE.2023-02-27T18-10-45Z
2023-02-28 00:30:32 +00:00
Aditya Manthramurthy
3f81cd1b22
Update OpenID doc with info on redirection params ( #16704 )
2023-02-24 12:13:00 -08:00
Minio Trusted
2bbf380262
Update yaml files to latest version RELEASE.2023-02-22T18-23-45Z
2023-02-22 21:50:11 +00:00
Minio Trusted
7f2c90a0ed
Update yaml files to latest version RELEASE.2023-02-17T17-52-43Z
2023-02-17 19:07:39 +00:00
Minio Trusted
bf749eec61
Update yaml files to latest version RELEASE.2023-02-10T18-48-39Z
2023-02-10 20:55:45 +00:00
k0i
6b41f941b6
fix: README.md in docs/config ( #16564 )
2023-02-10 03:02:11 -08:00
Minio Trusted
1141187bf2
Update yaml files to latest version RELEASE.2023-02-09T05-16-53Z
2023-02-09 06:21:34 +00:00
Harshavardhana
c97f50e274
replication syncs happen in 60sec intervals ( #16571 )
2023-02-08 08:23:26 -08:00
Harshavardhana
14cf8f1b22
upgrade deps for minio/pkg v1.6.1 to include groups conditions ( #16538 )
2023-02-06 09:27:29 -08:00
Harshavardhana
e47a31f9fc
fix: object size distribution in metrics for all objects ( #16539 )
2023-02-04 21:10:10 -08:00
Minio Trusted
a24037bfec
Update yaml files to latest version RELEASE.2023-01-31T02-24-19Z
2023-01-31 07:49:15 +00:00
Jan Zhanal
8fa80874a6
doc: LDAP/AD - nested groups ( #16483 )
2023-01-26 22:17:59 +05:30
Minio Trusted
1bf1fafc86
Update yaml files to latest version RELEASE.2023-01-25T00-19-54Z
2023-01-25 02:09:27 +00:00
Harshavardhana
e64b9f6751
fix: disallow SSE-C encrypted objects on replicated buckets ( #16467 )
2023-01-24 15:46:33 -08:00
Harshavardhana
3683673fb0
add missing gorilla/mux migration, update credits ( #16461 )
2023-01-23 08:46:37 -08:00
Anis Elleuch
e73894fa50
grafana: Show one metric for the total data growth ( #16449 )
2023-01-20 09:39:28 -08:00
Minio Trusted
3fa7218c44
Update yaml files to latest version RELEASE.2023-01-20T02-05-44Z
2023-01-20 08:11:58 +00:00
Minio Trusted
5c1a4ba5f9
Update yaml files to latest version RELEASE.2023-01-18T04-36-38Z
2023-01-18 07:46:44 +00:00
Minio Trusted
d33c527e39
Update yaml files to latest version RELEASE.2023-01-12T02-06-16Z
2023-01-12 07:27:07 +00:00
Minio Trusted
52b88b52f0
Update yaml files to latest version RELEASE.2023-01-06T18-11-18Z
2023-01-08 07:51:31 +00:00
Poorna
b29e159604
docs: Update replication setup commands ( #16361 )
2023-01-04 13:39:37 -08:00
Harshavardhana
b197623ed2
remove unnecessary kernel-tuning docs ( #16354 )
2023-01-04 01:33:40 -08:00
Harshavardhana
14d29b77ae
update replication tests with latest 'mc' ( #16348 )
2023-01-03 22:54:39 -08:00
Minio Trusted
72394a8319
Update yaml files to latest version RELEASE.2023-01-02T09-40-09Z
2023-01-03 10:16:34 +00:00
Anis Elleuch
b8943fdf19
doc: Update prometheus metrics list ( #16329 )
2022-12-29 15:08:22 -08:00
Harshavardhana
2937711390
fix: DeleteObject() API with versionId under replication ( #16325 )
2022-12-28 22:48:33 -08:00
Aditya Manthramurthy
9e6cc847f8
Add HTTP2 config option for policy plugin ( #16225 )
2022-12-13 14:28:48 -08:00
Minio Trusted
76905b7a67
Update yaml files to latest version RELEASE.2022-12-12T19-27-27Z
2022-12-13 01:10:31 +00:00
Aditya Manthramurthy
a469e6768d
Add LDAP DNS SRV record lookup support ( #16201 )
2022-12-12 11:27:27 -08:00
Harshavardhana
b03dd1af17
remove hard limit for number of buckets ( #16194 )
2022-12-08 12:24:03 -08:00
Klaus Post
3eb2d086b2
Replace filepathx with fork ( #16192 )
2022-12-08 10:42:44 -08:00
Minio Trusted
9f71369b67
Update yaml files to latest version RELEASE.2022-12-07T00-56-37Z
2022-12-07 01:30:51 +00:00
Aditya Manthramurthy
a30cfdd88f
Bump up madmin-go to v2 ( #16162 )
2022-12-06 13:46:50 -08:00
Harshavardhana
a9f5b58a01
fix: update the JSON keys for latest 'mc' release ( #16171 )
2022-12-05 10:28:22 -08:00
Minio Trusted
d6351879f3
Update yaml files to latest version RELEASE.2022-12-02T19-19-22Z
2022-12-02 20:15:36 +00:00
Harshavardhana
71133105d7
re-order the top-level config keys for priority ( #16150 )
2022-12-01 07:50:08 -08:00
Minio Trusted
76943ac05e
Update yaml files to latest version RELEASE.2022-11-29T23-40-49Z
2022-11-30 21:13:07 +00:00
Aditya Manthramurthy
87cbd41265
feat: Allow at most one claim based OpenID IDP ( #16145 )
2022-11-29 15:40:49 -08:00
Minio Trusted
53cbc020b9
Update yaml files to latest version RELEASE.2022-11-26T22-43-32Z
2022-11-27 04:08:35 +00:00
Minio Trusted
3661aaf8a1
Update yaml files to latest version RELEASE.2022-11-17T23-20-09Z
2022-11-18 08:51:38 +00:00
Minio Trusted
6dc7109a9f
Update yaml files to latest version RELEASE.2022-11-11T03-44-20Z
2022-11-11 04:57:16 +00:00
Minio Trusted
4fe9cbb973
Update yaml files to latest version RELEASE.2022-11-10T18-20-21Z
2022-11-10 19:36:54 +00:00
yanggang
52769e1e71
remove io/util for advanced golang ( #16011 )
2022-11-08 07:58:02 -08:00
Minio Trusted
808739867c
Update yaml files to latest version RELEASE.2022-11-08T05-27-07Z
2022-11-08 05:59:18 +00:00
Anis Elleuch
7e73fc2870
Implement inspect data API v2 ( #15474 )
...
Co-authored-by: Klaus Post <klauspost@gmail.com>
2022-11-02 13:36:38 -07:00
Minio Trusted
0303cd8625
Update yaml files to latest version RELEASE.2022-10-29T06-21-33Z
2022-10-29 09:29:37 +00:00
Poorna
dc92bb4646
xl-meta: update metadata version ( #15958 )
2022-10-28 02:48:43 -07:00
Harshavardhana
23b329b9df
remove gateway completely ( #15929 )
2022-10-24 17:44:15 -07:00
Minio Trusted
630dabf4b9
Update yaml files to latest version RELEASE.2022-10-24T18-35-07Z
2022-10-24 19:29:30 +00:00
Minio Trusted
c921dc75c7
Update yaml files to latest version RELEASE.2022-10-21T22-37-48Z
2022-10-22 00:04:37 +00:00
Klaus Post
86d543d0f6
Check for s3zip content offset ( #15924 )
2022-10-21 15:37:48 -07:00
Minio Trusted
bd77f1df4c
Update yaml files to latest version RELEASE.2022-10-20T00-55-09Z
2022-10-20 06:38:33 +00:00
Minio Trusted
196fab6834
Update yaml files to latest version RELEASE.2022-10-15T19-57-03Z
2022-10-15 23:20:56 +00:00
Minio Trusted
0c8dd8046a
Update yaml files to latest version RELEASE.2022-10-08T20-11-00Z
2022-10-09 19:44:19 +00:00
Harshavardhana
2a13cc28f2
feat: implement support batch replication ( #15554 )
2022-10-05 23:00:43 -07:00
Minio Trusted
4d761fda81
Update yaml files to latest version RELEASE.2022-10-05T14-58-27Z
2022-10-05 22:50:50 +00:00
Minio Trusted
dc6733dacc
Update yaml files to latest version RELEASE.2022-10-02T19-29-29Z
2022-10-03 02:29:56 +00:00
Daryl White
d44f3526dc
Update links to documentation site ( #15750 )
2022-09-28 21:28:45 -07:00
Minio Trusted
1480340830
Update yaml files to latest version RELEASE.2022-09-25T15-44-53Z
2022-09-26 04:54:15 +00:00
Minio Trusted
334f1ed45a
Update yaml files to latest version RELEASE.2022-09-22T18-57-27Z
2022-09-23 06:01:11 +00:00
Klaus Post
ff12080ff5
Remove deprecated io/ioutil ( #15707 )
2022-09-19 11:05:16 -07:00
Minio Trusted
98874c3baf
Update yaml files to latest version RELEASE.2022-09-17T00-09-45Z
2022-09-17 08:07:32 +00:00
Ashish Kumar Sinha
fb8d512f58
update docs to add cycle in scanner ( #15686 )
2022-09-13 22:46:02 -07:00
Harshavardhana
b579163802
limit number of buckets to 500k ( #15668 )
...
500k is a reasonable limit for any single MinIO
cluster deployment, in future we may increase this
value.
However for now we are going to keep this limit.
2022-09-09 03:06:34 -07:00
Minio Trusted
87f0c8e7e8
Update yaml files to latest version RELEASE.2022-09-07T22-25-02Z
2022-09-08 00:44:12 +00:00
Minio Trusted
240164560f
Update yaml files to latest version RELEASE.2022-09-01T23-53-36Z
2022-09-02 01:52:19 +00:00
Minio Trusted
cd18599e7b
Update yaml files to latest version RELEASE.2022-08-26T19-53-15Z
2022-08-29 00:10:22 +00:00
Minio Trusted
1fd72d5aea
Update yaml files to latest version RELEASE.2022-08-25T07-17-05Z
2022-08-25 07:47:18 +00:00
Anis Elleuch
b737c83a66
Ensure that only one node performs site replication healing ( #15584 )
...
When a node finds a change in the other replication cluster and applies
to itself will already notify other peers. No need for all nodes in a
given cluster to do site replication healing, only one node is
sufficient.
2022-08-24 13:46:09 -07:00
Minio Trusted
2c48f6a02b
Update yaml files to latest version RELEASE.2022-08-22T23-53-06Z
2022-08-23 05:45:31 +00:00
Klaus Frank
a2e037f0ec
doc: certgen typo in parameter name ( #15555 )
...
"-ca" is not a valid parameter remove it.
2022-08-19 10:48:34 -07:00
Harshavardhana
d350b666ff
feat: add idempotent delete marker support ( #15521 )
...
The bottom line is delete markers are a nuisance,
most applications are not version aware and this
has simply complicated the version management.
AWS S3 gave an unnecessary complication overhead
for customers, they need to now manage these
markers by applying ILM settings and clean
them up on a regular basis.
To make matters worse all these delete markers
get replicated as well in a replicated setup,
requiring two ILM settings on each site.
This PR is an attempt to address this inferior
implementation by deviating MinIO towards an
idempotent delete marker implementation i.e
MinIO will never create any more than single
consecutive delete markers.
This significantly reduces operational overhead
by making versioning more useful for real data.
This is an S3 spec deviation for pragmatic reasons.
2022-08-18 16:41:59 -07:00
Minio Trusted
fa9b361a3d
Update yaml files to latest version RELEASE.2022-08-13T21-54-44Z
2022-08-14 05:33:08 +00:00
Minio Trusted
c5b3666089
Update yaml files to latest version RELEASE.2022-08-11T04-37-28Z
2022-08-11 22:36:34 +00:00
Minio Trusted
6a6c772ff2
Update yaml files to latest version RELEASE.2022-08-08T18-34-09Z
2022-08-08 21:30:40 +00:00
Minio Trusted
fcd4b3ba9b
Update yaml files to latest version RELEASE.2022-08-05T23-27-09Z
2022-08-06 00:08:21 +00:00
ebozduman
b57e7321e7
Replaces 'disk'=>'drive' visible to end user ( #15464 )
2022-08-04 16:10:08 -07:00
Minio Trusted
e956369c4e
Update yaml files to latest version RELEASE.2022-08-02T23-59-16Z
2022-08-03 01:45:42 +00:00
Harshavardhana
fd349103e8
fix: allow P-384/P-512 constant time implementation ( #15445 )
...
since go1.18.x P-384/P-512 are now constant time
implementations, enable them.
2022-08-01 09:27:16 -07:00
Minio Trusted
6b4cb35f4f
Update yaml files to latest version RELEASE.2022-07-30T05-21-40Z
2022-07-30 05:50:06 +00:00
Minio Trusted
824d52a82b
Update yaml files to latest version RELEASE.2022-07-29T19-40-48Z
2022-07-29 22:06:57 +00:00
Minio Trusted
067ebab9d8
update object-locking docs and word them appropriately
2022-07-29 12:40:48 -07:00
Harshavardhana
5e763b71dc
use logger.LogOnce to reduce printing disconnection logs ( #15408 )
...
fixes #15334
- re-use net/url parsed value for http.Request{}
- remove gosimple, structcheck and unusued due to https://github.com/golangci/golangci-lint/issues/2649
- unwrapErrs upto leafErr to ensure that we store exactly the correct errors
2022-07-27 09:44:59 -07:00
Minio Trusted
bfc70bc74e
Update yaml files to latest version RELEASE.2022-07-26T00-53-03Z
2022-07-26 06:56:37 +00:00
Poorna
426c902b87
site replication: fix healing of bucket deletes. ( #15377 )
...
This PR changes the handling of bucket deletes for site
replicated setups to hold on to deleted bucket state until
it syncs to all the clusters participating in site replication.
2022-07-25 17:51:32 -07:00
Minio Trusted
e465c3587b
Update yaml files to latest version RELEASE.2022-07-24T17-09-31Z
2022-07-24 17:37:58 +00:00
Minio Trusted
f802d2ba83
Update yaml files to latest version RELEASE.2022-07-24T01-54-52Z
2022-07-24 02:31:24 +00:00
MohammadReza
f4d5c861f3
update grafana dashboard ( #15357 )
2022-07-21 15:17:44 -07:00
Minio Trusted
e7eb94de6b
Update yaml files to latest version RELEASE.2022-07-17T15-43-14Z
2022-07-17 22:06:11 +00:00
Harshavardhana
b6eb8dff64
Add decommission compression+encryption enabled tests ( #15322 )
...
update compression environment variables to follow
the expected sub-system style, however support fallback
mode.
2022-07-17 08:43:14 -07:00
Harshavardhana
7da9e3a6f8
support encrypted/compressed objects properly during decommission ( #15320 )
...
fixes #15314
2022-07-16 19:35:24 -07:00
Minio Trusted
4aecd8d039
Update yaml files to latest version RELEASE.2022-07-15T03-44-22Z
2022-07-15 06:05:11 +00:00
Poorna
7e32a17742
fix: site replication healing of missing buckets ( #15298 )
...
fixes a regression from #15186
- Adding tests to cover healing of buckets.
- Also dereference quota in SiteReplicationStatus only when non-nil
2022-07-14 14:27:47 -07:00
Minio Trusted
688215e787
Update yaml files to latest version RELEASE.2022-07-13T23-29-44Z
2022-07-14 00:11:19 +00:00
daniel-bogusz95
00e235a1ee
fix grammatic errors and minor rewrites ( #15264 )
...
Thank you @djwfyi for the help
2022-07-11 07:59:49 -07:00
Minio Trusted
cf9e3069f2
Update yaml files to latest version RELEASE.2022-07-08T00-05-23Z
2022-07-08 00:44:43 +00:00
Minio Trusted
c1901f4e12
Update yaml files to latest version RELEASE.2022-07-06T20-29-49Z
2022-07-07 00:24:36 +00:00
Harshavardhana
9d80ff5a05
fix: decommission delete markers for non-current objects ( #15225 )
...
versioned buckets were not creating the delete markers
present in the versioned stack of an object, this essentially
would stop decommission to succeed.
This PR fixes creating such delete markers properly during
a decommissioning process, adds tests as well.
2022-07-05 07:37:24 -07:00
Minio Trusted
39b3941892
Update yaml files to latest version RELEASE.2022-07-04T21-02-54Z
2022-07-04 21:51:54 +00:00
Harshavardhana
b311abed31
decom IAM, Bucket metadata properly ( #15220 )
...
Current code incorrectly passed the
config asset object name while decommissioning,
make sure that we pass the right object name
to be hashed on the newer set of pools.
This PR fixes situations after a successful
decommission, the users and policies might go
missing due to wrong hashed set.
2022-07-04 14:02:54 -07:00
Poorna
0ea5c9d8e8
site healing: Skip stale iam asset updates from peer. ( #15203 )
...
Allow healing to apply IAM change only when peer
gave the most recent update.
2022-07-01 13:19:13 -07:00
Minio Trusted
a01a39b153
Update yaml files to latest version RELEASE.2022-06-30T20-58-09Z
2022-07-01 00:44:04 +00:00
Poorna
7cc9286e0f
site healing: Skip stale bucket metadata updates from peer ( #15186 )
...
Allow healing to apply bucket metadata change only when peer
gave the most recent update.
2022-06-28 18:09:20 -07:00
Harshavardhana
9c605ad153
allow support for parity '0', '1' enabling support for 2,3 drive setups ( #15171 )
...
allows for further granular setups
- 2 drives (1 parity, 1 data)
- 3 drives (1 parity, 2 data)
Bonus: allows '0' parity as well.
2022-06-27 20:22:18 -07:00
Minio Trusted
2075501d86
Update yaml files to latest version RELEASE.2022-06-25T15-50-16Z
2022-06-26 16:09:28 +00:00
Anis Elleuch
f3bec41eb9
s3-verify: Add a flag to exclude younger than a certain age ( #15142 )
...
--minimum-object-age 1h can help exclude objects that are newly
uploaded but not replicated yet
2022-06-22 08:12:47 -07:00
Anis Elleuch
95b51c48be
s3-verify: Fix endpoint and missing comparaison ( #15129 )
...
- Fix a typo where target s3 client uses the source endpoint
- Fix a missing necessary comparison: if source name is lexically lower than target name
2022-06-21 05:35:41 -07:00
Minio Trusted
17ab8145b5
Update yaml files to latest version RELEASE.2022-06-20T23-13-45Z
2022-06-21 00:16:07 +00:00
Harshavardhana
e83e947ca3
debug/s3-verify: simplify the tool to use lower memory footprint ( #15110 )
2022-06-20 10:45:35 -07:00
daniel-bogusz95
ce6c23a360
docs: some grammatical, typo fixes
...
includes #15104 , #15105 , #15106 , #15107
2022-06-19 15:35:51 -07:00
Minio Trusted
1e1d9acb1b
Update yaml files to latest version RELEASE.2022-06-17T02-00-35Z
2022-06-17 02:56:57 +00:00
Harshavardhana
8082d1fed6
add bucket level S3 received/sent bytes ( #15084 )
...
adds bucket level metrics for bytes received and sent bytes on all S3 API calls.
2022-06-14 15:14:24 -07:00
Minio Trusted
f34b2ef90b
update dashboard Data Usage Growth as time series
2022-06-13 22:05:36 -07:00
George Costea
ce894665a8
examples: support configuration of a session policy file ( #15078 )
2022-06-13 15:36:58 -07:00
Anis Elleuch
e9efee0e64
debug: Close object after check ( #15077 )
2022-06-13 07:21:04 -07:00
Minio Trusted
4b3e7aee0b
Update yaml files to latest version RELEASE.2022-06-11T19-55-32Z
2022-06-11 21:04:23 +00:00
Harshavardhana
7413045f0e
fix: add missing minio_s3_requests_total ( #15070 )
...
PR #15052 caused a regression, add the missing metrics back.
Bonus:
- internode information should be only for distributed setups
- update the dashboard to include 4xx and 5xx error panels.
2022-06-11 00:50:31 -07:00
Harshavardhana
d76c508566
debug: verify diff on latest objects on source and target buckets ( #15069 )
2022-06-10 16:56:51 -07:00
Minio Trusted
8fb46de5e4
Update yaml files to latest version RELEASE.2022-06-10T16-59-15Z
2022-06-10 20:12:04 +00:00
Anis Elleuch
5fb420c703
prometheus: Add S3 4xx and 5xx S3 monitoring ( #15052 )
...
Currently minio_s3_requests_errors_total covers 4xx and
5xx S3 responses which can be confusing when s3 applications
sent a lot of HEAD requests with obvious 404 responses or
when the replication is enabled.
Add
- minio_s3_requests_4xx_errors_total
- minio_s3_requests_5xx_errors_total
to help users monitor 4xx and 5xx HTTP status codes separately.
2022-06-08 11:22:34 -07:00
Minio Trusted
f63645546d
update minimum goroutine threshold on dashboard
2022-06-06 22:13:54 -07:00
Minio Trusted
27ab780317
Update yaml files to latest version RELEASE.2022-06-07T00-33-41Z
2022-06-07 01:06:59 +00:00
Minio Trusted
ac8cb6ba0d
Update yaml files to latest version RELEASE.2022-06-06T23-14-52Z
2022-06-06 23:47:31 +00:00
Harshavardhana
48e367ff7d
reject resync start on misconfigured replication rules ( #15041 )
...
we expect resync to start on buckets with replication
rule ExistingObjects enabled, if not we reject such
calls.
2022-06-06 02:54:39 -07:00
Minio Trusted
3a398775fb
Update yaml files to latest version RELEASE.2022-06-03T01-40-53Z
2022-06-03 02:36:56 +00:00
Minio Trusted
197d6fb644
Update yaml files to latest version RELEASE.2022-06-02T16-16-26Z
2022-06-02 17:46:32 +00:00
Minio Trusted
1fce2b180f
Update yaml files to latest version RELEASE.2022-06-02T02-11-04Z
2022-06-02 02:42:14 +00:00
Harshavardhana
befbf48563
fix: s3-check-md5 to not panic for incomplete md5
2022-05-30 20:58:42 -07:00
Harshavardhana
f1abb92f0c
feat: Single drive XL implementation ( #14970 )
...
Main motivation is move towards a common backend format
for all different types of modes in MinIO, allowing for
a simpler code and predictable behavior across all features.
This PR also brings features such as versioning, replication,
transitioning to single drive setups.
2022-05-30 10:58:37 -07:00
Harshavardhana
c2630bb3a3
add total usage pie chart based on total/free bytes
2022-05-28 09:53:53 -07:00
Aditya Manthramurthy
464b9d7c80
Add support for Identity Management Plugin ( #14913 )
...
- Adds an STS API `AssumeRoleWithCustomToken` that can be used to
authenticate via the Id. Mgmt. Plugin.
- Adds a sample identity manager plugin implementation
- Add doc for plugin and STS API
- Add an example program using go SDK for AssumeRoleWithCustomToken
2022-05-26 17:58:09 -07:00
Praveen raj Mani
62cd643868
Add --insecure flag to skip TLS verification in s3-md5-check tool ( #14980 )
2022-05-26 06:02:05 -07:00
Minio Trusted
1b7dd70f72
Update yaml files to latest version RELEASE.2022-05-26T05-48-41Z
2022-05-26 06:27:03 +00:00
Klaus Post
fc08fcab52
hash-set: Add file input for debug tool ( #14965 )
...
Add input option for a file list to display total distribution.
2022-05-24 09:05:39 -07:00
Minio Trusted
5be76856bd
Update yaml files to latest version RELEASE.2022-05-23T18-45-11Z
2022-05-24 00:29:45 +00:00
Minio Trusted
18a4276e25
Update yaml files to latest version RELEASE.2022-05-19T18-20-59Z
2022-05-19 20:18:49 +00:00
Aditya Manthramurthy
4629abd5a2
Add tests for Access Management Plugin ( #14909 )
2022-05-12 15:24:19 -07:00
Krishna Srinivas
389ec21d0c
Update documentation for /minio/health/cluster ( #14889 )
2022-05-12 09:54:07 -07:00
Eric Qiu
c293c2e9a3
docs: update new name for MINIO_POLICY_OPA_URL ( #14898 )
2022-05-11 13:04:15 -07:00
Aditya Manthramurthy
83071a3459
Add support for Access Management Plugin ( #14875 )
...
- This change renames the OPA integration as Access Management Plugin - there is
nothing specific to OPA in the integration, it is just a webhook.
- OPA configuration is automatically migrated to Access Management Plugin and
OPA specific configuration is marked as deprecated.
- OPA doc is updated and moved.
2022-05-10 17:14:55 -07:00
Minio Trusted
95d1a12422
Update yaml files to latest version RELEASE.2022-05-08T23-50-31Z
2022-05-09 03:46:40 +00:00
Harshavardhana
62aa42cccf
avoid replication proxy on version excluded paths ( #14878 )
...
no need to attempt proxying objects that were
never replicated, but do have local `null`
versions on them.
2022-05-08 16:50:31 -07:00
Harshavardhana
5cffd3780a
fix: multiple fixes in prefix exclude implementation ( #14877 )
...
- do not need to restrict prefix exclusions that do not
have `/` as suffix, relax this requirement as spark may
have staging folders with other autogenerated characters
, so we are better off doing full prefix March and skip.
- multiple delete objects was incorrectly creating a
null delete marker on a versioned bucket instead of
creating a proper versioned delete marker.
- do not suspend paths on the excluded prefixes during
delete operations to avoid creating `null` delete markers,
honor suspension of versioning only at bucket level for
delete markers.
2022-05-07 22:06:44 -07:00
Krishnan Parthasarathi
ad8e611098
feat: implement prefix-level versioning exclusion ( #14828 )
...
Spark/Hadoop workloads which use Hadoop MR
Committer v1/v2 algorithm upload objects to a
temporary prefix in a bucket. These objects are
'renamed' to a different prefix on Job commit.
Object storage admins are forced to configure
separate ILM policies to expire these objects
and their versions to reclaim space.
Our solution:
This can be avoided by simply marking objects
under these prefixes to be excluded from versioning,
as shown below. Consequently, these objects are
excluded from replication, and don't require ILM
policies to prune unnecessary versions.
- MinIO Extension to Bucket Version Configuration
```xml
<VersioningConfiguration xmlns="http://s3.amazonaws.com/doc/2006-03-01/ ">
<Status>Enabled</Status>
<ExcludeFolders>true</ExcludeFolders>
<ExcludedPrefixes>
<Prefix>app1-jobs/*/_temporary/</Prefix>
</ExcludedPrefixes>
<ExcludedPrefixes>
<Prefix>app2-jobs/*/__magic/</Prefix>
</ExcludedPrefixes>
<!-- .. up to 10 prefixes in all -->
</VersioningConfiguration>
```
Note: `ExcludeFolders` excludes all folders in a bucket
from versioning. This is required to prevent the parent
folders from accumulating delete markers, especially
those which are shared across spark workloads
spanning projects/teams.
- To enable version exclusion on a list of prefixes
```
mc version enable --excluded-prefixes "app1-jobs/*/_temporary/,app2-jobs/*/_magic," --exclude-prefix-marker myminio/test
```
2022-05-06 19:05:28 -07:00
Aditya Manthramurthy
2b7e75e079
Add OPA doc and remove deprecation marking ( #14863 )
2022-05-04 23:53:42 -07:00
Minio Trusted
2fc65dcb99
Update yaml files to latest version RELEASE.2022-05-04T07-45-27Z
2022-05-04 08:54:16 +00:00
Minio Trusted
0a256053ee
Update yaml files to latest version RELEASE.2022-05-03T20-36-08Z
2022-05-03 21:27:19 +00:00
Minio Trusted
f427dbbd60
Update yaml files to latest version RELEASE.2022-04-30T22-23-53Z
2022-05-01 01:33:28 +00:00
Harshavardhana
85f3a9f3b0
Remove Azure gateway implementation ( #14418 )
...
refer #14331
2022-04-29 12:51:23 -07:00
Minio Trusted
96f27a4965
Update yaml files to latest version RELEASE.2022-04-29T01-27-09Z
2022-04-29 06:32:50 +00:00
Aditya Manthramurthy
0e502899a8
Add support for multiple OpenID providers with role policies ( #14223 )
...
- When using multiple providers, claim-based providers are not allowed. All
providers must use role policies.
- Update markdown config to allow `details` HTML element
2022-04-28 18:27:09 -07:00
Harshavardhana
990fbeb3a4
rename true/false to on/off in bucket notification docs
2022-04-27 23:51:31 -07:00
Minio Trusted
8a6b2b4447
Update yaml files to latest version RELEASE.2022-04-26T01-20-24Z
2022-04-26 02:08:20 +00:00
Harshavardhana
0cc993f403
Remove GCS, HDFS gateway implementations #14418
...
refer #14331
2022-04-24 10:19:17 -07:00
Minio Trusted
1494ba2e6e
Update yaml files to latest version RELEASE.2022-04-16T04-26-02Z
2022-04-16 05:03:00 +00:00
Minio Trusted
646350fa7f
Update yaml files to latest version RELEASE.2022-04-12T06-55-35Z
2022-04-12 07:23:20 +00:00
Minio Trusted
33d267fa1b
Update yaml files to latest version RELEASE.2022-04-09T15-09-52Z
2022-04-09 20:23:18 +00:00
Minio Trusted
f630d7c3fa
Update yaml files to latest version RELEASE.2022-04-08T19-44-35Z
2022-04-08 23:35:38 +00:00
Minio Trusted
c7962118f8
Update yaml files to latest version RELEASE.2022-04-01T03-41-39Z
2022-04-01 08:23:40 +00:00
Andreas Auernhammer
e955aa7f2a
kes: add support for encrypted private keys ( #14650 )
...
This commit adds support for encrypted KES
client private keys.
Now, it is possible to encrypt the KES client
private key (`MINIO_KMS_KES_KEY_FILE`) with
a password.
For example, KES CLI already supports the
creation of encrypted private keys:
```
kes identity new --encrypt --key client.key --cert client.crt MinIO
```
To decrypt an encrypted private key, the password
needs to be provided:
```
MINIO_KMS_KES_KEY_PASSWORD=<password>
```
Signed-off-by: Andreas Auernhammer <hi@aead.dev>
2022-03-29 09:53:33 -07:00
Eco
81d2b54dfd
doc: typo fix for ttfb entry in table ( #14647 )
2022-03-29 09:42:02 -07:00
Minio Trusted
be5d394e56
Update yaml files to latest version RELEASE.2022-03-26T06-49-28Z
2022-03-26 07:32:25 +00:00
Minio Trusted
849a27ee61
update hotfixes instructions and fix some typo
2022-03-25 23:49:28 -07:00
Andreas Auernhammer
4d2fc530d0
add support for SSE-S3 bulk ETag decryption ( #14627 )
...
This commit adds support for bulk ETag
decryption for SSE-S3 encrypted objects.
If KES supports a bulk decryption API, then
MinIO will check whether its policy grants
access to this API. If so, MinIO will use
a bulk API call instead of sending encrypted
ETags serially to KES.
Note that MinIO will not use the KES bulk API
if its client certificate is an admin identity.
MinIO will process object listings in batches.
A batch has a configurable size that can be set
via `MINIO_KMS_KES_BULK_API_BATCH_SIZE=N`.
It defaults to `500`.
This env. variable is experimental and may be
renamed / removed in the future.
Signed-off-by: Andreas Auernhammer <hi@aead.dev>
2022-03-25 15:01:41 -07:00
Minio Trusted
cf220be9b5
Update yaml files to latest version RELEASE.2022-03-24T00-43-44Z
2022-03-24 01:28:05 +00:00
Minio Trusted
751e9fb7be
Update yaml files to latest version RELEASE.2022-03-22T02-05-10Z
2022-03-22 02:45:24 +00:00
Minio Trusted
e9bc0e7e98
Update yaml files to latest version RELEASE.2022-03-17T06-34-49Z
2022-03-17 00:11:59 -07:00
Minio Trusted
7a733a8d54
Update yaml files to latest version RELEASE.2022-03-17T02-57-36Z
2022-03-16 22:27:48 -07:00
Aditya Manthramurthy
ce97313fda
Add extra LDAP configuration validation ( #14535 )
...
- The result now contains suggestions on fixing common configuration issues.
- These suggestions will subsequently be exposed in console/mc
2022-03-16 19:57:36 -07:00
Minio Trusted
721c053712
Update yaml files to latest version RELEASE.2022-03-14T18-25-24Z
2022-03-14 19:32:22 +00:00
Minio Trusted
57b7c3494f
Update yaml files to latest version RELEASE.2022-03-11T23-57-45Z
2022-03-13 08:47:27 +00:00
Poorna
f8d6eaaa96
fix: regression from range GET proxy on replicated buckets #14345 ( #14532 )
...
Fixes : #14531
2022-03-11 15:56:49 -08:00
Minio Trusted
80039f60d5
Update yaml files to latest version RELEASE.2022-03-11T11-08-23Z
2022-03-11 11:47:17 +00:00
Aditya Manthramurthy
b7ed3b77bd
Indicate required fields in LDAP configuration correctly ( #14526 )
2022-03-10 19:03:38 -08:00
Minio Trusted
fce380a044
Update yaml files to latest version RELEASE.2022-03-08T22-28-51Z
2022-03-09 01:36:59 +00:00
Minio Trusted
1f11af42f1
Update yaml files to latest version RELEASE.2022-03-05T06-32-39Z
2022-03-05 09:27:28 +00:00
Jan Madera
a026c8748f
Update nginx.conf for large file uploads ( #14481 )
2022-03-04 22:32:39 -08:00
Harshavardhana
b0c84e3de7
fix: deleteVersions causing xl.meta to have empty Versions[] slice ( #14483 )
...
This is a side-affect of the optimization done in PR #13544 which
causes a certain type of delete operations on given object versions
can cause lastVersion indication to be skipped, which leads to
an `xl.meta` where Versions[] slice is empty while the entire
file is intact by itself.
This PR tries to ensure that such files are visible and deletable
by regular means of listing as null 'delete-marker' and also
avoid the situation where this potential issue might arise.
2022-03-04 20:01:26 -08:00
Minio Trusted
04bbede17d
Update yaml files to latest version RELEASE.2022-03-03T21-21-16Z
2022-03-03 22:16:10 +00:00
Emmet McPoland
27fad98179
Replace HeadBucket permission with GetBucketAcl ( #14436 )
...
Resolves https://github.com/minio/minio/issues/14379
2022-03-01 21:18:23 -08:00
Minio Trusted
7d4579e737
Update yaml files to latest version RELEASE.2022-02-26T02-54-46Z
2022-02-26 03:36:08 +00:00
Harshavardhana
890e526bde
rename 'mc admin inspect' to 'mc support inspect'
2022-02-24 17:17:53 -08:00
Harshavardhana
16ce455fca
update docker release to RELEASE.2022-02-24T22-12-01Z
2022-02-24 15:35:14 -08:00
Minio Trusted
b23b19e5c3
Update yaml files to latest version RELEASE.2022-02-18T01-50-10Z
2022-02-17 19:12:27 -08:00
Minio Trusted
1dbb3f6f43
Update yaml files to latest version RELEASE.2022-02-17T23-22-26Z
2022-02-18 00:33:01 +00:00
Minio Trusted
27d94c64ed
Update yaml files to latest version RELEASE.2022-02-16T00-35-27Z
2022-02-16 05:34:56 +00:00
Pierre Kancir
d0862ddf86
doc: add console-address on all example ( #14307 )
...
--console-address ":9001" is missing on docker example for regular user.
2022-02-15 09:26:04 -08:00
Harshavardhana
f088e8960b
docs: turn-on more markdown rules and fix them ( #14301 )
2022-02-14 08:50:42 -08:00
Anis Elleuch
1f92fc3fc0
Always check for root disks unless MINIO_CI_CD is set ( #14232 )
...
The current code considers a pool with all root disks to be as part
of a testing environment even if there are other pools with mounted
disks. This will result to illegitimate writing in root disks.
Fix this by simplifing the logic: require MINIO_CI_CD in order to skip
root disk check.
2022-02-13 15:42:07 -08:00
Minio Trusted
f71b114a84
Update yaml files to latest version RELEASE.2022-02-12T00-51-25Z
2022-02-13 19:31:37 +00:00
Harshavardhana
e3e0532613
cleanup markdown docs across multiple files ( #14296 )
...
enable markdown-linter
2022-02-11 16:51:25 -08:00
Harshavardhana
97b5bf1fb7
update gateway docs to indicate code-freeze
2022-02-10 11:39:41 -08:00
Poorna
ed3418c046
Refactor replication resync to be an active process ( #14266 )
...
When resync is triggered, walk the bucket namespace and
resync objects that are unreplicated. This PR also adds
an API to report resync progress.
2022-02-10 10:16:52 -08:00
Harshavardhana
a2230868e0
remove all stale old docs about 2018 releases
2022-02-10 09:54:27 -08:00
Krishnan Parthasarathi
0ee2933234
Export tier metrics via Prometheus ( #13413 )
...
e.g
```
minio_cluster_ilm_transitioned_bytes{server="minio3:9000",tier="S3TIER-1"} 1.36317772e+08
minio_cluster_ilm_transitioned_bytes{server="minio3:9000",tier="S3TIER-2"} 2892
minio_cluster_ilm_transitioned_bytes{server="minio3:9000",tier="STANDARD"}
1.3631488e+08
minio_cluster_ilm_transitioned_objects{server="minio3:9000",tier="S3TIER-1"} 1
minio_cluster_ilm_transitioned_objects{server="minio3:9000",tier="S3TIER-2"} 0
minio_cluster_ilm_transitioned_objects{server="minio3:9000",tier="STANDARD"} 1
minio_cluster_ilm_transitioned_versions{server="minio3:9000",tier="S3TIER-1"} 3
minio_cluster_ilm_transitioned_versions{server="minio3:9000",tier="S3TIER-2"} 2
minio_cluster_ilm_transitioned_versions{server="minio3:9000",tier="STANDARD"} 1
```
2022-02-08 12:45:28 -08:00
Minio Trusted
2480c66857
Update yaml files to latest version RELEASE.2022-02-07T08-17-33Z
2022-02-07 09:19:24 +00:00
Minio Trusted
570670be8c
Update yaml files to latest version RELEASE.2022-02-05T04-40-59Z
2022-02-05 18:33:46 +00:00
Minio Trusted
9417fd933e
Update yaml files to latest version RELEASE.2022-02-01T18-00-14Z
2022-02-01 23:37:07 +00:00
Harshavardhana
74faed166a
Add quota usage as part of prometheus metrics ( #14222 )
...
Bonus: pass caller context when needed to all bucket metadata handling calls.
2022-01-31 17:27:43 -08:00
Harshavardhana
dbd05d6e82
remove FIFO bucket quota, use ILM expiration instead ( #14206 )
2022-01-31 11:07:04 -08:00
Minio Trusted
c7df5fb119
Update yaml files to latest version RELEASE.2022-01-28T02-28-16Z
2022-01-28 05:12:35 +00:00
Minio Trusted
a66071099c
Update yaml files to latest version RELEASE.2022-01-27T03-53-02Z
2022-01-27 04:47:45 +00:00
Aditya Manthramurthy
7dfa565d00
Identity LDAP: Allow multiple search base DNs ( #14191 )
...
This change allows the MinIO server to lookup users in different directory
sub-trees by allowing specification of multiple search bases separated by
semicolons.
2022-01-26 15:05:59 -08:00
Bingchang Chen
affe51cb19
docs: add casdoor as identity provider ( #14185 )
2022-01-26 09:49:10 -08:00
Minio Trusted
f556a72fe2
Update yaml files to latest version RELEASE.2022-01-25T19-56-04Z
2022-01-25 20:42:46 +00:00
Harshavardhana
cd7a5cab8a
update docs for Decommission
2022-01-25 11:56:04 -08:00
Poorna
295730408b
Disallow delete replication for tag based rules ( #14167 )
2022-01-24 15:22:20 -08:00
Harshavardhana
f30afa4956
docs: add decommission docs about pool removal ( #14159 )
2022-01-24 09:47:06 -08:00
Harshavardhana
8fb4ae916c
update decommission docs
2022-01-21 18:34:06 -08:00
Klaus Post
07df9eecda
Update xl.meta docs ( #14150 )
2022-01-21 08:47:46 -08:00
Harshavardhana
9d588319dd
support site replication to replicate IAM users,groups ( #14128 )
...
- Site replication was missing replicating users,
groups when an empty site was added.
- Add site replication for groups and users when they
are disabled and enabled.
- Add support for replicating bucket quota config.
2022-01-19 20:02:24 -08:00
Poorna
54a98773f8
fix: replication of tag removal ( #14056 )
...
Currently tag removal leaves replication state as `PENDING`
because the `HEAD` api returns just a tag count but not the
actual tags, and this is treated as a no-op
2022-01-10 19:06:10 -08:00
Harshavardhana
76b21de0c6
feat: decommission feature for pools ( #14012 )
...
```
λ mc admin decommission start alias/ http://minio{1...2}/data{1...4}
```
```
λ mc admin decommission status alias/
┌─────┬─────────────────────────────────┬──────────────────────────────────┬────────┐
│ ID │ Pools │ Capacity │ Status │
│ 1st │ http://minio{1...2}/data{1...4} │ 439 GiB (used) / 561 GiB (total) │ Active │
│ 2nd │ http://minio{3...4}/data{1...4} │ 329 GiB (used) / 421 GiB (total) │ Active │
└─────┴─────────────────────────────────┴──────────────────────────────────┴────────┘
```
```
λ mc admin decommission status alias/ http://minio{1...2}/data{1...4}
Progress: ===================> [1GiB/sec] [15%] [4TiB/50TiB]
Time Remaining: 4 hours (started 3 hours ago)
```
```
λ mc admin decommission status alias/ http://minio{1...2}/data{1...4}
ERROR: This pool is not scheduled for decommissioning currently.
```
```
λ mc admin decommission cancel alias/
┌─────┬─────────────────────────────────┬──────────────────────────────────┬──────────┐
│ ID │ Pools │ Capacity │ Status │
│ 1st │ http://minio{1...2}/data{1...4} │ 439 GiB (used) / 561 GiB (total) │ Draining │
└─────┴─────────────────────────────────┴──────────────────────────────────┴──────────┘
```
> NOTE: Canceled decommission will not make the pool active again, since we might have
> Potentially partial duplicate content on the other pools, to avoid this scenario be
> very sure to start decommissioning as a planned activity.
```
λ mc admin decommission cancel alias/ http://minio{1...2}/data{1...4}
┌─────┬─────────────────────────────────┬──────────────────────────────────┬────────────────────┐
│ ID │ Pools │ Capacity │ Status │
│ 1st │ http://minio{1...2}/data{1...4} │ 439 GiB (used) / 561 GiB (total) │ Draining(Canceled) │
└─────┴─────────────────────────────────┴──────────────────────────────────┴────────────────────┘
```
2022-01-10 09:07:49 -08:00
Minio Trusted
f394313fee
Update yaml files to latest version RELEASE.2022-01-08T03-11-54Z
2022-01-08 05:53:59 +00:00
Harshavardhana
b7c5e45fff
heal: isObjectDangling should return false when it cannot decide ( #14053 )
...
In a multi-pool setup when disks are coming up, or in a single pool
setup let's say with 100's of erasure sets with a slow network.
It's possible when healing is attempted on `.minio.sys/config`
folder, it can lead to healing unexpectedly deleting some policy
files as dangling due to a mistake in understanding when `isObjectDangling`
is considered to be 'true'.
This issue happened in commit 30135eed86
2022-01-07 19:11:54 -08:00
Aditya Manthramurthy
0a224654c2
fix: progagation of service accounts for site replication ( #14054 )
...
- Only non-root-owned service accounts are replicated for now.
- Add integration tests for OIDC with site replication
2022-01-07 17:41:43 -08:00
Minio Trusted
e420a1de4d
Update yaml files to latest version RELEASE.2022-01-07T01-53-23Z
2022-01-07 05:57:36 +00:00
Aditya Manthramurthy
62dc0f7698
Update site replication docs ( #14044 )
...
- Now OpenID external IDP is also supported for site replication.
- IAM users/groups are also replicated
2022-01-06 17:53:23 -08:00
Minio Trusted
f4c03e56b8
Update yaml files to latest version RELEASE.2022-01-04T07-41-07Z
2022-01-04 23:01:29 +00:00
Minio Trusted
5dd40b9377
Update yaml files to latest version RELEASE.2022-01-03T18-22-58Z
2022-01-04 00:12:07 +00:00
Harshavardhana
a60ac7ca17
fix: audit log to support object names in multipleObjectNames() handler ( #14017 )
2022-01-03 01:28:52 -08:00
Minio Trusted
c9e49f4366
Update yaml files to latest version RELEASE.2021-12-29T06-49-06Z
2021-12-29 07:38:12 +00:00
Yoann Guillerme
3e28af1723
docs: update TLS doc use -keyout instead of -key ( #14001 )
2021-12-28 12:51:38 -08:00
Minio Trusted
6aa0574a53
Update yaml files to latest version RELEASE.2021-12-27T07-23-18Z
2021-12-27 19:52:13 +00:00
Harshavardhana
7e3a7d7044
add healing for invalid shards by skipping the blocks ( #13978 )
...
Built on top of #13945 , now we need to simply skip the
shards and its automated.
2021-12-23 23:01:46 -08:00
Harshavardhana
416977436e
rename MINIO_CACHE_.._MASTER_KEY to MINIO_CACHE_.._SECRET_KEY
...
fixes #13975
2021-12-22 12:11:07 -08:00
Harshavardhana
0e3037631f
skip inconsistent shards if possible ( #13945 )
...
data shards were wrong due to a healing bug
reported in #13803 mainly with unaligned object
sizes.
This PR is an attempt to automatically avoid
these shards, with available information about
the `xl.meta` and actually disk mtime.
2021-12-21 10:08:26 -08:00
Minio Trusted
f3602d7d08
Update yaml files to latest version RELEASE.2021-12-20T22-07-16Z
2021-12-20 23:13:48 +00:00
Harshavardhana
0b21734571
update helm chart link
2021-12-20 13:20:59 -08:00
Minio Trusted
cfd66ab8c3
Update yaml files to latest version RELEASE.2021-12-18T04-42-33Z
2021-12-19 22:19:30 +00:00
Krishnan Parthasarathi
3ddb501190
Add docs for NewerNoncurrentVersions ( #13944 )
2021-12-17 19:32:29 -08:00
Harshavardhana
4fa250a6a1
add hash-set debugging currently supports SIPMOD ( #13911 )
...
fixes a bug in s3-check-md5 for single part
uploaded multipart objects.
2021-12-15 12:07:15 -08:00
Harshavardhana
88ad742da0
fix: error handling cases in site-replication ( #13901 )
...
- Allow proper SRError to be propagated to
handlers and converted appropriately.
- Make sure to enable object locking on buckets
when requested in MakeBucketHook.
- When DNSConfig is enabled attempt to delete it
first before deleting buckets locally.
2021-12-14 14:09:57 -08:00
fpaupier
40dbe243d9
update: keycloak binding documentation ( #13894 )
2021-12-13 18:23:16 -08:00
Harshavardhana
109c927dad
docs/debug: log any corruption and continue debug tool
2021-12-13 17:45:34 -08:00
Minio Trusted
878d368cea
Update yaml files to latest version RELEASE.2021-12-10T23-03-39Z
2021-12-11 00:02:59 -08:00
Klaus Post
518612492c
xl-meta: Add header titles ( #13880 )
...
Add type for headers and create custom marshal to make
it easier to read. Group headers and metadata.
Restore functionality that will read `xl.meta` in the current dir with no params.
Before:
```
{
"Headers": [
[
"8M04bTiYRDmEMQGeAsk1yg==",
1639150471630100400,
"rLD1Rw==",
1,
6
],
],
"Versions": [
{
"Type": 1,
"V2Obj": {
"CSumAlgo": 1,
"DDir": "oC1Xpg4tRfW03g8o8w7Bzg==",
"EcAlgo": 1,
"EcBSize": 1048576,
"EcDist": [
7,
8,
1,
2,
3,
4,
5,
6
],
"EcIndex": 1,
"EcM": 4,
"EcN": 4,
"ID": "8M04bTiYRDmEMQGeAsk1yg==",
"MTime": 1639150471630100400,
"MetaSys": {
"x-minio-internal-inline-data": "dHJ1ZQ=="
},
"MetaUsr": {
"content-type": "application/octet-stream",
"etag": "b8252c86fad2d8937300aa92b467a3aa"
},
"PartASizes": [
1000
],
"PartETags": null,
"PartNums": [
1
],
"PartSizes": [
1000
],
"Size": 1000
}
}
]
}
```
After:
```
{
"Versions": [
{
"Header": {
"Flags": 6,
"ModTime": "2021-12-10T16:34:31.6301004+01:00",
"Signature": "acb0f547",
"Type": 1,
"VersionID": "f0cd386d389844398431019e02c935ca"
},
"Idx": 0,
"Metadata": {
"Type": 1,
"V2Obj": {
"CSumAlgo": 1,
"DDir": "oC1Xpg4tRfW03g8o8w7Bzg==",
"EcAlgo": 1,
"EcBSize": 1048576,
"EcDist": [
7,
8,
1,
2,
3,
4,
5,
6
],
"EcIndex": 1,
"EcM": 4,
"EcN": 4,
"ID": "8M04bTiYRDmEMQGeAsk1yg==",
"MTime": 1639150471630100400,
"MetaSys": {
"x-minio-internal-inline-data": "dHJ1ZQ=="
},
"MetaUsr": {
"content-type": "application/octet-stream",
"etag": "b8252c86fad2d8937300aa92b467a3aa"
},
"PartASizes": [
1000
],
"PartETags": null,
"PartNums": [
1
],
"PartSizes": [
1000
],
"Size": 1000
}
}
}
]
}
```
2021-12-10 15:03:25 -08:00
Ravind Kumar
c76f86fdbd
Clarify example for Standalone Docker instructions ( #13879 )
...
Closes #13868
Also points users to the web documentation for docker installation.
2021-12-10 09:43:02 -08:00
Minio Trusted
4be8023408
Update yaml files to latest version RELEASE.2021-12-09T06-19-41Z
2021-12-09 08:40:46 +00:00
Harshavardhana
dcff6c996d
fix: do not list delete-marked objects ( #13864 )
...
delete marked objects should not be considered
for listing when listing is delimited, this issue
as introduced in PR #13804 which was mainly to
address listing of directories in listing when
delimited.
This PR fixes this properly and adds tests to
ensure that we behave in accordance with how
an S3 API behaves for ListObjects() without
versions.
2021-12-08 17:34:52 -08:00
Harshavardhana
e82a5c5c54
fix: site replication issues and add tests ( #13861 )
...
- deleting policies was deleting all LDAP
user mapping, this was a regression introduced
in #13567
- deleting of policies is properly sent across
all sites.
- remove unexpected errors instead embed the real
errors as part of the 500 error response.
2021-12-08 11:50:15 -08:00
Harshavardhana
92fdcafb66
add verification tests for ETag on replicated content ( #13857 )
2021-12-07 10:08:26 -08:00
Harshavardhana
be34fc9134
fix: kms-id header should have arn:aws:kms: prefix ( #13833 )
...
arn:aws:kms: is a must for KMS keyID.
2021-12-06 00:39:32 -08:00
Harshavardhana
20c60aae68
Update hotfix documentation and container building
2021-12-02 17:52:46 -08:00
Harshavardhana
f840080e5b
cleanup site-replication docs ( #13812 )
2021-12-02 13:27:01 -08:00
Harshavardhana
ffe9acfe4a
docs: Add a markdown documentation on hotfix branches and process
2021-12-01 01:00:18 -08:00
Poorna K
9ec197f2e8
Add support for adding new site(s) to site replication ( #13696 )
...
Currently, the new site is expected to be empty
2021-11-30 13:16:37 -08:00
Aditya Manthramurthy
4c0f48c548
Add role ARN support for OIDC identity provider ( #13651 )
...
- Allows setting a role policy parameter when configuring OIDC provider
- When role policy is set, the server prints a role ARN usable in STS API requests
- The given role policy is applied to STS API requests when the roleARN parameter is provided.
- Service accounts for role policy are also possible and work as expected.
2021-11-26 19:22:40 -08:00
Aditya Manthramurthy
4ce6d35e30
Add new site config sub-system intended to replace region ( #13672 )
...
- New sub-system has "region" and "name" fields.
- `region` subsystem is marked as deprecated, however still works, unless the
new region parameter under `site` is set - in this case, the region subsystem is
ignored. `region` subsystem is hidden from top-level help (i.e. from `mc admin
config set myminio`), but appears when specifically requested (i.e. with `mc
admin config set myminio region`).
- MINIO_REGION, MINIO_REGION_NAME are supported as legacy environment variables for server region.
- Adds MINIO_SITE_REGION as the current environment variable to configure the
server region and MINIO_SITE_NAME for the site name.
2021-11-25 13:06:25 -08:00
Minio Trusted
a5db4ca092
Update yaml files to latest version RELEASE.2021-11-24T23-19-33Z
2021-11-25 07:39:00 +00:00
chrisbecke
ef0b8367b5
Update minio-overview.json data source panel ( #13730 )
...
Add missing datasource in `Healing` panel.
2021-11-23 09:01:07 -08:00
Krishnan Parthasarathi
3da9ee15d3
Add MaxNoncurrentVersions to NoncurrentExpiration action ( #13580 )
...
This unit allows users to limit the maximum number of noncurrent
versions of an object.
To enable this rule you need the following *ilm.json*
```
cat >> ilm.json <<EOF
{
"Rules": [
{
"ID": "test-max-noncurrent",
"Status": "Enabled",
"Filter": {
"Prefix": "user-uploads/"
},
"NoncurrentVersionExpiration": {
"MaxNoncurrentVersions": 5
}
}
]
}
EOF
mc ilm import myminio/mybucket < ilm.json
```
2021-11-19 17:54:10 -08:00
Mani
7b82411e6f
change the unit of measurement from TB to TiB ( #13686 )
2021-11-18 20:06:37 -08:00
Harshavardhana
79b3a1fe4e
remove object torrent, AWS S3 removed support for torrent API
2021-11-18 12:21:48 -08:00
Klaus Post
faf013ec84
Improve performance on multiple versions ( #13573 )
...
Existing:
```go
type xlMetaV2 struct {
Versions []xlMetaV2Version `json:"Versions" msg:"Versions"`
}
```
Serialized as regular MessagePack.
```go
//msgp:tuple xlMetaV2VersionHeader
type xlMetaV2VersionHeader struct {
VersionID [16]byte
ModTime int64
Type VersionType
Flags xlFlags
}
```
Serialize as streaming MessagePack, format:
```
int(headerVersion)
int(xlmetaVersion)
int(nVersions)
for each version {
binary blob, xlMetaV2VersionHeader, serialized
binary blob, xlMetaV2Version, serialized.
}
```
xlMetaV2VersionHeader is <= 30 bytes serialized. Deserialized struct
can easily be reused and does not contain pointers, so efficient as a
slice (single allocation)
This allows quickly parsing everything as slices of bytes (no copy).
Versions are always *saved* sorted by modTime, newest *first*.
No more need to sort on load.
* Allows checking if a version exists.
* Allows reading single version without unmarshal all.
* Allows reading latest version of type without unmarshal all.
* Allows reading latest version without unmarshal of all.
* Allows checking if the latest is deleteMarker by reading first entry.
* Allows adding/updating/deleting a version with only header deserialization.
* Reduces allocations on conversion to FileInfo(s).
2021-11-18 12:15:22 -08:00
Ashish Kumar Sinha
3d2bc15e9a
Add grafana json file for replication metrics ( #13678 )
2021-11-17 14:49:46 -08:00
Harshavardhana
661b263e77
add gocritic/ruleguard checks back again, cleanup code. ( #13665 )
...
- remove some duplicated code
- reported a bug, separately fixed in #13664
- using strings.ReplaceAll() when needed
- using filepath.ToSlash() use when needed
- remove all non-Go style comments from the codebase
Co-authored-by: Aditya Manthramurthy <donatello@users.noreply.github.com>
2021-11-16 09:28:29 -08:00
Harshavardhana
82d73f387d
add tool to read healing.bin for debugging ( #13650 )
2021-11-12 16:18:53 -08:00
Harshavardhana
5acc8c0134
add multi-site replication tests ( #13631 )
2021-11-10 18:18:09 -08:00
Poorna K
03725dc015
Default multipart caching to writethrough ( #13613 )
...
when `MINIO_CACHE_COMMIT` is set.
- `writeback` caching applies only to single
uploads. When cache commit mode is
`writeback`, default multipart caching to be
synchronous.
- Add writethrough caching for single uploads
2021-11-10 08:12:03 -08:00
Minio Trusted
edf1f4233b
Update yaml files to latest version RELEASE.2021-11-09T03-21-45Z
2021-11-09 04:51:05 +00:00
Harshavardhana
5aef492b4c
update disk-caching design guide
2021-11-07 01:21:34 -08:00
Harshavardhana
5d7ed8ff7d
update S3 gateway limitation docs
2021-11-06 23:24:48 -07:00
Minio Trusted
cbb0828ab8
Update yaml files to latest version RELEASE.2021-11-05T09-16-26Z
2021-11-05 10:03:56 +00:00
Minio Trusted
9f3c151c3c
Update yaml files to latest version RELEASE.2021-11-03T03-36-36Z
2021-11-03 06:48:34 +00:00
Harshavardhana
e106070640
update docs to mention the expected behavior for requests_max
...
fixes #13561
2021-11-02 14:10:21 -07:00
jandres - moscardo
1aa08f594d
Update README.md prometheus ( #13514 )
...
Modify the doc to warn users about Prometheus sending `domain:port`
2021-11-02 12:27:30 -07:00
Poorna K
15dcacc1fc
Add support for caching multipart in writethrough mode ( #13507 )
2021-11-01 08:11:58 -07:00
Harshavardhana
3c1220adca
add tests for default governance replication
2021-10-30 08:57:59 -07:00
Harshavardhana
2af5445309
update 3-site replication tests
2021-10-29 22:09:55 -07:00
Harshavardhana
abb1916bda
update list objects limit to match S3 spec
2021-10-28 18:21:51 -07:00
Minio Trusted
8e29ae8c44
Update yaml files to latest version RELEASE.2021-10-27T16-29-42Z
2021-10-28 02:45:22 +00:00
Minio Trusted
0c76fb57f2
Update yaml files to latest version RELEASE.2021-10-23T03-28-24Z
2021-10-23 07:46:29 +00:00
Harshavardhana
52c5f6e152
remove extraneous whitespaces
2021-10-21 14:43:13 -07:00
Aditya Manthramurthy
26ca59859f
update LDAP doc ( #13492 )
...
- clarify the login flow
- add some sections on configuration
- minor fixes to improve readability
2021-10-21 14:41:32 -07:00
Klaus Post
1642867136
Add documentation for debugging tools ( #13484 )
...
Move `xl-meta` so it can be installed out-of-repo with a single command.
2021-10-20 10:12:46 -07:00
Harshavardhana
bedf739d16
update required IAM policies
2021-10-13 12:28:53 -07:00
Minio Trusted
6299e42aa9
Update yaml files to latest version RELEASE.2021-10-13T00-23-17Z
2021-10-13 01:14:23 +00:00
Harshavardhana
9ea45399ce
fix: enable AssumeRoleWithCertificate API only when asked ( #13410 )
...
This is a breaking change but we need to do this to avoid
issues discussed in #13409 based on discussions from #13371
fixes #13371
fixes #13409
2021-10-11 14:23:51 -07:00
Minio Trusted
e0db822a9b
Update yaml files to latest version RELEASE.2021-10-10T16-53-30Z
2021-10-10 21:24:01 +00:00
Minio Trusted
c49ebaaf1a
Update yaml files to latest version RELEASE.2021-10-08T23-58-24Z
2021-10-09 00:50:16 +00:00
Harshavardhana
d57b57bddc
feat: Add RX/TX to audit logging ( #13382 )
...
add additional values for audit logging
2021-10-07 19:03:46 -07:00
Aditya Manthramurthy
f81a188ef6
update site replication doc ( #13377 )
...
make pre-requisites clear
2021-10-07 15:21:01 -07:00
Minio Trusted
4ce6830a7b
Update yaml files to latest version RELEASE.2021-10-06T23-36-31Z
2021-10-07 04:13:46 +00:00
Aditya Manthramurthy
3a7c79e2c7
Add new site replication feature ( #13311 )
...
This change allows a set of MinIO sites (clusters) to be configured
for mutual replication of all buckets (including bucket policies, tags,
object-lock configuration and bucket encryption), IAM policies,
LDAP service accounts and LDAP STS accounts.
2021-10-06 16:36:31 -07:00
Minio Trusted
d6a3215fe2
Update yaml files to latest version RELEASE.2021-10-02T16-31-05Z
2021-10-03 21:43:13 +00:00
Klaus Post
bc6067d195
Add admin inspect Glob support ( #13328 )
...
* Add admin Glob support
Allow returning multiple files on inspect calls.
```
λ mc admin inspect --json local2/testbucket/nyc-taxi-data-10M.csv.zst/*
...
λ unzip -l inspect.5f0643b2.zip
Archive: inspect.5f0643b2.zip
Length Date Time Name
--------- ---------- ----- ----
0 2021-09-03 12:50 192.168.1.78:9001/a221edde-48fe-45f5-ad32-3bc7131c7659/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/
802 2021-09-03 12:50 192.168.1.78:9001/a221edde-48fe-45f5-ad32-3bc7131c7659/testbucket/nyc-taxi-data-10M.csv.zst/xl.meta
0 2021-09-03 12:50 192.168.1.78:9001/cb7440ef-f0d9-42a8-b137-f00f519276ca/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/
802 2021-09-03 12:50 192.168.1.78:9001/cb7440ef-f0d9-42a8-b137-f00f519276ca/testbucket/nyc-taxi-data-10M.csv.zst/xl.meta
0 2021-09-03 12:50 192.168.1.78:9001/759cd5ac-7860-4cf3-acad-a375fcbae338/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/
802 2021-09-03 12:50 192.168.1.78:9001/759cd5ac-7860-4cf3-acad-a375fcbae338/testbucket/nyc-taxi-data-10M.csv.zst/xl.meta
0 2021-09-09 15:56 192.168.1.78:9001/2b48619c-c2fa-4e69-839e-58fc82c1b43e/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/
802 2021-09-09 15:56 192.168.1.78:9001/2b48619c-c2fa-4e69-839e-58fc82c1b43e/testbucket/nyc-taxi-data-10M.csv.zst/xl.meta
--------- -------
3208 8 files
```
Using fully recursive:
```
λ mc admin inspect local2/testbucket/nyc-taxi-data-10M.csv.zst/**
...
Archive: inspect.79c261cb.zip
Length Date Time Name
--------- ---------- ----- ----
0 2021-09-03 12:50 192.168.1.78:9001/a221edde-48fe-45f5-ad32-3bc7131c7659/testbucket/nyc-taxi-data-10M.csv.zst/
0 2021-09-03 12:50 192.168.1.78:9001/a221edde-48fe-45f5-ad32-3bc7131c7659/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/
4194816 2021-09-03 12:50 192.168.1.78:9001/a221edde-48fe-45f5-ad32-3bc7131c7659/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.1
4194816 2021-09-03 12:50 192.168.1.78:9001/a221edde-48fe-45f5-ad32-3bc7131c7659/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.10
4194816 2021-09-03 12:50 192.168.1.78:9001/a221edde-48fe-45f5-ad32-3bc7131c7659/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.11
4194816 2021-09-03 12:50 192.168.1.78:9001/a221edde-48fe-45f5-ad32-3bc7131c7659/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.12
4194816 2021-09-03 12:50 192.168.1.78:9001/a221edde-48fe-45f5-ad32-3bc7131c7659/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.13
4194816 2021-09-03 12:50 192.168.1.78:9001/a221edde-48fe-45f5-ad32-3bc7131c7659/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.14
4194816 2021-09-03 12:50 192.168.1.78:9001/a221edde-48fe-45f5-ad32-3bc7131c7659/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.15
4194816 2021-09-03 12:50 192.168.1.78:9001/a221edde-48fe-45f5-ad32-3bc7131c7659/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.16
4194816 2021-09-03 12:50 192.168.1.78:9001/a221edde-48fe-45f5-ad32-3bc7131c7659/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.17
4194816 2021-09-03 12:50 192.168.1.78:9001/a221edde-48fe-45f5-ad32-3bc7131c7659/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.18
4194816 2021-09-03 12:50 192.168.1.78:9001/a221edde-48fe-45f5-ad32-3bc7131c7659/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.19
4194816 2021-09-03 12:50 192.168.1.78:9001/a221edde-48fe-45f5-ad32-3bc7131c7659/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.2
4194816 2021-09-03 12:50 192.168.1.78:9001/a221edde-48fe-45f5-ad32-3bc7131c7659/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.20
4194816 2021-09-03 12:50 192.168.1.78:9001/a221edde-48fe-45f5-ad32-3bc7131c7659/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.21
4194816 2021-09-03 12:50 192.168.1.78:9001/a221edde-48fe-45f5-ad32-3bc7131c7659/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.22
4194816 2021-09-03 12:50 192.168.1.78:9001/a221edde-48fe-45f5-ad32-3bc7131c7659/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.23
4194816 2021-09-03 12:50 192.168.1.78:9001/a221edde-48fe-45f5-ad32-3bc7131c7659/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.24
4194816 2021-09-03 12:50 192.168.1.78:9001/a221edde-48fe-45f5-ad32-3bc7131c7659/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.25
4194816 2021-09-03 12:50 192.168.1.78:9001/a221edde-48fe-45f5-ad32-3bc7131c7659/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.26
4194816 2021-09-03 12:50 192.168.1.78:9001/a221edde-48fe-45f5-ad32-3bc7131c7659/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.27
4194816 2021-09-03 12:50 192.168.1.78:9001/a221edde-48fe-45f5-ad32-3bc7131c7659/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.28
4194816 2021-09-03 12:50 192.168.1.78:9001/a221edde-48fe-45f5-ad32-3bc7131c7659/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.29
4194816 2021-09-03 12:50 192.168.1.78:9001/a221edde-48fe-45f5-ad32-3bc7131c7659/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.3
4194816 2021-09-03 12:50 192.168.1.78:9001/a221edde-48fe-45f5-ad32-3bc7131c7659/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.30
4194816 2021-09-03 12:50 192.168.1.78:9001/a221edde-48fe-45f5-ad32-3bc7131c7659/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.31
4194816 2021-09-03 12:50 192.168.1.78:9001/a221edde-48fe-45f5-ad32-3bc7131c7659/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.32
4194816 2021-09-03 12:50 192.168.1.78:9001/a221edde-48fe-45f5-ad32-3bc7131c7659/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.33
4194816 2021-09-03 12:50 192.168.1.78:9001/a221edde-48fe-45f5-ad32-3bc7131c7659/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.34
4194816 2021-09-03 12:50 192.168.1.78:9001/a221edde-48fe-45f5-ad32-3bc7131c7659/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.35
3439368 2021-09-03 12:50 192.168.1.78:9001/a221edde-48fe-45f5-ad32-3bc7131c7659/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.36
4194816 2021-09-03 12:50 192.168.1.78:9001/a221edde-48fe-45f5-ad32-3bc7131c7659/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.4
4194816 2021-09-03 12:50 192.168.1.78:9001/a221edde-48fe-45f5-ad32-3bc7131c7659/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.5
4194816 2021-09-03 12:50 192.168.1.78:9001/a221edde-48fe-45f5-ad32-3bc7131c7659/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.6
4194816 2021-09-03 12:50 192.168.1.78:9001/a221edde-48fe-45f5-ad32-3bc7131c7659/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.7
4194816 2021-09-03 12:50 192.168.1.78:9001/a221edde-48fe-45f5-ad32-3bc7131c7659/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.8
4194816 2021-09-03 12:50 192.168.1.78:9001/a221edde-48fe-45f5-ad32-3bc7131c7659/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.9
802 2021-09-03 12:50 192.168.1.78:9001/a221edde-48fe-45f5-ad32-3bc7131c7659/testbucket/nyc-taxi-data-10M.csv.zst/xl.meta
0 2021-09-03 12:50 192.168.1.78:9001/cb7440ef-f0d9-42a8-b137-f00f519276ca/testbucket/nyc-taxi-data-10M.csv.zst/
0 2021-09-03 12:50 192.168.1.78:9001/cb7440ef-f0d9-42a8-b137-f00f519276ca/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/
4194816 2021-09-03 12:50 192.168.1.78:9001/cb7440ef-f0d9-42a8-b137-f00f519276ca/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.1
4194816 2021-09-03 12:50 192.168.1.78:9001/cb7440ef-f0d9-42a8-b137-f00f519276ca/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.10
4194816 2021-09-03 12:50 192.168.1.78:9001/cb7440ef-f0d9-42a8-b137-f00f519276ca/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.11
4194816 2021-09-03 12:50 192.168.1.78:9001/cb7440ef-f0d9-42a8-b137-f00f519276ca/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.12
4194816 2021-09-03 12:50 192.168.1.78:9001/cb7440ef-f0d9-42a8-b137-f00f519276ca/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.13
4194816 2021-09-03 12:50 192.168.1.78:9001/cb7440ef-f0d9-42a8-b137-f00f519276ca/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.14
4194816 2021-09-03 12:50 192.168.1.78:9001/cb7440ef-f0d9-42a8-b137-f00f519276ca/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.15
4194816 2021-09-03 12:50 192.168.1.78:9001/cb7440ef-f0d9-42a8-b137-f00f519276ca/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.16
4194816 2021-09-03 12:50 192.168.1.78:9001/cb7440ef-f0d9-42a8-b137-f00f519276ca/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.17
4194816 2021-09-03 12:50 192.168.1.78:9001/cb7440ef-f0d9-42a8-b137-f00f519276ca/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.18
4194816 2021-09-03 12:50 192.168.1.78:9001/cb7440ef-f0d9-42a8-b137-f00f519276ca/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.19
4194816 2021-09-03 12:50 192.168.1.78:9001/cb7440ef-f0d9-42a8-b137-f00f519276ca/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.2
4194816 2021-09-03 12:50 192.168.1.78:9001/cb7440ef-f0d9-42a8-b137-f00f519276ca/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.20
4194816 2021-09-03 12:50 192.168.1.78:9001/cb7440ef-f0d9-42a8-b137-f00f519276ca/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.21
4194816 2021-09-03 12:50 192.168.1.78:9001/cb7440ef-f0d9-42a8-b137-f00f519276ca/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.22
4194816 2021-09-03 12:50 192.168.1.78:9001/cb7440ef-f0d9-42a8-b137-f00f519276ca/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.23
4194816 2021-09-03 12:50 192.168.1.78:9001/cb7440ef-f0d9-42a8-b137-f00f519276ca/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.24
4194816 2021-09-03 12:50 192.168.1.78:9001/cb7440ef-f0d9-42a8-b137-f00f519276ca/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.25
4194816 2021-09-03 12:50 192.168.1.78:9001/cb7440ef-f0d9-42a8-b137-f00f519276ca/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.26
4194816 2021-09-03 12:50 192.168.1.78:9001/cb7440ef-f0d9-42a8-b137-f00f519276ca/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.27
4194816 2021-09-03 12:50 192.168.1.78:9001/cb7440ef-f0d9-42a8-b137-f00f519276ca/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.28
4194816 2021-09-03 12:50 192.168.1.78:9001/cb7440ef-f0d9-42a8-b137-f00f519276ca/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.29
4194816 2021-09-03 12:50 192.168.1.78:9001/cb7440ef-f0d9-42a8-b137-f00f519276ca/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.3
4194816 2021-09-03 12:50 192.168.1.78:9001/cb7440ef-f0d9-42a8-b137-f00f519276ca/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.30
4194816 2021-09-03 12:50 192.168.1.78:9001/cb7440ef-f0d9-42a8-b137-f00f519276ca/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.31
4194816 2021-09-03 12:50 192.168.1.78:9001/cb7440ef-f0d9-42a8-b137-f00f519276ca/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.32
4194816 2021-09-03 12:50 192.168.1.78:9001/cb7440ef-f0d9-42a8-b137-f00f519276ca/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.33
4194816 2021-09-03 12:50 192.168.1.78:9001/cb7440ef-f0d9-42a8-b137-f00f519276ca/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.34
4194816 2021-09-03 12:50 192.168.1.78:9001/cb7440ef-f0d9-42a8-b137-f00f519276ca/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.35
3439368 2021-09-03 12:50 192.168.1.78:9001/cb7440ef-f0d9-42a8-b137-f00f519276ca/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.36
4194816 2021-09-03 12:50 192.168.1.78:9001/cb7440ef-f0d9-42a8-b137-f00f519276ca/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.4
4194816 2021-09-03 12:50 192.168.1.78:9001/cb7440ef-f0d9-42a8-b137-f00f519276ca/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.5
4194816 2021-09-03 12:50 192.168.1.78:9001/cb7440ef-f0d9-42a8-b137-f00f519276ca/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.6
4194816 2021-09-03 12:50 192.168.1.78:9001/cb7440ef-f0d9-42a8-b137-f00f519276ca/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.7
4194816 2021-09-03 12:50 192.168.1.78:9001/cb7440ef-f0d9-42a8-b137-f00f519276ca/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.8
4194816 2021-09-03 12:50 192.168.1.78:9001/cb7440ef-f0d9-42a8-b137-f00f519276ca/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.9
802 2021-09-03 12:50 192.168.1.78:9001/cb7440ef-f0d9-42a8-b137-f00f519276ca/testbucket/nyc-taxi-data-10M.csv.zst/xl.meta
0 2021-09-03 12:50 192.168.1.78:9001/759cd5ac-7860-4cf3-acad-a375fcbae338/testbucket/nyc-taxi-data-10M.csv.zst/
0 2021-09-03 12:50 192.168.1.78:9001/759cd5ac-7860-4cf3-acad-a375fcbae338/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/
4194816 2021-09-03 12:50 192.168.1.78:9001/759cd5ac-7860-4cf3-acad-a375fcbae338/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.1
4194816 2021-09-03 12:50 192.168.1.78:9001/759cd5ac-7860-4cf3-acad-a375fcbae338/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.10
4194816 2021-09-03 12:50 192.168.1.78:9001/759cd5ac-7860-4cf3-acad-a375fcbae338/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.11
4194816 2021-09-03 12:50 192.168.1.78:9001/759cd5ac-7860-4cf3-acad-a375fcbae338/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.12
4194816 2021-09-03 12:50 192.168.1.78:9001/759cd5ac-7860-4cf3-acad-a375fcbae338/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.13
4194816 2021-09-03 12:50 192.168.1.78:9001/759cd5ac-7860-4cf3-acad-a375fcbae338/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.14
4194816 2021-09-03 12:50 192.168.1.78:9001/759cd5ac-7860-4cf3-acad-a375fcbae338/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.15
4194816 2021-09-03 12:50 192.168.1.78:9001/759cd5ac-7860-4cf3-acad-a375fcbae338/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.16
4194816 2021-09-03 12:50 192.168.1.78:9001/759cd5ac-7860-4cf3-acad-a375fcbae338/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.17
4194816 2021-09-03 12:50 192.168.1.78:9001/759cd5ac-7860-4cf3-acad-a375fcbae338/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.18
4194816 2021-09-03 12:50 192.168.1.78:9001/759cd5ac-7860-4cf3-acad-a375fcbae338/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.19
4194816 2021-09-03 12:50 192.168.1.78:9001/759cd5ac-7860-4cf3-acad-a375fcbae338/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.2
4194816 2021-09-03 12:50 192.168.1.78:9001/759cd5ac-7860-4cf3-acad-a375fcbae338/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.20
4194816 2021-09-03 12:50 192.168.1.78:9001/759cd5ac-7860-4cf3-acad-a375fcbae338/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.21
4194816 2021-09-03 12:50 192.168.1.78:9001/759cd5ac-7860-4cf3-acad-a375fcbae338/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.22
4194816 2021-09-03 12:50 192.168.1.78:9001/759cd5ac-7860-4cf3-acad-a375fcbae338/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.23
4194816 2021-09-03 12:50 192.168.1.78:9001/759cd5ac-7860-4cf3-acad-a375fcbae338/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.24
4194816 2021-09-03 12:50 192.168.1.78:9001/759cd5ac-7860-4cf3-acad-a375fcbae338/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.25
4194816 2021-09-03 12:50 192.168.1.78:9001/759cd5ac-7860-4cf3-acad-a375fcbae338/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.26
4194816 2021-09-03 12:50 192.168.1.78:9001/759cd5ac-7860-4cf3-acad-a375fcbae338/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.27
4194816 2021-09-03 12:50 192.168.1.78:9001/759cd5ac-7860-4cf3-acad-a375fcbae338/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.28
4194816 2021-09-03 12:50 192.168.1.78:9001/759cd5ac-7860-4cf3-acad-a375fcbae338/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.29
4194816 2021-09-03 12:50 192.168.1.78:9001/759cd5ac-7860-4cf3-acad-a375fcbae338/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.3
4194816 2021-09-03 12:50 192.168.1.78:9001/759cd5ac-7860-4cf3-acad-a375fcbae338/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.30
4194816 2021-09-03 12:50 192.168.1.78:9001/759cd5ac-7860-4cf3-acad-a375fcbae338/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.31
4194816 2021-09-03 12:50 192.168.1.78:9001/759cd5ac-7860-4cf3-acad-a375fcbae338/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.32
4194816 2021-09-03 12:50 192.168.1.78:9001/759cd5ac-7860-4cf3-acad-a375fcbae338/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.33
4194816 2021-09-03 12:50 192.168.1.78:9001/759cd5ac-7860-4cf3-acad-a375fcbae338/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.34
4194816 2021-09-03 12:50 192.168.1.78:9001/759cd5ac-7860-4cf3-acad-a375fcbae338/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.35
3439368 2021-09-03 12:50 192.168.1.78:9001/759cd5ac-7860-4cf3-acad-a375fcbae338/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.36
4194816 2021-09-03 12:50 192.168.1.78:9001/759cd5ac-7860-4cf3-acad-a375fcbae338/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.4
4194816 2021-09-03 12:50 192.168.1.78:9001/759cd5ac-7860-4cf3-acad-a375fcbae338/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.5
4194816 2021-09-03 12:50 192.168.1.78:9001/759cd5ac-7860-4cf3-acad-a375fcbae338/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.6
4194816 2021-09-03 12:50 192.168.1.78:9001/759cd5ac-7860-4cf3-acad-a375fcbae338/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.7
4194816 2021-09-03 12:50 192.168.1.78:9001/759cd5ac-7860-4cf3-acad-a375fcbae338/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.8
4194816 2021-09-03 12:50 192.168.1.78:9001/759cd5ac-7860-4cf3-acad-a375fcbae338/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.9
802 2021-09-03 12:50 192.168.1.78:9001/759cd5ac-7860-4cf3-acad-a375fcbae338/testbucket/nyc-taxi-data-10M.csv.zst/xl.meta
0 2021-09-09 15:56 192.168.1.78:9001/2b48619c-c2fa-4e69-839e-58fc82c1b43e/testbucket/nyc-taxi-data-10M.csv.zst/
0 2021-09-09 15:56 192.168.1.78:9001/2b48619c-c2fa-4e69-839e-58fc82c1b43e/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/
4194816 2021-09-09 15:56 192.168.1.78:9001/2b48619c-c2fa-4e69-839e-58fc82c1b43e/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.1
4194816 2021-09-09 15:56 192.168.1.78:9001/2b48619c-c2fa-4e69-839e-58fc82c1b43e/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.10
4194816 2021-09-09 15:56 192.168.1.78:9001/2b48619c-c2fa-4e69-839e-58fc82c1b43e/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.11
4194816 2021-09-09 15:56 192.168.1.78:9001/2b48619c-c2fa-4e69-839e-58fc82c1b43e/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.12
4194816 2021-09-09 15:56 192.168.1.78:9001/2b48619c-c2fa-4e69-839e-58fc82c1b43e/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.13
4194816 2021-09-09 15:56 192.168.1.78:9001/2b48619c-c2fa-4e69-839e-58fc82c1b43e/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.14
4194816 2021-09-09 15:56 192.168.1.78:9001/2b48619c-c2fa-4e69-839e-58fc82c1b43e/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.15
4194816 2021-09-09 15:56 192.168.1.78:9001/2b48619c-c2fa-4e69-839e-58fc82c1b43e/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.16
4194816 2021-09-09 15:56 192.168.1.78:9001/2b48619c-c2fa-4e69-839e-58fc82c1b43e/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.17
4194816 2021-09-09 15:56 192.168.1.78:9001/2b48619c-c2fa-4e69-839e-58fc82c1b43e/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.18
4194816 2021-09-09 15:56 192.168.1.78:9001/2b48619c-c2fa-4e69-839e-58fc82c1b43e/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.19
4194816 2021-09-09 15:56 192.168.1.78:9001/2b48619c-c2fa-4e69-839e-58fc82c1b43e/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.2
4194816 2021-09-09 15:56 192.168.1.78:9001/2b48619c-c2fa-4e69-839e-58fc82c1b43e/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.20
4194816 2021-09-09 15:56 192.168.1.78:9001/2b48619c-c2fa-4e69-839e-58fc82c1b43e/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.21
4194816 2021-09-09 15:56 192.168.1.78:9001/2b48619c-c2fa-4e69-839e-58fc82c1b43e/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.22
4194816 2021-09-09 15:56 192.168.1.78:9001/2b48619c-c2fa-4e69-839e-58fc82c1b43e/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.23
4194816 2021-09-09 15:56 192.168.1.78:9001/2b48619c-c2fa-4e69-839e-58fc82c1b43e/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.24
4194816 2021-09-09 15:56 192.168.1.78:9001/2b48619c-c2fa-4e69-839e-58fc82c1b43e/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.25
4194816 2021-09-09 15:56 192.168.1.78:9001/2b48619c-c2fa-4e69-839e-58fc82c1b43e/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.26
4194816 2021-09-09 15:56 192.168.1.78:9001/2b48619c-c2fa-4e69-839e-58fc82c1b43e/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.27
4194816 2021-09-09 15:56 192.168.1.78:9001/2b48619c-c2fa-4e69-839e-58fc82c1b43e/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.28
4194816 2021-09-09 15:56 192.168.1.78:9001/2b48619c-c2fa-4e69-839e-58fc82c1b43e/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.29
4194816 2021-09-09 15:56 192.168.1.78:9001/2b48619c-c2fa-4e69-839e-58fc82c1b43e/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.3
4194816 2021-09-09 15:56 192.168.1.78:9001/2b48619c-c2fa-4e69-839e-58fc82c1b43e/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.30
4194816 2021-09-09 15:56 192.168.1.78:9001/2b48619c-c2fa-4e69-839e-58fc82c1b43e/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.31
4194816 2021-09-09 15:56 192.168.1.78:9001/2b48619c-c2fa-4e69-839e-58fc82c1b43e/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.32
4194816 2021-09-09 15:56 192.168.1.78:9001/2b48619c-c2fa-4e69-839e-58fc82c1b43e/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.33
4194816 2021-09-09 15:56 192.168.1.78:9001/2b48619c-c2fa-4e69-839e-58fc82c1b43e/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.34
4194816 2021-09-09 15:56 192.168.1.78:9001/2b48619c-c2fa-4e69-839e-58fc82c1b43e/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.35
3439368 2021-09-09 15:56 192.168.1.78:9001/2b48619c-c2fa-4e69-839e-58fc82c1b43e/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.36
4194816 2021-09-09 15:56 192.168.1.78:9001/2b48619c-c2fa-4e69-839e-58fc82c1b43e/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.4
4194816 2021-09-09 15:56 192.168.1.78:9001/2b48619c-c2fa-4e69-839e-58fc82c1b43e/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.5
4194816 2021-09-09 15:56 192.168.1.78:9001/2b48619c-c2fa-4e69-839e-58fc82c1b43e/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.6
4194816 2021-09-09 15:56 192.168.1.78:9001/2b48619c-c2fa-4e69-839e-58fc82c1b43e/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.7
4194816 2021-09-09 15:56 192.168.1.78:9001/2b48619c-c2fa-4e69-839e-58fc82c1b43e/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.8
4194816 2021-09-09 15:56 192.168.1.78:9001/2b48619c-c2fa-4e69-839e-58fc82c1b43e/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.9
802 2021-09-09 15:56 192.168.1.78:9001/2b48619c-c2fa-4e69-839e-58fc82c1b43e/testbucket/nyc-taxi-data-10M.csv.zst/xl.meta
--------- -------
601034920 156 files
```
Furthermore allow `inspect` to do direct decode from `mc`, for example:
```
λ mc admin inspect --json local2/testbucket/nyc-taxi-data-10M.csv.zst/*|inspect -json
Output decrypted to inspect.5f0643b2.zip
```
- Correct error, forward non-EOF errors.
- Add some extra safety. Log FNF when no files.
- Add `xl-meta` zip support.
For `xl-meta` multiple inputs output object with names as key.
Automatically switches `xl-meta` to single-line output when multiple objects.
Add double-star wildcard support to xl-meta input.
Co-authored-by: Harshavardhana <harsha@minio.io>
2021-10-01 11:50:00 -07:00
Poorna Krishnamoorthy
7f6ed35347
Allow null versions to be replicated ( #13310 )
...
for pre-existing objects present in a bucket
prior to enabling existing object replication.
Co-authored-by: Poorna Krishnamoorthy <poorna@minio.io>
2021-09-28 10:26:12 -07:00
Minio Trusted
a5923a5d51
Update yaml files to latest version RELEASE.2021-09-24T00-24-24Z
2021-09-24 19:20:44 +00:00
Minio Trusted
f4d1b7c603
Update yaml files to latest version RELEASE.2021-09-23T04-46-24Z
2021-09-23 07:42:55 +00:00
Poorna Krishnamoorthy
0b55a0423e
fix: cache usage deserialization from v5 to v6 ( #13258 )
2021-09-21 09:01:51 -07:00
Harshavardhana
f492f72154
add 3site replication script ( #13256 )
2021-09-20 18:24:24 -07:00
Poorna Krishnamoorthy
c4373ef290
Add support for multi site replication ( #12880 )
2021-09-18 13:31:35 -07:00
Minio Trusted
0b8c5a6872
Update yaml files to latest version RELEASE.2021-09-18T18-09-59Z
2021-09-18 20:28:07 +00:00
Minio Trusted
bf409936e7
Update yaml files to latest version RELEASE.2021-09-15T04-54-25Z
2021-09-15 08:04:57 +00:00
Harshavardhana
af78c3925a
add userinfo support for OpenID ( #12469 )
...
Some identity providers like GitLab do not provide
information about group membership as part of the
identity token claims. They only expose it via OIDC compatible
'/oauth/userinfo' endpoint, as described in the OpenID
Connect 1.0 sepcification.
But this of course requires application to make sure to add
additional accessToken, since idToken cannot be re-used to
perform the same 'userinfo' call. This is why this is specialized
requirement. Gitlab seems to be the only OpenID vendor that requires
this support for the time being.
fixes #12367
2021-09-13 16:22:14 -07:00
Harshavardhana
90e505e58f
calculate API requests/error as increase() intervals not as rate()
2021-09-12 11:28:28 -07:00
Minio Trusted
a216583d95
Update yaml files to latest version RELEASE.2021-09-09T21-37-07Z
2021-09-09 23:50:26 +00:00
soudhaf
950fe73c4f
fix: minio console nginx config ( #13156 )
2021-09-08 23:41:06 -07:00
Harshavardhana
aaa3fc3805
fix: remove deprecated LDAP username format support ( #13165 )
2021-09-08 13:31:51 -07:00
Andreas Auernhammer
e438dccf19
sts: add support for certificate-based authentication ( #12748 )
...
This commit adds a new STS API for X.509 certificate
authentication.
A client can make an HTTP POST request over a TLS connection
and MinIO will verify the provided client certificate, map it to an
S3 policy and return temp. S3 credentials to the client.
So, this STS API allows clients to authenticate with X.509
certificates over TLS and obtain temp. S3 credentials.
For more details and examples refer to the docs/sts/tls.md
documentation.
Signed-off-by: Andreas Auernhammer <hi@aead.dev>
2021-09-07 19:03:48 -07:00
Klaus Post
b2c92cdaaa
select: Add more compression formats ( #13142 )
...
Support Zstandard, LZ4, S2, and snappy as additional
compression formats for S3 Select.
2021-09-06 09:09:53 -07:00
Harshavardhana
1250312287
fail ready/liveness if etcd is unhealthy in gateway mode ( #13146 )
2021-09-03 17:05:41 -07:00
Minio Trusted
e2b6fb0a6a
Update yaml files to latest version RELEASE.2021-09-03T03-56-13Z
2021-09-03 06:45:54 +00:00
Harshavardhana
f486cfae86
point all docs for containers to quay.io
2021-09-01 18:48:26 -07:00
Minio Trusted
5c6dc63577
Update yaml files to latest version RELEASE.2021-08-31T05-46-54Z
2021-08-31 07:27:43 +00:00
Klaus Post
470553ff5d
Tweak readall allocation and renameData buffer reuse ( #13108 )
...
Use a single allocation for reading the file, not the growing buffer of `io.ReadAll`.
Reuse the write buffer if we can when writing metadata in RenameData.
2021-08-30 08:38:11 -07:00
Minio Trusted
abf079135e
Update yaml files to latest version RELEASE.2021-08-25T00-41-18Z
2021-08-25 02:01:05 +00:00
Nitish Tiwari
60394ddf83
Add support for changing job name in Grafana dashboard ( #13050 )
2021-08-24 09:51:09 -07:00
Minio Trusted
7802088e71
Update yaml files to latest version RELEASE.2021-08-20T18-32-01Z
2021-08-20 20:42:00 +00:00
Harshavardhana
202d0b64eb
fix: enable go1.17 github ci/cd ( #12997 )
2021-08-18 18:35:22 -07:00
Minio Trusted
16aeb68c28
Update yaml files to latest version RELEASE.2021-08-17T20-53-08Z
2021-08-17 22:34:33 +00:00
Krishnan Parthasarathi
30b77f59b1
doc: Add ilm prometheus metrics information ( #12994 )
2021-08-17 12:19:36 -07:00
Aditya Manthramurthy
9b7d593e28
Add helper script to call assume role ( #12978 )
2021-08-17 01:46:59 -07:00
Ricardo Katz
a526ad2e80
Add headers into AMQP notifications ( #12911 )
...
Signed-off-by: Ricardo Katz <rkatz@vmware.com>
2021-08-11 22:24:19 -07:00
Harshavardhana
39f81d2c5b
update max_delay to max_sleep under healing docs
2021-08-10 08:52:42 -07:00
Minio Trusted
7b0b0f9101
Update yaml files to latest version RELEASE.2021-08-05T22-01-19Z
2021-08-06 02:19:42 +00:00
Harshavardhana
c13cbc64d1
fix multiple typos in documentation
2021-08-04 14:15:45 -07:00
Matt Sarrel
109c8acf4f
fixed typo in metrics README.md ( #12874 )
2021-08-04 12:48:57 -07:00
Harshavardhana
035882d292
fix: remove parentIsObject() check ( #12851 )
...
we will allow situations such as
```
a/b/1.txt
a/b
```
and
```
a/b
a/b/1.txt
```
we are going to document that this usecase is
not supported and we will never support it, if
any application does this users have to delete
the top level parent to make sure namespace is
accessible at lower level.
rest of the situations where the prefixes get
created across sets are supported as is.
2021-08-03 13:26:57 -07:00
Harshavardhana
ea64a9263c
add deprecation notice for LDAP username format ( #12849 )
2021-08-02 18:20:06 -07:00
Harshavardhana
7281e86d9e
update docker-compose to RELEASE.2021-07-30T00-02-00Z
2021-07-29 18:07:06 -07:00
Harshavardhana
a78bc7bfdb
rename all access token to id_tokens
2021-07-27 22:38:12 -07:00
Harshavardhana
3735450e7e
fix: allow audience claim to be an array ( #12810 )
...
Some incorrect setups might have multiple audiences
where they are trying to use a single authentication
endpoint for multiple services.
Nevertheless OpenID spec allows it to make it
even more confusin for no good reason.
> It MUST contain the OAuth 2.0 client_id of the
> Relying Party as an audience value. It MAY also
> contain identifiers for other audiences. In the
> general case, the aud value is an array of case
> sensitive strings. In the common special case
> when there is one audience, the aud value MAY
> be a single case sensitive string.
fixes #12809
2021-07-27 18:37:51 -07:00
Minio Trusted
471b4fd0c9
Update yaml files to latest version RELEASE.2021-07-27T02-40-15Z
2021-07-27 05:02:00 +00:00
Aditya Manthramurthy
7106e9394c
[LDAP] Document new LDAP synchronization behavior ( #12786 )
2021-07-25 10:45:53 -07:00
Aditya Manthramurthy
9a31030e74
DEPRECATION Warning: Avoid configuring default LDAP STS Expiry ( #12781 )
...
- Show notice when `MINIO_IDENTITY_LDAP_STS_EXPIRY` or the
corresponding to the configuration option is used at server startup.
- Once support is removed, the default will be fixed at 1 hour.
- Users may specify expiry directly in the STS API.
- Update docs and help message
- Adds example in ldap.go to configure expiry in STS API.
2021-07-22 16:43:57 -07:00
Aditya Manthramurthy
a3079a7de2
fix: Add support for DurationSeconds in LDAP STS API ( #12778 )
2021-07-22 12:13:21 -07:00
Minio Trusted
026a005b64
Update yaml files to latest version RELEASE.2021-07-22T05-23-32Z
2021-07-22 06:12:29 +00:00
Minio Trusted
dbd7f74bb9
Update yaml files to latest version RELEASE.2021-07-21T22-15-23Z
2021-07-21 23:46:28 +00:00
Ali Malek
c25ad94b7e
Refactor docker-compose, Use YAML variable for common minio configs ( #12735 )
2021-07-18 18:06:40 -07:00
Minio Trusted
ead8778305
Update yaml files to latest version RELEASE.2021-07-15T22-27-34Z
2021-07-16 04:27:54 +00:00
Aditya Manthramurthy
eae9c2f65b
Add changes to ensure session policy is enforced in LDAP STS ( #12716 )
...
- Bonus: Fix bug in webidentity sts that doesnt parse session policy correctly.
- update ldap.go to support session policy argument
2021-07-15 15:27:34 -07:00
Ravind Kumar
ce800ed347
DOCS: Remove http links in favor of HTTPS ( #12725 )
2021-07-15 13:31:59 -07:00
Harshavardhana
8d19efe7e0
feat: increase allowed maximum STS expiration timeout to 365 days ( #12704 )
2021-07-14 00:08:22 -07:00
Harshavardhana
e316873f84
feat: Add support for kakfa audit logger target ( #12678 )
2021-07-13 09:39:13 -07:00
Harshavardhana
e25ae1c01f
add console-address flag for spoonfed users
2021-07-12 17:05:38 -07:00
Minio Trusted
bc8962102f
Update yaml files to latest version RELEASE.2021-07-12T02-44-53Z
2021-07-12 03:45:14 +00:00
Harshavardhana
55b08403cb
update docker docs with --console-address
...
also update the orchestration docs for nginx
proxy for console.
fixes #12660
2021-07-11 19:44:53 -07:00
Klaus Post
d6a2fe02d3
Add admin file inspector ( #12635 )
...
Download files from *any* bucket/path as an encrypted zip file.
The key is included in the response but can be separated so zip
and the key doesn't have to be sent on the same channel.
Requires https://github.com/minio/pkg/pull/6
2021-07-09 11:29:16 -07:00
Harshavardhana
28adb29db3
feat: Add support to poll users on external SSO ( #12592 )
...
Additional support for vendor-specific admin API
integrations for OpenID, to ensure validity of
credentials on MinIO.
Every 5minutes check for validity of credentials
on MinIO with vendor specific IDP.
2021-07-09 11:17:21 -07:00
Minio Trusted
b6dd9b55a7
Update yaml files to latest version RELEASE.2021-07-08T19-43-25Z
2021-07-08 22:53:49 -07:00
Christian Weiske
95d29a6a53
fix: Mention GetBucketyPolicy in S3 gateway docs policy ( #12642 )
...
That action is needed for the gateway to obtain the policy
setting for public access.
Resolves: https://github.com/minio/minio/issues/12638
2021-07-08 10:34:56 -07:00
