minio

mirror of https://github.com/minio/minio.git synced 2024-12-26 15:15:55 -05:00

Author	SHA1	Message	Date
Minio Trusted	a24037bfec	Update yaml files to latest version RELEASE.2023-01-31T02-24-19Z	2023-01-31 07:49:15 +00:00
Jan Zhanal	8fa80874a6	doc: LDAP/AD - nested groups (#16483 )	2023-01-26 22:17:59 +05:30
Minio Trusted	1bf1fafc86	Update yaml files to latest version RELEASE.2023-01-25T00-19-54Z	2023-01-25 02:09:27 +00:00
Harshavardhana	e64b9f6751	fix: disallow SSE-C encrypted objects on replicated buckets (#16467 )	2023-01-24 15:46:33 -08:00
Harshavardhana	3683673fb0	add missing gorilla/mux migration, update credits (#16461 )	2023-01-23 08:46:37 -08:00
Anis Elleuch	e73894fa50	grafana: Show one metric for the total data growth (#16449 )	2023-01-20 09:39:28 -08:00
Minio Trusted	3fa7218c44	Update yaml files to latest version RELEASE.2023-01-20T02-05-44Z	2023-01-20 08:11:58 +00:00
Minio Trusted	5c1a4ba5f9	Update yaml files to latest version RELEASE.2023-01-18T04-36-38Z	2023-01-18 07:46:44 +00:00
Minio Trusted	d33c527e39	Update yaml files to latest version RELEASE.2023-01-12T02-06-16Z	2023-01-12 07:27:07 +00:00
Minio Trusted	52b88b52f0	Update yaml files to latest version RELEASE.2023-01-06T18-11-18Z	2023-01-08 07:51:31 +00:00
Poorna	b29e159604	docs: Update replication setup commands (#16361 )	2023-01-04 13:39:37 -08:00
Harshavardhana	b197623ed2	remove unnecessary kernel-tuning docs (#16354 )	2023-01-04 01:33:40 -08:00
Harshavardhana	14d29b77ae	update replication tests with latest 'mc' (#16348 )	2023-01-03 22:54:39 -08:00
Minio Trusted	72394a8319	Update yaml files to latest version RELEASE.2023-01-02T09-40-09Z	2023-01-03 10:16:34 +00:00
Anis Elleuch	b8943fdf19	doc: Update prometheus metrics list (#16329 )	2022-12-29 15:08:22 -08:00
Harshavardhana	2937711390	fix: DeleteObject() API with versionId under replication (#16325 )	2022-12-28 22:48:33 -08:00
Aditya Manthramurthy	9e6cc847f8	Add HTTP2 config option for policy plugin (#16225 )	2022-12-13 14:28:48 -08:00
Minio Trusted	76905b7a67	Update yaml files to latest version RELEASE.2022-12-12T19-27-27Z	2022-12-13 01:10:31 +00:00
Aditya Manthramurthy	a469e6768d	Add LDAP DNS SRV record lookup support (#16201 )	2022-12-12 11:27:27 -08:00
Harshavardhana	b03dd1af17	remove hard limit for number of buckets (#16194 )	2022-12-08 12:24:03 -08:00
Klaus Post	3eb2d086b2	Replace filepathx with fork (#16192 )	2022-12-08 10:42:44 -08:00
Minio Trusted	9f71369b67	Update yaml files to latest version RELEASE.2022-12-07T00-56-37Z	2022-12-07 01:30:51 +00:00
Aditya Manthramurthy	a30cfdd88f	Bump up madmin-go to v2 (#16162 )	2022-12-06 13:46:50 -08:00
Harshavardhana	a9f5b58a01	fix: update the JSON keys for latest 'mc' release (#16171 )	2022-12-05 10:28:22 -08:00
Minio Trusted	d6351879f3	Update yaml files to latest version RELEASE.2022-12-02T19-19-22Z	2022-12-02 20:15:36 +00:00
Harshavardhana	71133105d7	re-order the top-level config keys for priority (#16150 )	2022-12-01 07:50:08 -08:00
Minio Trusted	76943ac05e	Update yaml files to latest version RELEASE.2022-11-29T23-40-49Z	2022-11-30 21:13:07 +00:00
Aditya Manthramurthy	87cbd41265	feat: Allow at most one claim based OpenID IDP (#16145 )	2022-11-29 15:40:49 -08:00
Minio Trusted	53cbc020b9	Update yaml files to latest version RELEASE.2022-11-26T22-43-32Z	2022-11-27 04:08:35 +00:00
Minio Trusted	3661aaf8a1	Update yaml files to latest version RELEASE.2022-11-17T23-20-09Z	2022-11-18 08:51:38 +00:00
Minio Trusted	6dc7109a9f	Update yaml files to latest version RELEASE.2022-11-11T03-44-20Z	2022-11-11 04:57:16 +00:00
Minio Trusted	4fe9cbb973	Update yaml files to latest version RELEASE.2022-11-10T18-20-21Z	2022-11-10 19:36:54 +00:00
yanggang	52769e1e71	remove io/util for advanced golang (#16011 )	2022-11-08 07:58:02 -08:00
Minio Trusted	808739867c	Update yaml files to latest version RELEASE.2022-11-08T05-27-07Z	2022-11-08 05:59:18 +00:00
Anis Elleuch	7e73fc2870	Implement inspect data API v2 (#15474 ) Co-authored-by: Klaus Post <klauspost@gmail.com>	2022-11-02 13:36:38 -07:00
Minio Trusted	0303cd8625	Update yaml files to latest version RELEASE.2022-10-29T06-21-33Z	2022-10-29 09:29:37 +00:00
Poorna	dc92bb4646	xl-meta: update metadata version (#15958 )	2022-10-28 02:48:43 -07:00
Harshavardhana	23b329b9df	remove gateway completely (#15929 )	2022-10-24 17:44:15 -07:00
Minio Trusted	630dabf4b9	Update yaml files to latest version RELEASE.2022-10-24T18-35-07Z	2022-10-24 19:29:30 +00:00
Minio Trusted	c921dc75c7	Update yaml files to latest version RELEASE.2022-10-21T22-37-48Z	2022-10-22 00:04:37 +00:00
Klaus Post	86d543d0f6	Check for s3zip content offset (#15924 )	2022-10-21 15:37:48 -07:00
Minio Trusted	bd77f1df4c	Update yaml files to latest version RELEASE.2022-10-20T00-55-09Z	2022-10-20 06:38:33 +00:00
Minio Trusted	196fab6834	Update yaml files to latest version RELEASE.2022-10-15T19-57-03Z	2022-10-15 23:20:56 +00:00
Minio Trusted	0c8dd8046a	Update yaml files to latest version RELEASE.2022-10-08T20-11-00Z	2022-10-09 19:44:19 +00:00
Harshavardhana	2a13cc28f2	feat: implement support batch replication (#15554 )	2022-10-05 23:00:43 -07:00
Minio Trusted	4d761fda81	Update yaml files to latest version RELEASE.2022-10-05T14-58-27Z	2022-10-05 22:50:50 +00:00
Minio Trusted	dc6733dacc	Update yaml files to latest version RELEASE.2022-10-02T19-29-29Z	2022-10-03 02:29:56 +00:00
Daryl White	d44f3526dc	Update links to documentation site (#15750 )	2022-09-28 21:28:45 -07:00
Minio Trusted	1480340830	Update yaml files to latest version RELEASE.2022-09-25T15-44-53Z	2022-09-26 04:54:15 +00:00
Minio Trusted	334f1ed45a	Update yaml files to latest version RELEASE.2022-09-22T18-57-27Z	2022-09-23 06:01:11 +00:00
Klaus Post	ff12080ff5	Remove deprecated io/ioutil (#15707 )	2022-09-19 11:05:16 -07:00
Minio Trusted	98874c3baf	Update yaml files to latest version RELEASE.2022-09-17T00-09-45Z	2022-09-17 08:07:32 +00:00
Ashish Kumar Sinha	fb8d512f58	update docs to add cycle in scanner (#15686 )	2022-09-13 22:46:02 -07:00
Harshavardhana	b579163802	limit number of buckets to 500k (#15668 ) 500k is a reasonable limit for any single MinIO cluster deployment, in future we may increase this value. However for now we are going to keep this limit.	2022-09-09 03:06:34 -07:00
Minio Trusted	87f0c8e7e8	Update yaml files to latest version RELEASE.2022-09-07T22-25-02Z	2022-09-08 00:44:12 +00:00
Minio Trusted	240164560f	Update yaml files to latest version RELEASE.2022-09-01T23-53-36Z	2022-09-02 01:52:19 +00:00
Minio Trusted	cd18599e7b	Update yaml files to latest version RELEASE.2022-08-26T19-53-15Z	2022-08-29 00:10:22 +00:00
Minio Trusted	1fd72d5aea	Update yaml files to latest version RELEASE.2022-08-25T07-17-05Z	2022-08-25 07:47:18 +00:00
Anis Elleuch	b737c83a66	Ensure that only one node performs site replication healing (#15584 ) When a node finds a change in the other replication cluster and applies to itself will already notify other peers. No need for all nodes in a given cluster to do site replication healing, only one node is sufficient.	2022-08-24 13:46:09 -07:00
Minio Trusted	2c48f6a02b	Update yaml files to latest version RELEASE.2022-08-22T23-53-06Z	2022-08-23 05:45:31 +00:00
Klaus Frank	a2e037f0ec	doc: certgen typo in parameter name (#15555 ) "-ca" is not a valid parameter remove it.	2022-08-19 10:48:34 -07:00
Harshavardhana	d350b666ff	feat: add idempotent delete marker support (#15521 ) The bottom line is delete markers are a nuisance, most applications are not version aware and this has simply complicated the version management. AWS S3 gave an unnecessary complication overhead for customers, they need to now manage these markers by applying ILM settings and clean them up on a regular basis. To make matters worse all these delete markers get replicated as well in a replicated setup, requiring two ILM settings on each site. This PR is an attempt to address this inferior implementation by deviating MinIO towards an idempotent delete marker implementation i.e MinIO will never create any more than single consecutive delete markers. This significantly reduces operational overhead by making versioning more useful for real data. This is an S3 spec deviation for pragmatic reasons.	2022-08-18 16:41:59 -07:00
Minio Trusted	fa9b361a3d	Update yaml files to latest version RELEASE.2022-08-13T21-54-44Z	2022-08-14 05:33:08 +00:00
Minio Trusted	c5b3666089	Update yaml files to latest version RELEASE.2022-08-11T04-37-28Z	2022-08-11 22:36:34 +00:00
Minio Trusted	6a6c772ff2	Update yaml files to latest version RELEASE.2022-08-08T18-34-09Z	2022-08-08 21:30:40 +00:00
Minio Trusted	fcd4b3ba9b	Update yaml files to latest version RELEASE.2022-08-05T23-27-09Z	2022-08-06 00:08:21 +00:00
ebozduman	b57e7321e7	Replaces 'disk'=>'drive' visible to end user (#15464 )	2022-08-04 16:10:08 -07:00
Minio Trusted	e956369c4e	Update yaml files to latest version RELEASE.2022-08-02T23-59-16Z	2022-08-03 01:45:42 +00:00
Harshavardhana	fd349103e8	fix: allow P-384/P-512 constant time implementation (#15445 ) since go1.18.x P-384/P-512 are now constant time implementations, enable them.	2022-08-01 09:27:16 -07:00
Minio Trusted	6b4cb35f4f	Update yaml files to latest version RELEASE.2022-07-30T05-21-40Z	2022-07-30 05:50:06 +00:00
Minio Trusted	824d52a82b	Update yaml files to latest version RELEASE.2022-07-29T19-40-48Z	2022-07-29 22:06:57 +00:00
Minio Trusted	067ebab9d8	update object-locking docs and word them appropriately	2022-07-29 12:40:48 -07:00
Harshavardhana	5e763b71dc	use logger.LogOnce to reduce printing disconnection logs (#15408 ) fixes #15334 - re-use net/url parsed value for http.Request{} - remove gosimple, structcheck and unusued due to https://github.com/golangci/golangci-lint/issues/2649 - unwrapErrs upto leafErr to ensure that we store exactly the correct errors	2022-07-27 09:44:59 -07:00
Minio Trusted	bfc70bc74e	Update yaml files to latest version RELEASE.2022-07-26T00-53-03Z	2022-07-26 06:56:37 +00:00
Poorna	426c902b87	site replication: fix healing of bucket deletes. (#15377 ) This PR changes the handling of bucket deletes for site replicated setups to hold on to deleted bucket state until it syncs to all the clusters participating in site replication.	2022-07-25 17:51:32 -07:00
Minio Trusted	e465c3587b	Update yaml files to latest version RELEASE.2022-07-24T17-09-31Z	2022-07-24 17:37:58 +00:00
Minio Trusted	f802d2ba83	Update yaml files to latest version RELEASE.2022-07-24T01-54-52Z	2022-07-24 02:31:24 +00:00
MohammadReza	f4d5c861f3	update grafana dashboard (#15357 )	2022-07-21 15:17:44 -07:00
Minio Trusted	e7eb94de6b	Update yaml files to latest version RELEASE.2022-07-17T15-43-14Z	2022-07-17 22:06:11 +00:00
Harshavardhana	b6eb8dff64	Add decommission compression+encryption enabled tests (#15322 ) update compression environment variables to follow the expected sub-system style, however support fallback mode.	2022-07-17 08:43:14 -07:00
Harshavardhana	7da9e3a6f8	support encrypted/compressed objects properly during decommission (#15320 ) fixes #15314	2022-07-16 19:35:24 -07:00
Minio Trusted	4aecd8d039	Update yaml files to latest version RELEASE.2022-07-15T03-44-22Z	2022-07-15 06:05:11 +00:00
Poorna	7e32a17742	fix: site replication healing of missing buckets (#15298 ) fixes a regression from #15186 - Adding tests to cover healing of buckets. - Also dereference quota in SiteReplicationStatus only when non-nil	2022-07-14 14:27:47 -07:00
Minio Trusted	688215e787	Update yaml files to latest version RELEASE.2022-07-13T23-29-44Z	2022-07-14 00:11:19 +00:00
daniel-bogusz95	00e235a1ee	fix grammatic errors and minor rewrites (#15264 ) Thank you @djwfyi for the help	2022-07-11 07:59:49 -07:00
Minio Trusted	cf9e3069f2	Update yaml files to latest version RELEASE.2022-07-08T00-05-23Z	2022-07-08 00:44:43 +00:00
Minio Trusted	c1901f4e12	Update yaml files to latest version RELEASE.2022-07-06T20-29-49Z	2022-07-07 00:24:36 +00:00
Harshavardhana	9d80ff5a05	fix: decommission delete markers for non-current objects (#15225 ) versioned buckets were not creating the delete markers present in the versioned stack of an object, this essentially would stop decommission to succeed. This PR fixes creating such delete markers properly during a decommissioning process, adds tests as well.	2022-07-05 07:37:24 -07:00
Minio Trusted	39b3941892	Update yaml files to latest version RELEASE.2022-07-04T21-02-54Z	2022-07-04 21:51:54 +00:00
Harshavardhana	b311abed31	decom IAM, Bucket metadata properly (#15220 ) Current code incorrectly passed the config asset object name while decommissioning, make sure that we pass the right object name to be hashed on the newer set of pools. This PR fixes situations after a successful decommission, the users and policies might go missing due to wrong hashed set.	2022-07-04 14:02:54 -07:00
Poorna	0ea5c9d8e8	site healing: Skip stale iam asset updates from peer. (#15203 ) Allow healing to apply IAM change only when peer gave the most recent update.	2022-07-01 13:19:13 -07:00
Minio Trusted	a01a39b153	Update yaml files to latest version RELEASE.2022-06-30T20-58-09Z	2022-07-01 00:44:04 +00:00
Poorna	7cc9286e0f	site healing: Skip stale bucket metadata updates from peer (#15186 ) Allow healing to apply bucket metadata change only when peer gave the most recent update.	2022-06-28 18:09:20 -07:00
Harshavardhana	9c605ad153	allow support for parity '0', '1' enabling support for 2,3 drive setups (#15171 ) allows for further granular setups - 2 drives (1 parity, 1 data) - 3 drives (1 parity, 2 data) Bonus: allows '0' parity as well.	2022-06-27 20:22:18 -07:00
Minio Trusted	2075501d86	Update yaml files to latest version RELEASE.2022-06-25T15-50-16Z	2022-06-26 16:09:28 +00:00
Anis Elleuch	f3bec41eb9	s3-verify: Add a flag to exclude younger than a certain age (#15142 ) --minimum-object-age 1h can help exclude objects that are newly uploaded but not replicated yet	2022-06-22 08:12:47 -07:00
Anis Elleuch	95b51c48be	s3-verify: Fix endpoint and missing comparaison (#15129 ) - Fix a typo where target s3 client uses the source endpoint - Fix a missing necessary comparison: if source name is lexically lower than target name	2022-06-21 05:35:41 -07:00
Minio Trusted	17ab8145b5	Update yaml files to latest version RELEASE.2022-06-20T23-13-45Z	2022-06-21 00:16:07 +00:00
Harshavardhana	e83e947ca3	debug/s3-verify: simplify the tool to use lower memory footprint (#15110 )	2022-06-20 10:45:35 -07:00
daniel-bogusz95	ce6c23a360	docs: some grammatical, typo fixes includes #15104, #15105, #15106, #15107	2022-06-19 15:35:51 -07:00
Minio Trusted	1e1d9acb1b	Update yaml files to latest version RELEASE.2022-06-17T02-00-35Z	2022-06-17 02:56:57 +00:00
Harshavardhana	8082d1fed6	add bucket level S3 received/sent bytes (#15084 ) adds bucket level metrics for bytes received and sent bytes on all S3 API calls.	2022-06-14 15:14:24 -07:00
Minio Trusted	f34b2ef90b	update dashboard Data Usage Growth as time series	2022-06-13 22:05:36 -07:00
George Costea	ce894665a8	examples: support configuration of a session policy file (#15078 )	2022-06-13 15:36:58 -07:00
Anis Elleuch	e9efee0e64	debug: Close object after check (#15077 )	2022-06-13 07:21:04 -07:00
Minio Trusted	4b3e7aee0b	Update yaml files to latest version RELEASE.2022-06-11T19-55-32Z	2022-06-11 21:04:23 +00:00
Harshavardhana	7413045f0e	fix: add missing minio_s3_requests_total (#15070 ) PR #15052 caused a regression, add the missing metrics back. Bonus: - internode information should be only for distributed setups - update the dashboard to include 4xx and 5xx error panels.	2022-06-11 00:50:31 -07:00
Harshavardhana	d76c508566	debug: verify diff on latest objects on source and target buckets (#15069 )	2022-06-10 16:56:51 -07:00
Minio Trusted	8fb46de5e4	Update yaml files to latest version RELEASE.2022-06-10T16-59-15Z	2022-06-10 20:12:04 +00:00
Anis Elleuch	5fb420c703	prometheus: Add S3 4xx and 5xx S3 monitoring (#15052 ) Currently minio_s3_requests_errors_total covers 4xx and 5xx S3 responses which can be confusing when s3 applications sent a lot of HEAD requests with obvious 404 responses or when the replication is enabled. Add - minio_s3_requests_4xx_errors_total - minio_s3_requests_5xx_errors_total to help users monitor 4xx and 5xx HTTP status codes separately.	2022-06-08 11:22:34 -07:00
Minio Trusted	f63645546d	update minimum goroutine threshold on dashboard	2022-06-06 22:13:54 -07:00
Minio Trusted	27ab780317	Update yaml files to latest version RELEASE.2022-06-07T00-33-41Z	2022-06-07 01:06:59 +00:00
Minio Trusted	ac8cb6ba0d	Update yaml files to latest version RELEASE.2022-06-06T23-14-52Z	2022-06-06 23:47:31 +00:00
Harshavardhana	48e367ff7d	reject resync start on misconfigured replication rules (#15041 ) we expect resync to start on buckets with replication rule ExistingObjects enabled, if not we reject such calls.	2022-06-06 02:54:39 -07:00
Minio Trusted	3a398775fb	Update yaml files to latest version RELEASE.2022-06-03T01-40-53Z	2022-06-03 02:36:56 +00:00
Minio Trusted	197d6fb644	Update yaml files to latest version RELEASE.2022-06-02T16-16-26Z	2022-06-02 17:46:32 +00:00
Minio Trusted	1fce2b180f	Update yaml files to latest version RELEASE.2022-06-02T02-11-04Z	2022-06-02 02:42:14 +00:00
Harshavardhana	befbf48563	fix: s3-check-md5 to not panic for incomplete md5	2022-05-30 20:58:42 -07:00
Harshavardhana	f1abb92f0c	feat: Single drive XL implementation (#14970 ) Main motivation is move towards a common backend format for all different types of modes in MinIO, allowing for a simpler code and predictable behavior across all features. This PR also brings features such as versioning, replication, transitioning to single drive setups.	2022-05-30 10:58:37 -07:00
Harshavardhana	c2630bb3a3	add total usage pie chart based on total/free bytes	2022-05-28 09:53:53 -07:00
Aditya Manthramurthy	464b9d7c80	Add support for Identity Management Plugin (#14913 ) - Adds an STS API `AssumeRoleWithCustomToken` that can be used to authenticate via the Id. Mgmt. Plugin. - Adds a sample identity manager plugin implementation - Add doc for plugin and STS API - Add an example program using go SDK for AssumeRoleWithCustomToken	2022-05-26 17:58:09 -07:00
Praveen raj Mani	62cd643868	Add `--insecure` flag to skip TLS verification in s3-md5-check tool (#14980 )	2022-05-26 06:02:05 -07:00
Minio Trusted	1b7dd70f72	Update yaml files to latest version RELEASE.2022-05-26T05-48-41Z	2022-05-26 06:27:03 +00:00
Klaus Post	fc08fcab52	hash-set: Add file input for debug tool (#14965 ) Add input option for a file list to display total distribution.	2022-05-24 09:05:39 -07:00
Minio Trusted	5be76856bd	Update yaml files to latest version RELEASE.2022-05-23T18-45-11Z	2022-05-24 00:29:45 +00:00
Minio Trusted	18a4276e25	Update yaml files to latest version RELEASE.2022-05-19T18-20-59Z	2022-05-19 20:18:49 +00:00
Aditya Manthramurthy	4629abd5a2	Add tests for Access Management Plugin (#14909 )	2022-05-12 15:24:19 -07:00
Krishna Srinivas	389ec21d0c	Update documentation for /minio/health/cluster (#14889 )	2022-05-12 09:54:07 -07:00
Eric Qiu	c293c2e9a3	docs: update new name for MINIO_POLICY_OPA_URL (#14898 )	2022-05-11 13:04:15 -07:00
Aditya Manthramurthy	83071a3459	Add support for Access Management Plugin (#14875 ) - This change renames the OPA integration as Access Management Plugin - there is nothing specific to OPA in the integration, it is just a webhook. - OPA configuration is automatically migrated to Access Management Plugin and OPA specific configuration is marked as deprecated. - OPA doc is updated and moved.	2022-05-10 17:14:55 -07:00
Minio Trusted	95d1a12422	Update yaml files to latest version RELEASE.2022-05-08T23-50-31Z	2022-05-09 03:46:40 +00:00
Harshavardhana	62aa42cccf	avoid replication proxy on version excluded paths (#14878 ) no need to attempt proxying objects that were never replicated, but do have local `null` versions on them.	2022-05-08 16:50:31 -07:00
Harshavardhana	5cffd3780a	fix: multiple fixes in prefix exclude implementation (#14877 ) - do not need to restrict prefix exclusions that do not have `/` as suffix, relax this requirement as spark may have staging folders with other autogenerated characters , so we are better off doing full prefix March and skip. - multiple delete objects was incorrectly creating a null delete marker on a versioned bucket instead of creating a proper versioned delete marker. - do not suspend paths on the excluded prefixes during delete operations to avoid creating `null` delete markers, honor suspension of versioning only at bucket level for delete markers.	2022-05-07 22:06:44 -07:00
Krishnan Parthasarathi	ad8e611098	feat: implement prefix-level versioning exclusion (#14828 ) Spark/Hadoop workloads which use Hadoop MR Committer v1/v2 algorithm upload objects to a temporary prefix in a bucket. These objects are 'renamed' to a different prefix on Job commit. Object storage admins are forced to configure separate ILM policies to expire these objects and their versions to reclaim space. Our solution: This can be avoided by simply marking objects under these prefixes to be excluded from versioning, as shown below. Consequently, these objects are excluded from replication, and don't require ILM policies to prune unnecessary versions. - MinIO Extension to Bucket Version Configuration ```xml <VersioningConfiguration xmlns="http://s3.amazonaws.com/doc/2006-03-01/"> <Status>Enabled</Status> <ExcludeFolders>true</ExcludeFolders> <ExcludedPrefixes> <Prefix>app1-jobs//_temporary/</Prefix> </ExcludedPrefixes> <ExcludedPrefixes> <Prefix>app2-jobs//__magic/</Prefix> </ExcludedPrefixes> <!-- .. up to 10 prefixes in all --> </VersioningConfiguration> ``` Note: `ExcludeFolders` excludes all folders in a bucket from versioning. This is required to prevent the parent folders from accumulating delete markers, especially those which are shared across spark workloads spanning projects/teams. - To enable version exclusion on a list of prefixes ``` mc version enable --excluded-prefixes "app1-jobs//_temporary/,app2-jobs//_magic," --exclude-prefix-marker myminio/test ```	2022-05-06 19:05:28 -07:00
Aditya Manthramurthy	2b7e75e079	Add OPA doc and remove deprecation marking (#14863 )	2022-05-04 23:53:42 -07:00
Minio Trusted	2fc65dcb99	Update yaml files to latest version RELEASE.2022-05-04T07-45-27Z	2022-05-04 08:54:16 +00:00
Minio Trusted	0a256053ee	Update yaml files to latest version RELEASE.2022-05-03T20-36-08Z	2022-05-03 21:27:19 +00:00
Minio Trusted	f427dbbd60	Update yaml files to latest version RELEASE.2022-04-30T22-23-53Z	2022-05-01 01:33:28 +00:00
Harshavardhana	85f3a9f3b0	Remove Azure gateway implementation (#14418 ) refer #14331	2022-04-29 12:51:23 -07:00
Minio Trusted	96f27a4965	Update yaml files to latest version RELEASE.2022-04-29T01-27-09Z	2022-04-29 06:32:50 +00:00
Aditya Manthramurthy	0e502899a8	Add support for multiple OpenID providers with role policies (#14223 ) - When using multiple providers, claim-based providers are not allowed. All providers must use role policies. - Update markdown config to allow `details` HTML element	2022-04-28 18:27:09 -07:00
Harshavardhana	990fbeb3a4	rename true/false to on/off in bucket notification docs	2022-04-27 23:51:31 -07:00
Minio Trusted	8a6b2b4447	Update yaml files to latest version RELEASE.2022-04-26T01-20-24Z	2022-04-26 02:08:20 +00:00
Harshavardhana	0cc993f403	Remove GCS, HDFS gateway implementations #14418 refer #14331	2022-04-24 10:19:17 -07:00
Minio Trusted	1494ba2e6e	Update yaml files to latest version RELEASE.2022-04-16T04-26-02Z	2022-04-16 05:03:00 +00:00
Minio Trusted	646350fa7f	Update yaml files to latest version RELEASE.2022-04-12T06-55-35Z	2022-04-12 07:23:20 +00:00
Minio Trusted	33d267fa1b	Update yaml files to latest version RELEASE.2022-04-09T15-09-52Z	2022-04-09 20:23:18 +00:00
Minio Trusted	f630d7c3fa	Update yaml files to latest version RELEASE.2022-04-08T19-44-35Z	2022-04-08 23:35:38 +00:00
Minio Trusted	c7962118f8	Update yaml files to latest version RELEASE.2022-04-01T03-41-39Z	2022-04-01 08:23:40 +00:00
Andreas Auernhammer	e955aa7f2a	kes: add support for encrypted private keys (#14650 ) This commit adds support for encrypted KES client private keys. Now, it is possible to encrypt the KES client private key (`MINIO_KMS_KES_KEY_FILE`) with a password. For example, KES CLI already supports the creation of encrypted private keys: ``` kes identity new --encrypt --key client.key --cert client.crt MinIO ``` To decrypt an encrypted private key, the password needs to be provided: ``` MINIO_KMS_KES_KEY_PASSWORD=<password> ``` Signed-off-by: Andreas Auernhammer <hi@aead.dev>	2022-03-29 09:53:33 -07:00
Eco	81d2b54dfd	doc: typo fix for ttfb entry in table (#14647 )	2022-03-29 09:42:02 -07:00
Minio Trusted	be5d394e56	Update yaml files to latest version RELEASE.2022-03-26T06-49-28Z	2022-03-26 07:32:25 +00:00
Minio Trusted	849a27ee61	update hotfixes instructions and fix some typo	2022-03-25 23:49:28 -07:00
Andreas Auernhammer	4d2fc530d0	add support for SSE-S3 bulk ETag decryption (#14627 ) This commit adds support for bulk ETag decryption for SSE-S3 encrypted objects. If KES supports a bulk decryption API, then MinIO will check whether its policy grants access to this API. If so, MinIO will use a bulk API call instead of sending encrypted ETags serially to KES. Note that MinIO will not use the KES bulk API if its client certificate is an admin identity. MinIO will process object listings in batches. A batch has a configurable size that can be set via `MINIO_KMS_KES_BULK_API_BATCH_SIZE=N`. It defaults to `500`. This env. variable is experimental and may be renamed / removed in the future. Signed-off-by: Andreas Auernhammer <hi@aead.dev>	2022-03-25 15:01:41 -07:00
Minio Trusted	cf220be9b5	Update yaml files to latest version RELEASE.2022-03-24T00-43-44Z	2022-03-24 01:28:05 +00:00
Minio Trusted	751e9fb7be	Update yaml files to latest version RELEASE.2022-03-22T02-05-10Z	2022-03-22 02:45:24 +00:00
Minio Trusted	e9bc0e7e98	Update yaml files to latest version RELEASE.2022-03-17T06-34-49Z	2022-03-17 00:11:59 -07:00
Minio Trusted	7a733a8d54	Update yaml files to latest version RELEASE.2022-03-17T02-57-36Z	2022-03-16 22:27:48 -07:00
Aditya Manthramurthy	ce97313fda	Add extra LDAP configuration validation (#14535 ) - The result now contains suggestions on fixing common configuration issues. - These suggestions will subsequently be exposed in console/mc	2022-03-16 19:57:36 -07:00
Minio Trusted	721c053712	Update yaml files to latest version RELEASE.2022-03-14T18-25-24Z	2022-03-14 19:32:22 +00:00
Minio Trusted	57b7c3494f	Update yaml files to latest version RELEASE.2022-03-11T23-57-45Z	2022-03-13 08:47:27 +00:00
Poorna	f8d6eaaa96	fix: regression from range GET proxy on replicated buckets #14345 (#14532 ) Fixes: #14531	2022-03-11 15:56:49 -08:00
Minio Trusted	80039f60d5	Update yaml files to latest version RELEASE.2022-03-11T11-08-23Z	2022-03-11 11:47:17 +00:00
Aditya Manthramurthy	b7ed3b77bd	Indicate required fields in LDAP configuration correctly (#14526 )	2022-03-10 19:03:38 -08:00
Minio Trusted	fce380a044	Update yaml files to latest version RELEASE.2022-03-08T22-28-51Z	2022-03-09 01:36:59 +00:00
Minio Trusted	1f11af42f1	Update yaml files to latest version RELEASE.2022-03-05T06-32-39Z	2022-03-05 09:27:28 +00:00
Jan Madera	a026c8748f	Update nginx.conf for large file uploads (#14481 )	2022-03-04 22:32:39 -08:00
Harshavardhana	b0c84e3de7	fix: deleteVersions causing xl.meta to have empty Versions[] slice (#14483 ) This is a side-affect of the optimization done in PR #13544 which causes a certain type of delete operations on given object versions can cause lastVersion indication to be skipped, which leads to an `xl.meta` where Versions[] slice is empty while the entire file is intact by itself. This PR tries to ensure that such files are visible and deletable by regular means of listing as null 'delete-marker' and also avoid the situation where this potential issue might arise.	2022-03-04 20:01:26 -08:00
Minio Trusted	04bbede17d	Update yaml files to latest version RELEASE.2022-03-03T21-21-16Z	2022-03-03 22:16:10 +00:00
Emmet McPoland	27fad98179	Replace HeadBucket permission with GetBucketAcl (#14436 ) Resolves https://github.com/minio/minio/issues/14379	2022-03-01 21:18:23 -08:00
Minio Trusted	7d4579e737	Update yaml files to latest version RELEASE.2022-02-26T02-54-46Z	2022-02-26 03:36:08 +00:00
Harshavardhana	890e526bde	rename 'mc admin inspect' to 'mc support inspect'	2022-02-24 17:17:53 -08:00
Harshavardhana	16ce455fca	update docker release to RELEASE.2022-02-24T22-12-01Z	2022-02-24 15:35:14 -08:00
Minio Trusted	b23b19e5c3	Update yaml files to latest version RELEASE.2022-02-18T01-50-10Z	2022-02-17 19:12:27 -08:00
Minio Trusted	1dbb3f6f43	Update yaml files to latest version RELEASE.2022-02-17T23-22-26Z	2022-02-18 00:33:01 +00:00
Minio Trusted	27d94c64ed	Update yaml files to latest version RELEASE.2022-02-16T00-35-27Z	2022-02-16 05:34:56 +00:00
Pierre Kancir	d0862ddf86	doc: add console-address on all example (#14307 ) --console-address ":9001" is missing on docker example for regular user.	2022-02-15 09:26:04 -08:00
Harshavardhana	f088e8960b	docs: turn-on more markdown rules and fix them (#14301 )	2022-02-14 08:50:42 -08:00
Anis Elleuch	1f92fc3fc0	Always check for root disks unless MINIO_CI_CD is set (#14232 ) The current code considers a pool with all root disks to be as part of a testing environment even if there are other pools with mounted disks. This will result to illegitimate writing in root disks. Fix this by simplifing the logic: require MINIO_CI_CD in order to skip root disk check.	2022-02-13 15:42:07 -08:00
Minio Trusted	f71b114a84	Update yaml files to latest version RELEASE.2022-02-12T00-51-25Z	2022-02-13 19:31:37 +00:00
Harshavardhana	e3e0532613	cleanup markdown docs across multiple files (#14296 ) enable markdown-linter	2022-02-11 16:51:25 -08:00
Harshavardhana	97b5bf1fb7	update gateway docs to indicate code-freeze	2022-02-10 11:39:41 -08:00
Poorna	ed3418c046	Refactor replication resync to be an active process (#14266 ) When resync is triggered, walk the bucket namespace and resync objects that are unreplicated. This PR also adds an API to report resync progress.	2022-02-10 10:16:52 -08:00
Harshavardhana	a2230868e0	remove all stale old docs about 2018 releases	2022-02-10 09:54:27 -08:00
Krishnan Parthasarathi	0ee2933234	Export tier metrics via Prometheus (#13413 ) e.g ``` minio_cluster_ilm_transitioned_bytes{server="minio3:9000",tier="S3TIER-1"} 1.36317772e+08 minio_cluster_ilm_transitioned_bytes{server="minio3:9000",tier="S3TIER-2"} 2892 minio_cluster_ilm_transitioned_bytes{server="minio3:9000",tier="STANDARD"} 1.3631488e+08 minio_cluster_ilm_transitioned_objects{server="minio3:9000",tier="S3TIER-1"} 1 minio_cluster_ilm_transitioned_objects{server="minio3:9000",tier="S3TIER-2"} 0 minio_cluster_ilm_transitioned_objects{server="minio3:9000",tier="STANDARD"} 1 minio_cluster_ilm_transitioned_versions{server="minio3:9000",tier="S3TIER-1"} 3 minio_cluster_ilm_transitioned_versions{server="minio3:9000",tier="S3TIER-2"} 2 minio_cluster_ilm_transitioned_versions{server="minio3:9000",tier="STANDARD"} 1 ```	2022-02-08 12:45:28 -08:00
Minio Trusted	2480c66857	Update yaml files to latest version RELEASE.2022-02-07T08-17-33Z	2022-02-07 09:19:24 +00:00
Minio Trusted	570670be8c	Update yaml files to latest version RELEASE.2022-02-05T04-40-59Z	2022-02-05 18:33:46 +00:00
Minio Trusted	9417fd933e	Update yaml files to latest version RELEASE.2022-02-01T18-00-14Z	2022-02-01 23:37:07 +00:00
Harshavardhana	74faed166a	Add quota usage as part of prometheus metrics (#14222 ) Bonus: pass caller context when needed to all bucket metadata handling calls.	2022-01-31 17:27:43 -08:00
Harshavardhana	dbd05d6e82	remove FIFO bucket quota, use ILM expiration instead (#14206 )	2022-01-31 11:07:04 -08:00
Minio Trusted	c7df5fb119	Update yaml files to latest version RELEASE.2022-01-28T02-28-16Z	2022-01-28 05:12:35 +00:00
Minio Trusted	a66071099c	Update yaml files to latest version RELEASE.2022-01-27T03-53-02Z	2022-01-27 04:47:45 +00:00
Aditya Manthramurthy	7dfa565d00	Identity LDAP: Allow multiple search base DNs (#14191 ) This change allows the MinIO server to lookup users in different directory sub-trees by allowing specification of multiple search bases separated by semicolons.	2022-01-26 15:05:59 -08:00
Bingchang Chen	affe51cb19	docs: add casdoor as identity provider (#14185 )	2022-01-26 09:49:10 -08:00
Minio Trusted	f556a72fe2	Update yaml files to latest version RELEASE.2022-01-25T19-56-04Z	2022-01-25 20:42:46 +00:00
Harshavardhana	cd7a5cab8a	update docs for Decommission	2022-01-25 11:56:04 -08:00
Poorna	295730408b	Disallow delete replication for tag based rules (#14167 )	2022-01-24 15:22:20 -08:00
Harshavardhana	f30afa4956	docs: add decommission docs about pool removal (#14159 )	2022-01-24 09:47:06 -08:00
Harshavardhana	8fb4ae916c	update decommission docs	2022-01-21 18:34:06 -08:00
Klaus Post	07df9eecda	Update xl.meta docs (#14150 )	2022-01-21 08:47:46 -08:00
Harshavardhana	9d588319dd	support site replication to replicate IAM users,groups (#14128 ) - Site replication was missing replicating users, groups when an empty site was added. - Add site replication for groups and users when they are disabled and enabled. - Add support for replicating bucket quota config.	2022-01-19 20:02:24 -08:00
Poorna	54a98773f8	fix: replication of tag removal (#14056 ) Currently tag removal leaves replication state as `PENDING` because the `HEAD` api returns just a tag count but not the actual tags, and this is treated as a no-op	2022-01-10 19:06:10 -08:00
Harshavardhana	76b21de0c6	feat: decommission feature for pools (#14012 ) ``` λ mc admin decommission start alias/ http://minio{1...2}/data{1...4} ``` ``` λ mc admin decommission status alias/ ┌─────┬─────────────────────────────────┬──────────────────────────────────┬────────┐ │ ID │ Pools │ Capacity │ Status │ │ 1st │ http://minio{1...2}/data{1...4} │ 439 GiB (used) / 561 GiB (total) │ Active │ │ 2nd │ http://minio{3...4}/data{1...4} │ 329 GiB (used) / 421 GiB (total) │ Active │ └─────┴─────────────────────────────────┴──────────────────────────────────┴────────┘ ``` ``` λ mc admin decommission status alias/ http://minio{1...2}/data{1...4} Progress: ===================> [1GiB/sec] [15%] [4TiB/50TiB] Time Remaining: 4 hours (started 3 hours ago) ``` ``` λ mc admin decommission status alias/ http://minio{1...2}/data{1...4} ERROR: This pool is not scheduled for decommissioning currently. ``` ``` λ mc admin decommission cancel alias/ ┌─────┬─────────────────────────────────┬──────────────────────────────────┬──────────┐ │ ID │ Pools │ Capacity │ Status │ │ 1st │ http://minio{1...2}/data{1...4} │ 439 GiB (used) / 561 GiB (total) │ Draining │ └─────┴─────────────────────────────────┴──────────────────────────────────┴──────────┘ ``` > NOTE: Canceled decommission will not make the pool active again, since we might have > Potentially partial duplicate content on the other pools, to avoid this scenario be > very sure to start decommissioning as a planned activity. ``` λ mc admin decommission cancel alias/ http://minio{1...2}/data{1...4} ┌─────┬─────────────────────────────────┬──────────────────────────────────┬────────────────────┐ │ ID │ Pools │ Capacity │ Status │ │ 1st │ http://minio{1...2}/data{1...4} │ 439 GiB (used) / 561 GiB (total) │ Draining(Canceled) │ └─────┴─────────────────────────────────┴──────────────────────────────────┴────────────────────┘ ```	2022-01-10 09:07:49 -08:00
Minio Trusted	f394313fee	Update yaml files to latest version RELEASE.2022-01-08T03-11-54Z	2022-01-08 05:53:59 +00:00
Harshavardhana	b7c5e45fff	heal: isObjectDangling should return false when it cannot decide (#14053 ) In a multi-pool setup when disks are coming up, or in a single pool setup let's say with 100's of erasure sets with a slow network. It's possible when healing is attempted on `.minio.sys/config` folder, it can lead to healing unexpectedly deleting some policy files as dangling due to a mistake in understanding when `isObjectDangling` is considered to be 'true'. This issue happened in commit `30135eed86` when we assumed the validMeta with empty ErasureInfo is considered to be fully dangling. This implementation issue gets exposed when the server is starting up. This is most easily seen with multiple-pool setups because of the disconnected fashion pools that come up. The decision to purge the object as dangling is taken incorrectly prior to the correct state being achieved on each pool, when the corresponding drive let's say returns 'errDiskNotFound', a 'delete' is triggered. At this point, the 'drive' comes online because this is part of the startup sequence as drives can come online lazily. This kind of situation exists because we allow (totalDisks/2) number of drives to be online when the server is being restarted. Implementation made an incorrect assumption here leading to policies getting deleted. Added tests to capture the implementation requirements.	2022-01-07 19:11:54 -08:00
Aditya Manthramurthy	0a224654c2	fix: progagation of service accounts for site replication (#14054 ) - Only non-root-owned service accounts are replicated for now. - Add integration tests for OIDC with site replication	2022-01-07 17:41:43 -08:00
Minio Trusted	e420a1de4d	Update yaml files to latest version RELEASE.2022-01-07T01-53-23Z	2022-01-07 05:57:36 +00:00
Aditya Manthramurthy	62dc0f7698	Update site replication docs (#14044 ) - Now OpenID external IDP is also supported for site replication. - IAM users/groups are also replicated	2022-01-06 17:53:23 -08:00
Minio Trusted	f4c03e56b8	Update yaml files to latest version RELEASE.2022-01-04T07-41-07Z	2022-01-04 23:01:29 +00:00
Minio Trusted	5dd40b9377	Update yaml files to latest version RELEASE.2022-01-03T18-22-58Z	2022-01-04 00:12:07 +00:00
Harshavardhana	a60ac7ca17	fix: audit log to support object names in multipleObjectNames() handler (#14017 )	2022-01-03 01:28:52 -08:00
Minio Trusted	c9e49f4366	Update yaml files to latest version RELEASE.2021-12-29T06-49-06Z	2021-12-29 07:38:12 +00:00
Yoann Guillerme	3e28af1723	docs: update TLS doc use -keyout instead of -key (#14001 )	2021-12-28 12:51:38 -08:00
Minio Trusted	6aa0574a53	Update yaml files to latest version RELEASE.2021-12-27T07-23-18Z	2021-12-27 19:52:13 +00:00
Harshavardhana	7e3a7d7044	add healing for invalid shards by skipping the blocks (#13978 ) Built on top of #13945, now we need to simply skip the shards and its automated.	2021-12-23 23:01:46 -08:00
Harshavardhana	416977436e	rename MINIO_CACHE_.._MASTER_KEY to MINIO_CACHE_.._SECRET_KEY fixes #13975	2021-12-22 12:11:07 -08:00
Harshavardhana	0e3037631f	skip inconsistent shards if possible (#13945 ) data shards were wrong due to a healing bug reported in #13803 mainly with unaligned object sizes. This PR is an attempt to automatically avoid these shards, with available information about the `xl.meta` and actually disk mtime.	2021-12-21 10:08:26 -08:00
Minio Trusted	f3602d7d08	Update yaml files to latest version RELEASE.2021-12-20T22-07-16Z	2021-12-20 23:13:48 +00:00
Harshavardhana	0b21734571	update helm chart link	2021-12-20 13:20:59 -08:00
Minio Trusted	cfd66ab8c3	Update yaml files to latest version RELEASE.2021-12-18T04-42-33Z	2021-12-19 22:19:30 +00:00
Krishnan Parthasarathi	3ddb501190	Add docs for NewerNoncurrentVersions (#13944 )	2021-12-17 19:32:29 -08:00
Harshavardhana	4fa250a6a1	add hash-set debugging currently supports SIPMOD (#13911 ) fixes a bug in s3-check-md5 for single part uploaded multipart objects.	2021-12-15 12:07:15 -08:00
Harshavardhana	88ad742da0	fix: error handling cases in site-replication (#13901 ) - Allow proper SRError to be propagated to handlers and converted appropriately. - Make sure to enable object locking on buckets when requested in MakeBucketHook. - When DNSConfig is enabled attempt to delete it first before deleting buckets locally.	2021-12-14 14:09:57 -08:00
fpaupier	40dbe243d9	update: keycloak binding documentation (#13894 )	2021-12-13 18:23:16 -08:00
Harshavardhana	109c927dad	docs/debug: log any corruption and continue debug tool	2021-12-13 17:45:34 -08:00
Minio Trusted	878d368cea	Update yaml files to latest version RELEASE.2021-12-10T23-03-39Z	2021-12-11 00:02:59 -08:00
Klaus Post	518612492c	xl-meta: Add header titles (#13880 ) Add type for headers and create custom marshal to make it easier to read. Group headers and metadata. Restore functionality that will read `xl.meta` in the current dir with no params. Before: ``` { "Headers": [ [ "8M04bTiYRDmEMQGeAsk1yg==", 1639150471630100400, "rLD1Rw==", 1, 6 ], ], "Versions": [ { "Type": 1, "V2Obj": { "CSumAlgo": 1, "DDir": "oC1Xpg4tRfW03g8o8w7Bzg==", "EcAlgo": 1, "EcBSize": 1048576, "EcDist": [ 7, 8, 1, 2, 3, 4, 5, 6 ], "EcIndex": 1, "EcM": 4, "EcN": 4, "ID": "8M04bTiYRDmEMQGeAsk1yg==", "MTime": 1639150471630100400, "MetaSys": { "x-minio-internal-inline-data": "dHJ1ZQ==" }, "MetaUsr": { "content-type": "application/octet-stream", "etag": "b8252c86fad2d8937300aa92b467a3aa" }, "PartASizes": [ 1000 ], "PartETags": null, "PartNums": [ 1 ], "PartSizes": [ 1000 ], "Size": 1000 } } ] } ``` After: ``` { "Versions": [ { "Header": { "Flags": 6, "ModTime": "2021-12-10T16:34:31.6301004+01:00", "Signature": "acb0f547", "Type": 1, "VersionID": "f0cd386d389844398431019e02c935ca" }, "Idx": 0, "Metadata": { "Type": 1, "V2Obj": { "CSumAlgo": 1, "DDir": "oC1Xpg4tRfW03g8o8w7Bzg==", "EcAlgo": 1, "EcBSize": 1048576, "EcDist": [ 7, 8, 1, 2, 3, 4, 5, 6 ], "EcIndex": 1, "EcM": 4, "EcN": 4, "ID": "8M04bTiYRDmEMQGeAsk1yg==", "MTime": 1639150471630100400, "MetaSys": { "x-minio-internal-inline-data": "dHJ1ZQ==" }, "MetaUsr": { "content-type": "application/octet-stream", "etag": "b8252c86fad2d8937300aa92b467a3aa" }, "PartASizes": [ 1000 ], "PartETags": null, "PartNums": [ 1 ], "PartSizes": [ 1000 ], "Size": 1000 } } } ] } ```	2021-12-10 15:03:25 -08:00
Ravind Kumar	c76f86fdbd	Clarify example for Standalone Docker instructions (#13879 ) Closes #13868 Also points users to the web documentation for docker installation.	2021-12-10 09:43:02 -08:00
Minio Trusted	4be8023408	Update yaml files to latest version RELEASE.2021-12-09T06-19-41Z	2021-12-09 08:40:46 +00:00
Harshavardhana	dcff6c996d	fix: do not list delete-marked objects (#13864 ) delete marked objects should not be considered for listing when listing is delimited, this issue as introduced in PR #13804 which was mainly to address listing of directories in listing when delimited. This PR fixes this properly and adds tests to ensure that we behave in accordance with how an S3 API behaves for ListObjects() without versions.	2021-12-08 17:34:52 -08:00
Harshavardhana	e82a5c5c54	fix: site replication issues and add tests (#13861 ) - deleting policies was deleting all LDAP user mapping, this was a regression introduced in #13567 - deleting of policies is properly sent across all sites. - remove unexpected errors instead embed the real errors as part of the 500 error response.	2021-12-08 11:50:15 -08:00
Harshavardhana	92fdcafb66	add verification tests for ETag on replicated content (#13857 )	2021-12-07 10:08:26 -08:00
Harshavardhana	be34fc9134	fix: kms-id header should have arn:aws:kms: prefix (#13833 ) arn:aws:kms: is a must for KMS keyID.	2021-12-06 00:39:32 -08:00
Harshavardhana	20c60aae68	Update hotfix documentation and container building	2021-12-02 17:52:46 -08:00
Harshavardhana	f840080e5b	cleanup site-replication docs (#13812 )	2021-12-02 13:27:01 -08:00
Harshavardhana	ffe9acfe4a	docs: Add a markdown documentation on hotfix branches and process	2021-12-01 01:00:18 -08:00
Poorna K	9ec197f2e8	Add support for adding new site(s) to site replication (#13696 ) Currently, the new site is expected to be empty	2021-11-30 13:16:37 -08:00
Aditya Manthramurthy	4c0f48c548	Add role ARN support for OIDC identity provider (#13651 ) - Allows setting a role policy parameter when configuring OIDC provider - When role policy is set, the server prints a role ARN usable in STS API requests - The given role policy is applied to STS API requests when the roleARN parameter is provided. - Service accounts for role policy are also possible and work as expected.	2021-11-26 19:22:40 -08:00
Aditya Manthramurthy	4ce6d35e30	Add new `site` config sub-system intended to replace `region` (#13672 ) - New sub-system has "region" and "name" fields. - `region` subsystem is marked as deprecated, however still works, unless the new region parameter under `site` is set - in this case, the region subsystem is ignored. `region` subsystem is hidden from top-level help (i.e. from `mc admin config set myminio`), but appears when specifically requested (i.e. with `mc admin config set myminio region`). - MINIO_REGION, MINIO_REGION_NAME are supported as legacy environment variables for server region. - Adds MINIO_SITE_REGION as the current environment variable to configure the server region and MINIO_SITE_NAME for the site name.	2021-11-25 13:06:25 -08:00
Minio Trusted	a5db4ca092	Update yaml files to latest version RELEASE.2021-11-24T23-19-33Z	2021-11-25 07:39:00 +00:00
chrisbecke	ef0b8367b5	Update minio-overview.json data source panel (#13730 ) Add missing datasource in `Healing` panel.	2021-11-23 09:01:07 -08:00
Krishnan Parthasarathi	3da9ee15d3	Add MaxNoncurrentVersions to NoncurrentExpiration action (#13580 ) This unit allows users to limit the maximum number of noncurrent versions of an object. To enable this rule you need the following ilm.json ``` cat >> ilm.json <<EOF { "Rules": [ { "ID": "test-max-noncurrent", "Status": "Enabled", "Filter": { "Prefix": "user-uploads/" }, "NoncurrentVersionExpiration": { "MaxNoncurrentVersions": 5 } } ] } EOF mc ilm import myminio/mybucket < ilm.json ```	2021-11-19 17:54:10 -08:00
Mani	7b82411e6f	change the unit of measurement from TB to TiB (#13686 )	2021-11-18 20:06:37 -08:00
Harshavardhana	79b3a1fe4e	remove object torrent, AWS S3 removed support for torrent API	2021-11-18 12:21:48 -08:00
Klaus Post	faf013ec84	Improve performance on multiple versions (#13573 ) Existing: ```go type xlMetaV2 struct { Versions []xlMetaV2Version `json:"Versions" msg:"Versions"` } ``` Serialized as regular MessagePack. ```go //msgp:tuple xlMetaV2VersionHeader type xlMetaV2VersionHeader struct { VersionID [16]byte ModTime int64 Type VersionType Flags xlFlags } ``` Serialize as streaming MessagePack, format: ``` int(headerVersion) int(xlmetaVersion) int(nVersions) for each version { binary blob, xlMetaV2VersionHeader, serialized binary blob, xlMetaV2Version, serialized. } ``` xlMetaV2VersionHeader is <= 30 bytes serialized. Deserialized struct can easily be reused and does not contain pointers, so efficient as a slice (single allocation) This allows quickly parsing everything as slices of bytes (no copy). Versions are always saved sorted by modTime, newest first. No more need to sort on load. * Allows checking if a version exists. * Allows reading single version without unmarshal all. * Allows reading latest version of type without unmarshal all. * Allows reading latest version without unmarshal of all. * Allows checking if the latest is deleteMarker by reading first entry. * Allows adding/updating/deleting a version with only header deserialization. * Reduces allocations on conversion to FileInfo(s).	2021-11-18 12:15:22 -08:00
Ashish Kumar Sinha	3d2bc15e9a	Add grafana json file for replication metrics (#13678 )	2021-11-17 14:49:46 -08:00
Harshavardhana	661b263e77	add gocritic/ruleguard checks back again, cleanup code. (#13665 ) - remove some duplicated code - reported a bug, separately fixed in #13664 - using strings.ReplaceAll() when needed - using filepath.ToSlash() use when needed - remove all non-Go style comments from the codebase Co-authored-by: Aditya Manthramurthy <donatello@users.noreply.github.com>	2021-11-16 09:28:29 -08:00
Harshavardhana	82d73f387d	add tool to read healing.bin for debugging (#13650 )	2021-11-12 16:18:53 -08:00
Harshavardhana	5acc8c0134	add multi-site replication tests (#13631 )	2021-11-10 18:18:09 -08:00
Poorna K	03725dc015	Default multipart caching to writethrough (#13613 ) when `MINIO_CACHE_COMMIT` is set. - `writeback` caching applies only to single uploads. When cache commit mode is `writeback`, default multipart caching to be synchronous. - Add writethrough caching for single uploads	2021-11-10 08:12:03 -08:00
Minio Trusted	edf1f4233b	Update yaml files to latest version RELEASE.2021-11-09T03-21-45Z	2021-11-09 04:51:05 +00:00
Harshavardhana	5aef492b4c	update disk-caching design guide	2021-11-07 01:21:34 -08:00
Harshavardhana	5d7ed8ff7d	update S3 gateway limitation docs	2021-11-06 23:24:48 -07:00
Minio Trusted	cbb0828ab8	Update yaml files to latest version RELEASE.2021-11-05T09-16-26Z	2021-11-05 10:03:56 +00:00
Minio Trusted	9f3c151c3c	Update yaml files to latest version RELEASE.2021-11-03T03-36-36Z	2021-11-03 06:48:34 +00:00
Harshavardhana	e106070640	update docs to mention the expected behavior for requests_max fixes #13561	2021-11-02 14:10:21 -07:00
jandres - moscardo	1aa08f594d	Update README.md prometheus (#13514 ) Modify the doc to warn users about Prometheus sending `domain:port`	2021-11-02 12:27:30 -07:00
Poorna K	15dcacc1fc	Add support for caching multipart in writethrough mode (#13507 )	2021-11-01 08:11:58 -07:00
Harshavardhana	3c1220adca	add tests for default governance replication	2021-10-30 08:57:59 -07:00
Harshavardhana	2af5445309	update 3-site replication tests	2021-10-29 22:09:55 -07:00
Harshavardhana	abb1916bda	update list objects limit to match S3 spec	2021-10-28 18:21:51 -07:00
Minio Trusted	8e29ae8c44	Update yaml files to latest version RELEASE.2021-10-27T16-29-42Z	2021-10-28 02:45:22 +00:00
Minio Trusted	0c76fb57f2	Update yaml files to latest version RELEASE.2021-10-23T03-28-24Z	2021-10-23 07:46:29 +00:00
Harshavardhana	52c5f6e152	remove extraneous whitespaces	2021-10-21 14:43:13 -07:00
Aditya Manthramurthy	26ca59859f	update LDAP doc (#13492 ) - clarify the login flow - add some sections on configuration - minor fixes to improve readability	2021-10-21 14:41:32 -07:00
Klaus Post	1642867136	Add documentation for debugging tools (#13484 ) Move `xl-meta` so it can be installed out-of-repo with a single command.	2021-10-20 10:12:46 -07:00
Harshavardhana	bedf739d16	update required IAM policies	2021-10-13 12:28:53 -07:00
Minio Trusted	6299e42aa9	Update yaml files to latest version RELEASE.2021-10-13T00-23-17Z	2021-10-13 01:14:23 +00:00
Harshavardhana	9ea45399ce	fix: enable AssumeRoleWithCertificate API only when asked (#13410 ) This is a breaking change but we need to do this to avoid issues discussed in #13409 based on discussions from #13371 fixes #13371 fixes #13409	2021-10-11 14:23:51 -07:00
Minio Trusted	e0db822a9b	Update yaml files to latest version RELEASE.2021-10-10T16-53-30Z	2021-10-10 21:24:01 +00:00
Minio Trusted	c49ebaaf1a	Update yaml files to latest version RELEASE.2021-10-08T23-58-24Z	2021-10-09 00:50:16 +00:00
Harshavardhana	d57b57bddc	feat: Add RX/TX to audit logging (#13382 ) add additional values for audit logging	2021-10-07 19:03:46 -07:00
Aditya Manthramurthy	f81a188ef6	update site replication doc (#13377 ) make pre-requisites clear	2021-10-07 15:21:01 -07:00
Minio Trusted	4ce6830a7b	Update yaml files to latest version RELEASE.2021-10-06T23-36-31Z	2021-10-07 04:13:46 +00:00
Aditya Manthramurthy	3a7c79e2c7	Add new site replication feature (#13311 ) This change allows a set of MinIO sites (clusters) to be configured for mutual replication of all buckets (including bucket policies, tags, object-lock configuration and bucket encryption), IAM policies, LDAP service accounts and LDAP STS accounts.	2021-10-06 16:36:31 -07:00
Minio Trusted	d6a3215fe2	Update yaml files to latest version RELEASE.2021-10-02T16-31-05Z	2021-10-03 21:43:13 +00:00
Klaus Post	bc6067d195	Add admin inspect Glob support (#13328 ) * Add admin Glob support Allow returning multiple files on inspect calls. ``` λ mc admin inspect --json local2/testbucket/nyc-taxi-data-10M.csv.zst/* ... λ unzip -l inspect.5f0643b2.zip Archive: inspect.5f0643b2.zip Length Date Time Name --------- ---------- ----- ---- 0 2021-09-03 12:50 192.168.1.78:9001/a221edde-48fe-45f5-ad32-3bc7131c7659/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/ 802 2021-09-03 12:50 192.168.1.78:9001/a221edde-48fe-45f5-ad32-3bc7131c7659/testbucket/nyc-taxi-data-10M.csv.zst/xl.meta 0 2021-09-03 12:50 192.168.1.78:9001/cb7440ef-f0d9-42a8-b137-f00f519276ca/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/ 802 2021-09-03 12:50 192.168.1.78:9001/cb7440ef-f0d9-42a8-b137-f00f519276ca/testbucket/nyc-taxi-data-10M.csv.zst/xl.meta 0 2021-09-03 12:50 192.168.1.78:9001/759cd5ac-7860-4cf3-acad-a375fcbae338/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/ 802 2021-09-03 12:50 192.168.1.78:9001/759cd5ac-7860-4cf3-acad-a375fcbae338/testbucket/nyc-taxi-data-10M.csv.zst/xl.meta 0 2021-09-09 15:56 192.168.1.78:9001/2b48619c-c2fa-4e69-839e-58fc82c1b43e/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/ 802 2021-09-09 15:56 192.168.1.78:9001/2b48619c-c2fa-4e69-839e-58fc82c1b43e/testbucket/nyc-taxi-data-10M.csv.zst/xl.meta --------- ------- 3208 8 files ``` Using fully recursive: ``` λ mc admin inspect local2/testbucket/nyc-taxi-data-10M.csv.zst/** ... Archive: inspect.79c261cb.zip Length Date Time Name --------- ---------- ----- ---- 0 2021-09-03 12:50 192.168.1.78:9001/a221edde-48fe-45f5-ad32-3bc7131c7659/testbucket/nyc-taxi-data-10M.csv.zst/ 0 2021-09-03 12:50 192.168.1.78:9001/a221edde-48fe-45f5-ad32-3bc7131c7659/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/ 4194816 2021-09-03 12:50 192.168.1.78:9001/a221edde-48fe-45f5-ad32-3bc7131c7659/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.1 4194816 2021-09-03 12:50 192.168.1.78:9001/a221edde-48fe-45f5-ad32-3bc7131c7659/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.10 4194816 2021-09-03 12:50 192.168.1.78:9001/a221edde-48fe-45f5-ad32-3bc7131c7659/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.11 4194816 2021-09-03 12:50 192.168.1.78:9001/a221edde-48fe-45f5-ad32-3bc7131c7659/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.12 4194816 2021-09-03 12:50 192.168.1.78:9001/a221edde-48fe-45f5-ad32-3bc7131c7659/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.13 4194816 2021-09-03 12:50 192.168.1.78:9001/a221edde-48fe-45f5-ad32-3bc7131c7659/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.14 4194816 2021-09-03 12:50 192.168.1.78:9001/a221edde-48fe-45f5-ad32-3bc7131c7659/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.15 4194816 2021-09-03 12:50 192.168.1.78:9001/a221edde-48fe-45f5-ad32-3bc7131c7659/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.16 4194816 2021-09-03 12:50 192.168.1.78:9001/a221edde-48fe-45f5-ad32-3bc7131c7659/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.17 4194816 2021-09-03 12:50 192.168.1.78:9001/a221edde-48fe-45f5-ad32-3bc7131c7659/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.18 4194816 2021-09-03 12:50 192.168.1.78:9001/a221edde-48fe-45f5-ad32-3bc7131c7659/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.19 4194816 2021-09-03 12:50 192.168.1.78:9001/a221edde-48fe-45f5-ad32-3bc7131c7659/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.2 4194816 2021-09-03 12:50 192.168.1.78:9001/a221edde-48fe-45f5-ad32-3bc7131c7659/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.20 4194816 2021-09-03 12:50 192.168.1.78:9001/a221edde-48fe-45f5-ad32-3bc7131c7659/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.21 4194816 2021-09-03 12:50 192.168.1.78:9001/a221edde-48fe-45f5-ad32-3bc7131c7659/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.22 4194816 2021-09-03 12:50 192.168.1.78:9001/a221edde-48fe-45f5-ad32-3bc7131c7659/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.23 4194816 2021-09-03 12:50 192.168.1.78:9001/a221edde-48fe-45f5-ad32-3bc7131c7659/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.24 4194816 2021-09-03 12:50 192.168.1.78:9001/a221edde-48fe-45f5-ad32-3bc7131c7659/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.25 4194816 2021-09-03 12:50 192.168.1.78:9001/a221edde-48fe-45f5-ad32-3bc7131c7659/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.26 4194816 2021-09-03 12:50 192.168.1.78:9001/a221edde-48fe-45f5-ad32-3bc7131c7659/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.27 4194816 2021-09-03 12:50 192.168.1.78:9001/a221edde-48fe-45f5-ad32-3bc7131c7659/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.28 4194816 2021-09-03 12:50 192.168.1.78:9001/a221edde-48fe-45f5-ad32-3bc7131c7659/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.29 4194816 2021-09-03 12:50 192.168.1.78:9001/a221edde-48fe-45f5-ad32-3bc7131c7659/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.3 4194816 2021-09-03 12:50 192.168.1.78:9001/a221edde-48fe-45f5-ad32-3bc7131c7659/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.30 4194816 2021-09-03 12:50 192.168.1.78:9001/a221edde-48fe-45f5-ad32-3bc7131c7659/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.31 4194816 2021-09-03 12:50 192.168.1.78:9001/a221edde-48fe-45f5-ad32-3bc7131c7659/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.32 4194816 2021-09-03 12:50 192.168.1.78:9001/a221edde-48fe-45f5-ad32-3bc7131c7659/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.33 4194816 2021-09-03 12:50 192.168.1.78:9001/a221edde-48fe-45f5-ad32-3bc7131c7659/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.34 4194816 2021-09-03 12:50 192.168.1.78:9001/a221edde-48fe-45f5-ad32-3bc7131c7659/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.35 3439368 2021-09-03 12:50 192.168.1.78:9001/a221edde-48fe-45f5-ad32-3bc7131c7659/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.36 4194816 2021-09-03 12:50 192.168.1.78:9001/a221edde-48fe-45f5-ad32-3bc7131c7659/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.4 4194816 2021-09-03 12:50 192.168.1.78:9001/a221edde-48fe-45f5-ad32-3bc7131c7659/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.5 4194816 2021-09-03 12:50 192.168.1.78:9001/a221edde-48fe-45f5-ad32-3bc7131c7659/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.6 4194816 2021-09-03 12:50 192.168.1.78:9001/a221edde-48fe-45f5-ad32-3bc7131c7659/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.7 4194816 2021-09-03 12:50 192.168.1.78:9001/a221edde-48fe-45f5-ad32-3bc7131c7659/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.8 4194816 2021-09-03 12:50 192.168.1.78:9001/a221edde-48fe-45f5-ad32-3bc7131c7659/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.9 802 2021-09-03 12:50 192.168.1.78:9001/a221edde-48fe-45f5-ad32-3bc7131c7659/testbucket/nyc-taxi-data-10M.csv.zst/xl.meta 0 2021-09-03 12:50 192.168.1.78:9001/cb7440ef-f0d9-42a8-b137-f00f519276ca/testbucket/nyc-taxi-data-10M.csv.zst/ 0 2021-09-03 12:50 192.168.1.78:9001/cb7440ef-f0d9-42a8-b137-f00f519276ca/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/ 4194816 2021-09-03 12:50 192.168.1.78:9001/cb7440ef-f0d9-42a8-b137-f00f519276ca/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.1 4194816 2021-09-03 12:50 192.168.1.78:9001/cb7440ef-f0d9-42a8-b137-f00f519276ca/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.10 4194816 2021-09-03 12:50 192.168.1.78:9001/cb7440ef-f0d9-42a8-b137-f00f519276ca/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.11 4194816 2021-09-03 12:50 192.168.1.78:9001/cb7440ef-f0d9-42a8-b137-f00f519276ca/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.12 4194816 2021-09-03 12:50 192.168.1.78:9001/cb7440ef-f0d9-42a8-b137-f00f519276ca/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.13 4194816 2021-09-03 12:50 192.168.1.78:9001/cb7440ef-f0d9-42a8-b137-f00f519276ca/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.14 4194816 2021-09-03 12:50 192.168.1.78:9001/cb7440ef-f0d9-42a8-b137-f00f519276ca/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.15 4194816 2021-09-03 12:50 192.168.1.78:9001/cb7440ef-f0d9-42a8-b137-f00f519276ca/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.16 4194816 2021-09-03 12:50 192.168.1.78:9001/cb7440ef-f0d9-42a8-b137-f00f519276ca/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.17 4194816 2021-09-03 12:50 192.168.1.78:9001/cb7440ef-f0d9-42a8-b137-f00f519276ca/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.18 4194816 2021-09-03 12:50 192.168.1.78:9001/cb7440ef-f0d9-42a8-b137-f00f519276ca/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.19 4194816 2021-09-03 12:50 192.168.1.78:9001/cb7440ef-f0d9-42a8-b137-f00f519276ca/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.2 4194816 2021-09-03 12:50 192.168.1.78:9001/cb7440ef-f0d9-42a8-b137-f00f519276ca/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.20 4194816 2021-09-03 12:50 192.168.1.78:9001/cb7440ef-f0d9-42a8-b137-f00f519276ca/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.21 4194816 2021-09-03 12:50 192.168.1.78:9001/cb7440ef-f0d9-42a8-b137-f00f519276ca/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.22 4194816 2021-09-03 12:50 192.168.1.78:9001/cb7440ef-f0d9-42a8-b137-f00f519276ca/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.23 4194816 2021-09-03 12:50 192.168.1.78:9001/cb7440ef-f0d9-42a8-b137-f00f519276ca/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.24 4194816 2021-09-03 12:50 192.168.1.78:9001/cb7440ef-f0d9-42a8-b137-f00f519276ca/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.25 4194816 2021-09-03 12:50 192.168.1.78:9001/cb7440ef-f0d9-42a8-b137-f00f519276ca/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.26 4194816 2021-09-03 12:50 192.168.1.78:9001/cb7440ef-f0d9-42a8-b137-f00f519276ca/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.27 4194816 2021-09-03 12:50 192.168.1.78:9001/cb7440ef-f0d9-42a8-b137-f00f519276ca/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.28 4194816 2021-09-03 12:50 192.168.1.78:9001/cb7440ef-f0d9-42a8-b137-f00f519276ca/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.29 4194816 2021-09-03 12:50 192.168.1.78:9001/cb7440ef-f0d9-42a8-b137-f00f519276ca/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.3 4194816 2021-09-03 12:50 192.168.1.78:9001/cb7440ef-f0d9-42a8-b137-f00f519276ca/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.30 4194816 2021-09-03 12:50 192.168.1.78:9001/cb7440ef-f0d9-42a8-b137-f00f519276ca/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.31 4194816 2021-09-03 12:50 192.168.1.78:9001/cb7440ef-f0d9-42a8-b137-f00f519276ca/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.32 4194816 2021-09-03 12:50 192.168.1.78:9001/cb7440ef-f0d9-42a8-b137-f00f519276ca/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.33 4194816 2021-09-03 12:50 192.168.1.78:9001/cb7440ef-f0d9-42a8-b137-f00f519276ca/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.34 4194816 2021-09-03 12:50 192.168.1.78:9001/cb7440ef-f0d9-42a8-b137-f00f519276ca/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.35 3439368 2021-09-03 12:50 192.168.1.78:9001/cb7440ef-f0d9-42a8-b137-f00f519276ca/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.36 4194816 2021-09-03 12:50 192.168.1.78:9001/cb7440ef-f0d9-42a8-b137-f00f519276ca/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.4 4194816 2021-09-03 12:50 192.168.1.78:9001/cb7440ef-f0d9-42a8-b137-f00f519276ca/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.5 4194816 2021-09-03 12:50 192.168.1.78:9001/cb7440ef-f0d9-42a8-b137-f00f519276ca/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.6 4194816 2021-09-03 12:50 192.168.1.78:9001/cb7440ef-f0d9-42a8-b137-f00f519276ca/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.7 4194816 2021-09-03 12:50 192.168.1.78:9001/cb7440ef-f0d9-42a8-b137-f00f519276ca/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.8 4194816 2021-09-03 12:50 192.168.1.78:9001/cb7440ef-f0d9-42a8-b137-f00f519276ca/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.9 802 2021-09-03 12:50 192.168.1.78:9001/cb7440ef-f0d9-42a8-b137-f00f519276ca/testbucket/nyc-taxi-data-10M.csv.zst/xl.meta 0 2021-09-03 12:50 192.168.1.78:9001/759cd5ac-7860-4cf3-acad-a375fcbae338/testbucket/nyc-taxi-data-10M.csv.zst/ 0 2021-09-03 12:50 192.168.1.78:9001/759cd5ac-7860-4cf3-acad-a375fcbae338/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/ 4194816 2021-09-03 12:50 192.168.1.78:9001/759cd5ac-7860-4cf3-acad-a375fcbae338/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.1 4194816 2021-09-03 12:50 192.168.1.78:9001/759cd5ac-7860-4cf3-acad-a375fcbae338/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.10 4194816 2021-09-03 12:50 192.168.1.78:9001/759cd5ac-7860-4cf3-acad-a375fcbae338/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.11 4194816 2021-09-03 12:50 192.168.1.78:9001/759cd5ac-7860-4cf3-acad-a375fcbae338/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.12 4194816 2021-09-03 12:50 192.168.1.78:9001/759cd5ac-7860-4cf3-acad-a375fcbae338/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.13 4194816 2021-09-03 12:50 192.168.1.78:9001/759cd5ac-7860-4cf3-acad-a375fcbae338/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.14 4194816 2021-09-03 12:50 192.168.1.78:9001/759cd5ac-7860-4cf3-acad-a375fcbae338/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.15 4194816 2021-09-03 12:50 192.168.1.78:9001/759cd5ac-7860-4cf3-acad-a375fcbae338/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.16 4194816 2021-09-03 12:50 192.168.1.78:9001/759cd5ac-7860-4cf3-acad-a375fcbae338/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.17 4194816 2021-09-03 12:50 192.168.1.78:9001/759cd5ac-7860-4cf3-acad-a375fcbae338/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.18 4194816 2021-09-03 12:50 192.168.1.78:9001/759cd5ac-7860-4cf3-acad-a375fcbae338/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.19 4194816 2021-09-03 12:50 192.168.1.78:9001/759cd5ac-7860-4cf3-acad-a375fcbae338/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.2 4194816 2021-09-03 12:50 192.168.1.78:9001/759cd5ac-7860-4cf3-acad-a375fcbae338/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.20 4194816 2021-09-03 12:50 192.168.1.78:9001/759cd5ac-7860-4cf3-acad-a375fcbae338/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.21 4194816 2021-09-03 12:50 192.168.1.78:9001/759cd5ac-7860-4cf3-acad-a375fcbae338/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.22 4194816 2021-09-03 12:50 192.168.1.78:9001/759cd5ac-7860-4cf3-acad-a375fcbae338/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.23 4194816 2021-09-03 12:50 192.168.1.78:9001/759cd5ac-7860-4cf3-acad-a375fcbae338/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.24 4194816 2021-09-03 12:50 192.168.1.78:9001/759cd5ac-7860-4cf3-acad-a375fcbae338/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.25 4194816 2021-09-03 12:50 192.168.1.78:9001/759cd5ac-7860-4cf3-acad-a375fcbae338/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.26 4194816 2021-09-03 12:50 192.168.1.78:9001/759cd5ac-7860-4cf3-acad-a375fcbae338/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.27 4194816 2021-09-03 12:50 192.168.1.78:9001/759cd5ac-7860-4cf3-acad-a375fcbae338/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.28 4194816 2021-09-03 12:50 192.168.1.78:9001/759cd5ac-7860-4cf3-acad-a375fcbae338/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.29 4194816 2021-09-03 12:50 192.168.1.78:9001/759cd5ac-7860-4cf3-acad-a375fcbae338/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.3 4194816 2021-09-03 12:50 192.168.1.78:9001/759cd5ac-7860-4cf3-acad-a375fcbae338/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.30 4194816 2021-09-03 12:50 192.168.1.78:9001/759cd5ac-7860-4cf3-acad-a375fcbae338/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.31 4194816 2021-09-03 12:50 192.168.1.78:9001/759cd5ac-7860-4cf3-acad-a375fcbae338/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.32 4194816 2021-09-03 12:50 192.168.1.78:9001/759cd5ac-7860-4cf3-acad-a375fcbae338/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.33 4194816 2021-09-03 12:50 192.168.1.78:9001/759cd5ac-7860-4cf3-acad-a375fcbae338/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.34 4194816 2021-09-03 12:50 192.168.1.78:9001/759cd5ac-7860-4cf3-acad-a375fcbae338/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.35 3439368 2021-09-03 12:50 192.168.1.78:9001/759cd5ac-7860-4cf3-acad-a375fcbae338/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.36 4194816 2021-09-03 12:50 192.168.1.78:9001/759cd5ac-7860-4cf3-acad-a375fcbae338/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.4 4194816 2021-09-03 12:50 192.168.1.78:9001/759cd5ac-7860-4cf3-acad-a375fcbae338/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.5 4194816 2021-09-03 12:50 192.168.1.78:9001/759cd5ac-7860-4cf3-acad-a375fcbae338/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.6 4194816 2021-09-03 12:50 192.168.1.78:9001/759cd5ac-7860-4cf3-acad-a375fcbae338/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.7 4194816 2021-09-03 12:50 192.168.1.78:9001/759cd5ac-7860-4cf3-acad-a375fcbae338/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.8 4194816 2021-09-03 12:50 192.168.1.78:9001/759cd5ac-7860-4cf3-acad-a375fcbae338/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.9 802 2021-09-03 12:50 192.168.1.78:9001/759cd5ac-7860-4cf3-acad-a375fcbae338/testbucket/nyc-taxi-data-10M.csv.zst/xl.meta 0 2021-09-09 15:56 192.168.1.78:9001/2b48619c-c2fa-4e69-839e-58fc82c1b43e/testbucket/nyc-taxi-data-10M.csv.zst/ 0 2021-09-09 15:56 192.168.1.78:9001/2b48619c-c2fa-4e69-839e-58fc82c1b43e/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/ 4194816 2021-09-09 15:56 192.168.1.78:9001/2b48619c-c2fa-4e69-839e-58fc82c1b43e/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.1 4194816 2021-09-09 15:56 192.168.1.78:9001/2b48619c-c2fa-4e69-839e-58fc82c1b43e/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.10 4194816 2021-09-09 15:56 192.168.1.78:9001/2b48619c-c2fa-4e69-839e-58fc82c1b43e/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.11 4194816 2021-09-09 15:56 192.168.1.78:9001/2b48619c-c2fa-4e69-839e-58fc82c1b43e/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.12 4194816 2021-09-09 15:56 192.168.1.78:9001/2b48619c-c2fa-4e69-839e-58fc82c1b43e/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.13 4194816 2021-09-09 15:56 192.168.1.78:9001/2b48619c-c2fa-4e69-839e-58fc82c1b43e/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.14 4194816 2021-09-09 15:56 192.168.1.78:9001/2b48619c-c2fa-4e69-839e-58fc82c1b43e/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.15 4194816 2021-09-09 15:56 192.168.1.78:9001/2b48619c-c2fa-4e69-839e-58fc82c1b43e/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.16 4194816 2021-09-09 15:56 192.168.1.78:9001/2b48619c-c2fa-4e69-839e-58fc82c1b43e/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.17 4194816 2021-09-09 15:56 192.168.1.78:9001/2b48619c-c2fa-4e69-839e-58fc82c1b43e/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.18 4194816 2021-09-09 15:56 192.168.1.78:9001/2b48619c-c2fa-4e69-839e-58fc82c1b43e/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.19 4194816 2021-09-09 15:56 192.168.1.78:9001/2b48619c-c2fa-4e69-839e-58fc82c1b43e/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.2 4194816 2021-09-09 15:56 192.168.1.78:9001/2b48619c-c2fa-4e69-839e-58fc82c1b43e/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.20 4194816 2021-09-09 15:56 192.168.1.78:9001/2b48619c-c2fa-4e69-839e-58fc82c1b43e/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.21 4194816 2021-09-09 15:56 192.168.1.78:9001/2b48619c-c2fa-4e69-839e-58fc82c1b43e/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.22 4194816 2021-09-09 15:56 192.168.1.78:9001/2b48619c-c2fa-4e69-839e-58fc82c1b43e/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.23 4194816 2021-09-09 15:56 192.168.1.78:9001/2b48619c-c2fa-4e69-839e-58fc82c1b43e/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.24 4194816 2021-09-09 15:56 192.168.1.78:9001/2b48619c-c2fa-4e69-839e-58fc82c1b43e/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.25 4194816 2021-09-09 15:56 192.168.1.78:9001/2b48619c-c2fa-4e69-839e-58fc82c1b43e/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.26 4194816 2021-09-09 15:56 192.168.1.78:9001/2b48619c-c2fa-4e69-839e-58fc82c1b43e/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.27 4194816 2021-09-09 15:56 192.168.1.78:9001/2b48619c-c2fa-4e69-839e-58fc82c1b43e/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.28 4194816 2021-09-09 15:56 192.168.1.78:9001/2b48619c-c2fa-4e69-839e-58fc82c1b43e/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.29 4194816 2021-09-09 15:56 192.168.1.78:9001/2b48619c-c2fa-4e69-839e-58fc82c1b43e/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.3 4194816 2021-09-09 15:56 192.168.1.78:9001/2b48619c-c2fa-4e69-839e-58fc82c1b43e/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.30 4194816 2021-09-09 15:56 192.168.1.78:9001/2b48619c-c2fa-4e69-839e-58fc82c1b43e/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.31 4194816 2021-09-09 15:56 192.168.1.78:9001/2b48619c-c2fa-4e69-839e-58fc82c1b43e/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.32 4194816 2021-09-09 15:56 192.168.1.78:9001/2b48619c-c2fa-4e69-839e-58fc82c1b43e/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.33 4194816 2021-09-09 15:56 192.168.1.78:9001/2b48619c-c2fa-4e69-839e-58fc82c1b43e/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.34 4194816 2021-09-09 15:56 192.168.1.78:9001/2b48619c-c2fa-4e69-839e-58fc82c1b43e/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.35 3439368 2021-09-09 15:56 192.168.1.78:9001/2b48619c-c2fa-4e69-839e-58fc82c1b43e/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.36 4194816 2021-09-09 15:56 192.168.1.78:9001/2b48619c-c2fa-4e69-839e-58fc82c1b43e/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.4 4194816 2021-09-09 15:56 192.168.1.78:9001/2b48619c-c2fa-4e69-839e-58fc82c1b43e/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.5 4194816 2021-09-09 15:56 192.168.1.78:9001/2b48619c-c2fa-4e69-839e-58fc82c1b43e/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.6 4194816 2021-09-09 15:56 192.168.1.78:9001/2b48619c-c2fa-4e69-839e-58fc82c1b43e/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.7 4194816 2021-09-09 15:56 192.168.1.78:9001/2b48619c-c2fa-4e69-839e-58fc82c1b43e/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.8 4194816 2021-09-09 15:56 192.168.1.78:9001/2b48619c-c2fa-4e69-839e-58fc82c1b43e/testbucket/nyc-taxi-data-10M.csv.zst/18a50b3e-3c56-418e-a045-ad5c58c1d44b/part.9 802 2021-09-09 15:56 192.168.1.78:9001/2b48619c-c2fa-4e69-839e-58fc82c1b43e/testbucket/nyc-taxi-data-10M.csv.zst/xl.meta --------- ------- 601034920 156 files ``` Furthermore allow `inspect` to do direct decode from `mc`, for example: ``` λ mc admin inspect --json local2/testbucket/nyc-taxi-data-10M.csv.zst/*\|inspect -json Output decrypted to inspect.5f0643b2.zip ``` - Correct error, forward non-EOF errors. - Add some extra safety. Log FNF when no files. - Add `xl-meta` zip support. For `xl-meta` multiple inputs output object with names as key. Automatically switches `xl-meta` to single-line output when multiple objects. Add double-star wildcard support to xl-meta input. Co-authored-by: Harshavardhana <harsha@minio.io>	2021-10-01 11:50:00 -07:00
Poorna Krishnamoorthy	7f6ed35347	Allow null versions to be replicated (#13310 ) for pre-existing objects present in a bucket prior to enabling existing object replication. Co-authored-by: Poorna Krishnamoorthy <poorna@minio.io>	2021-09-28 10:26:12 -07:00
Minio Trusted	a5923a5d51	Update yaml files to latest version RELEASE.2021-09-24T00-24-24Z	2021-09-24 19:20:44 +00:00
Minio Trusted	f4d1b7c603	Update yaml files to latest version RELEASE.2021-09-23T04-46-24Z	2021-09-23 07:42:55 +00:00
Poorna Krishnamoorthy	0b55a0423e	fix: cache usage deserialization from v5 to v6 (#13258 )	2021-09-21 09:01:51 -07:00
Harshavardhana	f492f72154	add 3site replication script (#13256 )	2021-09-20 18:24:24 -07:00
Poorna Krishnamoorthy	c4373ef290	Add support for multi site replication (#12880 )	2021-09-18 13:31:35 -07:00
Minio Trusted	0b8c5a6872	Update yaml files to latest version RELEASE.2021-09-18T18-09-59Z	2021-09-18 20:28:07 +00:00
Minio Trusted	bf409936e7	Update yaml files to latest version RELEASE.2021-09-15T04-54-25Z	2021-09-15 08:04:57 +00:00
Harshavardhana	af78c3925a	add userinfo support for OpenID (#12469 ) Some identity providers like GitLab do not provide information about group membership as part of the identity token claims. They only expose it via OIDC compatible '/oauth/userinfo' endpoint, as described in the OpenID Connect 1.0 sepcification. But this of course requires application to make sure to add additional accessToken, since idToken cannot be re-used to perform the same 'userinfo' call. This is why this is specialized requirement. Gitlab seems to be the only OpenID vendor that requires this support for the time being. fixes #12367	2021-09-13 16:22:14 -07:00
Harshavardhana	90e505e58f	calculate API requests/error as increase() intervals not as rate()	2021-09-12 11:28:28 -07:00
Minio Trusted	a216583d95	Update yaml files to latest version RELEASE.2021-09-09T21-37-07Z	2021-09-09 23:50:26 +00:00
soudhaf	950fe73c4f	fix: minio console nginx config (#13156 )	2021-09-08 23:41:06 -07:00
Harshavardhana	aaa3fc3805	fix: remove deprecated LDAP username format support (#13165 )	2021-09-08 13:31:51 -07:00
Andreas Auernhammer	e438dccf19	sts: add support for certificate-based authentication (#12748 ) This commit adds a new STS API for X.509 certificate authentication. A client can make an HTTP POST request over a TLS connection and MinIO will verify the provided client certificate, map it to an S3 policy and return temp. S3 credentials to the client. So, this STS API allows clients to authenticate with X.509 certificates over TLS and obtain temp. S3 credentials. For more details and examples refer to the docs/sts/tls.md documentation. Signed-off-by: Andreas Auernhammer <hi@aead.dev>	2021-09-07 19:03:48 -07:00
Klaus Post	b2c92cdaaa	select: Add more compression formats (#13142 ) Support Zstandard, LZ4, S2, and snappy as additional compression formats for S3 Select.	2021-09-06 09:09:53 -07:00
Harshavardhana	1250312287	fail ready/liveness if etcd is unhealthy in gateway mode (#13146 )	2021-09-03 17:05:41 -07:00
Minio Trusted	e2b6fb0a6a	Update yaml files to latest version RELEASE.2021-09-03T03-56-13Z	2021-09-03 06:45:54 +00:00
Harshavardhana	f486cfae86	point all docs for containers to quay.io	2021-09-01 18:48:26 -07:00
Minio Trusted	5c6dc63577	Update yaml files to latest version RELEASE.2021-08-31T05-46-54Z	2021-08-31 07:27:43 +00:00
Klaus Post	470553ff5d	Tweak readall allocation and renameData buffer reuse (#13108 ) Use a single allocation for reading the file, not the growing buffer of `io.ReadAll`. Reuse the write buffer if we can when writing metadata in RenameData.	2021-08-30 08:38:11 -07:00
Minio Trusted	abf079135e	Update yaml files to latest version RELEASE.2021-08-25T00-41-18Z	2021-08-25 02:01:05 +00:00
Nitish Tiwari	60394ddf83	Add support for changing job name in Grafana dashboard (#13050 )	2021-08-24 09:51:09 -07:00
Minio Trusted	7802088e71	Update yaml files to latest version RELEASE.2021-08-20T18-32-01Z	2021-08-20 20:42:00 +00:00
Harshavardhana	202d0b64eb	fix: enable go1.17 github ci/cd (#12997 )	2021-08-18 18:35:22 -07:00
Minio Trusted	16aeb68c28	Update yaml files to latest version RELEASE.2021-08-17T20-53-08Z	2021-08-17 22:34:33 +00:00
Krishnan Parthasarathi	30b77f59b1	doc: Add ilm prometheus metrics information (#12994 )	2021-08-17 12:19:36 -07:00
Aditya Manthramurthy	9b7d593e28	Add helper script to call assume role (#12978 )	2021-08-17 01:46:59 -07:00
Ricardo Katz	a526ad2e80	Add headers into AMQP notifications (#12911 ) Signed-off-by: Ricardo Katz <rkatz@vmware.com>	2021-08-11 22:24:19 -07:00
Harshavardhana	39f81d2c5b	update max_delay to max_sleep under healing docs	2021-08-10 08:52:42 -07:00
Minio Trusted	7b0b0f9101	Update yaml files to latest version RELEASE.2021-08-05T22-01-19Z	2021-08-06 02:19:42 +00:00
Harshavardhana	c13cbc64d1	fix multiple typos in documentation	2021-08-04 14:15:45 -07:00
Matt Sarrel	109c8acf4f	fixed typo in metrics README.md (#12874 )	2021-08-04 12:48:57 -07:00
Harshavardhana	035882d292	fix: remove parentIsObject() check (#12851 ) we will allow situations such as ``` a/b/1.txt a/b ``` and ``` a/b a/b/1.txt ``` we are going to document that this usecase is not supported and we will never support it, if any application does this users have to delete the top level parent to make sure namespace is accessible at lower level. rest of the situations where the prefixes get created across sets are supported as is.	2021-08-03 13:26:57 -07:00
Harshavardhana	ea64a9263c	add deprecation notice for LDAP username format (#12849 )	2021-08-02 18:20:06 -07:00
Harshavardhana	7281e86d9e	update docker-compose to RELEASE.2021-07-30T00-02-00Z	2021-07-29 18:07:06 -07:00
Harshavardhana	a78bc7bfdb	rename all access token to id_tokens	2021-07-27 22:38:12 -07:00
Harshavardhana	3735450e7e	fix: allow audience claim to be an array (#12810 ) Some incorrect setups might have multiple audiences where they are trying to use a single authentication endpoint for multiple services. Nevertheless OpenID spec allows it to make it even more confusin for no good reason. > It MUST contain the OAuth 2.0 client_id of the > Relying Party as an audience value. It MAY also > contain identifiers for other audiences. In the > general case, the aud value is an array of case > sensitive strings. In the common special case > when there is one audience, the aud value MAY > be a single case sensitive string. fixes #12809	2021-07-27 18:37:51 -07:00
Minio Trusted	471b4fd0c9	Update yaml files to latest version RELEASE.2021-07-27T02-40-15Z	2021-07-27 05:02:00 +00:00
Aditya Manthramurthy	7106e9394c	[LDAP] Document new LDAP synchronization behavior (#12786 )	2021-07-25 10:45:53 -07:00
Aditya Manthramurthy	9a31030e74	DEPRECATION Warning: Avoid configuring default LDAP STS Expiry (#12781 ) - Show notice when `MINIO_IDENTITY_LDAP_STS_EXPIRY` or the corresponding to the configuration option is used at server startup. - Once support is removed, the default will be fixed at 1 hour. - Users may specify expiry directly in the STS API. - Update docs and help message - Adds example in ldap.go to configure expiry in STS API.	2021-07-22 16:43:57 -07:00
Aditya Manthramurthy	a3079a7de2	fix: Add support for DurationSeconds in LDAP STS API (#12778 )	2021-07-22 12:13:21 -07:00
Minio Trusted	026a005b64	Update yaml files to latest version RELEASE.2021-07-22T05-23-32Z	2021-07-22 06:12:29 +00:00
Minio Trusted	dbd7f74bb9	Update yaml files to latest version RELEASE.2021-07-21T22-15-23Z	2021-07-21 23:46:28 +00:00
Ali Malek	c25ad94b7e	Refactor docker-compose, Use YAML variable for common minio configs (#12735 )	2021-07-18 18:06:40 -07:00
Minio Trusted	ead8778305	Update yaml files to latest version RELEASE.2021-07-15T22-27-34Z	2021-07-16 04:27:54 +00:00
Aditya Manthramurthy	eae9c2f65b	Add changes to ensure session policy is enforced in LDAP STS (#12716 ) - Bonus: Fix bug in webidentity sts that doesnt parse session policy correctly. - update ldap.go to support session policy argument	2021-07-15 15:27:34 -07:00
Ravind Kumar	ce800ed347	DOCS: Remove http links in favor of HTTPS (#12725 )	2021-07-15 13:31:59 -07:00
Harshavardhana	8d19efe7e0	feat: increase allowed maximum STS expiration timeout to 365 days (#12704 )	2021-07-14 00:08:22 -07:00
Harshavardhana	e316873f84	feat: Add support for kakfa audit logger target (#12678 )	2021-07-13 09:39:13 -07:00
Harshavardhana	e25ae1c01f	add console-address flag for spoonfed users	2021-07-12 17:05:38 -07:00
Minio Trusted	bc8962102f	Update yaml files to latest version RELEASE.2021-07-12T02-44-53Z	2021-07-12 03:45:14 +00:00
Harshavardhana	55b08403cb	update docker docs with --console-address also update the orchestration docs for nginx proxy for console. fixes #12660	2021-07-11 19:44:53 -07:00
Klaus Post	d6a2fe02d3	Add admin file inspector (#12635 ) Download files from any bucket/path as an encrypted zip file. The key is included in the response but can be separated so zip and the key doesn't have to be sent on the same channel. Requires https://github.com/minio/pkg/pull/6	2021-07-09 11:29:16 -07:00
Harshavardhana	28adb29db3	feat: Add support to poll users on external SSO (#12592 ) Additional support for vendor-specific admin API integrations for OpenID, to ensure validity of credentials on MinIO. Every 5minutes check for validity of credentials on MinIO with vendor specific IDP.	2021-07-09 11:17:21 -07:00
Minio Trusted	b6dd9b55a7	Update yaml files to latest version RELEASE.2021-07-08T19-43-25Z	2021-07-08 22:53:49 -07:00
Christian Weiske	95d29a6a53	fix: Mention GetBucketyPolicy in S3 gateway docs policy (#12642 ) That action is needed for the gateway to obtain the policy setting for public access. Resolves: https://github.com/minio/minio/issues/12638	2021-07-08 10:34:56 -07:00
Minio Trusted	c14f965293	Update yaml files to latest version RELEASE.2021-07-08T01-15-01Z	2021-07-08 03:12:44 +00:00
Harshavardhana	2ce60d772b	fix: update README.md for new release (#12637 ) rename all 'docker run' commands to 'podman run' fixes #12633	2021-07-07 18:07:29 -07:00
Harshavardhana	3137dc2eb3	support implicit flow in web-identity.go example (#12600 ) when a client secret is not provided, automatically assume implicit flow for authentication and invoke relevant code accordingly.	2021-06-30 07:43:04 -07:00
Harshavardhana	b043e61e8e	remove deprecated warning for 'mc encrypt'	2021-06-25 08:12:40 -07:00
iternity-dotcom	d40268d899	docs: add limits for bucket and object name length (#12564 )	2021-06-23 12:51:31 -07:00
Harshavardhana	cdeccb5510	feat: Deprecate embedded browser and import console (#12460 ) This feature also changes the default port where the browser is running, now the port has moved to 9001 and it can be configured with ``` --console-address ":9001" ```	2021-06-17 20:27:04 -07:00
Harshavardhana	e4fbc6a9ff	update to RELEASE.2021-06-17T00-10-46Z	2021-06-16 17:50:32 -07:00
Klaus Post	0d1d26a4ea	Simplify s3zip example (#12500 ) There is no need to create a custom transport wrapper. Just set the header in the options.	2021-06-14 11:04:14 -07:00
Harshavardhana	264ee97219	update to RELEASE.2021-06-14T01-29-23Z release	2021-06-13 20:58:56 -07:00
Poorna Krishnamoorthy	92e4c8be10	Update replication docs to fix mc reference (#12490 ) Signed-off-by: Poorna Krishnamoorthy <poorna@minio.io>	2021-06-13 11:37:22 -07:00
Poorna Krishnamoorthy	f2a3872301	Update design.md for replication (#12486 ) Fixes #12483	2021-06-10 16:05:39 -07:00
Anis Elleuch	ba5fb2365c	feat: support of ZIP list/get/head as S3 extension (#12267 ) When enabled, it is possible to list/get files inside a zip file without uncompressing it. Signed-off-by: Anis Elleuch <anis@min.io>	2021-06-10 08:17:03 -07:00
Minio Trusted	22c58be421	Update yaml files to latest version RELEASE.2021-06-09T18-51-39Z	2021-06-09 19:21:21 +00:00
iternity-dotcom	dd5e9493f1	docs: add missing admin actions (#12442 )	2021-06-09 10:37:20 -07:00
Nitish Tiwari	32017454ee	fix typo in Grafana dashboard json (#12471 )	2021-06-09 08:04:12 -07:00
Minio Trusted	1bf80a6eea	Update yaml files to latest version RELEASE.2021-06-07T21-40-51Z	2021-06-07 22:13:41 +00:00
Nitish Tiwari	00c5d7e1b3	Add healing related metrics in official dashboard (#12456 )	2021-06-07 12:46:54 -07:00

... 5 6 7 8 9 ...

1636 Commits