minio/docs
Krishnan Parthasarathi c829e3a13b Support for remote tier management (#12090)
With this change, MinIO's ILM supports transitioning objects to a remote tier.
This change includes support for Azure Blob Storage, AWS S3 compatible object
storage incl. MinIO and Google Cloud Storage as remote tier storage backends.

Some new additions include:

 - Admin APIs remote tier configuration management

 - Simple journal to track remote objects to be 'collected'
   This is used by object API handlers which 'mutate' object versions by
   overwriting/replacing content (Put/CopyObject) or removing the version
   itself (e.g DeleteObjectVersion).

 - Rework of previous ILM transition to fit the new model
   In the new model, a storage class (a.k.a remote tier) is defined by the
   'remote' object storage type (one of s3, azure, GCS), bucket name and a
   prefix.

* Fixed bugs, review comments, and more unit-tests

- Leverage inline small object feature
- Migrate legacy objects to the latest object format before transitioning
- Fix restore to particular version if specified
- Extend SharedDataDirCount to handle transitioned and restored objects
- Restore-object should accept version-id for version-suspended bucket (#12091)
- Check if remote tier creds have sufficient permissions
- Bonus minor fixes to existing error messages

Co-authored-by: Poorna Krishnamoorthy <poorna@minio.io>
Co-authored-by: Krishna Srinivas <krishna@minio.io>
Signed-off-by: Harshavardhana <harsha@minio.io>
2021-04-23 11:58:53 -07:00
..
bigdata Update hadoop docs to indicate new committers (#8060) 2019-09-30 21:34:06 -07:00
bucket Support for remote tier management (#12090) 2021-04-23 11:58:53 -07:00
chroot fix: docs remove goreportcard, its deprecated 2020-03-24 14:51:06 -07:00
compression Allow Compression + encryption (#11103) 2021-01-05 20:08:35 -08:00
config rename all references from crawl -> scanner (#11621) 2021-02-26 15:11:42 -08:00
debugging Rename OBD to Health (#10842) 2020-11-20 12:52:53 -08:00
deployment/kernel-tuning fix sysctl.sh quotes which are incompatible with sysctl (#10446) 2020-09-09 17:29:23 -07:00
disk-caching feat: migrate to ROOT_USER/PASSWORD from ACCESS/SECRET_KEY (#11185) 2021-01-05 10:22:57 -08:00
distributed fix incorrect values in sizing guide (#11583) 2021-02-19 10:05:04 -08:00
docker feat: migrate to ROOT_USER/PASSWORD from ACCESS/SECRET_KEY (#11185) 2021-01-05 10:22:57 -08:00
erasure Fix STANDARD defaults, point to new docs site. (#11800) 2021-03-16 12:04:28 -07:00
federation/lookup docs: add deprecation notice for federation 2021-02-04 17:18:37 -08:00
gateway fix: allow S3 gateway passthrough for SSE-S3 header (#12020) 2021-04-08 16:40:38 -07:00
integrations/veeam docs: fix veeam document formatting 2020-07-18 18:38:12 -07:00
kms crypto: deprecate native Hashicorp Vault support (#11352) 2021-01-29 17:55:37 -08:00
logging Add support for mTLS for Audit log target (#11645) 2021-03-01 09:19:13 -08:00
metrics update prometheus metrics with failed_count 2021-04-04 09:52:37 -07:00
multi-tenancy feat: migrate to ROOT_USER/PASSWORD from ACCESS/SECRET_KEY (#11185) 2021-01-05 10:22:57 -08:00
multi-user docs: Add policy variables for resource and conditions (#10278) 2020-08-17 17:39:55 -07:00
orchestration Support for remote tier management (#12090) 2021-04-23 11:58:53 -07:00
screenshots fix: distributed docs image path 2020-05-11 09:33:55 -07:00
security cleanup security overview guide 2020-07-11 00:34:56 -07:00
select feat: disable Parquet by default (breaking change) (#9920) 2020-08-18 10:23:28 -07:00
shared-backend fix: use buffers only when necessary for io.Copy() (#11229) 2021-01-06 09:36:55 -08:00
sts Support for remote tier management (#12090) 2021-04-23 11:58:53 -07:00
throttle feat: migrate to ROOT_USER/PASSWORD from ACCESS/SECRET_KEY (#11185) 2021-01-05 10:22:57 -08:00
tls Use -new during OpenSSL certificate generation (#11199) 2021-01-11 02:24:50 -08:00
minio-limits.md Fix caddy project url (#11198) 2020-12-31 09:44:07 -08:00