MyFavMirrors/minio
1
0
Fork 0
mirror of https://github.com/minio/minio.git synced 2024-12-26 23:25:54 -05:00
Code Issues Packages Projects Releases Wiki Activity
f7feff8665
minio/mint/run/core/s3select
History
Krishnan Parthasarathi c829e3a13b Support for remote tier management (#12090) 
With this change, MinIO's ILM supports transitioning objects to a remote tier.
This change includes support for Azure Blob Storage, AWS S3 compatible object
storage incl. MinIO and Google Cloud Storage as remote tier storage backends.

Some new additions include:

 - Admin APIs remote tier configuration management

 - Simple journal to track remote objects to be 'collected'
   This is used by object API handlers which 'mutate' object versions by
   overwriting/replacing content (Put/CopyObject) or removing the version
   itself (e.g DeleteObjectVersion).

 - Rework of previous ILM transition to fit the new model
   In the new model, a storage class (a.k.a remote tier) is defined by the
   'remote' object storage type (one of s3, azure, GCS), bucket name and a
   prefix.

* Fixed bugs, review comments, and more unit-tests

- Leverage inline small object feature
- Migrate legacy objects to the latest object format before transitioning
- Fix restore to particular version if specified
- Extend SharedDataDirCount to handle transitioned and restored objects
- Restore-object should accept version-id for version-suspended bucket (#12091)
- Check if remote tier creds have sufficient permissions
- Bonus minor fixes to existing error messages

Co-authored-by: Poorna Krishnamoorthy <poorna@minio.io>
Co-authored-by: Krishna Srinivas <krishna@minio.io>
Signed-off-by: Harshavardhana <harsha@minio.io>
2021-04-23 11:58:53 -07:00
..
csv.py Support for remote tier management (#12090) 2021-04-23 11:58:53 -07:00
README.md Support configurable quote character parameter in Select (#8955) 2020-03-13 22:09:34 -07:00
run.sh Support for remote tier management (#12090) 2021-04-23 11:58:53 -07:00
sql_ops.py Support for remote tier management (#12090) 2021-04-23 11:58:53 -07:00
tests.py Support for remote tier management (#12090) 2021-04-23 11:58:53 -07:00
utils.py Support for remote tier management (#12090) 2021-04-23 11:58:53 -07:00

README.md

s3select tests

This directory serves as the location for Mint tests for s3select features. Top level mint.sh calls run.sh to execute tests.

Adding new tests

New tests are added into s3select/tests.py as new functions.

Running tests manually

  • Set environment variables MINT_DATA_DIR, MINT_MODE, SERVER_ENDPOINT, ACCESS_KEY, SECRET_KEY, SERVER_REGION and ENABLE_HTTPS
  • Call run.sh with output log file and error log file. for example
export MINT_DATA_DIR=~/my-mint-dir
export MINT_MODE=core
export SERVER_ENDPOINT="play.min.io"
export ACCESS_KEY="Q3AM3UQ867SPQQA43P2F"
export SECRET_KEY="zuf+tfteSlswRu7BJ86wekitnifILbZam1KYY3TG"
export ENABLE_HTTPS=1
export SERVER_REGION=us-east-1
./run.sh /tmp/output.log /tmp/error.log