1
0
mirror of https://github.com/minio/minio.git synced 2025-01-16 17:23:16 -05:00

24 Commits

Author SHA1 Message Date
coderwander
3c5f2d8916
fix some typo in struct name comments ()
Signed-off-by: coderwander <770732124@qq.com>
2024-05-14 00:26:50 -07:00
Harshavardhana
a60ac7ca17
fix: audit log to support object names in multipleObjectNames() handler () 2022-01-03 01:28:52 -08:00
Poorna Krishnamoorthy
c4373ef290
Add support for multi site replication () 2021-09-18 13:31:35 -07:00
Krishnan Parthasarathi
c829e3a13b Support for remote tier management ()
With this change, MinIO's ILM supports transitioning objects to a remote tier.
This change includes support for Azure Blob Storage, AWS S3 compatible object
storage incl. MinIO and Google Cloud Storage as remote tier storage backends.

Some new additions include:

 - Admin APIs remote tier configuration management

 - Simple journal to track remote objects to be 'collected'
   This is used by object API handlers which 'mutate' object versions by
   overwriting/replacing content (Put/CopyObject) or removing the version
   itself (e.g DeleteObjectVersion).

 - Rework of previous ILM transition to fit the new model
   In the new model, a storage class (a.k.a remote tier) is defined by the
   'remote' object storage type (one of s3, azure, GCS), bucket name and a
   prefix.

* Fixed bugs, review comments, and more unit-tests

- Leverage inline small object feature
- Migrate legacy objects to the latest object format before transitioning
- Fix restore to particular version if specified
- Extend SharedDataDirCount to handle transitioned and restored objects
- Restore-object should accept version-id for version-suspended bucket ()
- Check if remote tier creds have sufficient permissions
- Bonus minor fixes to existing error messages

Co-authored-by: Poorna Krishnamoorthy <poorna@minio.io>
Co-authored-by: Krishna Srinivas <krishna@minio.io>
Signed-off-by: Harshavardhana <harsha@minio.io>
2021-04-23 11:58:53 -07:00
Harshavardhana
069432566f update license change for MinIO
Signed-off-by: Harshavardhana <harsha@minio.io>
2021-04-23 11:58:53 -07:00
Harshavardhana
bdd094bc39
fix: avoid sending errors on missing objects on locked buckets ()
make sure multi-object delete returned errors that are AWS S3 compatible
2020-11-28 21:15:45 -08:00
Poorna Krishnamoorthy
2ff655a745
Refactor replication, ILM handling in DELETE API () 2020-11-25 11:24:50 -08:00
Harshavardhana
8f7fe0405e fix: delete marker replication should support directories ()
allow directories to be replicated as well, along with
their delete markers in replication.

Bonus fix to fix bloom filter updates for directories
to be preserved.
2020-11-19 18:47:12 -08:00
Harshavardhana
9a34fd5c4a Revert "Revert "Add delete marker replication support ()""
This reverts commit 267d7bf0a9f114065314a0b2863f7fcc9e923012.
2020-11-19 18:43:58 -08:00
Harshavardhana
267d7bf0a9 Revert "Add delete marker replication support ()"
This reverts commit 50c10a5087d52052c92625aa021d82fdb6e75d17.

PR is moved to origin/dev branch
2020-11-12 11:43:14 -08:00
Poorna Krishnamoorthy
50c10a5087
Add delete marker replication support ()
Delete marker replication is implemented for V2
configuration specified in AWS spec (though AWS
allows it only in the V1 configuration).

This PR also brings in a MinIO only extension of
replicating permanent deletes, i.e. deletes specifying
version id are replicated to target cluster.
2020-11-10 15:24:14 -08:00
kannappanr
efe9fe6124
azure: Return success when deleting non-existent object () 2020-07-10 08:30:23 -07:00
Harshavardhana
4915433bd2
Support bucket versioning ()
- Implement a new xl.json 2.0.0 format to support,
  this moves the entire marshaling logic to POSIX
  layer, top layer always consumes a common FileInfo
  construct which simplifies the metadata reads.
- Implement list object versions
- Migrate to siphash from crchash for new deployments
  for object placements.

Fixes 
2020-06-12 20:04:01 -07:00
poornas
ca96560d56 Add object retention at the per object ()
level - this PR builds on  which
added PutBucketObjectLockConfiguration and
GetBucketObjectLockConfiguration APIS

This PR implements PutObjectRetention,
GetObjectRetention API and enhances
PUT and GET API operations to display
governance metadata if permissions allow.
2019-11-20 13:18:09 -08:00
Harshavardhana
c43f745449
Ensure that we use constants everywhere ()
This allows for canonicalization of the strings
throughout our code and provides a common space
for all these constants to reside.

This list is rather non-exhaustive but captures
all the headers used in AWS S3 API operations
2019-07-02 22:34:32 -07:00
kannappanr
70b350c383
Remove DeploymentID from response headers ()
Response headers need not contain deployment ID.
2019-07-01 12:22:01 -07:00
kannappanr
5ecac91a55
Replace Minio refs in docs with MinIO and links () 2019-04-09 11:39:42 -07:00
Harshavardhana
bfb505aa8e Refactor logging in more Go idiomatic style ()
This refactor brings a change which allows
targets to be added in a cleaner way and also
audit is now moved out.

This PR also simplifies logger dependency for auditing
2018-11-19 14:47:03 -08:00
Ashish Kumar Sinha
c0b4bf0a3e SQL select query for CSV/JSON ()
select * , select column names have been implemented for CSV.
select * is implemented for JSON.
2018-10-22 12:12:22 -07:00
Harshavardhana
a0683d3c1f Send progress only when requested by client in SelectObject () 2018-09-17 11:52:46 +05:30
Arjun Mishra
7c14cdb60e S3 Select API Support for CSV ()
Add support for trivial where clause cases
2018-08-15 03:30:19 -07:00
Harshavardhana
b0cfceb211 event: Enhance event message struct to provide origin server. ()
`principalId` i.e user identity is kept as AccessKey in
accordance with S3 spec.

Additionally responseElements{} are added starting with

`x-amz-request-id` is a hexadecimal of the event time itself in nanosecs.
`x-minio-origin-server` - points to the server generating the event.

Fixes 
2017-01-10 16:43:48 -08:00
Harshavardhana
64083b9227 signature: Region changes should be handled just like AWS. ()
- PutBucket happens with 'us-east-1'.
- ListBuckets happens with any region.
- GetBucketLocation happens with 'us-east-1' and location is returned.
2016-09-29 15:51:00 -07:00
Harshavardhana
bccf549463 server: Move all the top level files into cmd folder. ()
This change brings a change which was done for the 'mc'
package to allow for clean repo and have a cleaner
github drop in experience.
2016-08-18 16:23:42 -07:00