1
0
mirror of https://github.com/minio/minio.git synced 2025-01-29 15:35:58 -05:00
Commit Graph

7591 Commits

Author SHA1 Message Date
Harshavardhana
ceff7bcca5 fix: ruleguard gopath link RELEASE.2020-08-25T00-21-20Z 2020-08-24 16:25:00 -07:00
Daniel Valdivia
7d1734d033
indicate through HTTP header cluster healing in progress () 2020-08-24 15:20:50 -07:00
Harshavardhana
03ec6adfd0
fix: KES http2.0 communication support () 2020-08-24 14:37:53 -07:00
Harshavardhana
309b10f201 keep crawler cycle at 5 minutes 2020-08-24 14:05:16 -07:00
飞雪无情
2a8e40f19f
add chroot zh_CN document () 2020-08-24 13:58:19 -07:00
KevinSmile
5f7bd2b1da
fix: lifecycle-expiration validation bug () 2020-08-24 13:56:50 -07:00
Klaus Post
c097ce9c32
continous healing based on crawler ()
Design: https://gist.github.com/klauspost/792fe25c315caf1dd15c8e79df124914
2020-08-24 13:47:01 -07:00
Harshavardhana
caad314faa
add ruleguard support, fix all the reported issues () 2020-08-24 12:11:20 -07:00
Klaus Post
bc2ebe0021
Only enforce quota on success ()
We should only enforce quotas if no error has been returned.

firstErr is safe to access since all goroutines have exited at this point.

If `firstErr` hasn't been set by something else return the context error if cancelled.
2020-08-24 10:15:46 -07:00
飞雪无情
21e8440423
add compression zh_CN document () 2020-08-23 22:07:36 -07:00
Harshavardhana
11aa393ba7
Allow region errors to be dynamic ()
remove other FIXMEs as we are not planning to fix these, 
instead we will add dynamism case by case basis.

fixes 
2020-08-23 22:06:22 -07:00
Praveen raj Mani
d0c910a6f3
Support https and basic-auth for elasticsearch notification target () 2020-08-23 09:43:48 -07:00
Harshavardhana
81c90ae430
move to gorilla mux 1.8.0 () 2020-08-22 23:14:02 -07:00
kannappanr
d15a5ad4cc
S3 Gateway: Check for encryption headers properly () 2020-08-22 11:41:49 -07:00
飞雪无情
0ff246653b
CN bucket policy document that is no longer needed can be removed, ()
which is consistent with the English document.
2020-08-22 11:05:21 -07:00
飞雪无情
113bcbdb78
update minio limit zh_CN document () 2020-08-22 11:04:31 -07:00
Harshavardhana
95411228db
add missing cleanupStaleMultipartUploads ()
fixes 
2020-08-21 21:39:54 -07:00
ebozduman
23774353b7
get_object() returns NoSuchKey error when object is a prefix () 2020-08-21 13:08:01 -07:00
Tobias Nygren
052b5262ff
use statvfs(2) for disk.GetInfo on NetBSD () 2020-08-20 20:13:06 -07:00
poornas
a2a5ec93d3
fix: use global context for filling cache in the background () 2020-08-20 14:23:24 -07:00
飞雪无情
331c517a5b
translate bucket versioning design document to zh_CN () 2020-08-20 13:18:51 -07:00
Harshavardhana
27a774cbe9
fix: FS mode should reject putBucketVersioning () 2020-08-20 13:18:06 -07:00
Klaus Post
8e6787a302
Fix TestDataUpdateTracker hanging ()
Keep dataUpdateTracker while goroutine is starting.

This will ensure the object is updated one `start` returns

Tested with

```
λ go test -cpu=1,2,4,8 -test.run TestDataUpdateTracker -count=1000
PASS
ok      github.com/minio/minio/cmd      8.913s
```

Fixes 
2020-08-20 13:17:42 -07:00
Harshavardhana
59352d0ac2
load all blocking metadata in background ()
most of this metadata already has fallbacks
and there is no good reason to load them
in blocking fashion
2020-08-20 10:38:53 -07:00
Harshavardhana
75d44b3bae
add disk for more context in bitrot errors () 2020-08-20 09:41:15 -07:00
Klaus Post
95ae6c4b49
Fix missing unlock in *healSequence.hasEnded() ()
The background healing sequence would always hang when this function is called.
2020-08-20 08:48:09 -07:00
Harshavardhana
98ca770f81
mint fixes for go1.14 ()
add go.mod to ensure that mint can be
built with go1.14.x
2020-08-19 20:07:37 -07:00
Krishnan Parthasarathi
ccd967e3be
Add ExpiresAt to LicenseInfo () 2020-08-19 19:21:04 -07:00
KevinSmile
0ebb73ee2e
use const instead of literals () 2020-08-19 16:43:52 -07:00
Harshavardhana
c8b84a0e9e
Add nancy vulnerability scanner () 2020-08-19 14:25:21 -07:00
Ritesh H Shukla
3acb5cff45
Update code comment () 2020-08-19 14:24:58 -07:00
Harshavardhana
ab801ad3d4
build edge containers with go1.14 () 2020-08-19 12:08:11 +05:30
Harshavardhana
74116204ce
handle fresh setup with mixed drives ()
fresh drive setups when one of the drive is
a root drive, we should ignore such a root
drive and not proceed to format.

This PR handles this properly by marking
the disks which are root disk and they are
taken offline.
2020-08-18 14:37:26 -07:00
飞雪无情
2eb5f934d8
add bucket versioning zh_CN document () 2020-08-18 13:10:26 -07:00
Minio Trusted
b43d376a87 Update yaml files to latest version RELEASE.2020-08-18T19-41-00Z 2020-08-18 20:04:22 +00:00
Harshavardhana
e4a44f6224
fix: commonPrefixes behavior in ListObjectVersions ()
```
$ aws s3api --profile minio --endpoint-url http://localhost:9003 \
    list-object-versions --bucket testbucket \
    --delimiter / --prefix Veeam/Archive/

{
    "CommonPrefixes": [
        {
            "Prefix": "Veeam/Archive/003/"
        }
    ]
}
```

Also add coverage tests similar to ListObjects to
catch errors in future, skip these tests in FS mode
RELEASE.2020-08-18T19-41-00Z
2020-08-18 12:19:44 -07:00
poornas
0272973175
Fix regression in web ui for retention ()
Fixes:  regression from PR 
2020-08-18 12:09:42 -07:00
Klaus Post
adca28801d
feat: disable Parquet by default (breaking change) ()
I have built a fuzz test and it crashes heavily in seconds and will OOM shortly after.
It seems like supporting Parquet is basically a completely open way to crash the 
server if you can upload a file and run s3 select on it.

Until Parquet is more hardened it is DISABLED by default since hostile 
crafted input can easily crash the server.

If you are in a controlled environment where it is safe to assume no hostile
content can be uploaded to your cluster you can safely enable Parquet.

To enable Parquet set the environment variable `MINIO_API_SELECT_PARQUET=on`
while starting the MinIO server.

Furthermore, we guard parquet by recover functions.
2020-08-18 10:23:28 -07:00
Harshavardhana
d2a3f92452
fix: health handler for lockers () 2020-08-18 07:27:41 -07:00
Harshavardhana
ede86845e5
docs: Add policy variables for resource and conditions ()
Bonus fix adds LDAP policy variable and clarifies the
usage of policy variables for temporary credentials.

fixes 
2020-08-17 17:39:55 -07:00
Harshavardhana
e57c742674
use single dynamic timeout for most locked API/heal ops ()
newDynamicTimeout should be allocated once, in-case
of temporary locks in config and IAM we should
have allocated timeout once before the `for loop`

This PR doesn't fix any issue as such, but provides
enough dynamism for the timeout as per expectation.
2020-08-17 11:29:58 -07:00
Klaus Post
bb5976d727
healbucket: Send object version ID ()
Based on our previous conversations I assume we should send the version
 id when healing an object.

Maybe we should even list object versions and heal all?
2020-08-17 08:25:44 -07:00
Minio Trusted
670724184c Update yaml files to latest version RELEASE.2020-08-16T18-39-38Z 2020-08-16 18:56:41 +00:00
Harshavardhana
f7c1a59de1
add validation logs for configured Logger/Audit HTTP targets ()
extra logs in-case of misconfiguration of audit/logger targets
RELEASE.2020-08-16T18-39-38Z
2020-08-16 10:25:00 -07:00
飞雪无情
01a2ccc52f
add bucket retention zh_CN document () 2020-08-14 22:12:03 -07:00
Anis Elleuch
51ba1dac49
listing: Fix result when prefix is an object with a slash ()
In a non recursive mode, issuing a list request where prefix
is an existing object with a slash and delimiter is a slash will
return entries in the object directory (data dir IDs)

```
$ aws s3api --profile minioadmin --endpoint-url http://localhost:9000 \
        list-objects-v2 --bucket testbucket --prefix code_of_conduct.md/ --delimiter '/'
{
    "CommonPrefixes": [
        {
            "Prefix":
"code_of_conduct.md/ec750fe0-ea7e-4b87-bbec-1e32407e5e47/"
        }
    ]
}
```

This commit adds a fast exit track in Walk() in this specific case.
2020-08-14 20:13:24 -07:00
Harshavardhana
a4463dd40f
fix: storageClass shouldn't set the value upon failure () 2020-08-14 19:48:04 -07:00
Harshavardhana
83a82d818e
allow lock tolerance to match storage-class drive tolerance () 2020-08-14 18:17:14 -07:00
Harshavardhana
1d1c4430b2
decrypt ETags in parallel around 500 at a time ()
Listing speed-up gained from 10secs for
just 400 entries to 2secs for 400 entries
2020-08-14 11:56:35 -07:00
Krishnan Parthasarathi
4e00b47b52
licverifier: fail verify if accountId is missing in license metadata () 2020-08-13 17:05:24 -07:00