623e0f9243
XL: listOnlineDisks should use modTime instead of version. ( #2166 )
...
This change is needed to make reading from objects future proof
in-terms of handling online disks. Our current counter is not
based on affirmative knowledge and relies on arithmetic sequence
which can lead to bugs.
Using modTime simplifies the understanding of `xl.json` and future
tooling / debugging of the format.
2016-07-12 15:20:31 -07:00
e5cd35aad0
XL: GetObjectInfo() store and retrieve user-defined object metadata. ( #2189 )
2016-07-12 12:45:17 -07:00
5cd629adca
XL/fs: DeleteVol should not return error cleaning multipart dir for errVolumeNotFound ( #2188 )
2016-07-12 10:07:32 -07:00
0fddf3fe17
Avoid creating tmp directories under .minio/tmp/ to facilitate cleaning ( #2187 )
2016-07-12 09:38:45 -07:00
ac6ff67546
Tool for running benchmark comparison of 2 commits ( #2161 )
2016-07-12 02:08:38 -07:00
126865e8df
XL/bucket: Remove bucket should cleanup incomplete uploads as well. ( #2173 )
...
This behavior is in accordance with S3.
Fixes #2170
2016-07-12 01:01:47 -07:00
1c82b81408
Rename parts/objects only on onlineDisks ( #2185 )
2016-07-11 22:53:54 -07:00
749a94f6c9
tests: Add tests for signature-jwt code ( #2169 )
...
Fixes #1989
2016-07-11 21:57:40 -07:00
e9647b5f12
API/CopyObject: Refactor the code and handle if-modified-since as well. ( #2183 )
...
This completes the S3 spec behavior for CopyObject API as reported
by `s3verify`.
2016-07-11 19:24:34 -07:00
bef72f26db
xl: Make locking more granular for PutObjectPart requests ( #2168 )
2016-07-11 17:24:49 -07:00
ede4dd0f9c
server: update command should check for 3s from 1ms. ( #2175 )
...
Programmer error :-)
2016-07-11 16:22:10 -07:00
bfc59b7d50
tests: improve unit tests for xl-v1-metadata. ( #2172 )
...
Fixes #2124
2016-07-11 11:42:01 -07:00
a162198623
implemented systemd script ( #2167 )
2016-07-11 03:55:40 -07:00
de468f92ec
posix: ReadAll should handle the case when parent is not a dir. ( #2163 )
...
It can happen so that a read request can come for a file which
already has a parent i.e a file.
This fix handles this scenario - fixes #2047
2016-07-11 00:15:37 -07:00
d676e660c9
API/CopyObject: If-None-Match should return Precondition failed. ( #2164 )
2016-07-10 17:32:59 -07:00
aa7079fc7b
XL/GetObject: If quorum not available during GetObject appropriate error should be returned. ( #2135 )
2016-07-10 17:12:22 -07:00
bdff0848ed
server: Implement --ignore-disks for ignoring disks from healing. ( #2158 )
...
By default server heals/creates missing directories and re-populates
`format.json`, in some scenarios when disk is down for maintainenance
it would be beneficial for users to ignore such disks rather than
mistakenly using `root` partition.
Fixes #2128
2016-07-10 14:38:15 -07:00
0793237d94
tests: Move signature calculation in separate function. ( #2160 )
...
Previously newTestRequest() creates request object and returns
signature v4 signed request. In TestCopyObject(), its required to add
headers later to the request and sign the request.
This patch introduces two new functions
* signRequest(): signs request using given access/secret keys.
* newTestSignedRequest(): returns new request object signed with given
access/secret keys.
Fixes #2097
2016-07-10 11:10:59 -07:00
2a95eabb8a
benchmarks: add parallel benchmarks for PutObject/GetObject. ( #2159 )
...
Fixes #2092
2016-07-10 11:08:45 -07:00
bc8720406d
Added specific error for InvalidObjectName ( #2157 )
2016-07-09 17:11:08 -07:00
ae80f8ca35
ObjectLayer/GetObject: Should return the right error value. Fix done in FS and XL. ( #2133 )
...
fixes #2117
2016-07-09 13:01:32 -07:00
5102a5877e
API/handler: CopyObject make it behave in accordance with S3 spec. ( #2155 )
...
Fixes bugs found while running s3verify tool - fixes #2152
2016-07-09 12:13:40 -07:00
3341fe9b28
organizing the benchmarks in the right test files ( #2154 )
2016-07-09 00:45:49 -07:00
c0c8a8430e
XL/PutObject: Add single putObject and multipart caching. ( #2115 )
...
- Additionally adds test cases as well for object cache.
- Adds auto-expiry with expiration and cleanup time interval.
Fixes #2080
Fixes #2091
2016-07-08 20:34:27 -07:00
b0c180b77c
Test for ObjectLayer.GetObject() ( #2153 )
2016-07-08 18:26:04 -07:00
778b870b77
placing the http range error in objct-api-errors. ( #2150 )
2016-07-08 17:22:55 -07:00
cb415ef12e
Merge pull request #2149 from harshavardhana/hash-order
...
XL/metadata: use new hashOrder algorithm for newXLMeta. (#2147 )
2016-07-08 15:57:16 -07:00
6266328a85
XL/metadata: use new hashOrder algorithm for newXLMeta. ( #2147 )
2016-07-08 15:39:21 -07:00
63b3f1dcfd
Use new algorithm to get fixed random order of disks ( #2147 )
2016-07-08 15:38:47 -07:00
5ff1203fc0
Add PutObjectPart benchmark ( #2145 )
2016-07-08 14:28:06 -07:00
c3ab8bbd51
Turning off OSX builds for now.
2016-07-08 11:22:25 -07:00
a4a55bf134
tests: Fix erasure-readfile test formatting.
2016-07-08 11:05:30 -07:00
ec35330ebb
XL/fs: GetObject should validate all its inputs. ( #2142 )
...
Fixes #2141
Fixes #2139
2016-07-08 07:46:49 -07:00
ca1b1921c4
XL: Implement ignore errors. ( #2136 )
...
Each metadata ops have a list of errors which can be
ignored, this is essentially needed when
- disks are not found
- disks are found but cannot be accessed (permission denied)
- disks are there but fresh disks were added
This is needed since we don't have healing code in place where
it would have healed the fresh disks added.
Fixes #2072
2016-07-07 22:10:27 -07:00
4c21d6d09d
tests: Remove racey failedDisks behavior in RenameObject tests. ( #2138 )
...
Additionally also initialize namespace lock only once per test
run, there is no reason to initialize it multiple times to avoid
races.
Fixes #2137
2016-07-07 19:50:44 -07:00
5ec7734d88
FS: Check offset is within object size in GetObject() ( #2123 )
...
Fixes #2118
2016-07-07 19:49:45 -07:00
2c837128ef
Object layer tests revamp for individual execution ( #2134 )
2016-07-07 15:05:51 -07:00
282044d454
http: handle possible range requests properly. ( #2122 )
...
Previously range string is not validated against various combination
of values. This patch fixes the issue.
Fixes #2098
2016-07-07 15:05:18 -07:00
8e53064bb4
XL/format: Initialize missing meta volume. ( #2131 )
...
Fixes #2127
2016-07-07 15:01:54 -07:00
f55093cdd6
multipart: During multipart list the listing go-routine should be saved to the List-pool. ( #2130 )
2016-07-07 09:06:35 -07:00
ddf3245677
xl/fs: offset and length cannot be negative. ( #2121 )
...
Fixes #2119
2016-07-07 01:30:34 -07:00
169c72cdab
vendor: Bring new updates from blake2b-simd repo. ( #2094 )
...
This vendorization is needed to bring in new improvements
and support for AVX2 and SSE.
Fixes #2081
2016-07-06 18:24:31 -07:00
8c767218a4
URL Encode X-Amz-Copy-Source as per the spec ( #2114 )
...
The documents for COPY state that the X-Amz-Copy-Source must be URL encoded.
http://docs.aws.amazon.com/AmazonS3/latest/API/RESTObjectCOPY.html
2016-07-06 15:42:17 -07:00
a51bb1d728
http: handle request range like Amazon S3. ( #2112 )
...
Fixes #2098
2016-07-06 12:50:24 -07:00
26b7d79a85
XL/ObjectCache: DeleteObject() should delete the object from the object cache. ( #2113 )
...
fixes #2103
2016-07-06 10:25:42 -07:00
01cbacd803
object-cache: use golang bytes.Buffer and bytes.NewReader instead of custom implementation. ( #2108 )
2016-07-06 01:29:49 -07:00
7bde27032d
signv4: Validate preSigned payload properly. ( #2106 )
...
We need to only validate presigned payload only
if the payload is requested for, with default payload
i.e 'UNSIGNED-PAYLOAD' we don't need to validate.
Fixes #2105
2016-07-05 21:00:20 -07:00
44ae7a037b
fix: allocate buffer to required size than readSizeV1 ( #2095 )
...
Refer #2077
2016-07-05 20:59:54 -07:00
a35341448f
XL: Cache: Purging partially cached content upon erasureReadFile failure ( #2104 )
2016-07-05 12:48:54 -07:00
d6dfcd0ba7
unit-tests: Unit tests for functions in erasure-readfile.go ( #2090 )
2016-07-05 11:41:25 -07:00
Harshavardhana
utsl42
Anis Elleuch
karthic rao
Krishnan Parthasarathi
Bala FA
Remco Verhoef
Krishna Srinivas
frankw
Nick Craig-Wood