ac7a7cec20
bucket-policy: Delete policy should remove policy properly. ( #1456 )
2016-05-02 16:58:10 -07:00
afd59c45dc
xl/fs: Move few functions into common code. ( #1453 )
...
- PutObject()
- PutObjectPart()
- NewMultipartUpload()
- AbortMultipartUpload()
Implementations across both FS and XL object layer
share common implementation.
2016-05-02 16:57:31 -07:00
3bf3d18f1f
rpc/client: Implement RenameFile properly. ( #1443 )
2016-05-02 03:12:18 -07:00
8102a4712a
xl/metadata: Keep the json erasure tag consistent. ( #1447 )
...
Currently the on-disk json has "Erasure" we should
keep it consistent name and move to lower case instead.
2016-05-02 01:13:07 -07:00
2393a3a0be
XL non-recursive fix ( #1450 )
2016-05-01 23:16:44 -07:00
d006129fb5
xl/vol: Add healing and quorum support for StatVol, MakeVol.
...
Fixes #1437
2016-05-01 18:42:00 -07:00
7caa82f32f
xl/fs: Rename minioMetaVolume to minioMetaBucket. ( #1442 )
2016-05-01 18:13:10 -07:00
286de4de2c
XL - fixes mostly related to multipart listing. ( #1441 )
...
* XL/Multipart: Use json.NewDecoder to decode read stream.
* XL/Multipart: fix recursive and non-recursive listing.
* XL/Multipart: Create object part with md5sum later using RenameFile.
* XL/Multipart: ListObjectParts should list parts in order.
previously: uploadID.10.md5sum < uploadID.2.md5sum
fix : uploadID.00010.md5sum > uploadID.00002.md5sum
* XL/Multipart: Keep the size of each part in the multipart metadata file to avoid stats on the parts.
* XL/Multipart: fix listing bug which was showing size of the multipart uploaded objects as 0.
2016-05-01 17:52:16 -07:00
ba7a55c321
xl: ReedSolomon code fix small file erasure bug. ( #1431 )
...
For files less than 'dataBlocks', erasure encoding would fail
with short data due to a bug in the implementation itself.
Relax the error return, even a single byte can be properly
erasure coded without issues.
Fixes #1413
2016-05-01 15:30:40 -07:00
e05aa762a9
fs: Create object part with md5sum later using RenameFile. ( #1440 )
...
Fixes #1340 .
2016-05-01 14:50:30 -07:00
0c27d8e5b1
XL/Multipart: maintain the parts info in multipart.json after complete-multipart-upload. ( #1436 )
2016-05-01 01:25:48 -07:00
443ec37765
xl: Add disk usages properly for ListVols() and StatVol(). ( #1435 )
2016-04-30 23:34:43 -07:00
d5df8b8b8d
xl: remove unused err return in listFileVersions() ( #1434 )
2016-04-30 03:21:54 -07:00
ac2933c799
windows: Enable erasure test for windows. ( #1432 )
...
Fixes #1363
2016-04-30 02:52:23 -07:00
84afec9ae0
xl: fix DeleteFile() removing meta data files without updating it ( #1433 )
...
Fixes #1428 #1427
2016-04-30 02:52:15 -07:00
27c50a70cc
obj: support object names with curly braces. ( #1429 )
...
Example files like
```
/usr/share/mozilla/extensions/{ec8030f7-c20a-464f-9b0e-13a3a9e97384}/ubufox@ubuntu.com.xpi
Song's Son.ogg
```
Should be supported.
2016-04-29 20:19:08 -07:00
a978975eea
xl: add quorum support for DeleteFile() ( #1426 )
...
Fixes #1396
2016-04-29 18:43:18 -07:00
dc45ea3946
log: Fix file logging, enable it properly. ( #1424 )
...
Fixes #1419
2016-04-29 17:54:02 -07:00
9eb56f0676
xl/healFile: Handle errors and continue ( #1425 )
...
Fixes #1354
2016-04-29 17:52:49 -07:00
10a010c1ad
xl/fs: Object layer - keep common functions into single place. ( #1423 )
2016-04-29 17:52:17 -07:00
a9935f886c
vendor: update reedsolomon package with new perm improvements. ( #1422 )
2016-04-29 14:59:03 -07:00
4e34e03dd4
xl/fs: Split object layer into interface. ( #1415 )
2016-04-29 14:24:10 -07:00
4d1b3d5e9a
docs: FreeBSD minio source intructions ( #1421 )
...
* Modifications of documentation for using and building minio server on FreeBSD.
- update example of enabling compression to use lz4 vs gzip and provide
explanation of benefits of lz4
- provide walkthrough of building minio server on FreeBSD with binary
golang and gmake
* Fixing markdown syntax for code blocks so we render correctly.
* typo fix
* reword compression enablement docs for easier reading
2016-04-29 13:35:20 -07:00
7066ce5160
XL/Multipart: rename the parts instead of concatenating. ( #1416 )
2016-04-29 12:17:48 -07:00
39df425b2a
lock: bug fixes. ( #1420 )
...
* release Lock on map before trying to Lock NS
* delete NS lock from map if no more refs.
* refactor to avoid repetition of code.
2016-04-29 11:39:20 -07:00
984903cce1
server: Add global namespace lock. ( #1398 )
...
Fixes #1393
2016-04-29 01:29:09 -07:00
8deddb82f4
Cleanup: Moving IsValidLocationContraint to handler utils
2016-04-28 20:01:11 -07:00
a1a667ae5d
xl: Change fileMetadata to xlMetadata. ( #1404 )
...
Finalized backend format
```
{
"version": "1.0.0",
"stat": {
"size": 24256,
"modTime": "2016-04-28T00:11:37.843Z"
},
"erasure": {
"data": 5,
"parity": 5,
"blockSize": 4194304
],
"minio": {
"release": "RELEASE.2016-04-28T00-09-47Z"
}
}
```
2016-04-28 19:27:02 -07:00
41b35cff7b
xl: Fixes a bug in read quorum ListFiles() ( #1412 )
...
Fixes a bug in #1406
2016-04-28 17:32:46 -07:00
eed756777b
object: Allow '[' and ']' as part of object names.
2016-04-28 13:29:32 -07:00
2ac10209cc
xl: ListFiles - return sorted files. ( #1408 )
...
Fixes #1407
2016-04-28 01:48:57 -07:00
5bd6b0b510
xl: check read quorum for ListFiles() ( #1406 )
...
Fixes #1364
2016-04-27 21:09:26 -07:00
1813e9c070
Cleanup - Comments and readability fixes ( #1386 )
2016-04-27 19:28:13 -07:00
f87a19a15c
Minor changes to CONTIRBUTING.md instructions ( #1403 )
2016-04-27 16:57:16 -07:00
5fffd558d0
xl/heal: Make healFile non-blocking for StatFile and ReadFile. ( #1399 )
...
Fixes #1355
2016-04-27 15:10:19 -07:00
b51bef85e6
objectapi: ListMultipart now lists more than 1000 entries in non-recursive. ( #1397 )
...
Having keyMarker with "/" is a valid marker.
Fixes #1394
2016-04-27 13:19:48 -07:00
d0e5470050
ListMultipart fixes ( #1392 )
...
* ListMultipart: listLeafEntries() - return earlier if a directory is found.
* ListMultipart: do listLeafEntries() only for directories.
2016-04-27 00:15:40 -07:00
90987df9b4
objectapi: Simplify ListMultipart combine recursive and non-recursive. ( #1390 )
...
Fixes #1365
2016-04-26 17:57:16 -07:00
ad1abc4486
xl-v1/Cleanup: use listOnlineDisks instead of getReadableDisks. ( #1389 )
...
Remove usage of getFileVersionQuorumMap, instead use listFileVersions
to get the version list and extract higherVersion.
Fixes #1379
Fixes #1378
Fixes #1377
2016-04-26 13:03:37 -07:00
4333e529e6
xl/ListFiles: return as many objects as requested. ( #1383 )
...
* xl/ListFiles: return as many objects as requested and take care of eof (#1361 )
* xl/ListFiles: fix review comments.
* xl/ListFiles: Add windows filepath translation.
* xl/ListFiles: Use slashSeparator instead of "/". Remove filepath.FromSlash() as golang-windows takes care of it automatically.
2016-04-26 10:35:39 -07:00
9685f88b84
Added FreeBSD installation steps with ZFS. ( #1388 )
2016-04-26 10:17:02 -07:00
5f80edf232
routers: Fix a crash while initializing network fs. ( #1382 )
...
Crash happens when 'minio server filename' a file name is
provided instead of a directory on command line argument.
```
panic: runtime error: slice bounds out of range
goroutine 1 [running]:
panic(0x5eb460, 0xc82000e0b0)
/usr/local/opt/go/libexec/src/runtime/panic.go:464 +0x3e6
main.splitNetPath(0x7fff5fbff9bd, 0x7, 0x0, 0x0, 0x0, 0x0)
/Users/harsha/mygo/src/github.com/minio/minio/network-fs.go:49 +0xb7
main.newNetworkFS(0x7fff5fbff9bd, 0x7, 0x0, 0x0, 0x0, 0x0)
/Users/harsha/mygo/src/github.com/minio/minio/network-fs.go:90 +0x20a
main.configureServerHandler(0xc82024e1c8, 0x5, 0xc8200640e0, 0x1, 0x1, 0x0, 0x0)
/Users/harsha/mygo/src/github.com/minio/minio/routers.go:43 +0x6ce
main.configureServer(0xc82024e1c8, 0x5, 0xc8200640e0, 0x1, 0x1, 0x5)
/Users/harsha/mygo/src/github.com/minio/minio/server-main.go:86 +0x67
```
2016-04-25 18:10:40 -07:00
42254b5c4d
xl: Rename blockingWriteCloser to waitCloser. ( #1376 )
2016-04-25 16:00:58 -07:00
00c697393a
Merge pull request #1381 from minio/xl-layer
...
Implement XL layer
2016-04-25 15:59:30 -07:00
55032ffdf9
xl: Simplify blockingWriter and its usage. ( #1373 )
...
This removes odd races since we don't need to
track errors and avoids locking. All we need
is a Wait() and Done() waitgroup.
2016-04-25 12:47:31 -07:00
8bce699dae
xl: Add logging. ( #1372 )
2016-04-25 12:47:31 -07:00
57f35c2bcc
xl: Introduce new blocking writer to make CreateFile atomic. ( #1362 )
...
Creates a new write closer that must be released
by the read consumer. This is necessary so that
while commiting the underlying writers in erasure
coding we need to make sure we reply success only if
we have committed to disk.
This in turn also fixes plethora of bugs related to
subsequent PutObject() races with namespace locking.
This patch also enables most of the tests, other than
ListObjects paging which has some issues still.
Fixes #1358 , #1360
2016-04-25 12:47:31 -07:00
cab6805f09
xl: Enable a subset of tests for XL branch. ( #1359 )
2016-04-25 12:47:31 -07:00
8c85815106
xl: refactor functions to xl-v1-common.go xl-v1-utils.go. ( #1357 )
2016-04-25 12:47:31 -07:00
becc814531
Xl layer selfheal quorum2
...
* xl/selfheal: selfheal based on read quorum on GET
* xl: getReadableDisks() also returns whether self-heal is needed so that this info can be used by ReadFile/SelfHeal/StatFile.
* xl: trigger selfheal from StatFile.
2016-04-25 12:47:31 -07:00
Harshavardhana
karthic rao
Krishna Srinivas
Bala FA
nomadlogic
Scott McClellan
koolhead17