b69a97aed4
server: Set rLimit properly to the max. ( #1676 )
...
4000 is too small to handle 500 go-routines.
Fixes #1666
2016-05-18 11:34:24 -07:00
2da34e4668
vendor changes to pkg/profile ( #1671 )
2016-05-18 09:22:06 -07:00
4bc923e63b
XL/fs: Optimize calling isBucketExist() ( #1656 )
...
* posix: Avoid using getAllVolumeInfo() in getVolumeDir()
This is necessary compromise to avoid significant slowness this
causes under load. The compromise is also substantial in a way
so that to avoid penalizing common cases v/s special cases.
For buckets with Caps on Unixes, we filter buckets based on the
latest anyways, so this is completely acceptable.
* XL/fs: Change the usage of verification of existance of buckets.
Optimize calling isBucketExists, it is not needed for all call
paths. isBucketExist should be called only for calls which use
temporary volume location for operations, for the rest rely on
the errors returned on their original call path.
Remove usage of filtering as well across all volume names.
2016-05-17 21:22:27 -07:00
4214da65af
XL/fs: MakeVol replies should be consistent. ( #1667 )
...
Fixes #1658
Fixes #1633
2016-05-17 18:41:17 -07:00
596fe65e84
Write pprof output files under config dir supplied ( #1660 )
...
Since config dir, supplied as command line argument, is parsed after pprof
output directory is determined, pprof output files are written in ~/.minio/profile
directory instead of <configDir>/profile/. This change fixes this behaviour.
2016-05-17 11:44:40 -07:00
39865c0d2e
XL/Multipart: Fix list multipart output. ( #1661 )
...
Fixes #1541
2016-05-17 11:44:32 -07:00
1760687c83
XL: Make sure to create proper temporary files for renames to succeed. ( #1654 )
...
Renames work in a special manner, temporary location files should
be created properly.
Fixes #1653
Fixes #1651
2016-05-16 15:40:57 -07:00
9472299308
logging: Log only for unhandled errors, remove all the debug logging. ( #1652 )
...
This patch brings in the removal of debug logging altogether, instead
we bring in the functionality of being able to trace the errors properly
pointing back to the origination of the problem.
To enable tracing you need to enable "MINIO_TRACE" set to "1" or "true"
environment variable which would print back traces whenever there is an
error which is unhandled or at the handler layer.
By default this tracing is turned off and only user level logging is
provided.
2016-05-16 14:31:28 -07:00
8828fd1e5c
vendor: Remove unused packages.
2016-05-15 00:04:56 -07:00
7de206cb85
XL: ListVols should provide consistent view. ( #1648 )
...
Additionally get list of all volumes in parallel for aggregation
and quorum verification.
Fixes #1647
2016-05-14 23:57:57 -07:00
498ce1e9bb
handler: Add a waitgroup to avoid expect100Continue crash. ( #1623 )
...
This waitgroup allows for safe blocking operation where we can cleanly
control the flow of the writes and the underlying pipe altogether.
Fixes #1553
2016-05-14 17:18:00 -07:00
5b29cefd40
api: DeleteObject should always return 204. ( #1645 )
...
Fixes #1643
2016-05-14 15:47:19 -07:00
e03ebfd13b
Add default cmd ( #1625 )
2016-05-14 02:58:50 -07:00
74c23a3544
docs: Move developer docs from top-level to its own directory. ( #1642 )
2016-05-14 02:47:16 -07:00
025054fb36
XL: CreateFile/ReadFile should write and read from all disks in parallel. ( #1612 )
...
* XL: CreateFile should write to all disks in parallel.
* XL: ReadFile should read from all disks in parallel.
2016-05-14 01:57:04 -07:00
7264cd2ab3
Fix error message when wrong set of disks are passed ( #1634 )
...
Previously when wrong set of disks are given with last minio server
run, it throws unclear error message. This is fixed by returning
appropriate errors.
Fixes #1591
2016-05-13 23:04:10 -07:00
0e4e9c4bc1
XL: ListDir should return each List from a random disk in the set. ( #1613 )
...
Fixes #1609
2016-05-13 18:12:26 -07:00
8099396ff0
xl/putObject: Should take care of the situation if an object already exists at the location. ( #1606 )
...
Fixes #1598 #1594 #1595
2016-05-13 11:52:36 -07:00
d267696110
Validation: Reject object names with trailing "/". ( #1619 )
...
Fixes #1616
2016-05-13 11:43:06 -07:00
43539a0c86
posix: parseDirents() should follow symlink and get values. ( #1631 )
...
Previously parseDirents() ignores symbolic links. This patch fixes
the issue by following the symlink using os.Stat().
Fixes #1545
2016-05-13 11:39:48 -07:00
9e45d138cc
Closed readCloser for each multipart in xl.GetObject ( #1629 )
...
* Closed readCloser for each multipart in xl.GetObject
2016-05-13 04:50:13 -07:00
ee8605e333
Make bucket failure fix with high concurrent load ( #1630 )
2016-05-13 04:03:38 -07:00
e4958f9757
Removing regexp check and adding string based check, regexp check was unnecessary here ( #1627 )
2016-05-13 03:33:53 -07:00
b62774d32f
storage/xl: Return errVolumeAccessDenied if disks cannot be accessed. ( #1621 )
...
Fixes #1614
2016-05-12 21:01:11 -07:00
d6e0f3ab33
added awscli commands & minor typo fix. ( #1578 )
2016-05-12 16:35:11 -07:00
3ff0a56e62
XL: Ignore errDiskNotFound in certain situations ( #1610 )
...
When a disk is removed while an operation is going on
(eg. single/multipart put object, list/multipart list objects etc),
its required to ignore errDiskNotFound error and continue the
operation.
Fixes #1552
2016-05-11 23:42:14 -07:00
50431e91a6
erasure: Handle failed disks so that we initialize properly if they are missing. ( #1607 )
...
Fixes #1592
Fixes #1579
2016-05-11 18:58:32 -07:00
d4745c7d6a
object: PutObjectHandler should set the md5Sum properly. ( #1604 )
...
Additionally add a test case as well for validating for us
to reply BadDigest properly.
Fixes #1603
2016-05-11 16:13:37 -07:00
adbcafefad
xl/CreateFile: handle errFileNameTooLong error properly ( #1523 )
...
When errFileNameTooLong error is returned from posix, xl.CreateFile()
treats the error specially by returning the same error immediately.
Fixes #1501
2016-05-11 12:55:02 -07:00
86e5d71519
erasure: MakeVol, DeleteVol and StatVol should hold locks. ( #1597 )
...
Since there is a good amount of overlap, each code has to lock
properly for the operation they are going to perform.
- MakeVol create vols in a routine on all disks, hold locks.
- DeleteVol delete vols in a routine on all disks, hold locks.
- StatVol stat vols in a routine on all disks, hold locks.
Fixes #1588
2016-05-11 12:54:21 -07:00
72748d2073
erasure: healVolume err should be different from shadowed version. ( #1590 )
...
Multiple go-routines updating the same shadowed variable can
cause a data race, avoid it by using its own err variable.
Fixes #1589
2016-05-11 01:36:09 -07:00
49141eb3e4
http: Remove minhttp package and use standard Golang http. ( #1587 )
...
The functionality provided by minhttp will be implemented
cleanly through our own APIs. Since we are not going to
send SIGUSR2 and manage configuration in that manner, it
doesn't make sense to use minhttp.
Fixes #1586
2016-05-10 18:03:00 -07:00
d1fa1d9352
Remove binary files from previous commit.
2016-05-10 15:49:17 -07:00
26e2c4bf4d
Replacing fastsha256 with crypto/sha256 package from golang standard package ( #1584 )
2016-05-10 14:20:11 -07:00
b044336329
XL/GetObject: If the offset does not fall in the first "dataBlock" it gives incorrect data. ( #1583 )
...
Fixes #1582
2016-05-10 11:38:49 -07:00
e99cb05516
XL/GetObject: offset should be reset to 0 after reading first part. ( #1580 ) ( #1581 )
2016-05-10 10:38:12 -07:00
409e09c1e5
XL/Selfheal: skip reading from disk if ReadFile had returned error. ( #1575 )
2016-05-10 01:24:58 -07:00
c314a98c1a
XL/list: fix panic on list when a disk is down. ( #1562 )
2016-05-10 00:35:29 -07:00
5f0ca64346
erasure: listOnlineDisks should return errFileNotFound for errReadQuorum. ( #1573 )
...
Fixes #1571
2016-05-10 00:10:34 -07:00
0db3218d5d
xl: getPartsMetadata fetch parts and decode in go-routine. ( #1569 )
...
Ref #1516
2016-05-09 23:51:05 -07:00
eec41c369c
posix: Return diskNotFound error rather than errVolumeNotFound ( #1568 )
...
Fixes #1559
2016-05-09 18:57:39 -07:00
b66c3bf35e
server: Enable server profiling as needed. ( #1565 )
2016-05-09 16:18:56 -07:00
f733120d3d
xl: CompleteMultipartUpload make sure to delete uploads.json ( #1539 )
...
Fixes #1537
Ref #1540 - for missing functionality in this patch.
2016-05-09 12:09:48 -07:00
6627388dc3
posix: remove dead code related to posix reserved suffixes. ( #1555 )
2016-05-09 11:40:30 -07:00
9d41414fb5
posix: reserved files should be filtered out at posix not object layer. ( #1554 )
2016-05-09 02:53:08 -07:00
722abe2d0f
xl/fs: pathJoin now takes variadic inputs. ( #1550 )
...
Retains slash for the last element.
Fixes #1546
2016-05-09 00:46:54 -07:00
04a5b25929
Multipart: Minimum part size limit does not apply to the last part during CompleteMultipartUpload. ( #1518 ) ( #1538 )
2016-05-08 23:49:49 -07:00
90ea494338
erasure: waitCloser should implement CloseWithError. ( #1543 )
...
This is needed so that the other end of the pipe receives
and error, cleanups temporary files.
2016-05-08 16:26:10 -07:00
a8fdd04e62
erasure: ReadFile should honor proper offsets. ( #1542 )
...
Fixes #1535
2016-05-08 15:39:24 -07:00
76c511c9fe
api: Extend S3 errors with Minio errors. ( #1533 )
...
Fixes #1530
2016-05-08 12:36:16 -07:00
Harshavardhana
karthic rao
Krishnan Parthasarathi
Krishna Srinivas
Harshavardhana
Hori Ryota
Bala FA
koolhead17