MyFavMirrors
/
minio
mirror of https://github.com/minio/minio.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
5,806 Commits 5 Branches 503 Tags 186 MiB
Commit Graph

1246 Commits

Author SHA1 Message Date
iliul d3f9f8be88 golint: fix redundant code logic (#7842) 
Signed-off-by: Lei Liu <liul.stone@gmail.com>
 2019-06-27 15:18:33 +05:30
Krishna Srinivas 183ec094c4 Simplify HTTP trace related code (#7833) 2019-06-26 22:41:12 -07:00
Anis Elleuch 48f2c98052 admin: Add Background heal status info API (#7774) 
This API returns the information related to the self healing routine.

For the moment, it returns:
- The total number of objects that are scanned
- The last time when an item was scanned
 2019-06-25 16:42:24 -07:00
Yao Zongyou 941fed8e4a s3Select: call Close on error to release the read lock (#7830) 2019-06-25 13:30:48 -07:00
Yao Zongyou 55092bede1 add timestamp compare support (#7832) 2019-06-25 11:05:37 -07:00
Yao Zongyou 90a3b830f4 fix typo and the string representation of the time.Time value (#7831) 2019-06-25 09:54:14 -07:00
Yao Zongyou 23b9df0694 Fix s3select TRIM function's nil pointer dereference bug (#7817) 2019-06-24 16:59:33 -07:00
Ashish Kumar Sinha 3022f60561 Stop duplicate entry in Notification.xml (#7690) 
fixes #7671
 2019-06-21 13:28:02 +05:30
Harshavardhana 1af6e8cb72
Add support for session policies in STS APIs (#7747) 
This PR adds support for adding session policies
for further restrictions on STS credentials, useful
in situations when applications want to generate
creds for multiple interested parties with different
set of policy restrictions.

This session policy is not mandatory, but optional.

Fixes #7732
 2019-06-20 15:28:33 -07:00
poornas 299ef9b188 Trace: Replace function name with API prefix (#7794) 
This change is required for `Admin Trace`
 2019-06-18 13:55:13 -07:00
Harshavardhana 99bf4d0c42 [sec] Match ${aws:username} exactly instead of prefix match (#7791) 
This PR fixes a security issue where an IAM user based
on his policy is granted more privileges than restricted
by the users IAM policy.

This is due to an issue of prefix based Matcher() function
which was incorrectly matching prefix based on resource
prefixes instead of exact match.
 2019-06-15 11:27:17 -07:00
Harshavardhana 002a205c9c Fix OPA result response handling (#7763) 
Also update the document with updated rego policy
and updated OPA agent REST API.

This PR is to fix a regression caused by PR #7637
 2019-06-10 17:06:32 -07:00
poornas 97090aa16c Add admin API to send trace notifications to registered (#7128) 
Remove current functionality to log trace to file
using MINIO_HTTP_TRACE env, and replace it with
mc admin trace command on mc client.
 2019-06-08 15:54:41 -07:00
Joe Stevens a19cf063b5 Fixes for multiplatform dev and testing from forks (#7734) 
Add support for correct dependency URLs on all platforms

only build mountinfo.go on linux

make testfile path relative to support fork work
 2019-06-04 00:59:40 -07:00
Harshavardhana ff7799452b Fix build failure due to nats project migration 2019-06-03 17:49:49 -07:00
Harshavardhana d16a409943
Ignore srvRecords from domain level entries (#7742) 
Fixes #7741
 2019-06-03 16:16:05 -07:00
Harshavardhana 2c0b3cadfc Update go mod with sem versions of our libraries (#7687) 2019-05-29 16:35:12 -07:00
Praveen raj Mani 763fce909b Enable event persistence in kafka (#7633) 2019-05-29 13:19:48 -07:00
Harshavardhana 7906f464fd
Skip non-bucket dns entry (#7699) 
Fixes #7697
 2019-05-28 19:13:49 -07:00
Harshavardhana 39b3e4f9b3 Avoid using io.ReadFull() for WriteAll and CreateFile (#7676) 
With these changes we are now able to peak performances
for all Write() operations across disks HDD and NVMe.

Also adds readahead for disk reads, which also increases
performance for reads by 3x.
 2019-05-22 13:47:15 -07:00
Praveen raj Mani c4c79f61ce Notification: Changes to persistent event store (#7658) 
This patch includes the following changes in event store interface
- Removes memory store. We will not persist events in memory anymore, if `queueDir` is not set.
- Orders the events before replaying to the broker.
 2019-05-22 13:34:48 -07:00
Krishna Srinivas 502456db91 Accept simpler response from OPA (#7637) 2019-05-12 18:40:49 +05:30
Harshavardhana ac3b59645e
Add API retry functionality in mc admin (#7602) 2019-05-09 17:41:54 -07:00
Harshavardhana 72929ec05b
Turn off md5sum optionally if content-md5 is not set (#7609) 
This PR also brings --compat option to run MinIO in strict
S3 compatibility mode, MinIO by default will now try to run
high performance mode.
 2019-05-08 18:35:40 -07:00
Praveen raj Mani 998f01fadc Support IPv6 hosts for postgres connections (#7168) 
Fixes #7145
 2019-05-03 17:31:33 +05:30
Harshavardhana ae002aa724 Deprecate updating admin credentials using API calls (#7570) 
Root credentials are not allowed to change in all of our
distributed setup deployments, this PR simply removes
that behavior.
 2019-04-24 12:54:44 -07:00
Krishna Srinivas a3ec71bc28 Use O_DIRECT while writing to disk (#7479) 
- Use O_DIRECT while writing to disk
- Remove MINIO_DRIVE_SYNC option
 2019-04-23 21:25:06 -07:00
Harshavardhana 4c048963dc etcd: Handle create buckets with common prefixes properly (#7556) 
common prefixes in bucket name if already created
are disallowed when etcd is configured due to the
prefix matching issue. Make sure that when we look
for bucket we are only interested in exact bucket
name not the prefix.
 2019-04-17 17:29:49 -07:00
Praveen raj Mani 47ca411163 Enhance the event store interface to support channeling (#7343) 
- Avoids code duplication across the other targets. By having a
  centralized function call.

- Reduce the room for race.
 2019-04-10 18:16:01 +05:30
kannappanr 5ecac91a55
Replace Minio refs in docs with MinIO and links (#7494) 2019-04-09 11:39:42 -07:00
Harshavardhana 0188009c7e Expose total and available disk space (#7453) 2019-04-05 09:51:50 +05:30
Aditya Manthramurthy b1b1d77893 Set S3 Select record message length to 128KiB (#7475) 
- Previously this limit was a little more than 1MiB, and it broke
  compatibility with AWS SDK Java causing a buffer overflow error.
 2019-04-04 00:41:52 -07:00
poornas dd1d69ab5c fix mysql config for native password authentication (#7436) 
fixes #7430
 2019-03-28 10:45:22 -07:00
Krishnan Parthasarathi 8a77a298f2 Add deploymentID to ServerInfo (#7372) 2019-03-19 16:12:24 +05:30
Kirill Motkov 3d29ab4059 Rewrite if-else chains to switch statements (#7382) 2019-03-18 07:46:20 -07:00
Anis Elleuch facbd653ba Add normal/deep type of heal scanning (#7251) 
Healing scan used to read all objects parts to check for bitrot
checksum. This commit will add a quicker way of healing scan
by only checking if parts are actually present in disks or not.
 2019-03-14 13:08:51 -07:00
Harshavardhana 91d85a0d53
Fix stale locks held by SelectParquet API (#7364) 
Vendorize upstream parquet-go to fix this issue.
 2019-03-13 20:33:18 -07:00
Harshavardhana 7079abc931 Implement HealObjects API to simplify healing (#7351) 2019-03-13 17:35:09 -07:00
Harshavardhana 285c09fe6b Support buckets with '.' with etcd+coreDNS (#7353) 
Fixes #7340
 2019-03-12 17:57:08 -07:00
Aditya Manthramurthy e463386921 Add JSON Path expression evaluation support (#7315) 
- Includes support for FROM clause JSON path
 2019-03-09 08:13:37 -08:00
Aditya Manthramurthy b296b3cf8b Skip non-bucket dns entry in federated bucket list (#7339) 2019-03-08 14:22:58 -08:00
Aditya Manthramurthy f4879ed96d Use jstream to serialize records to JSON format in S3Select (#7318) 
- Also, switch to jstream to generate internal record representation
  from CSV/JSON readers

- This fixes a bug in which JSON output objects have their keys
  reversed from the order they are specified in the Select columns.

- Also includes a fix for tests.
 2019-03-07 00:20:10 -08:00
Harshavardhana 12eb71828b Fix posix tests for SimpleCI (#7328) 2019-03-05 19:53:01 -08:00
Harshavardhana c3ca954684 Implement AssumeRole API for Minio users (#7267) 
For actual API reference read here

https://docs.aws.amazon.com/STS/latest/APIReference/API_AssumeRole.html

Documentation is added and updated as well at docs/sts/assume-role.md

Fixes #6381
 2019-02-27 17:46:55 -08:00
Harshavardhana 5e69a107d8 Support detecting mountpoints correctly (#7288) 
Currently windows support was relying on Symlink as
a way to detect a drive, this doesn't work in latest
Windows 2016, fix this to use a proper mechanism by
using win32 APIs.

Additionally also add support for detecting bind mounts
on Linux.
 2019-02-26 18:04:53 -08:00
Praveen raj Mani 78d116c487 Event persistence for MQTT (#7268) 
- The events will be persisted in queueStore if `queueDir` is set.
- Else, if queueDir is not set events persist in memory.

The events are replayed back when the mqtt broker is back online.
 2019-02-25 18:01:13 -08:00
Harshavardhana 2520e535a0
Allow lazyQuotes for certain types of CSV (#7278) 
Set lazyQuotes to true, to allow a quote to appear
in an unquote field and a non-doubled quote may
appear in a quoted field.
 2019-02-24 06:51:02 -08:00
Harshavardhana 7923b83953 Support multiple-domains in MINIO_DOMAIN (#7274) 
Fixes #7173
 2019-02-23 08:48:01 +05:30
Aditya Manthramurthy 80a351633f Update vendorized bcicen/jstream (#7257) 
- Includes an error handling fix that is waiting to be merged upstream
- Uses order-preserving (un)marshalling for JSON objects.
 2019-02-20 23:59:23 -08:00
Aditya Manthramurthy 8a405cab2f COUNT() function in select should return an int (#7243) 2019-02-13 16:32:59 -08:00