MyFavMirrors/minio
1
0
Fork 0
mirror of https://github.com/minio/minio.git synced 2024-12-25 22:55:54 -05:00
Code Issues Packages Projects Releases Wiki Activity
5,801 Commits 4 Branches 506 Tags 189 MiB
48f2c98052
Commit Graph

1244 Commits

Author SHA1 Message Date
Anis Elleuch
48f2c98052 admin: Add Background heal status info API (#7774) 
This API returns the information related to the self healing routine.

For the moment, it returns:
- The total number of objects that are scanned
- The last time when an item was scanned
 2019-06-25 16:42:24 -07:00
Yao Zongyou
941fed8e4a s3Select: call Close on error to release the read lock (#7830) 2019-06-25 13:30:48 -07:00
Yao Zongyou
55092bede1 add timestamp compare support (#7832) 2019-06-25 11:05:37 -07:00
Yao Zongyou
90a3b830f4 fix typo and the string representation of the time.Time value (#7831) 2019-06-25 09:54:14 -07:00
Yao Zongyou
23b9df0694 Fix s3select TRIM function's nil pointer dereference bug (#7817) 2019-06-24 16:59:33 -07:00
Ashish Kumar Sinha
3022f60561 Stop duplicate entry in Notification.xml (#7690) 
fixes #7671
 2019-06-21 13:28:02 +05:30
Harshavardhana
1af6e8cb72
Add support for session policies in STS APIs (#7747) 
This PR adds support for adding session policies
for further restrictions on STS credentials, useful
in situations when applications want to generate
creds for multiple interested parties with different
set of policy restrictions.

This session policy is not mandatory, but optional.

Fixes #7732
 2019-06-20 15:28:33 -07:00
poornas
299ef9b188 Trace: Replace function name with API prefix (#7794) 
This change is required for `Admin Trace`
 2019-06-18 13:55:13 -07:00
Harshavardhana
99bf4d0c42 [sec] Match ${aws:username} exactly instead of prefix match (#7791) 
This PR fixes a security issue where an IAM user based
on his policy is granted more privileges than restricted
by the users IAM policy.

This is due to an issue of prefix based Matcher() function
which was incorrectly matching prefix based on resource
prefixes instead of exact match.
 2019-06-15 11:27:17 -07:00
Harshavardhana
002a205c9c Fix OPA result response handling (#7763) 
Also update the document with updated rego policy
and updated OPA agent REST API.

This PR is to fix a regression caused by PR #7637
 2019-06-10 17:06:32 -07:00
poornas
97090aa16c Add admin API to send trace notifications to registered (#7128) 
Remove current functionality to log trace to file
using MINIO_HTTP_TRACE env, and replace it with
mc admin trace command on mc client.
 2019-06-08 15:54:41 -07:00
Joe Stevens
a19cf063b5 Fixes for multiplatform dev and testing from forks (#7734) 
Add support for correct dependency URLs on all platforms

only build mountinfo.go on linux

make testfile path relative to support fork work
 2019-06-04 00:59:40 -07:00
Harshavardhana
ff7799452b Fix build failure due to nats project migration 2019-06-03 17:49:49 -07:00
Harshavardhana
d16a409943
Ignore srvRecords from domain level entries (#7742) 
Fixes #7741
 2019-06-03 16:16:05 -07:00
Harshavardhana
2c0b3cadfc Update go mod with sem versions of our libraries (#7687) 2019-05-29 16:35:12 -07:00
Praveen raj Mani
763fce909b Enable event persistence in kafka (#7633) 2019-05-29 13:19:48 -07:00
Harshavardhana
7906f464fd
Skip non-bucket dns entry (#7699) 
Fixes #7697
 2019-05-28 19:13:49 -07:00
Harshavardhana
39b3e4f9b3 Avoid using io.ReadFull() for WriteAll and CreateFile (#7676) 
With these changes we are now able to peak performances
for all Write() operations across disks HDD and NVMe.

Also adds readahead for disk reads, which also increases
performance for reads by 3x.
 2019-05-22 13:47:15 -07:00
Praveen raj Mani
c4c79f61ce Notification: Changes to persistent event store (#7658) 
This patch includes the following changes in event store interface
- Removes memory store. We will not persist events in memory anymore, if `queueDir` is not set.
- Orders the events before replaying to the broker.
 2019-05-22 13:34:48 -07:00
Krishna Srinivas
502456db91 Accept simpler response from OPA (#7637) 2019-05-12 18:40:49 +05:30
Harshavardhana
ac3b59645e
Add API retry functionality in mc admin (#7602) 2019-05-09 17:41:54 -07:00
Harshavardhana
72929ec05b
Turn off md5sum optionally if content-md5 is not set (#7609) 
This PR also brings --compat option to run MinIO in strict
S3 compatibility mode, MinIO by default will now try to run
high performance mode.
 2019-05-08 18:35:40 -07:00
Praveen raj Mani
998f01fadc Support IPv6 hosts for postgres connections (#7168) 
Fixes #7145
 2019-05-03 17:31:33 +05:30
Harshavardhana
ae002aa724 Deprecate updating admin credentials using API calls (#7570) 
Root credentials are not allowed to change in all of our
distributed setup deployments, this PR simply removes
that behavior.
 2019-04-24 12:54:44 -07:00
Krishna Srinivas
a3ec71bc28 Use O_DIRECT while writing to disk (#7479) 
- Use O_DIRECT while writing to disk
- Remove MINIO_DRIVE_SYNC option
 2019-04-23 21:25:06 -07:00
Harshavardhana
4c048963dc etcd: Handle create buckets with common prefixes properly (#7556) 
common prefixes in bucket name if already created
are disallowed when etcd is configured due to the
prefix matching issue. Make sure that when we look
for bucket we are only interested in exact bucket
name not the prefix.
 2019-04-17 17:29:49 -07:00
Praveen raj Mani
47ca411163 Enhance the event store interface to support channeling (#7343) 
- Avoids code duplication across the other targets. By having a
  centralized function call.

- Reduce the room for race.
 2019-04-10 18:16:01 +05:30
kannappanr
5ecac91a55
Replace Minio refs in docs with MinIO and links (#7494) 2019-04-09 11:39:42 -07:00
Harshavardhana
0188009c7e Expose total and available disk space (#7453) 2019-04-05 09:51:50 +05:30
Aditya Manthramurthy
b1b1d77893 Set S3 Select record message length to 128KiB (#7475) 
- Previously this limit was a little more than 1MiB, and it broke
  compatibility with AWS SDK Java causing a buffer overflow error.
 2019-04-04 00:41:52 -07:00
poornas
dd1d69ab5c fix mysql config for native password authentication (#7436) 
fixes #7430
 2019-03-28 10:45:22 -07:00
Krishnan Parthasarathi
8a77a298f2 Add deploymentID to ServerInfo (#7372) 2019-03-19 16:12:24 +05:30
Kirill Motkov
3d29ab4059 Rewrite if-else chains to switch statements (#7382) 2019-03-18 07:46:20 -07:00
Anis Elleuch
facbd653ba Add normal/deep type of heal scanning (#7251) 
Healing scan used to read all objects parts to check for bitrot
checksum. This commit will add a quicker way of healing scan
by only checking if parts are actually present in disks or not.
 2019-03-14 13:08:51 -07:00
Harshavardhana
91d85a0d53
Fix stale locks held by SelectParquet API (#7364) 
Vendorize upstream parquet-go to fix this issue.
 2019-03-13 20:33:18 -07:00
Harshavardhana
7079abc931 Implement HealObjects API to simplify healing (#7351) 2019-03-13 17:35:09 -07:00
Harshavardhana
285c09fe6b Support buckets with '.' with etcd+coreDNS (#7353) 
Fixes #7340
 2019-03-12 17:57:08 -07:00
Aditya Manthramurthy
e463386921 Add JSON Path expression evaluation support (#7315) 
- Includes support for FROM clause JSON path
 2019-03-09 08:13:37 -08:00
Aditya Manthramurthy
b296b3cf8b Skip non-bucket dns entry in federated bucket list (#7339) 2019-03-08 14:22:58 -08:00
Aditya Manthramurthy
f4879ed96d Use jstream to serialize records to JSON format in S3Select (#7318) 
- Also, switch to jstream to generate internal record representation
  from CSV/JSON readers

- This fixes a bug in which JSON output objects have their keys
  reversed from the order they are specified in the Select columns.

- Also includes a fix for tests.
 2019-03-07 00:20:10 -08:00
Harshavardhana
12eb71828b Fix posix tests for SimpleCI (#7328) 2019-03-05 19:53:01 -08:00
Harshavardhana
c3ca954684 Implement AssumeRole API for Minio users (#7267) 
For actual API reference read here

https://docs.aws.amazon.com/STS/latest/APIReference/API_AssumeRole.html

Documentation is added and updated as well at docs/sts/assume-role.md

Fixes #6381
 2019-02-27 17:46:55 -08:00
Harshavardhana
5e69a107d8 Support detecting mountpoints correctly (#7288) 
Currently windows support was relying on Symlink as
a way to detect a drive, this doesn't work in latest
Windows 2016, fix this to use a proper mechanism by
using win32 APIs.

Additionally also add support for detecting bind mounts
on Linux.
 2019-02-26 18:04:53 -08:00
Praveen raj Mani
78d116c487 Event persistence for MQTT (#7268) 
- The events will be persisted in queueStore if `queueDir` is set.
- Else, if queueDir is not set events persist in memory.

The events are replayed back when the mqtt broker is back online.
 2019-02-25 18:01:13 -08:00
Harshavardhana
2520e535a0
Allow lazyQuotes for certain types of CSV (#7278) 
Set lazyQuotes to true, to allow a quote to appear
in an unquote field and a non-doubled quote may
appear in a quoted field.
 2019-02-24 06:51:02 -08:00
Harshavardhana
7923b83953 Support multiple-domains in MINIO_DOMAIN (#7274) 
Fixes #7173
 2019-02-23 08:48:01 +05:30
Aditya Manthramurthy
80a351633f Update vendorized bcicen/jstream (#7257) 
- Includes an error handling fix that is waiting to be merged upstream
- Uses order-preserving (un)marshalling for JSON objects.
 2019-02-20 23:59:23 -08:00
Aditya Manthramurthy
8a405cab2f COUNT() function in select should return an int (#7243) 2019-02-13 16:32:59 -08:00
Harshavardhana
df35d7db9d Introduce staticcheck for stricter builds (#7035) 2019-02-13 18:29:36 +05:30
Aditya Manthramurthy
ee5b3622a5 Evaluate where clause in aggregation queries (#7235) 2019-02-12 13:54:26 -08:00