Harshavardhana 7e1661f4fa Performance improvements to SELECT API on certain query operations (#6752) ...

This improves the performance of certain queries dramatically,
such as 'count(*)' etc.

Without this PR
```
~ time mc select --query "select count(*) from S3Object" myminio/sjm-airlines/star2000.csv.gz
2173762

real	0m42.464s
user	0m0.071s
sys	0m0.010s
```

With this PR
```
~ time mc select --query "select count(*) from S3Object" myminio/sjm-airlines/star2000.csv.gz
2173762

real	0m17.603s
user	0m0.093s
sys	0m0.008s
```

Almost a 250% improvement in performance. This PR avoids a lot of type
conversions and instead relies on raw sequences of data and interprets
them lazily.

```
benchcmp old new
benchmark                        old ns/op       new ns/op       delta
BenchmarkSQLAggregate_100K-4     551213          259782          -52.87%
BenchmarkSQLAggregate_1M-4       6981901985      2432413729      -65.16%
BenchmarkSQLAggregate_2M-4       13511978488     4536903552      -66.42%
BenchmarkSQLAggregate_10M-4      68427084908     23266283336     -66.00%

benchmark                        old allocs     new allocs     delta
BenchmarkSQLAggregate_100K-4     2366           485            -79.50%
BenchmarkSQLAggregate_1M-4       47455492       21462860       -54.77%
BenchmarkSQLAggregate_2M-4       95163637       43110771       -54.70%
BenchmarkSQLAggregate_10M-4      476959550      216906510      -54.52%

benchmark                        old bytes       new bytes      delta
BenchmarkSQLAggregate_100K-4     1233079         1086024        -11.93%
BenchmarkSQLAggregate_1M-4       2607984120      557038536      -78.64%
BenchmarkSQLAggregate_2M-4       5254103616      1128149168     -78.53%
BenchmarkSQLAggregate_10M-4      26443524872     5722715992     -78.36%
```

2018-11-14 15:55:10 -08:00

..

crypto

crypto: add RemoveInternalEntries function (#6616)

2018-10-19 10:50:52 -07:00

gateway

Enable default vet flags (#6810)

2018-11-14 10:23:44 -08:00

http

Shouldn't require space in HTTP host header (#6743)

2018-10-31 15:31:42 -07:00

logger

Support audit logs with additional fields (#6738)

2018-11-02 18:40:08 -07:00

rest

Move remote disk StorageAPI abstraction from RPC to REST (#6464)

2018-10-04 17:44:06 -07:00

rpc

Drain response body properly for http connection pool (#6415)

2018-09-05 16:47:14 -07:00

acl-handlers.go

Make sure to log unhandled errors always (#6784)

2018-11-12 11:07:43 -08:00

admin-handlers_test.go

Enable default vet flags (#6810)

2018-11-14 10:23:44 -08:00

admin-handlers.go

Make sure to log unhandled errors always (#6784)

2018-11-12 11:07:43 -08:00

admin-heal-ops.go

Make sure to log unhandled errors always (#6784)

2018-11-12 11:07:43 -08:00

admin-router.go

Enable admin users API on gateway (#6659)

2018-10-17 17:25:16 -07:00

admin-rpc_test.go

Ensure that setConfig uses latest functionality (#6302)

2018-08-17 18:51:34 -07:00

admin-rpc-client.go

Remove unnecessary contexts passed as data to FatalIf. No need to log an empty context. (#6487)

2018-09-21 16:04:11 -07:00

admin-rpc-server.go

Remove unnecessary contexts passed as data to FatalIf. No need to log an empty context. (#6487)

2018-09-21 16:04:11 -07:00

api-datatypes.go

SQL select query for CSV/JSON (#6648)

2018-10-22 12:12:22 -07:00

api-errors_test.go

Make sure to log unhandled errors always (#6784)

2018-11-12 11:07:43 -08:00

api-errors.go

Performance improvements to SELECT API on certain query operations (#6752)

2018-11-14 15:55:10 -08:00

api-headers_test.go

Add UTCNow() function. (#3931)

2017-03-18 11:28:41 -07:00

api-headers.go

Add object compression support (#6292)

2018-09-28 09:06:17 +05:30

api-resources_test.go

Add error handling in api-resource.go (#6651)

2018-10-18 07:31:46 -07:00

api-resources.go

Add error handling in api-resource.go (#6651)

2018-10-18 07:31:46 -07:00

api-response_test.go

Handle incoming proxy requests ip, scheme (#5591)

2018-03-02 15:23:04 -08:00

api-response-multipart.go

Make sure to log unhandled errors always (#6784)

2018-11-12 11:07:43 -08:00

api-response.go

Add forceStop flag to provide facility to stop healing (#6718)

2018-11-04 19:24:16 -08:00

api-router.go

S3 Select API Support for CSV (#6127)

2018-08-15 03:30:19 -07:00

auth-handler_test.go

Make sure to log unhandled errors always (#6784)

2018-11-12 11:07:43 -08:00

auth-handler.go

Check for STS Action first to allow browser requests (#6796)

2018-11-13 15:53:06 -08:00

benchmark-utils_test.go

Add ObjectOptions to ObjectLayer calls (#6382)

2018-09-10 09:42:43 -07:00

bitrot_test.go

Simplify erasure code by separating bitrot from erasure code (#5959)

2018-08-06 15:14:08 -07:00

bitrot.go

Add 'disk' tag to log output to enhance 'disk not found' errors (#6460)

2018-09-13 21:42:50 -07:00

bool-flag_test.go

Persist MINIO_WORM as part of config.json (#6022)

2018-06-06 18:10:51 -07:00

bool-flag.go

simplifying if-else chains to switches (#6208)

2018-08-06 10:26:40 -07:00

bucket-handlers_test.go

Add GetObjectNInfo to object layer (#6449)

2018-09-20 19:22:09 -07:00

bucket-handlers-listobjects.go

Make sure to log unhandled errors always (#6784)

2018-11-12 11:07:43 -08:00

bucket-handlers.go

Make sure to log unhandled errors always (#6784)

2018-11-12 11:07:43 -08:00

bucket-notification-handlers.go

Make sure to log unhandled errors always (#6784)

2018-11-12 11:07:43 -08:00

bucket-policy-handlers_test.go

Add GetObjectNInfo to object layer (#6449)

2018-09-20 19:22:09 -07:00

bucket-policy-handlers.go

Make sure to log unhandled errors always (#6784)

2018-11-12 11:07:43 -08:00

build-constants.go

Cleanup stack trace in error logs (#6045)

2018-06-18 12:04:46 -07:00

certs_test.go

Ensure to load only regular files for CAs (#5612)

2018-03-07 22:16:28 +05:30

certs.go

Root CAs can be used for backend without TLS (#6711)

2018-10-28 06:21:00 +05:30

common-main.go

Support audit logs with additional fields (#6738)

2018-11-02 18:40:08 -07:00

config-common.go

Add etcd support to support STS on gateway mode (#6531)

2018-10-12 11:32:18 -07:00

config-current_test.go

feature: added nsq as broker for events (#6740)

2018-11-07 10:23:13 -08:00

config-current.go

feature: added nsq as broker for events (#6740)

2018-11-07 10:23:13 -08:00

config-dir.go

Migrate config.json from config-dir to backend (#6195)

2018-08-15 10:11:47 +05:30

config-migrate_test.go

Introduce STS client grants API and OPA policy integration (#6168)

2018-10-09 14:00:01 -07:00

config-migrate.go

feature: added nsq as broker for events (#6740)

2018-11-07 10:23:13 -08:00

config-versions.go

feature: added nsq as broker for events (#6740)

2018-11-07 10:23:13 -08:00

config.go

Introduce STS client grants API and OPA policy integration (#6168)

2018-10-09 14:00:01 -07:00

copy-part-range_test.go

Remove unused range parsing code and update tests (#6530)

2018-09-27 15:24:07 +05:30

copy-part-range.go

Remove unused range parsing code and update tests (#6530)

2018-09-27 15:24:07 +05:30

crossdomain-xml-handler_test.go

use package name correctly (#5827)

2018-04-21 19:23:54 -07:00

crossdomain-xml-handler.go

fs: Re-implement object layer to remember the fd (#3509)

2017-01-16 17:05:00 -08:00

disk-cache_test.go

Add object compression support (#6292)

2018-09-28 09:06:17 +05:30

disk-cache-config_test.go

cache: allow ellipse style entries for MINIO_CACHE_DRIVES (#6088)

2018-07-03 16:54:10 -07:00

disk-cache-config.go

Better validation of all config file fields (#6090)

2018-07-18 11:22:29 -07:00

disk-cache-fs.go

Add object compression support (#6292)

2018-09-28 09:06:17 +05:30

disk-cache.go

Add missing error check (#6632)

2018-10-17 10:57:12 -07:00

disk-usage.go

Deprecate and remove configurable disk usage check (#6016)

2018-06-05 18:53:44 -07:00

dummy-data-generator_test.go

Add GetObjectNInfo to object layer (#6449)

2018-09-20 19:22:09 -07:00

dummy-object-layer_test.go

Add object compression support (#6292)

2018-09-28 09:06:17 +05:30

dynamic-timeouts_test.go

Add support for timeouts for locks (#4377)

2017-08-31 14:43:59 -07:00

dynamic-timeouts.go

Change average from int to int64 in order to support 32-bit systems. (#4921)

2017-09-14 10:23:23 -07:00

encryption-v1_test.go

Enable default vet flags (#6810)

2018-11-14 10:23:44 -08:00

encryption-v1.go

Make sure to log unhandled errors always (#6784)

2018-11-12 11:07:43 -08:00

endpoint_test.go

Enhance fatal errors printing of common issues seen by users (#5878)

2018-05-08 19:04:36 -07:00

endpoint-ellipses_test.go

Enable default vet flags (#6810)

2018-11-14 10:23:44 -08:00

endpoint-ellipses.go

Support supplying custom drives per set count (#6261)

2018-08-15 16:35:21 -07:00

endpoint.go

Prioritize HTTP requests over Heal (#6468)

2018-09-17 18:28:34 -07:00

erasure_test.go

Rename of structs and methods (#6230)

2018-08-23 23:35:37 -07:00

erasure-decode_test.go

Rename of structs and methods (#6230)

2018-08-23 23:35:37 -07:00

erasure-decode.go

Rename of structs and methods (#6230)

2018-08-23 23:35:37 -07:00

erasure-encode_test.go

Add 'disk' tag to log output to enhance 'disk not found' errors (#6460)

2018-09-13 21:42:50 -07:00

erasure-encode.go

Rename of structs and methods (#6230)

2018-08-23 23:35:37 -07:00

erasure-heal_test.go

Rename of structs and methods (#6230)

2018-08-23 23:35:37 -07:00

erasure-heal.go

Rename of structs and methods (#6230)

2018-08-23 23:35:37 -07:00

erasure-utils.go

Avoid printing i/o closed pipe error message (#6654)

2018-10-17 15:52:18 -07:00

erasure.go

Rename of structs and methods (#6230)

2018-08-23 23:35:37 -07:00

fallocate_linux_test.go

fs: Re-implement object layer to remember the fd (#3509)

2017-01-16 17:05:00 -08:00

fallocate_linux.go

fs: Re-implement object layer to remember the fd (#3509)

2017-01-16 17:05:00 -08:00

fallocate.go

Add support of fallocate for FS and XL backends (#3032)

2016-10-29 12:44:44 -07:00

format-disk-cache_test.go

Remove all unused variables and functions (#5823)

2018-04-15 19:26:04 +05:30

format-disk-cache.go

Remove all unused variables and functions (#5823)

2018-04-15 19:26:04 +05:30

format-fs_test.go

Create logger package and rename errorIf to LogIf (#5678)

2018-04-05 15:04:40 -07:00

format-fs.go

Remove unused functions and constants (#6175)

2018-07-20 23:37:43 +05:30

format-meta.go

Add support for deployment ID (#6144)

2018-07-18 20:17:35 -07:00

format-xl_test.go

Add support for deployment ID (#6144)

2018-07-18 20:17:35 -07:00

format-xl.go

Ignore windows hidden folders (#6735)

2018-11-02 11:31:55 -07:00

fs-v1_test.go

Add ObjectOptions to ObjectLayer calls (#6382)

2018-09-10 09:42:43 -07:00

fs-v1-helpers_test.go

Throw 404 for head requests for prefixes without trailing "/" (#5966)

2018-06-26 06:54:00 +05:30

fs-v1-helpers.go

Remove unnecessary error log messages (#6186)

2018-08-16 12:57:49 -07:00

fs-v1-metadata_test.go

Add ObjectOptions to ObjectLayer calls (#6382)

2018-09-10 09:42:43 -07:00

fs-v1-metadata.go

Simplify pkg mimedb (#6549)

2018-10-02 11:48:17 +05:30

fs-v1-multipart_test.go

Add ObjectOptions to ObjectLayer calls (#6382)

2018-09-10 09:42:43 -07:00

fs-v1-multipart.go

Remove tmp file and multipart folder in FS mode. (#6677)

2018-10-22 07:36:30 -07:00

fs-v1-rwpool_test.go

posix: Deprecate custom removeAll/mkdirAll implementations. (#4808)

2017-08-12 19:25:43 -07:00

fs-v1-rwpool.go

simplifying if-else chains to switches (#6208)

2018-08-06 10:26:40 -07:00

fs-v1.go

Return default ETag if fs.json is empty (#6787)

2018-11-09 10:34:59 -08:00

gateway-common.go

handle exception InvalidPart (#6649)

2018-10-17 21:50:58 +05:30

gateway-main_test.go

Convert gateways into respective packages (#5200)

2017-12-05 17:58:09 -08:00

gateway-main.go

Support audit logs with additional fields (#6738)

2018-11-02 18:40:08 -07:00

gateway-router.go

Unify gateway and object layer. (#5487)

2018-02-09 15:19:30 -08:00

gateway-startup-msg_test.go

Migrate config.json from config-dir to backend (#6195)

2018-08-15 10:11:47 +05:30

gateway-startup-msg.go

Disable printing access/secrets in systemd (#6621)

2018-10-16 13:19:12 -07:00

gateway-unsupported.go

Cleanup unnecessary logs (#6788)

2018-11-09 14:03:37 -08:00

generic-handlers_test.go

Return error response header only for HEAD method (#6709)

2018-10-26 18:03:17 -07:00

generic-handlers.go

Make sure to log unhandled errors always (#6784)

2018-11-12 11:07:43 -08:00

globals.go

Introduce STS client grants API and OPA policy integration (#6168)

2018-10-09 14:00:01 -07:00

handler-utils_test.go

Test for multiple values for x-amz-meta header added (#6753)

2018-11-02 11:32:18 -07:00

handler-utils.go

Parse and return proper errors with x-amz-security-token (#6766)

2018-11-07 20:10:03 +05:30

hasher.go

Remove all unused variables and functions (#5823)

2018-04-15 19:26:04 +05:30

healthcheck-handler_test.go

Add healthcheck endpoints (#5543)

2018-03-12 11:46:53 +05:30

healthcheck-handler.go

Fix healthcheck for NAS gateway (#6452)

2018-09-11 13:44:10 -07:00

healthcheck-router.go

Add request tracing support for other REST APIs (#6013)

2018-06-07 10:41:13 -07:00

http-stats.go

Add RPC counters for HTTP stats. (#6206)

2018-08-30 14:17:58 +05:30

httprange_test.go

Add GetObjectNInfo to object layer (#6449)

2018-09-20 19:22:09 -07:00

httprange.go

Add GetObjectNInfo to object layer (#6449)

2018-09-20 19:22:09 -07:00

iam.go

Add policy claim support for JWT (#6660)

2018-10-29 11:08:59 -07:00

jwt_test.go

Introduce STS client grants API and OPA policy integration (#6168)

2018-10-09 14:00:01 -07:00

jwt.go

Parse and return proper errors with x-amz-security-token (#6766)

2018-11-07 20:10:03 +05:30

leak-detect_test.go

Add UTCNow() function. (#3931)

2017-03-18 11:28:41 -07:00

local-admin-client_test.go

Ensure that setConfig uses latest functionality (#6302)

2018-08-17 18:51:34 -07:00

local-admin-client.go

Add Profiler Admin API (#6463)

2018-09-18 16:46:35 -07:00

local-locker.go

Implement HTTP POST based RPC (#5840)

2018-06-06 14:21:56 +05:30

lock-rpc-client_test.go

Implement HTTP POST based RPC (#5840)

2018-06-06 14:21:56 +05:30

lock-rpc-client.go

Implement HTTP POST based RPC (#5840)

2018-06-06 14:21:56 +05:30

lock-rpc-server_test.go

Migrate config.json from config-dir to backend (#6195)

2018-08-15 10:11:47 +05:30

lock-rpc-server-common_test.go

posix: Deprecate custom removeAll/mkdirAll implementations. (#4808)

2017-08-12 19:25:43 -07:00

lock-rpc-server-common.go

Implement HTTP POST based RPC (#5840)

2018-06-06 14:21:56 +05:30

lock-rpc-server.go

Remove unnecessary contexts passed as data to FatalIf. No need to log an empty context. (#6487)

2018-09-21 16:04:11 -07:00

lock-stat.go

Add support for timeouts for locks (#4377)

2017-08-31 14:43:59 -07:00

main.go

Honor global flags irrespective of the position. (#5486)

2018-02-28 20:13:33 -08:00

metrics-router.go

Enhancements in Minio Prometheus exporter (#5848)

2018-05-09 01:38:27 -07:00

metrics.go

Rename of structs and methods (#6230)

2018-08-23 23:35:37 -07:00

namespace-lock_test.go

Fix goroutine test fatalf (#6682)

2018-10-23 09:44:20 -07:00

namespace-lock.go

Remove unnecessary contexts passed as data to FatalIf. No need to log an empty context. (#6487)

2018-09-21 16:04:11 -07:00

naughty-disk_test.go

Add sync mode for 'xl.json' (#6798)

2018-11-14 19:48:35 +05:30

net_test.go

tests: Remove dependency on check.v1 (#5034)

2017-10-10 02:14:42 -07:00

net.go

Return detailed msg for notification errors (#5913)

2018-05-09 15:11:24 -07:00

notification.go

Enable default vet flags (#6810)

2018-11-14 10:23:44 -08:00

object_api_suite_test.go

Add ObjectOptions to ObjectLayer calls (#6382)

2018-09-10 09:42:43 -07:00

object-api-common.go

Move remote disk StorageAPI abstraction from RPC to REST (#6464)

2018-10-04 17:44:06 -07:00

object-api-datatypes.go

encryption: Fix copy from encrypted multipart to single part (#6604)

2018-10-15 11:07:36 -07:00

object-api-deleteobject_test.go

Add ObjectOptions to ObjectLayer calls (#6382)

2018-09-10 09:42:43 -07:00

object-api-errors.go

Add etcd support to support STS on gateway mode (#6531)

2018-10-12 11:32:18 -07:00

object-api-getobject_test.go

Add ObjectOptions to ObjectLayer calls (#6382)

2018-09-10 09:42:43 -07:00

object-api-getobjectinfo_test.go

Add ObjectOptions to ObjectLayer calls (#6382)

2018-09-10 09:42:43 -07:00

object-api-input-checks.go

Remove unnecessary error log messages (#6186)

2018-08-16 12:57:49 -07:00

object-api-interface.go

Add object compression support (#6292)

2018-09-28 09:06:17 +05:30

object-api-listobjects_test.go

Add ObjectOptions to ObjectLayer calls (#6382)

2018-09-10 09:42:43 -07:00

object-api-multipart_test.go

Enable default vet flags (#6810)

2018-11-14 10:23:44 -08:00

object-api-putobject_test.go

Enable default vet flags (#6810)

2018-11-14 10:23:44 -08:00

object-api-utils_test.go

Add object compression support (#6292)

2018-09-28 09:06:17 +05:30

object-api-utils.go

Add object compression support (#6292)

2018-09-28 09:06:17 +05:30

object-handlers_test.go

Make sure to log unhandled errors always (#6784)

2018-11-12 11:07:43 -08:00

object-handlers-common.go

Use GetSourceIP for source ip as request params (#6109)

2018-07-02 14:40:18 -07:00

object-handlers.go

Performance improvements to SELECT API on certain query operations (#6752)

2018-11-14 15:55:10 -08:00

os-reliable_test.go

Remove error package and cause functions (#5784)

2018-04-10 09:36:37 -07:00

os-reliable.go

simplifying if-else chains to switches (#6208)

2018-08-06 10:26:40 -07:00

peer-rpc-client-target.go

Enable default vet flags (#6810)

2018-11-14 10:23:44 -08:00

peer-rpc-client.go

Remove unnecessary contexts passed as data to FatalIf. No need to log an empty context. (#6487)

2018-09-21 16:04:11 -07:00

peer-rpc-server.go

Remove unnecessary contexts passed as data to FatalIf. No need to log an empty context. (#6487)

2018-09-21 16:04:11 -07:00

policy_test.go

Enhance policy handling to support SSE and WORM (#5790)

2018-04-24 15:53:30 -07:00

policy.go

Introduce STS client grants API and OPA policy integration (#6168)

2018-10-09 14:00:01 -07:00

posix_test.go

Simplify erasure code by separating bitrot from erasure code (#5959)

2018-08-06 15:14:08 -07:00

posix_unix_test.go

remove separate file for posix utils. (#5948)

2018-06-07 12:31:40 +05:30

posix_windows_test.go

docs: fix all Chinese doc links for the new docs site (#6097)

2018-06-28 16:02:02 -07:00

posix-dirent-fileno.go

server: Move all the top level files into cmd folder. (#2490)

2016-08-18 16:23:42 -07:00

posix-dirent-ino.go

server: Move all the top level files into cmd folder. (#2490)

2016-08-18 16:23:42 -07:00

posix-errors_test.go

Add constants for commonly used values. (#3588)

2017-01-18 12:24:34 -08:00

posix-errors.go

simplifying if-else chains to switches (#6208)

2018-08-06 10:26:40 -07:00

posix-list-dir_plan9.go

Implement memory efficient readdir for windows (#6247)

2018-08-09 14:52:29 -07:00

posix-list-dir_test.go

Better support of empty directories (#5890)

2018-05-09 01:38:21 -07:00

posix-list-dir_unix.go

Implement memory efficient readdir for windows (#6247)

2018-08-09 14:52:29 -07:00

posix-list-dir_windows.go

Implement memory efficient readdir for windows (#6247)

2018-08-09 14:52:29 -07:00

posix.go

Add sync mode for 'xl.json' (#6798)

2018-11-14 19:48:35 +05:30

post-policy_test.go

Add ObjectOptions to ObjectLayer calls (#6382)

2018-09-10 09:42:43 -07:00

postpolicyform_test.go

Fix PostPolicy form tests without hardcoded dates (#5337)

2018-01-01 07:28:10 +05:30

postpolicyform.go

simplifying if-else chains to switches (#6208)

2018-08-06 10:26:40 -07:00

prepare-storage.go

Add 'disk' tag to log output to enhance 'disk not found' errors (#6460)

2018-09-13 21:42:50 -07:00

retry_test.go

auth/rpc: Make auth rpc client retry configurable. (#3695)

2017-02-07 02:16:29 -08:00

retry.go

Implement HTTP POST based RPC (#5840)

2018-06-06 14:21:56 +05:30

routers.go

move SSE-C TLS enforcement into generic handler (#6639)

2018-10-16 19:22:09 -07:00

rpc_test.go

Implement HTTP POST based RPC (#5840)

2018-06-06 14:21:56 +05:30

rpc.go

Add granular locking in retryTicker (#6236)

2018-08-03 18:57:00 -07:00

server_test.go

Fix goroutine test fatalf (#6682)

2018-10-23 09:44:20 -07:00

server-main_test.go

Add NAS gateway support (#5516)

2018-02-20 12:21:12 -08:00

server-main.go

Honor certs from config-dir (#6757)

2018-11-02 11:53:45 -07:00

server-rlimit.go

Deprecate and remove in-memory object caching (#5481)

2018-02-02 10:17:13 -08:00

server-startup-msg_test.go

Rename of structs and methods (#6230)

2018-08-23 23:35:37 -07:00

server-startup-msg.go

Disable printing access/secrets in systemd (#6621)

2018-10-16 13:19:12 -07:00

service.go

Refactor HTTP server to address bugs (#4636)

2017-07-12 16:33:21 -07:00

setup-type.go

Add extensive endpoints validation (#4019)

2017-04-11 15:44:27 -07:00

signals.go

change received system signal output to upper case (#6761)

2018-11-12 15:07:16 -08:00

signature-v2_test.go

Introduce STS client grants API and OPA policy integration (#6168)

2018-10-09 14:00:01 -07:00

signature-v2.go

Parse and return proper errors with x-amz-security-token (#6766)

2018-11-07 20:10:03 +05:30

signature-v4_test.go

Migrate config.json from config-dir to backend (#6195)

2018-08-15 10:11:47 +05:30

signature-v4-parser_test.go

fix X-Amz-Credential parsing for V4 policy signature (#6451)

2018-09-11 11:17:23 -07:00

signature-v4-parser.go

Parse and return proper errors with x-amz-security-token (#6766)

2018-11-07 20:10:03 +05:30

signature-v4-utils_test.go

Fix presigned URL for access key with special characters (#6012)

2018-06-05 10:48:51 -07:00

signature-v4-utils.go

Parse and return proper errors with x-amz-security-token (#6766)

2018-11-07 20:10:03 +05:30

signature-v4.go

Parse and return proper errors with x-amz-security-token (#6766)

2018-11-07 20:10:03 +05:30

storage-class_test.go

Add ObjectOptions to ObjectLayer calls (#6382)

2018-09-10 09:42:43 -07:00

storage-class.go

Return 503 instead of 404 if more than half of disks are not found (#6207)

2018-07-31 00:23:29 -07:00

storage-datatypes.go

Use getObjectInfo() in both FS and XL ListObjects() to simplify and to return complete object information (#3247)

2016-11-13 11:48:02 -08:00

storage-errors.go

Simplify erasure code by separating bitrot from erasure code (#5959)

2018-08-06 15:14:08 -07:00

storage-interface.go

Add sync mode for 'xl.json' (#6798)

2018-11-14 19:48:35 +05:30

storage-rest_test.go

Move remote disk StorageAPI abstraction from RPC to REST (#6464)

2018-10-04 17:44:06 -07:00

storage-rest-client.go

Add sync mode for 'xl.json' (#6798)

2018-11-14 19:48:35 +05:30

storage-rest-common.go

Add sync mode for 'xl.json' (#6798)

2018-11-14 19:48:35 +05:30

storage-rest-server.go

Add sync mode for 'xl.json' (#6798)

2018-11-14 19:48:35 +05:30

streaming-signature-v4_test.go

Refactor streaming signatureV4 w/ state machine (#2862)

2016-10-10 01:42:32 -07:00

streaming-signature-v4.go

Parse and return proper errors with x-amz-security-token (#6766)

2018-11-07 20:10:03 +05:30

sts-errors.go

Introduce STS client grants API and OPA policy integration (#6168)

2018-10-09 14:00:01 -07:00

sts-handlers.go

Add policy claim support for JWT (#6660)

2018-10-29 11:08:59 -07:00

test-utils_test.go

Make sure to log unhandled errors always (#6784)

2018-11-12 11:07:43 -08:00

tree-walk_test.go

Make sure to handle FaultyDisks in listing ops (#6204)

2018-07-27 15:32:19 -07:00

tree-walk-pool_test.go

server: Move all the top level files into cmd folder. (#2490)

2016-08-18 16:23:42 -07:00

tree-walk-pool.go

server: Move all the top level files into cmd folder. (#2490)

2016-08-18 16:23:42 -07:00

tree-walk.go

Make sure to handle FaultyDisks in listing ops (#6204)

2018-07-27 15:32:19 -07:00

typed-errors.go

Allow all browser calls to honor multi-users (#6645)

2018-10-17 16:23:09 -07:00

ui-errors-utils.go

More fixes for error messages (#5911)

2018-05-09 13:29:37 -07:00

ui-errors.go

Add object compression support (#6292)

2018-09-28 09:06:17 +05:30

update-main_test.go

Support in-place upgrades of new minio binary and releases. (#4961)

2017-12-15 12:33:42 -08:00

update-main.go

Remove UA worm and cache (#6809)

2018-11-14 13:18:55 +05:30

update-notifier_test.go

Ensure that setConfig uses latest functionality (#6302)

2018-08-17 18:51:34 -07:00

update-notifier.go

Support dumb terminals by turning off color (#6246)

2018-08-06 18:16:49 +05:30

utils_test.go

Move remote disk StorageAPI abstraction from RPC to REST (#6464)

2018-10-04 17:44:06 -07:00

utils.go

profiling: Fix downloading tracing profiling data (#6599)

2018-10-15 11:13:19 -07:00

version_test.go

tests: Remove dependency on check.v1 (#5034)

2017-10-10 02:14:42 -07:00

version-main.go

Fix tabs/indents in help message (#5962)

2018-05-21 11:11:57 -07:00

web-handlers_test.go

Allow all browser calls to honor multi-users (#6645)

2018-10-17 16:23:09 -07:00

web-handlers.go

Support audit logs with additional fields (#6738)

2018-11-02 18:40:08 -07:00

web-router.go

Add request tracing support for other REST APIs (#6013)

2018-06-07 10:41:13 -07:00

xl-sets_test.go

Migrate config.json from config-dir to backend (#6195)

2018-08-15 10:11:47 +05:30

xl-sets.go

HealBucket was double counting endpoints (#6707)

2018-10-26 10:25:52 -07:00

xl-v1_test.go

Deprecate showing drive capacity and total free (#5976)

2018-05-23 17:30:25 -07:00

xl-v1-bucket.go

Remove unwanted logs (#6708)

2018-10-26 14:41:25 -07:00

xl-v1-common_test.go

Add ObjectOptions to ObjectLayer calls (#6382)

2018-09-10 09:42:43 -07:00

xl-v1-common.go

Remove unnecessary error log messages (#6186)

2018-08-16 12:57:49 -07:00

xl-v1-errors.go

Make sure to re-load reference format after HealFormat (#5772)

2018-04-09 22:55:41 +05:30

xl-v1-healing_test.go

Add ObjectOptions to ObjectLayer calls (#6382)

2018-09-10 09:42:43 -07:00

xl-v1-healing-common_test.go

Return always a default heal item upon unexpected error (#6556)

2018-10-02 17:13:51 -07:00

xl-v1-healing-common.go

Return always a default heal item upon unexpected error (#6556)

2018-10-02 17:13:51 -07:00

xl-v1-healing.go

Fix healing bucket properly (#6716)

2018-10-28 14:13:17 -07:00

xl-v1-list-objects-heal.go

Add context to the object-interface methods.

2018-03-15 16:28:25 -07:00

xl-v1-list-objects.go

Make sure to handle FaultyDisks in listing ops (#6204)

2018-07-27 15:32:19 -07:00

xl-v1-metadata_test.go

Add object compression support (#6292)

2018-09-28 09:06:17 +05:30

xl-v1-metadata.go

Add sync mode for 'xl.json' (#6798)

2018-11-14 19:48:35 +05:30

xl-v1-multipart_test.go

Add ObjectOptions to ObjectLayer calls (#6382)

2018-09-10 09:42:43 -07:00

xl-v1-multipart.go

Remove unwanted logs (#6708)

2018-10-26 14:41:25 -07:00

xl-v1-object_test.go

Add ObjectOptions to ObjectLayer calls (#6382)

2018-09-10 09:42:43 -07:00

xl-v1-object.go

Avoid double bucket validation in DeleteObjectHandler (#6720)

2018-10-30 16:07:57 -07:00

xl-v1-utils_test.go

Add object compression support (#6292)

2018-09-28 09:06:17 +05:30

xl-v1-utils.go

Treat empty xl.json as file not found (#6804)

2018-11-13 11:57:03 -08:00

xl-v1.go

Add 'disk' tag to log output to enhance 'disk not found' errors (#6460)

2018-09-13 21:42:50 -07:00