minio/cmd
Harshavardhana f21d650ed4
fix: readData in bulk call using messagepack byte wrappers (#11228)
This PR refactors the way we use buffers for O_DIRECT and
to re-use those buffers for messagepack reader writer.

After some extensive benchmarking found that not all objects
have this benefit, and only objects smaller than 64KiB see
this benefit overall.

Benefits are seen from almost all objects from

1KiB - 32KiB

Beyond this no objects see benefit with bulk call approach
as the latency of bytes sent over the wire v/s streaming
content directly from disk negate each other with no
remarkable benefits.

All other optimizations include reuse of msgp.Reader,
msgp.Writer using sync.Pool's for all internode calls.
2021-01-07 19:27:31 -08:00
..
config Allow Compression + encryption (#11103) 2021-01-05 20:08:35 -08:00
crypto refactor cmd/crypto code for SSE handling and parsing (#11045) 2020-12-22 09:19:32 -08:00
gateway feat: migrate to ROOT_USER/PASSWORD from ACCESS/SECRET_KEY (#11185) 2021-01-05 10:22:57 -08:00
http refactor cmd/crypto code for SSE handling and parsing (#11045) 2020-12-22 09:19:32 -08:00
jwt fix: send valid claims in AuditLogs for browser requests (#9713) 2020-05-27 12:38:44 -07:00
logger Context based AccessKey passing (#10615) 2020-11-04 09:13:34 -08:00
rest Reduce logging when peer is offline (#11184) 2020-12-30 14:38:54 -08:00
testdata Optimize decryptObjectInfo (#10726) 2020-10-29 09:34:20 -07:00
acl-handlers.go migrate all bucket metadata into a single file (#9586) 2020-05-19 13:53:54 -07:00
admin-bucket-handlers.go remove/deprecate crawler disable environment (#11214) 2021-01-04 09:43:31 -08:00
admin-handlers_test.go avoid a crash in crawler when lifecycle is not initialized (#11170) 2020-12-26 22:58:06 -08:00
admin-handlers-config-kv.go Profiling does not required object layer to be initialized (#11133) 2020-12-18 11:51:15 -08:00
admin-handlers-users.go normalize users with double // in accessKeys (#11143) 2020-12-20 10:09:51 -08:00
admin-handlers.go heal: Reduce whitespace ticker to 5 seconds (#11234) 2021-01-06 13:29:50 -08:00
admin-heal-ops.go fix: inherit heal opts globally, including bitrot settings (#11166) 2020-12-24 23:04:03 -08:00
admin-router.go remove/deprecate crawler disable environment (#11214) 2021-01-04 09:43:31 -08:00
admin-server-info.go expire stale locks when owner is down (#11247) 2021-01-07 19:16:18 -08:00
api-datatypes.go fix: avoid sending errors on missing objects on locked buckets (#10994) 2020-11-28 21:15:45 -08:00
api-errors_test.go Move etcd, logger, crypto into their own packages (#8366) 2019-10-08 11:17:56 +05:30
api-errors.go remove/deprecate crawler disable environment (#11214) 2021-01-04 09:43:31 -08:00
api-headers_test.go Replace Minio refs in docs with MinIO and links (#7494) 2019-04-09 11:39:42 -07:00
api-headers.go s3: Fix reading GET with partNumber specified (#11032) 2020-12-08 13:12:42 -08:00
api-resources_test.go Increase maximum 1000 List keys to 10000 (#8444) 2019-10-28 10:36:15 -07:00
api-resources.go listV2: Continuation and NextContinuation tokens are encoded with base64 (#8337) 2019-10-02 01:39:29 +05:30
api-response_test.go fix: obtain correct location string with DNS style buckets (#10060) 2020-07-16 13:28:29 -07:00
api-response.go update x/net/http2 to address few bugs (#11144) 2020-12-21 21:42:38 -08:00
api-router.go feat: Small object optimization read data in single bulk call (#11207) 2021-01-03 11:27:57 -08:00
api-utils_test.go Make Encoding URL more compliant to S3 spec (#7360) 2019-04-12 12:02:37 -07:00
api-utils.go Make Encoding URL more compliant to S3 spec (#7360) 2019-04-12 12:02:37 -07:00
auth-handler_test.go Profiling does not required object layer to be initialized (#11133) 2020-12-18 11:51:15 -08:00
auth-handler.go handlers: Avoid initializing a struct in each handler call (#11217) 2021-01-04 09:54:22 -08:00
background-heal-ops.go tracing: NumSubscribers() to use atomic instead of mutex (#11219) 2021-01-04 09:40:30 -08:00
background-newdisks-heal-ops_gen_test.go add '.healing.bin' for tracking currently healing disk (#10573) 2020-09-28 19:39:32 -07:00
background-newdisks-heal-ops_gen.go add '.healing.bin' for tracking currently healing disk (#10573) 2020-09-28 19:39:32 -07:00
background-newdisks-heal-ops.go fix: rename remaining zone -> pool (#11231) 2021-01-06 09:35:47 -08:00
benchmark-utils_test.go avoid a crash in crawler when lifecycle is not initialized (#11170) 2020-12-26 22:58:06 -08:00
bitrot_test.go fix: readData in bulk call using messagepack byte wrappers (#11228) 2021-01-07 19:27:31 -08:00
bitrot-streaming.go fix: readData in bulk call using messagepack byte wrappers (#11228) 2021-01-07 19:27:31 -08:00
bitrot-whole.go fix: ignore faulty drives and continue (#10511) 2020-09-18 12:09:05 -07:00
bitrot.go fix: readData in bulk call using messagepack byte wrappers (#11228) 2021-01-07 19:27:31 -08:00
bootstrap-peer-server.go rename server sets to server pools 2020-12-01 13:50:33 -08:00
bucket-encryption_test.go Add support for bucket encryption feature (#8890) 2020-02-05 15:12:34 +05:30
bucket-encryption-handlers.go Relax content-md5 requirement in set encryption handler (#9750) 2020-06-01 18:08:19 -07:00
bucket-encryption.go remove safeMode behavior in startup (#10645) 2020-10-09 09:59:52 -07:00
bucket-handlers_test.go avoid a crash in crawler when lifecycle is not initialized (#11170) 2020-12-26 22:58:06 -08:00
bucket-handlers.go remove/deprecate crawler disable environment (#11214) 2021-01-04 09:43:31 -08:00
bucket-lifecycle-handlers_test.go feat: Add notification support for bucketCreates and removal (#10075) 2020-07-20 12:52:49 -07:00
bucket-lifecycle-handlers.go Add support for ILM transition (#10565) 2020-11-19 18:47:17 -08:00
bucket-lifecycle.go fix: getObject fd leaks in transition and replication code (#11237) 2021-01-06 16:13:10 -08:00
bucket-listobjects-handlers.go ListObjects Metadata Caching (#10648) 2020-10-28 09:18:35 -07:00
bucket-metadata_gen_test.go migrate all bucket metadata into a single file (#9586) 2020-05-19 13:53:54 -07:00
bucket-metadata_gen.go Encrypt remote target if kms is configured (#11034) 2020-12-21 16:21:33 -08:00
bucket-metadata-sys.go tests: Fix occasional data race (#11223) 2021-01-05 10:45:26 -08:00
bucket-metadata.go Encrypt remote target if kms is configured (#11034) 2020-12-21 16:21:33 -08:00
bucket-notification-handlers.go feat: Add notification support for bucketCreates and removal (#10075) 2020-07-20 12:52:49 -07:00
bucket-object-lock.go Ignore ObjectNotFound errors in delete api while enforcing locking (#11114) 2020-12-15 11:15:49 -08:00
bucket-policy-handlers_test.go feat: Add notification support for bucketCreates and removal (#10075) 2020-07-20 12:52:49 -07:00
bucket-policy-handlers.go Support bucket versioning (#9377) 2020-06-12 20:04:01 -07:00
bucket-policy.go support 'ldap:user' variable replacement properly (#10391) 2020-09-01 12:26:22 +05:30
bucket-quota.go remove safeMode behavior in startup (#10645) 2020-10-09 09:59:52 -07:00
bucket-replication.go fix: getObject fd leaks in transition and replication code (#11237) 2021-01-06 16:13:10 -08:00
bucket-targets.go fix: getObject fd leaks in transition and replication code (#11237) 2021-01-06 16:13:10 -08:00
bucket-versioning-handler.go Handle changes to versioning config for replication (#10598) 2020-09-30 13:36:37 -07:00
bucket-versioning.go tests: Fix occasional data race (#11223) 2021-01-05 10:45:26 -08:00
build-constants.go Add support for minioreleaser a fork for goreleaser (#9890) 2020-06-22 08:26:40 -07:00
common-main.go feat: migrate to ROOT_USER/PASSWORD from ACCESS/SECRET_KEY (#11185) 2021-01-05 10:22:57 -08:00
config-common.go Remove erasureSets and erasureObjects from ObjectLayer (#10442) 2020-09-10 09:18:19 -07:00
config-current_test.go Revert "Support variable server sets (#10314)" 2020-12-01 12:02:29 -08:00
config-current.go Add crawler delay config + dynamic config values (#11018) 2020-12-04 09:32:35 -08:00
config-dir.go fix: unwrapping issues with os.Is* functions (#10949) 2020-11-23 08:36:49 -08:00
config-encrypted_test.go Config migration should handle plain-text (#8506) 2019-11-11 12:01:21 -08:00
config-encrypted.go feat: migrate to ROOT_USER/PASSWORD from ACCESS/SECRET_KEY (#11185) 2021-01-05 10:22:57 -08:00
config-migrate_test.go Revert "Support variable server sets (#10314)" 2020-12-01 12:02:29 -08:00
config-migrate.go Revert "Support variable server sets (#10314)" 2020-12-01 12:02:29 -08:00
config-versions.go Migrate config to KV data format (#8392) 2019-10-22 22:59:13 -07:00
config.go Revert "Support variable server sets (#10314)" 2020-12-01 12:02:29 -08:00
consolelogger.go tracing: NumSubscribers() to use atomic instead of mutex (#11219) 2021-01-04 09:40:30 -08:00
copy-part-range_test.go Replace Minio refs in docs with MinIO and links (#7494) 2019-04-09 11:39:42 -07:00
copy-part-range.go Support bucket versioning (#9377) 2020-06-12 20:04:01 -07:00
crossdomain-xml-handler_test.go Replace Minio refs in docs with MinIO and links (#7494) 2019-04-09 11:39:42 -07:00
crossdomain-xml-handler.go Replace Minio refs in docs with MinIO and links (#7494) 2019-04-09 11:39:42 -07:00
data-crawler.go remove/deprecate crawler disable environment (#11214) 2021-01-04 09:43:31 -08:00
data-update-tracker_test.go avoid a crash in crawler when lifecycle is not initialized (#11170) 2020-12-26 22:58:06 -08:00
data-update-tracker.go fix: enhance logging in crawler use console.Debug instead of logger.Info (#11179) 2020-12-29 01:57:28 -08:00
data-usage_test.go crawler: Stream bucket usage cache data (#11068) 2020-12-10 13:03:22 -08:00
data-usage-cache_gen_test.go merge object lifecycle checks into usage crawler (#9579) 2020-06-12 10:28:21 -07:00
data-usage-cache_gen.go Add replication capacity metrics support in crawler (#10786) 2020-12-07 13:47:48 -08:00
data-usage-cache.go fix: log once updating dataUsageCache versions (#11190) 2020-12-31 09:45:09 -08:00
data-usage.go remove/deprecate crawler disable environment (#11214) 2021-01-04 09:43:31 -08:00
disk-cache_test.go add ruleguard support, fix all the reported issues (#10335) 2020-08-24 12:11:20 -07:00
disk-cache-backend.go refactor cmd/crypto code for SSE handling and parsing (#11045) 2020-12-22 09:19:32 -08:00
disk-cache-check-support_other.go Use registry to check Atime support on Windows (#9741) 2020-05-30 09:47:42 -07:00
disk-cache-check-support_windows.go Use registry to check Atime support on Windows (#9741) 2020-05-30 09:47:42 -07:00
disk-cache-stats.go Add cache usage, total capacity to prometheus metrics (#11026) 2020-12-07 16:35:11 -08:00
disk-cache-utils_test.go cache: Only start at high watermark (#10403) 2020-09-02 17:48:44 -07:00
disk-cache-utils.go cache: Only start at high watermark (#10403) 2020-09-02 17:48:44 -07:00
disk-cache.go Add cache usage, total capacity to prometheus metrics (#11026) 2020-12-07 16:35:11 -08:00
dummy-data-generator_test.go avoid a crash in crawler when lifecycle is not initialized (#11170) 2020-12-26 22:58:06 -08:00
dummy-handlers.go Add support for server side bucket replication (#9882) 2020-07-21 17:49:56 -07:00
dynamic-timeouts_test.go Tweaks to dynamic locks (#10508) 2020-09-18 09:18:18 -07:00
dynamic-timeouts.go Tweaks to dynamic locks (#10508) 2020-09-18 09:18:18 -07:00
encryption-v1_test.go refactor cmd/crypto code for SSE handling and parsing (#11045) 2020-12-22 09:19:32 -08:00
encryption-v1.go Allow Compression + encryption (#11103) 2021-01-05 20:08:35 -08:00
endpoint_test.go fix: all hosts local and port same should be local erasure setup (#10951) 2020-11-23 09:07:50 -08:00
endpoint-ellipses_test.go fix: make sure to use uniform drive count calculation (#10208) 2020-08-05 13:31:12 -07:00
endpoint-ellipses.go rename server sets to server pools 2020-12-01 13:50:33 -08:00
endpoint.go fix: rename remaining zone -> pool (#11231) 2021-01-06 09:35:47 -08:00
erasure_test.go Add storage layer contexts (#10321) 2020-09-04 09:45:06 -07:00
erasure-bucket.go fix: remove the requirement for healing buckets in ListBucketsHeal (#11098) 2020-12-14 12:07:07 -08:00
erasure-coding.go add ruleguard support, fix all the reported issues (#10335) 2020-08-24 12:11:20 -07:00
erasure-common_test.go parentDirIsObject() to return quickly with inexistant parent (#11204) 2021-01-02 12:01:29 -08:00
erasure-common.go parentDirIsObject() to return quickly with inexistant parent (#11204) 2021-01-02 12:01:29 -08:00
erasure-decode_test.go fix: readData in bulk call using messagepack byte wrappers (#11228) 2021-01-07 19:27:31 -08:00
erasure-decode.go erasure: avoid io.Copy in hotpaths to reduce allocation (#11213) 2021-01-03 16:27:34 -08:00
erasure-encode_test.go ListObjects Metadata Caching (#10648) 2020-10-28 09:18:35 -07:00
erasure-encode.go Support bucket versioning (#9377) 2020-06-12 20:04:01 -07:00
erasure-errors.go Support bucket versioning (#9377) 2020-06-12 20:04:01 -07:00
erasure-heal_test.go fix: readData in bulk call using messagepack byte wrappers (#11228) 2021-01-07 19:27:31 -08:00
erasure-healing_test.go fix: readData in bulk call using messagepack byte wrappers (#11228) 2021-01-07 19:27:31 -08:00
erasure-healing-common_test.go fix: readData in bulk call using messagepack byte wrappers (#11228) 2021-01-07 19:27:31 -08:00
erasure-healing-common.go fix: IAM store fallback to list users and policies from disk (#10787) 2020-11-02 17:52:13 -08:00
erasure-healing.go fix: readData in bulk call using messagepack byte wrappers (#11228) 2021-01-07 19:27:31 -08:00
erasure-lowlevel-heal.go Support bucket versioning (#9377) 2020-06-12 20:04:01 -07:00
erasure-metadata_test.go fix: add more protection distribution to match EcIndex (#10772) 2020-10-28 00:09:15 -07:00
erasure-metadata-utils_test.go rename server sets to server pools 2020-12-01 13:50:33 -08:00
erasure-metadata-utils.go fix: readData in bulk call using messagepack byte wrappers (#11228) 2021-01-07 19:27:31 -08:00
erasure-metadata.go Revert "Support variable server sets (#10314)" 2020-12-01 12:02:29 -08:00
erasure-multipart.go fix: readData in bulk call using messagepack byte wrappers (#11228) 2021-01-07 19:27:31 -08:00
erasure-object_test.go fix: readData in bulk call using messagepack byte wrappers (#11228) 2021-01-07 19:27:31 -08:00
erasure-object.go fix: readData in bulk call using messagepack byte wrappers (#11228) 2021-01-07 19:27:31 -08:00
erasure-server-sets.go fix: treat errVolumeNotFound as EOF error in listPathRaw (#11238) 2021-01-07 09:52:53 -08:00
erasure-sets_test.go ListObjects Metadata Caching (#10648) 2020-10-28 09:18:35 -07:00
erasure-sets.go fix: calculate prometheus disks_offline/disks_total correctly (#11215) 2021-01-04 09:42:09 -08:00
erasure-utils.go do not use large buffers if not necessary (#11220) 2021-01-04 18:51:52 -08:00
erasure.go fix: calculate prometheus disks_offline/disks_total correctly (#11215) 2021-01-04 09:42:09 -08:00
etcd.go fix: etcd import paths again depend on v3.4.14 release (#11020) 2020-12-03 11:35:18 -08:00
fallocate_linux_test.go Replace Minio refs in docs with MinIO and links (#7494) 2019-04-09 11:39:42 -07:00
fallocate_linux.go Replace Minio refs in docs with MinIO and links (#7494) 2019-04-09 11:39:42 -07:00
fallocate.go Replace Minio refs in docs with MinIO and links (#7494) 2019-04-09 11:39:42 -07:00
fastwalk.go fix: unwrapping issues with os.Is* functions (#10949) 2020-11-23 08:36:49 -08:00
format-disk-cache_test.go Return appropriate errors API versions changes across REST APIs (#8480) 2019-11-04 09:30:59 -08:00
format-disk-cache.go fix: unwrapping issues with os.Is* functions (#10949) 2020-11-23 08:36:49 -08:00
format-erasure_test.go fix: retain the previous UUID for newly replaced drives (#10759) 2020-10-26 10:29:29 -07:00
format-erasure.go Revert "Support variable server sets (#10314)" 2020-12-01 12:02:29 -08:00
format-fs_test.go Return appropriate errors API versions changes across REST APIs (#8480) 2019-11-04 09:30:59 -08:00
format-fs.go fix: unwrapping issues with os.Is* functions (#10949) 2020-11-23 08:36:49 -08:00
format-meta.go Fix writing 'format.json' and make it atomic (#8296) 2019-09-24 18:47:26 -07:00
fs-tree-walk-pool_test.go fix: use internode data for DisksInfo, VolsInfo in message pack (#10821) 2020-11-04 10:10:54 -08:00
fs-tree-walk-pool.go fix: use internode data for DisksInfo, VolsInfo in message pack (#10821) 2020-11-04 10:10:54 -08:00
fs-v1_test.go Support bucket versioning (#9377) 2020-06-12 20:04:01 -07:00
fs-v1-helpers_test.go fix: use buffers only when necessary for io.Copy() (#11229) 2021-01-06 09:36:55 -08:00
fs-v1-helpers.go fix: use buffers only when necessary for io.Copy() (#11229) 2021-01-06 09:36:55 -08:00
fs-v1-metadata_test.go Support bucket versioning (#9377) 2020-06-12 20:04:01 -07:00
fs-v1-metadata.go fix: allow CopyObject/PutObjecTags on pre-existing content (#10485) 2020-09-15 09:18:41 -07:00
fs-v1-multipart_test.go fix: dangling objects on actual namespace (#10822) 2020-11-05 11:48:55 -08:00
fs-v1-multipart.go fix: use buffers only when necessary for io.Copy() (#11229) 2021-01-06 09:36:55 -08:00
fs-v1-rwpool_test.go Support bucket versioning (#9377) 2020-06-12 20:04:01 -07:00
fs-v1-rwpool.go fix: unwrapping issues with os.Is* functions (#10949) 2020-11-23 08:36:49 -08:00
fs-v1.go fix: use buffers only when necessary for io.Copy() (#11229) 2021-01-06 09:36:55 -08:00
gateway-common_test.go Replace Minio refs in docs with MinIO and links (#7494) 2019-04-09 11:39:42 -07:00
gateway-common.go fix: check for gateway backend online without http request (#10924) 2020-11-19 10:38:02 -08:00
gateway-env.go Replace Minio refs in docs with MinIO and links (#7494) 2019-04-09 11:39:42 -07:00
gateway-interface.go Use constants for gateway names to avoid bugs caused by spelling. (#10355) 2020-08-26 08:52:46 -07:00
gateway-main_test.go [Bugfix] duplicating flag registration (#7853) 2019-07-03 14:31:19 -07:00
gateway-main.go handlers: Avoid initializing a struct in each handler call (#11217) 2021-01-04 09:54:22 -08:00
gateway-metrics.go simplify usage of mutexes and atomic constants (#9501) 2020-05-03 22:35:40 -07:00
gateway-startup-msg_test.go Replace Minio refs in docs with MinIO and links (#7494) 2019-04-09 11:39:42 -07:00
gateway-startup-msg.go fix: server/gateway banner formatting (#11230) 2021-01-06 10:38:07 -08:00
gateway-unsupported.go admin: ServerInfo returns info without object layer initialized (#11142) 2020-12-21 09:35:19 -08:00
generic-handlers_test.go refactor cmd/crypto code for SSE handling and parsing (#11045) 2020-12-22 09:19:32 -08:00
generic-handlers.go handlers: Avoid initializing a struct in each handler call (#11217) 2021-01-04 09:54:22 -08:00
global-heal.go fix: discarding results do not attempt in-memory metacache writer (#11163) 2020-12-24 15:02:02 -08:00
globals.go expire stale locks when owner is down (#11247) 2021-01-07 19:16:18 -08:00
handler-api.go fix: use buffers only when necessary for io.Copy() (#11229) 2021-01-06 09:36:55 -08:00
handler-utils_test.go avoid a crash in crawler when lifecycle is not initialized (#11170) 2020-12-26 22:58:06 -08:00
handler-utils.go tracing: NumSubscribers() to use atomic instead of mutex (#11219) 2021-01-04 09:40:30 -08:00
hasher.go Replace Minio refs in docs with MinIO and links (#7494) 2019-04-09 11:39:42 -07:00
healthcheck-handler.go re-route requests if IAM is not initialized (#10850) 2020-11-07 21:03:06 -08:00
healthcheck-router.go fix: readiness needs to be like liveness (#9941) 2020-06-30 11:28:27 -07:00
healthinfo_linux.go Rename OBD to Health (#10842) 2020-11-20 12:52:53 -08:00
healthinfo_nonlinux.go Rename OBD to Health (#10842) 2020-11-20 12:52:53 -08:00
healthinfo.go rename server sets to server pools 2020-12-01 13:50:33 -08:00
http-stats.go fix: TTFB prometheus metrics calculation (#11082) 2020-12-10 23:02:25 -08:00
http-tracer.go add audit/admin trace support for browser requests (#10947) 2020-11-20 22:52:17 -08:00
httprange_test.go Replace Minio refs in docs with MinIO and links (#7494) 2019-04-09 11:39:42 -07:00
httprange.go Cache only the range requested for range GETs (#8599) 2019-12-08 13:58:04 -08:00
iam-etcd-store.go fix: etcd import paths again depend on v3.4.14 release (#11020) 2020-12-03 11:35:18 -08:00
iam-object-store.go fix: support user/groups with '/' character (#11127) 2020-12-19 09:36:37 -08:00
iam.go initialize IAM store before Init() to avoid any crash (#11236) 2021-01-06 13:40:20 -08:00
jwt_test.go jwt: Simplify JWT parsing (#8802) 2020-01-31 08:29:22 +05:30
jwt.go initialize IAM as soon as object layer is initialized (#10700) 2020-10-19 09:54:40 -07:00
leak-detect_test.go Add UTCNow() function. (#3931) 2017-03-18 11:28:41 -07:00
listen-notification-handlers.go ListObjects Metadata Caching (#10648) 2020-10-28 09:18:35 -07:00
local-locker.go expire stale locks when owner is down (#11247) 2021-01-07 19:16:18 -08:00
lock-rest-client_test.go re-use remote transports in Peer,Storage,Locker clients (#10788) 2020-11-02 07:43:11 -08:00
lock-rest-client.go fix: refactor locks to apply them uniquely per node (#11052) 2020-12-10 07:28:37 -08:00
lock-rest-server-common_test.go fix: add lock ownership to expire locks (#10571) 2020-09-25 19:21:52 -07:00
lock-rest-server-common.go expire lockers if lockers are offline (#10749) 2020-10-24 13:23:16 -07:00
lock-rest-server.go fix: refactor locks to apply them uniquely per node (#11052) 2020-12-10 07:28:37 -08:00
main.go fix: [fs] CompleteMultipart use trie structure for partMatch (#10522) 2020-09-21 01:18:13 -07:00
metacache_gen_test.go ListObjects Metadata Caching (#10648) 2020-10-28 09:18:35 -07:00
metacache_gen.go metacache: Allow prefix filtering (#10920) 2020-11-18 10:44:18 -08:00
metacache_test.go metacache: Add option for life extension (#10837) 2020-11-05 11:49:56 -08:00
metacache-bucket_gen_test.go ListObjects Metadata Caching (#10648) 2020-10-28 09:18:35 -07:00
metacache-bucket_gen.go ListObjects Metadata Caching (#10648) 2020-10-28 09:18:35 -07:00
metacache-bucket_test.go Don't copy interesting ids, clean up logging (#11102) 2020-12-14 13:13:33 -08:00
metacache-bucket.go fix: re-use bytes.Buffer using sync.Pool (#11156) 2020-12-22 23:22:37 -08:00
metacache-entries_test.go ListObjects Metadata Caching (#10648) 2020-10-28 09:18:35 -07:00
metacache-entries.go fix: issues with handling delete markers in metacache (#11150) 2020-12-22 09:16:43 -08:00
metacache-manager.go metadata: Invalidate cache if unreadable and not updating (#10844) 2020-11-06 08:54:09 -08:00
metacache-marker.go ListObjects Metadata Caching (#10648) 2020-10-28 09:18:35 -07:00
metacache-server-pool.go fix: rename remaining zone -> pool (#11231) 2021-01-06 09:35:47 -08:00
metacache-set.go fix: readData in bulk call using messagepack byte wrappers (#11228) 2021-01-07 19:27:31 -08:00
metacache-stream_test.go avoid a crash in crawler when lifecycle is not initialized (#11170) 2020-12-26 22:58:06 -08:00
metacache-stream.go fix: re-use bytes.Buffer using sync.Pool (#11156) 2020-12-22 23:22:37 -08:00
metacache-walk.go fix: heal optimizations in crawler to avoid multiple healing attempts (#11173) 2020-12-28 10:31:00 -08:00
metacache.go add _MINIO_SERVER_DEBUG env for enabling debug messages (#11128) 2020-12-17 16:52:47 -08:00
metrics-router.go enable full linter across the codebase (#9620) 2020-05-18 09:59:45 -07:00
metrics.go remove/deprecate crawler disable environment (#11214) 2021-01-04 09:43:31 -08:00
namespace-lock_test.go tests: Avoid running TestNSRace in short test mode (#10735) 2020-10-23 21:23:12 -07:00
namespace-lock.go fix: refactor locks to apply them uniquely per node (#11052) 2020-12-10 07:28:37 -08:00
naughty-disk_test.go fix: readData in bulk call using messagepack byte wrappers (#11228) 2021-01-07 19:27:31 -08:00
net_test.go update for smartos build (solaris too) (#10378) 2020-08-31 10:19:25 -07:00
net.go update x/net/http2 to address few bugs (#11144) 2020-12-21 21:42:38 -08:00
notification.go tracing: NumSubscribers() to use atomic instead of mutex (#11219) 2021-01-04 09:40:30 -08:00
object_api_suite_test.go Allow Compression + encryption (#11103) 2021-01-05 20:08:35 -08:00
object-api-common.go fix: use buffers only when necessary for io.Copy() (#11229) 2021-01-06 09:36:55 -08:00
object-api-datatypes.go admin: ServerInfo returns info without object layer initialized (#11142) 2020-12-21 09:35:19 -08:00
object-api-deleteobject_test.go avoid a crash in crawler when lifecycle is not initialized (#11170) 2020-12-26 22:58:06 -08:00
object-api-errors.go fix: avoid sending errors on missing objects on locked buckets (#10994) 2020-11-28 21:15:45 -08:00
object-api-getobject_test.go Allow Compression + encryption (#11103) 2021-01-05 20:08:35 -08:00
object-api-getobjectinfo_test.go Support bucket versioning (#9377) 2020-06-12 20:04:01 -07:00
object-api-input-checks.go fix: cleanup old directory handling code (#10633) 2020-10-06 12:03:57 -07:00
object-api-interface.go fix: calculate prometheus disks_offline/disks_total correctly (#11215) 2021-01-04 09:42:09 -08:00
object-api-listobjects_test.go fix: delimiter based listing was broken without marker (#11136) 2020-12-19 09:36:04 -08:00
object-api-multipart_test.go Allow Compression + encryption (#11103) 2021-01-05 20:08:35 -08:00
object-api-options.go replication: Ensure to always use nano precision source modtime (#11135) 2020-12-18 11:37:28 -08:00
object-api-putobject_test.go Allow Compression + encryption (#11103) 2021-01-05 20:08:35 -08:00
object-api-utils_test.go Allow Compression + encryption (#11103) 2021-01-05 20:08:35 -08:00
object-api-utils.go Allow Compression + encryption (#11103) 2021-01-05 20:08:35 -08:00
object-handlers_test.go Allow Compression + encryption (#11103) 2021-01-05 20:08:35 -08:00
object-handlers-common_test.go Replace Minio refs in docs with MinIO and links (#7494) 2019-04-09 11:39:42 -07:00
object-handlers-common.go ilm: Send delete marker creation event when appropriate (#10696) 2020-10-16 21:22:12 -07:00
object-handlers.go Allow Compression + encryption (#11103) 2021-01-05 20:08:35 -08:00
os-dirent_fileino.go allow large buffer to list more entries per directory (#9785) 2020-06-09 09:44:50 -07:00
os-dirent_ino.go add ruleguard support, fix all the reported issues (#10335) 2020-08-24 12:11:20 -07:00
os-dirent_namelen_bsd.go allow large buffer to list more entries per directory (#9785) 2020-06-09 09:44:50 -07:00
os-dirent_namelen_linux.go allow large buffer to list more entries per directory (#9785) 2020-06-09 09:44:50 -07:00
os-readdir_other.go update for smartos build (solaris too) (#10378) 2020-08-31 10:19:25 -07:00
os-readdir_test.go Support bucket versioning (#9377) 2020-06-12 20:04:01 -07:00
os-readdir_unix.go fix: unwrapping issues with os.Is* functions (#10949) 2020-11-23 08:36:49 -08:00
os-readdir_windows.go Fix crash on Windows when crawling (#10385) 2020-09-01 09:33:16 -07:00
os-reliable_test.go Support bucket versioning (#9377) 2020-06-12 20:04:01 -07:00
os-reliable.go fix: unwrapping issues with os.Is* functions (#10949) 2020-11-23 08:36:49 -08:00
peer-rest-client.go fix: select always online peers for remote listing (#11153) 2020-12-22 09:16:07 -08:00
peer-rest-common.go Rename OBD to Health (#10842) 2020-11-20 12:52:53 -08:00
peer-rest-server.go fix: rename remaining zone -> pool (#11231) 2021-01-06 09:35:47 -08:00
policy_test.go Move dependency from minio-go v6 to v7 (#10042) 2020-07-14 09:38:05 -07:00
post-policy_test.go Allow region errors to be dynamic (#10323) 2020-08-23 22:06:22 -07:00
postpolicyform_test.go Move dependency from minio-go v6 to v7 (#10042) 2020-07-14 09:38:05 -07:00
postpolicyform.go Remove unusued params and functions (#8399) 2019-10-15 18:35:41 -07:00
prepare-storage.go expire stale locks when owner is down (#11247) 2021-01-07 19:16:18 -08:00
routers.go handlers: Avoid initializing a struct in each handler call (#11217) 2021-01-04 09:54:22 -08:00
server_test.go Support for "directory" objects (#10499) 2020-09-19 08:39:41 -07:00
server-main_test.go rename server sets to server pools 2020-12-01 13:50:33 -08:00
server-main.go expire stale locks when owner is down (#11247) 2021-01-07 19:16:18 -08:00
server-rlimit.go add '.healing.bin' for tracking currently healing disk (#10573) 2020-09-28 19:39:32 -07:00
server-startup-msg_test.go admin: ServerInfo returns info without object layer initialized (#11142) 2020-12-21 09:35:19 -08:00
server-startup-msg.go fix: server/gateway banner formatting (#11230) 2021-01-06 10:38:07 -08:00
service.go fix: heal bucket metadata right before healing bucket (#11097) 2020-12-13 11:57:08 -08:00
setup-type.go Support bucket versioning (#9377) 2020-06-12 20:04:01 -07:00
signals.go remove safeMode behavior in startup (#10645) 2020-10-09 09:59:52 -07:00
signature-v2_test.go Migrate config to KV data format (#8392) 2019-10-22 22:59:13 -07:00
signature-v2.go Copy metadata before spawning goroutine + prealloc maps (#10458) 2020-09-10 11:37:22 -07:00
signature-v4_test.go Allow region errors to be dynamic (#10323) 2020-08-23 22:06:22 -07:00
signature-v4-parser_test.go add ruleguard support, fix all the reported issues (#10335) 2020-08-24 12:11:20 -07:00
signature-v4-parser.go Allow region errors to be dynamic (#10323) 2020-08-23 22:06:22 -07:00
signature-v4-utils_test.go refactor cmd/crypto code for SSE handling and parsing (#11045) 2020-12-22 09:19:32 -08:00
signature-v4-utils.go initialize IAM as soon as object layer is initialized (#10700) 2020-10-19 09:54:40 -07:00
signature-v4.go Adds "x-amz-usr-agent" and "x-id" params to be used in authentication of presignedURL (#10792) 2020-12-02 02:02:49 -08:00
storage-datatypes_gen_test.go fix: use internode data for DisksInfo, VolsInfo in message pack (#10821) 2020-11-04 10:10:54 -08:00
storage-datatypes_gen.go fix: readData in bulk call using messagepack byte wrappers (#11228) 2021-01-07 19:27:31 -08:00
storage-datatypes_test.go feat: Small object optimization read data in single bulk call (#11207) 2021-01-03 11:27:57 -08:00
storage-datatypes.go fix: readData in bulk call using messagepack byte wrappers (#11228) 2021-01-07 19:27:31 -08:00
storage-errors.go parentDirIsObject() to return quickly with inexistant parent (#11204) 2021-01-02 12:01:29 -08:00
storage-interface.go fix: readData in bulk call using messagepack byte wrappers (#11228) 2021-01-07 19:27:31 -08:00
storage-rest_test.go Revert "Support variable server sets (#10314)" 2020-12-01 12:02:29 -08:00
storage-rest-client.go fix: readData in bulk call using messagepack byte wrappers (#11228) 2021-01-07 19:27:31 -08:00
storage-rest-common.go fix: readData in bulk call using messagepack byte wrappers (#11228) 2021-01-07 19:27:31 -08:00
storage-rest-server.go fix: readData in bulk call using messagepack byte wrappers (#11228) 2021-01-07 19:27:31 -08:00
streaming-signature-v4_test.go add ruleguard support, fix all the reported issues (#10335) 2020-08-24 12:11:20 -07:00
streaming-signature-v4.go re-implement data usage crawler to be more efficient (#9075) 2020-03-18 16:19:29 -07:00
sts-datatypes.go Fix LDAP responseXML to be named appropriately (#8285) 2019-09-24 03:51:16 +05:30
sts-errors.go add ruleguard support, fix all the reported issues (#10335) 2020-08-24 12:11:20 -07:00
sts-handlers.go re-route requests if IAM is not initialized (#10850) 2020-11-07 21:03:06 -08:00
test-utils_test.go Allow Compression + encryption (#11103) 2021-01-05 20:08:35 -08:00
tree-walk_test.go Add storage layer contexts (#10321) 2020-09-04 09:45:06 -07:00
tree-walk.go Support for "directory" objects (#10499) 2020-09-19 08:39:41 -07:00
typed-errors.go fix: optimize IAM users load, add fallback (#9809) 2020-06-11 14:11:30 -07:00
update_test.go add ruleguard support, fix all the reported issues (#10335) 2020-08-24 12:11:20 -07:00
update-notifier_test.go Refactor config and split them in packages (#8351) 2019-10-04 23:05:33 +05:30
update-notifier.go Refactor config and split them in packages (#8351) 2019-10-04 23:05:33 +05:30
update.go fix: unwrapping issues with os.Is* functions (#10949) 2020-11-23 08:36:49 -08:00
utils_test.go feat: Add notification support for bucketCreates and removal (#10075) 2020-07-20 12:52:49 -07:00
utils.go fix: allow HTTP2.0 to be always configured 2020-12-22 16:32:58 -08:00
version_test.go Replace Minio refs in docs with MinIO and links (#7494) 2019-04-09 11:39:42 -07:00
web-handler-context_test.go Pass on web-handler arguments properly to log entries (#7894) 2019-07-11 22:37:13 +01:00
web-handler-context.go use GlobalContext whenever possible (#9280) 2020-04-09 09:30:02 -07:00
web-handlers_test.go rename server sets to server pools 2020-12-01 13:50:33 -08:00
web-handlers.go Pass versionID to checkReplicateDelete in web handler (#11244) 2021-01-07 15:28:27 -08:00
web-router.go tracing: NumSubscribers() to use atomic instead of mutex (#11219) 2021-01-04 09:40:30 -08:00
xl-storage_test.go fix: use buffers only when necessary for io.Copy() (#11229) 2021-01-06 09:36:55 -08:00
xl-storage_unix_test.go Add storage layer contexts (#10321) 2020-09-04 09:45:06 -07:00
xl-storage_windows_test.go ListObjects Metadata Caching (#10648) 2020-10-28 09:18:35 -07:00
xl-storage-disk-id-check.go fix: readData in bulk call using messagepack byte wrappers (#11228) 2021-01-07 19:27:31 -08:00
xl-storage-errors_test.go Support bucket versioning (#9377) 2020-06-12 20:04:01 -07:00
xl-storage-errors.go fix: unwrapping issues with os.Is* functions (#10949) 2020-11-23 08:36:49 -08:00
xl-storage-format_test.go Support bucket versioning (#9377) 2020-06-12 20:04:01 -07:00
xl-storage-format-utils.go Show Delete replication status header (#10946) 2020-11-21 23:48:50 -08:00
xl-storage-format-v1_gen_test.go Support bucket versioning (#9377) 2020-06-12 20:04:01 -07:00
xl-storage-format-v1_gen.go Support bucket versioning (#9377) 2020-06-12 20:04:01 -07:00
xl-storage-format-v1.go Add support for ILM transition (#10565) 2020-11-19 18:47:17 -08:00
xl-storage-format-v2_gen_test.go Support bucket versioning (#9377) 2020-06-12 20:04:01 -07:00
xl-storage-format-v2_gen.go Revert "Revert "Add delete marker replication support (#10396)"" 2020-11-19 18:43:58 -08:00
xl-storage-format-v2.go fix: avoid sending errors on missing objects on locked buckets (#10994) 2020-11-28 21:15:45 -08:00
xl-storage.go fix: readData in bulk call using messagepack byte wrappers (#11228) 2021-01-07 19:27:31 -08:00