MyFavMirrors
/
minio
mirror of https://github.com/minio/minio.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
minio/go.mod

89 lines
3.2 KiB
Modula-2
Raw Normal View History

add go modules file and start running go 1.11 style builds (#7354)
2019-03-19 16:50:59 -04:00
module github.com/minio/minio
[feat]: change erasure coding default block size from 10MiB to 1MiB (#11721) major performance improvements in range GETs to avoid large read amplification when ranges are tiny and random ``` ------------------- Operation: GET Operations: 142014 -> 339421 Duration: 4m50s -> 4m56s * Average: +139.41% (+1177.3 MiB/s) throughput, +139.11% (+658.4) obj/s * Fastest: +125.24% (+1207.4 MiB/s) throughput, +132.32% (+612.9) obj/s * 50% Median: +139.06% (+1175.7 MiB/s) throughput, +133.46% (+660.9) obj/s * Slowest: +203.40% (+1267.9 MiB/s) throughput, +198.59% (+753.5) obj/s ``` TTFB from 10MiB BlockSize ``` * First Access TTFB: Avg: 81ms, Median: 61ms, Best: 20ms, Worst: 2.056s ``` TTFB from 1MiB BlockSize ``` * First Access TTFB: Avg: 22ms, Median: 21ms, Best: 8ms, Worst: 91ms ``` Full object reads however do see a slight change which won't be noticeable in real world, so not doing any comparisons TTFB still had improvements with full object reads with 1MiB ``` * First Access TTFB: Avg: 68ms, Median: 35ms, Best: 11ms, Worst: 1.16s ``` v/s TTFB with 10MiB ``` * First Access TTFB: Avg: 388ms, Median: 98ms, Best: 20ms, Worst: 4.156s ``` This change should affect all new uploads, previous uploads should continue to work with business as usual. But dramatic improvements can be seen with these changes.
2021-03-06 17:09:34 -05:00
go 1.16
Migrate to go1.12 to simplify our cmd/http package (#7302) Simplify the cmd/http package overall by removing custom plain text v/s tls connection detection, by migrating to go1.12 and choose minimum version to be go1.12 Also remove all the vendored deps, since they are not useful anymore.
2019-04-02 21:28:39 -04:00
add go modules file and start running go 1.11 style builds (#7354)
2019-03-19 16:50:59 -04:00
require (
kms: replace KES client implementation with minio/kes (#12207) This commit replaces the custom KES client implementation with the KES SDK from https://github.com/minio/kes The SDK supports multi-server client load-balancing and requests retry out of the box. Therefore, this change reduces the overall complexity within the MinIO server and there is no need to maintain two separate client implementations. Signed-off-by: Andreas Auernhammer <aead@mail.de>
2021-05-10 21:15:11 -04:00
cloud.google.com/go/storage v1.10.0
update for smartos build (solaris too) (#10378)
2020-08-31 13:19:25 -04:00
github.com/Azure/azure-pipeline-go v0.2.2
github.com/Azure/azure-storage-blob-go v0.10.0
upgrade event notification dependencies (#11095)
2020-12-12 23:31:28 -05:00
github.com/Shopify/sarama v1.27.2
add additional metrics per disk API latency, API call counts #11250) ``` mc admin info --json ``` provides these details, for now, we shall eventually expose this at Prometheus level eventually. Co-authored-by: Harshavardhana <harsha@minio.io>
2021-03-16 23:06:57 -04:00
github.com/VividCortex/ewma v1.1.1
Migrate to go1.12 to simplify our cmd/http package (#7302) Simplify the cmd/http package overall by removing custom plain text v/s tls connection detection, by migrating to go1.12 and choose minimum version to be go1.12 Also remove all the vendored deps, since they are not useful anymore.
2019-04-02 21:28:39 -04:00
github.com/alecthomas/participle v0.2.1
update jstream to latest release v1.0.1 (#10909)
2020-11-17 12:13:28 -05:00
github.com/bcicen/jstream v1.0.1
update NTP package for accurate time resolution fixes (#10670)
2020-10-14 02:59:20 -04:00
github.com/beevik/ntp v0.3.0
Update bloom module (#12383) To fix dependency import issues when importing madmin-go v0.7.1
2021-05-27 11:02:39 -04:00
github.com/bits-and-blooms/bloom/v3 v3.0.1
re-implement data usage crawler to be more efficient (#9075) Implementation overview: https://gist.github.com/klauspost/1801c858d5e0df391114436fdad6987b
2020-03-18 19:19:29 -04:00
github.com/cespare/xxhash/v2 v2.1.1
Add support for replication of object tags, retention metadata (#10880)
2020-11-19 14:50:22 -05:00
github.com/cheggaaa/pb v1.0.29
Update colinmarc/hdfs (#11417) Updates needed dependency as well. Fixes #11416
2021-02-02 18:37:30 -05:00
github.com/colinmarc/hdfs/v2 v2.2.0
Migrate to go1.12 to simplify our cmd/http package (#7302) Simplify the cmd/http package overall by removing custom plain text v/s tls connection detection, by migrating to go1.12 and choose minimum version to be go1.12 Also remove all the vendored deps, since they are not useful anymore.
2019-04-02 21:28:39 -04:00
github.com/coredns/coredns v1.4.0
Support bucket versioning (#9377) - Implement a new xl.json 2.0.0 format to support, this moves the entire marshaling logic to POSIX layer, top layer always consumes a common FileInfo construct which simplifies the metadata reads. - Implement list object versions - Migrate to siphash from crchash for new deployments for object placements. Fixes #2111
2020-06-12 23:04:01 -04:00
github.com/dchest/siphash v1.2.1
Migrate to go1.12 to simplify our cmd/http package (#7302) Simplify the cmd/http package overall by removing custom plain text v/s tls connection detection, by migrating to go1.12 and choose minimum version to be go1.12 Also remove all the vendored deps, since they are not useful anymore.
2019-04-02 21:28:39 -04:00
github.com/dgrijalva/jwt-go v3.2.0+incompatible
github.com/djherbis/atime v1.0.0
add NVMe drive info [model num, serial num, drive temp. etc.] (#10613) * add NVMe drive info [model num, serial num, drive temp. etc.] * Ignore fuse partitions * Add the nvme logic only for linux * Move smart/nvme structs to a separate file Co-authored-by: wlan0 <sidharthamn@gmail.com>
2020-10-04 13:18:46 -04:00
github.com/dswarbrick/smart v0.0.0-20190505152634-909a45200d6d
Migrate to go1.12 to simplify our cmd/http package (#7302) Simplify the cmd/http package overall by removing custom plain text v/s tls connection detection, by migrating to go1.12 and choose minimum version to be go1.12 Also remove all the vendored deps, since they are not useful anymore.
2019-04-02 21:28:39 -04:00
github.com/dustin/go-humanize v1.0.0
upgrade event notification dependencies (#11095)
2020-12-12 23:31:28 -05:00
github.com/eclipse/paho.mqtt.golang v1.3.0
Add support for Elasticsearch 7.x (#12053) - Check ES server version by querying its API - Minimum required version of ES is 5.x - Add deprecation warnings for ES versions < 7.x - Still works with 5.x and 6.x, but support to be removed at a later date. Signed-off-by: Aditya Manthramurthy <aditya@minio.io>
2021-05-10 18:06:58 -04:00
github.com/elastic/go-elasticsearch/v7 v7.12.0
move the dependency to minio/pkg for common libraries (#12397)
2021-05-28 18:17:01 -04:00
github.com/fatih/color v1.12.0
update dependenices for relevant projects (#11445) - minio-go -> v7.0.8 - ldap/v3 -> v3.2.4 - reedsolomon -> v1.9.11 - sio-go -> v0.3.1 - msgp -> v1.1.5 - simdjson-go, md5-simd, highwayhash
2021-02-04 16:49:52 -05:00
github.com/go-ldap/ldap/v3 v3.2.4
Update go-sql-driver pkg to support `checkConnLiveness` (#9766) Fixes #9679
2020-06-04 19:11:42 -04:00
github.com/go-sql-driver/mysql v1.5.0
Support for remote tier management (#12090) With this change, MinIO's ILM supports transitioning objects to a remote tier. This change includes support for Azure Blob Storage, AWS S3 compatible object storage incl. MinIO and Google Cloud Storage as remote tier storage backends. Some new additions include: - Admin APIs remote tier configuration management - Simple journal to track remote objects to be 'collected' This is used by object API handlers which 'mutate' object versions by overwriting/replacing content (Put/CopyObject) or removing the version itself (e.g DeleteObjectVersion). - Rework of previous ILM transition to fit the new model In the new model, a storage class (a.k.a remote tier) is defined by the 'remote' object storage type (one of s3, azure, GCS), bucket name and a prefix. * Fixed bugs, review comments, and more unit-tests - Leverage inline small object feature - Migrate legacy objects to the latest object format before transitioning - Fix restore to particular version if specified - Extend SharedDataDirCount to handle transitioned and restored objects - Restore-object should accept version-id for version-suspended bucket (#12091) - Check if remote tier creds have sufficient permissions - Bonus minor fixes to existing error messages Co-authored-by: Poorna Krishnamoorthy <poorna@minio.io> Co-authored-by: Krishna Srinivas <krishna@minio.io> Signed-off-by: Harshavardhana <harsha@minio.io>
2021-04-19 13:30:42 -04:00
github.com/gomodule/redigo v2.0.0+incompatible
upgrade event notification dependencies (#11095)
2020-12-12 23:31:28 -05:00
github.com/google/uuid v1.1.2
Revert "deprecate embedded browser (#12163)" This reverts commit 736d8cbac483d8bf56c3422ca9a9c4c3e043c6cf. Bring contrib files for older contributions
2021-04-29 22:01:43 -04:00
github.com/gorilla/handlers v1.5.1
move to gorilla mux 1.8.0 (#10328)
2020-08-23 02:14:02 -04:00
github.com/gorilla/mux v1.8.0
Support for remote tier management (#12090) With this change, MinIO's ILM supports transitioning objects to a remote tier. This change includes support for Azure Blob Storage, AWS S3 compatible object storage incl. MinIO and Google Cloud Storage as remote tier storage backends. Some new additions include: - Admin APIs remote tier configuration management - Simple journal to track remote objects to be 'collected' This is used by object API handlers which 'mutate' object versions by overwriting/replacing content (Put/CopyObject) or removing the version itself (e.g DeleteObjectVersion). - Rework of previous ILM transition to fit the new model In the new model, a storage class (a.k.a remote tier) is defined by the 'remote' object storage type (one of s3, azure, GCS), bucket name and a prefix. * Fixed bugs, review comments, and more unit-tests - Leverage inline small object feature - Migrate legacy objects to the latest object format before transitioning - Fix restore to particular version if specified - Extend SharedDataDirCount to handle transitioned and restored objects - Restore-object should accept version-id for version-suspended bucket (#12091) - Check if remote tier creds have sufficient permissions - Bonus minor fixes to existing error messages Co-authored-by: Poorna Krishnamoorthy <poorna@minio.io> Co-authored-by: Krishna Srinivas <krishna@minio.io> Signed-off-by: Harshavardhana <harsha@minio.io>
2021-04-19 13:30:42 -04:00
github.com/hashicorp/golang-lru v0.5.3 // indirect
Update colinmarc/hdfs (#11417) Updates needed dependency as well. Fixes #11416
2021-02-02 18:37:30 -05:00
github.com/jcmturner/gokrb5/v8 v8.4.2
Revert "deprecate embedded browser (#12163)" This reverts commit 736d8cbac483d8bf56c3422ca9a9c4c3e043c6cf. Bring contrib files for older contributions
2021-04-29 22:01:43 -04:00
github.com/json-iterator/go v1.1.11
github.com/klauspost/compress v1.12.2
Update S2 compression (#11753) Relevant updates: * Less allocations on decode: https://github.com/klauspost/compress/pull/322 * Fixed rare out-of-bounds write on amd64. * ARM64 decompression assembly. Around 2x output speed. https://github.com/klauspost/compress/pull/324 * Speed up decompression on non-assembly platforms. https://github.com/klauspost/compress/pull/328 Upgrade cpuid to match simdjson.
2021-03-10 12:41:29 -05:00
github.com/klauspost/cpuid/v2 v2.0.4
Upgrade compress and pgzip package (#10992) Should provide faster decompression for s3 select and other places where it is used.
2020-11-27 13:10:15 -05:00
github.com/klauspost/pgzip v1.2.5
Fix JSON Close data race. (#8486) The JSON stream library has no safe way of aborting while Since we cannot expect the called to safely handle "Read" and "Close" calls we must handle this. Also any Read error returned from upstream will crash the server. We preserve the errors and instead always return io.EOF upstream, but send the error on Close. `readahead v1.3.1` handles Read after Close better. Updates to `progressReader` is mostly to ensure safety. Fixes #8481
2019-11-05 17:20:37 -05:00
github.com/klauspost/readahead v1.3.1
update dependenices for relevant projects (#11445) - minio-go -> v7.0.8 - ldap/v3 -> v3.2.4 - reedsolomon -> v1.9.11 - sio-go -> v0.3.1 - msgp -> v1.1.5 - simdjson-go, md5-simd, highwayhash
2021-02-04 16:49:52 -05:00
github.com/klauspost/reedsolomon v1.9.11
use Access() instead of Lstat() for frequent use (#11911) using Lstat() is causing tiny memory allocations, that are usually wasted and never used, instead we can simply uses Access() call that does 0 memory allocations.
2021-03-29 11:07:23 -04:00
github.com/lib/pq v1.9.0
update deps to latest for some vulnerable deps (#11080) - github.com/miekg/dns - update elasticsearch library deps to circumvent some aws-sdk-go deps
2020-12-10 16:23:06 -05:00
github.com/miekg/dns v1.1.35
Migrate config to KV data format (#8392) - adding oauth support to MinIO browser (#8400) by @kanagaraj - supports multi-line get/set/del for all config fields - add support for comments, allow toggle - add extensive validation of config before saving - support MinIO browser to support proper claims, using STS tokens - env support for all config parameters, legacy envs are also supported with all documentation now pointing to latest ENVs - preserve accessKey/secretKey from FS mode setups - add history support implements three APIs - ClearHistory - RestoreHistory - ListHistory - add help command support for each config parameters - all the bug fixes after migration to KV, and other bug fixes encountered during testing.
2019-10-23 01:59:13 -04:00
github.com/minio/cli v1.22.0
Revert "deprecate embedded browser (#12163)" This reverts commit 736d8cbac483d8bf56c3422ca9a9c4c3e043c6cf. Bring contrib files for older contributions
2021-04-29 22:01:43 -04:00
github.com/minio/csvparser v1.0.0
highwayhash: update to latest version containing an arm64 fix (#11901) This commit updates the highwayhash version to `v1.0.2` that fixes a critical issue on arm64.
2021-03-25 14:44:58 -04:00
github.com/minio/highwayhash v1.0.2
kms: replace KES client implementation with minio/kes (#12207) This commit replaces the custom KES client implementation with the KES SDK from https://github.com/minio/kes The SDK supports multi-server client load-balancing and requests retry out of the box. Therefore, this change reduces the overall complexity within the MinIO server and there is no need to maintain two separate client implementations. Signed-off-by: Andreas Auernhammer <aead@mail.de>
2021-05-10 21:15:11 -04:00
github.com/minio/kes v0.14.0
tiering: add aws role support for s3 (#12424) Signed-off-by: Poorna Krishnamoorthy <poorna@minio.io>
2021-06-04 15:47:00 -04:00
github.com/minio/madmin-go v1.0.10-0.20210602195449-b1bf23ec13e4
Avoid notification event for replicas (#11683) Creating notification events for replica creation is not particularly useful to send as the notification event generated at source already includes replication completion events. For applications using replica cluster as failover, avoiding duplicate notifications for replica event will allow seamless failover.
2021-03-03 14:13:31 -05:00
github.com/minio/minio-go/v7 v7.0.11-0.20210302210017-6ae69c73ce78
move parquet-go to github.com/minio/parquet-go repo
2021-05-03 11:51:43 -04:00
github.com/minio/parquet-go v1.0.0
Add support for existing object replication. (#12109) Also adding an API to allow resyncing replication when existing object replication is enabled and the remote target is entirely lost. With the `mc replicate reset` command, the objects that are eligible for replication as per the replication config will be resynced to target if existing object replication is enabled on the rule.
2021-06-01 22:59:11 -04:00
github.com/minio/pkg v1.0.4
Revert "deprecate embedded browser (#12163)" This reverts commit 736d8cbac483d8bf56c3422ca9a9c4c3e043c6cf. Bring contrib files for older contributions
2021-04-29 22:01:43 -04:00
github.com/minio/rpc v1.0.0
update CREDITS with minio/selfupdate project
2020-08-01 02:58:22 -04:00
github.com/minio/selfupdate v0.3.1
update sha256-simd to v1.0.0 (#11607)
2021-02-22 16:19:53 -05:00
github.com/minio/sha256-simd v1.0.0
update dependenices for relevant projects (#11445) - minio-go -> v7.0.8 - ldap/v3 -> v3.2.4 - reedsolomon -> v1.9.11 - sio-go -> v0.3.1 - msgp -> v1.1.5 - simdjson-go, md5-simd, highwayhash
2021-02-04 16:49:52 -05:00
github.com/minio/simdjson-go v0.2.1
update sio package to v0.3.0 (#12254)
2021-05-07 17:41:58 -04:00
github.com/minio/sio v0.3.0
add go modules file and start running go 1.11 style builds (#7354)
2019-03-19 16:50:59 -04:00
github.com/mitchellh/go-homedir v1.1.0
Implement oboard diagnostics admin API (#9024) - Implement a graph algorithm to test network bandwidth from every node to every other node - Saturate any network bandwidth adaptively, accounting for slow and fast network capacity - Implement parallel drive OBD tests - Implement a paging mechanism for OBD test to provide periodic updates to client - Implement Sys, Process, Host, Mem OBD Infos
2020-03-27 00:07:39 -04:00
github.com/montanaflynn/stats v0.5.0
update nats.io/jwt dependency (#11066) primarily for a vulnerability report https://nvd.nist.gov/vuln/detail/CVE-2020-26521
2020-12-09 17:30:35 -05:00
github.com/nats-io/nats-server/v2 v2.1.9
Refactor health data structure (#11914) This feature comes with simplified data structures and versioning support. Signed-off-by: Bala.FA <bala.gluster@gmail.com>
2021-06-01 11:55:49 -04:00
github.com/nats-io/nats-streaming-server v0.21.2 // indirect
fix: migrate to go.etcd.io import path (#9987) with the merge of https://github.com/etcd-io/etcd/pull/11823 etcd v3.5.0 will now have a properly imported versioned path this fixes our pending migration to newer repo
2020-07-07 22:04:29 -04:00
github.com/nats-io/nats.go v1.10.0
use Access() instead of Lstat() for frequent use (#11911) using Lstat() is causing tiny memory allocations, that are usually wasted and never used, instead we can simply uses Access() call that does 0 memory allocations.
2021-03-29 11:07:23 -04:00
github.com/nats-io/stan.go v0.8.3
Use O_DIRECT while writing to disk (#7479) - Use O_DIRECT while writing to disk - Remove MINIO_DRIVE_SYNC option
2019-04-24 00:25:06 -04:00
github.com/ncw/directio v1.0.5
upgrade event notification dependencies (#11095)
2020-12-12 23:31:28 -05:00
github.com/nsqio/go-nsq v1.0.8
update deps to latest for some vulnerable deps (#11080) - github.com/miekg/dns - update elasticsearch library deps to circumvent some aws-sdk-go deps
2020-12-10 16:23:06 -05:00
github.com/olivere/elastic/v7 v7.0.22
fix: readData in bulk call using messagepack byte wrappers (#11228) This PR refactors the way we use buffers for O_DIRECT and to re-use those buffers for messagepack reader writer. After some extensive benchmarking found that not all objects have this benefit, and only objects smaller than 64KiB see this benefit overall. Benefits are seen from almost all objects from 1KiB - 32KiB Beyond this no objects see benefit with bulk call approach as the latency of bytes sent over the wire v/s streaming content directly from disk negate each other with no remarkable benefits. All other optimizations include reuse of msgp.Reader, msgp.Writer using sync.Pool's for all internode calls.
2021-01-07 22:27:31 -05:00
github.com/philhofer/fwd v1.1.1
move parquet-go to github.com/minio/parquet-go repo
2021-05-03 11:51:43 -04:00
github.com/pierrec/lz4 v2.6.0+incompatible
Support https and basic-auth for elasticsearch notification target (#10332)
2020-08-23 12:43:48 -04:00
github.com/pkg/errors v0.9.1
upgrade event notification dependencies (#11095)
2020-12-12 23:31:28 -05:00
github.com/prometheus/client_golang v1.8.0
Updated Prometheus metrics (#11141) * Add metrics for nodes online and offline * Add cluster capacity metrics * Introduce v2 metrics
2021-01-18 23:35:38 -05:00
github.com/prometheus/client_model v0.2.0
use Access() instead of Lstat() for frequent use (#11911) using Lstat() is causing tiny memory allocations, that are usually wasted and never used, instead we can simply uses Access() call that does 0 memory allocations.
2021-03-29 11:07:23 -04:00
github.com/prometheus/procfs v0.6.0
simplify context timeout for readiness (#9772) additionally also add CORS support to restrict for specific origin, adds a new config and updated the documentation as well
2020-06-04 17:58:34 -04:00
github.com/rs/cors v1.7.0
update dependenices for relevant projects (#11445) - minio-go -> v7.0.8 - ldap/v3 -> v3.2.4 - reedsolomon -> v1.9.11 - sio-go -> v0.3.1 - msgp -> v1.1.5 - simdjson-go, md5-simd, highwayhash
2021-02-04 16:49:52 -05:00
github.com/secure-io/sio-go v0.3.1
upgrade event notification dependencies (#11095)
2020-12-12 23:31:28 -05:00
github.com/streadway/amqp v1.0.0
fix: implement readMetadata common function for re-use (#12353) Previous PR #12351 added functions to read from the reader stream to reduce memory usage, use the same technique in few other places where we are not interested in reading the data part.
2021-05-21 14:41:25 -04:00
github.com/tinylib/msgp v1.1.6-0.20210521143832-0becd170c402
reduce memory usage in metacache reader (#12334)
2021-05-20 12:00:11 -04:00
github.com/valyala/bytebufferpool v1.0.0
add go modules file and start running go 1.11 style builds (#7354)
2019-03-19 16:50:59 -04:00
github.com/valyala/tcplisten v0.0.0-20161114210144-ceec8f93295a
added support for SASL/SCRAM on Kafka bucket notifications. (#9168) fixes #9167
2020-03-20 14:10:27 -04:00
github.com/xdg/scram v0.0.0-20180814205039-7eeb5667e42c
fix: move to new etcd imports (#12391)
2021-05-28 13:31:42 -04:00
go.etcd.io/etcd/api/v3 v3.5.0-beta.4
go.etcd.io/etcd/client/v3 v3.5.0-beta.4
go.uber.org/zap v1.16.1-0.20210329175301-c23abee72d19
move madmin to github.com/minio/madmin-go (#12239)
2021-05-06 11:52:02 -04:00
golang.org/x/crypto v0.0.0-20210421170649-83a5a9bb288b
Update yaml files to latest version RELEASE.2021-05-11T23-27-41Z
2021-05-11 20:16:44 -04:00
golang.org/x/sys v0.0.0-20210510120138-977fb7262007
golang.org/x/tools v0.1.1 // indirect
kms: replace KES client implementation with minio/kes (#12207) This commit replaces the custom KES client implementation with the KES SDK from https://github.com/minio/kes The SDK supports multi-server client load-balancing and requests retry out of the box. Therefore, this change reduces the overall complexity within the MinIO server and there is no need to maintain two separate client implementations. Signed-off-by: Andreas Auernhammer <aead@mail.de>
2021-05-10 21:15:11 -04:00
google.golang.org/api v0.31.0
move the dependency to minio/pkg for common libraries (#12397)
2021-05-28 18:17:01 -04:00
gopkg.in/yaml.v2 v2.4.0
Update yaml files to latest version RELEASE.2021-01-30T00-20-58Z
2021-01-29 19:45:11 -05:00
)
kms: replace KES client implementation with minio/kes (#12207) This commit replaces the custom KES client implementation with the KES SDK from https://github.com/minio/kes The SDK supports multi-server client load-balancing and requests retry out of the box. Therefore, this change reduces the overall complexity within the MinIO server and there is no need to maintain two separate client implementations. Signed-off-by: Andreas Auernhammer <aead@mail.de>
2021-05-10 21:15:11 -04:00
replace google.golang.org/grpc => google.golang.org/grpc v1.29.1